Qualtrics XM for Strategy and Research vs. UserTesting

Qualtrics is a good medium for creating surveys and getting analytics back for it. I think it's easy to learn if you are in the business of creating surveys or if it's part of your studies. It can be a little overwhelming for a brand new user who has never created a survey for the first time. So onboarding could be better.

Mainly to test products from industries that are well-established and have a huge use base of users (e.g., beauty, health, bank applications, etc). I would not recommend it for things that are too niche (e.g. French card mobile games) because the tool doesn't have enough filters or screening questions to allow researchers to recruit participants from UserTesting userbase. Probably this is on purpose right?

Incentivized

• Qualtrics CoreXM is easy to use for quick one-time surveys or for measuring opinions over time
• It's great for sending/managing RSVPs for meetings or other gatherings or to collect important data like Conflict of Interest declarations.
• Qualtrics CoreXM's reporting and crosstab functionality is beefy and gets better all of the time. I'm always amazed at how easy it is to generate reports for sharing my survey response data and research.

Incentivized

• Usable - great dashboards and data metrics
• Different options for testing to suit your needs - surveys, moderated and unmoderated tests, and interviews
• Platform keeps you up to date as a partner to any networking events or webinars hosted to learn from other clients and businesses

Incentivized

• The collaborate feature can be clunky and sometimes we have to remove access and add a person back in for them to see the survey in their lists
• We have a contract through our university and more than one person has created their account in the wrong place, causing some administrative headaches as that is fixed so that we can collaborate on surveys with them.
• I wish it was easier to organize my surveys into folders, there should be a more efficient way to do that.

Incentivized

• Bulk exporting multiple tests.
• I believe some contributors are lying on their demographic info. Sometimes when I try to reach native English speakers or another language, I come across users who are not native speakers even though I set up demographics accordingly.

Incentivized

I was impressed a couple years ago when two heads of market research at Fortune 500 companies told me about them, and I've been even more impressed with the advancements I've seen in the last year. I like where the company is headed, and I look forward to using them again in a future role.

I'm very happy with my experience of the product and the level of service and learning resources they provide. If the service becomes more expensive than it currently is then we might not be able to justify additional cost - but this is theoretical. I would recommend UserTesting and would ideally renew our contract.

Incentivized

All the menus are very user friendly and intuitive. I can always find exactly what I'm looking for and can change anything I need to with ease. All the elements of the survey are adjustable with very little effort and without confusion.

It's quite straightforward how to use the platform. It can take a couple of times to get how to set up a test and you will need to play around to find a good audience (with that I'd say it's safer to go for a broader audience if possible). But in general, I never had a problem with the usability of the platform itself.

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

Whenever we have had an issue with trying to figure out how to do something (even though the documentation is incredibly well put together) we have asked Qualtrics support and have always received our answer nearly immediately (I think in maybe 10 times, only once did a support person need to call us back). Qualtrics support is dedicated to solving customer issues right, and in the first contact, if at all possible

The technical support is great. They're really friendly and helpful. We've always been able to solve any issues presented. Whenever I have a problem while setting up my test, I can easily click on technical support and be contacted with a rep that we'll go into my account and solve whatever issue I have.

Incentivized

I still use it. It does everything you need an online survey to do. From heat mapping to complex skip logic and display logic. I use it weekly and it never disappoints

I like being able to easily integrate new colleagues by simply giving them a log in user name and password

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

]Qualtrics] CoreXM is great if you want something that is a little more [long] lasting and impactful than a simple survey engine, but aren't quite ready for something that is a long term sustainable program. I would put [Qualtrics] CoreXM squarely in the large, defined project phase. CX is more of the program phase, and other lessor vendors are great for the pre-project definition phase

Incentivized

UserTesting allows for a quicker recruiting process for our studies. Additionally, UserTesting has more unmoderated research features and capabilities. I think that their payment model is also easier than UserInterviews. We typically user UserTesting for reaching our hard to reach segments and recruiting prospective users not already within our product user population.

Incentivized

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• Increased productivity due to the highly intuitive user-interface and template saving capabilities.
• Reporting and analytics are extremely valuable. Our team can track responses and share feedback/results extremely quickly.
• If a user has created a great template, they can share to external teams quite easily. It helps other departments!

Incentivized

• Cost savings of over $100K as we dont involve our research vendors as much as we used to do in the past
• Better tested experience get out in the market quickly even when we don't have enough time available with our researchers; our designers who are well-trained on usertesting.com can test out quickly

Incentivized