Qualtrics CoreXM vs. UserTesting

Qualtrics is a good medium for creating surveys and getting analytics back for it. I think it's easy to learn if you are in the business of creating surveys or if it's part of your studies. It can be a little overwhelming for a brand new user who has never created a survey for the first time. So onboarding could be better.

UserTesting solves the problem of recruitment. Thanks to UserTesting I can recruit participants from different countries around the world with the characteristics I need. Recruitment is a very difficult process for a small research team and I sometimes still struggle with that; for example, when recruiting minors for research. But not having to do the whole recruitment and reward process is a huge benefit.

Incentivized

• Qualtrics CoreXM is easy to use for quick one-time surveys or for measuring opinions over time
• It's great for sending/managing RSVPs for meetings or other gatherings or to collect important data like Conflict of Interest declarations.
• Qualtrics CoreXM's reporting and crosstab functionality is beefy and gets better all of the time. I'm always amazed at how easy it is to generate reports for sharing my survey response data and research.

Incentivized

• Taking notes with video clips. I can take notes while I am watching a session and I can create clips of UX issues or bugs occurring. This really helps when I share them with other teams.
• Exporting all your notes. I analyze all usability tests by exporting my notes from UserTesting. I wish I could bulk export multiple tests though.
• Setting up demographics. This helps me reach out to users who are similar to our audience.
• Setting up screeners. Some studies require specific audiences (using a specific tool etc.), by setting screeners I can make sure I reached the correct audience.

Incentivized

• The collaborate feature can be clunky and sometimes we have to remove access and add a person back in for them to see the survey in their lists
• We have a contract through our university and more than one person has created their account in the wrong place, causing some administrative headaches as that is fixed so that we can collaborate on surveys with them.
• I wish it was easier to organize my surveys into folders, there should be a more efficient way to do that.

Incentivized

• Comparative tests on mobile devices is a major issue. Users find it very difficult to user test a comparative test where they are asked to compare two experiences.
• Users sometimes hurry on to complete the tests.
• Reusing a saved templated is sometimes tricky and qualifying questions are not saved properly.

Incentivized

I was impressed a couple years ago when two heads of market research at Fortune 500 companies told me about them, and I've been even more impressed with the advancements I've seen in the last year. I like where the company is headed, and I look forward to using them again in a future role.

I'm very happy with my experience of the product and the level of service and learning resources they provide. If the service becomes more expensive than it currently is then we might not be able to justify additional cost - but this is theoretical. I would recommend UserTesting and would ideally renew our contract.

Incentivized

All the menus are very user friendly and intuitive. I can always find exactly what I'm looking for and can change anything I need to with ease. All the elements of the survey are adjustable with very little effort and without confusion.

The video review interface is user-friendly and makes it easy to navigate between different test responses. This helps us quickly analyze and understand the feedback we receive from users.

UserTesting's platform is straightforward and intuitive to use when setting up tests. We can easily select the type of test we want to conduct, define our objectives and criteria, and invite participants to take the test.

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

Whenever we have had an issue with trying to figure out how to do something (even though the documentation is incredibly well put together) we have asked Qualtrics support and have always received our answer nearly immediately (I think in maybe 10 times, only once did a support person need to call us back). Qualtrics support is dedicated to solving customer issues right, and in the first contact, if at all possible

The support team at UserTesting is super helpful, responsive, and overall respectful and nice. They respond to your chat requests very quickly if you need immediate support within the tool, where time is of the essence. If you need support via email, they are quick and responsive there too. They are also very nice and helpful

Incentivized

I still use it. It does everything you need an online survey to do. From heat mapping to complex skip logic and display logic. I use it weekly and it never disappoints

I like being able to easily integrate new colleagues by simply giving them a log in user name and password

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

]Qualtrics] CoreXM is great if you want something that is a little more [long] lasting and impactful than a simple survey engine, but aren't quite ready for something that is a long term sustainable program. I would put [Qualtrics] CoreXM squarely in the large, defined project phase. CX is more of the program phase, and other lessor vendors are great for the pre-project definition phase

Incentivized

UserTesting allows for a quicker recruiting process for our studies. Additionally, UserTesting has more unmoderated research features and capabilities. I think that their payment model is also easier than UserInterviews. We typically user UserTesting for reaching our hard to reach segments and recruiting prospective users not already within our product user population.

Incentivized

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• Increased productivity due to the highly intuitive user-interface and template saving capabilities.
• Reporting and analytics are extremely valuable. Our team can track responses and share feedback/results extremely quickly.
• If a user has created a great template, they can share to external teams quite easily. It helps other departments!

Incentivized

• Cost savings of over $100K as we dont involve our research vendors as much as we used to do in the past
• Better tested experience get out in the market quickly even when we don't have enough time available with our researchers; our designers who are well-trained on usertesting.com can test out quickly

Incentivized