Qualtrics XM for Strategy and Research vs. Userlytics vs. UserTesting

Qualtrics is a good medium for creating surveys and getting analytics back for it. I think it's easy to learn if you are in the business of creating surveys or if it's part of your studies. It can be a little overwhelming for a brand new user who has never created a survey for the first time. So onboarding could be better.

Userlytics would be appropriate to use if you were investigating UX on your website, or wanted to identify any pain points which could be causing lower conversion rates. Not only will it be a way to gain direct user feedback, but it enhances your visual ability to see how a user progresses through your website. It is well suited if you have less time to conduct moderated user research at a facility or a client doesn't quite have the budget for that. It may be less appropriate if a client wants a bigger project with larger budgets and more time. In this case, moderated, face-to-face research may be more appropriate.

Incentivized

UserTesting has been great for moderated customer interviews/usability testing as well as for unmoderated testing of messaging, imagery, prototypes and live experiences. I would say that the scope of what you want needs to be limited, as the participants are only paid so much and tests are supposed to not exceed a certain amount of time. For customer interviews, I think it can be difficult to onboard customers to UserTesting if they have never used it before. If I set up interviews, I don't even have them use the UserTesting scheduling tool, I actually set up all the interviews with the customers myself through the tool (being mindful of time zones!). When we run the meeting, they really don't even know UserTesting is involved. Might be nice for UserTesting to allow the upload/connecting to of a Zoom interview and let it do the transcription/analysis from there.

Incentivized

• Qualtrics CoreXM is easy to use for quick one-time surveys or for measuring opinions over time
• It's great for sending/managing RSVPs for meetings or other gatherings or to collect important data like Conflict of Interest declarations.
• Qualtrics CoreXM's reporting and crosstab functionality is beefy and gets better all of the time. I'm always amazed at how easy it is to generate reports for sharing my survey response data and research.

Incentivized

• Excellent customer service
• Fast response rate
• Implementing new features

Incentivized

• Product Manager who follows up on your UserTesting usage and gives advice/support when you need it.
• UserTesting University is a great platform to learn how to use UT and general information about research.
• UserTesting can find participants quickly, so you won't need to wait long before you can start the analysis.

Incentivized

• The collaborate feature can be clunky and sometimes we have to remove access and add a person back in for them to see the survey in their lists
• We have a contract through our university and more than one person has created their account in the wrong place, causing some administrative headaches as that is fixed so that we can collaborate on surveys with them.
• I wish it was easier to organize my surveys into folders, there should be a more efficient way to do that.

Incentivized

• User interface
• Mobile support
• Consolidation of Results

• Sometimes there are restrictions around types of research that can be used for moderated user-testing with our own users.
• For tests on relatively small areas of a website or app, the AI analysis seems rather overblown, like it's trying too hard to come up with something insightful when the test is actually about something quite small (e.g. structure of a mobile app menu).
• It's difficult to invite our own users to unmoderated user-testing because they wouldn't know how the UserTesting interface works - this is particularly an issue for mobile research.

Incentivized

I was impressed a couple years ago when two heads of market research at Fortune 500 companies told me about them, and I've been even more impressed with the advancements I've seen in the last year. I like where the company is headed, and I look forward to using them again in a future role.

I'm very happy with my experience of the product and the level of service and learning resources they provide. If the service becomes more expensive than it currently is then we might not be able to justify additional cost - but this is theoretical. I would recommend UserTesting and would ideally renew our contract.

Incentivized

All the menus are very user friendly and intuitive. I can always find exactly what I'm looking for and can change anything I need to with ease. All the elements of the survey are adjustable with very little effort and without confusion.

I think it's very user friendly. I think it gives you a chance to get a feel for websites you may not previously have experience with nor have otherwise experienced. It's also a great way to give input and help shape functionality of business you may enjoy or have further interest in

Incentivized

It's very good, I have used other tools in the past and this is by far the most intuitive and user friendly. Testament to this is the ease with which other non researchers who have been onboarded to the tool with our additional seat have found it easy to use

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

Whenever we have had an issue with trying to figure out how to do something (even though the documentation is incredibly well put together) we have asked Qualtrics support and have always received our answer nearly immediately (I think in maybe 10 times, only once did a support person need to call us back). Qualtrics support is dedicated to solving customer issues right, and in the first contact, if at all possible

They give their best and also reply to queries immediately

I have contacted UserTesting's customer service online, by email, or by phone a few times, and each time, I have encountered the same professionalism and expertise. Even in person during a work event, they were there, and it was the same experience.

Incentivized

Well trained Professionls

I still use it. It does everything you need an online survey to do. From heat mapping to complex skip logic and display logic. I use it weekly and it never disappoints

Decent but not comprehensive

I like being able to easily integrate new colleagues by simply giving them a log in user name and password

Even though it takes time to set up. The work is diligent and out of the quality is great

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

]Qualtrics] CoreXM is great if you want something that is a little more [long] lasting and impactful than a simple survey engine, but aren't quite ready for something that is a long term sustainable program. I would put [Qualtrics] CoreXM squarely in the large, defined project phase. CX is more of the program phase, and other lessor vendors are great for the pre-project definition phase

Incentivized

We used WhatUsersDo. However, the tool currently got bought out by a bigger company and were removing the remote research tool. We chose to use Userlytics as it stacked up well against competitors.

Incentivized

The quality of the participants: they usually have good feedback and act like "professional" users. Which is good when we want a few insights in a short amount of time. Also, the interface is good. I miss having more features, like a good transcription tool like we have in Condens

Incentivized

Delay to get output

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• Increased productivity due to the highly intuitive user-interface and template saving capabilities.
• Reporting and analytics are extremely valuable. Our team can track responses and share feedback/results extremely quickly.
• If a user has created a great template, they can share to external teams quite easily. It helps other departments!

Incentivized

• Definitely positive, I would say about 30%.

Incentivized

• Content is key to the sign up journey and UserTesting helps me improve that.
• UserTesting has helped me improve the Cashier on our site, making it easier for users to deposit money.
• UserTesting is helping me iterate all our content decisions, helping us improve the UX across all platforms.

Incentivized