UserTesting vs. UserZoom

UserTesting is ideal for big companies that work in an agile setting. If you are working in a fast paces environment and need to get some insights fast, UserTesting helps a lot. If you are creative, and know how to ask questions, you would be surprised how fast UserTesting starts to show its value. We are a small team and we try to minimize our work load as much as we can by optimizing our research operations, so making unmoderated tests are very important to us. If you are a small company with limited resources though, it might be expensive. Then, buying multiple tools that cover different areas might actually become more affordable

Incentivized

UserZoom is well suited for usability testing, I found specifically around test websites and marketing materials. I was able to invite others to participate and watch as well as screen share so that it was an interactive session. Other tools I have used have been a little better with the video output and transcripts of each session so that we could capture notes quickly, but overall it was a good tool to use to test.

Incentivized

• Creating clips and highlight reels of recorded interviews--these really help you "land" the research findings with stakeholders.
• Capturing a blend of qual and quant in unmoderated interviews. They've been continuously improving the quality of visuals, so it can sometimes be a simple drag and drop into a report!
• The technical and account support teams are second to none. Response times and even resolution of issues is usually same day.
• They've come in to do product onboarding and trainings for our teams which allows our research team to keep driving research while expanding what our "people who sometimes do research" are able to take on.

Incentivized

• Quantitative testing can be done on the cheap compared to other quant tools or vendors... once you buy the license, you only pay for additional recruiting and you are managing the project, so there isn't the high cost of having other vendors doing the project management or running a survey etc.
• Farily robust means of tracking and recording data. I also relied heavily on the excel spreadsheet of all the raw data, which you can have UZ customize for you to get what you need.
• Great support system from the UserZoom team - they have researchers who can help with coding and also provide research support for a very good price.
• Also they have tree testing, card sorting, survey capabilities (in addition to usability testing)... and mobile testing. and they seem to be continously be developing the tool to support additional methods.

Incentivized

• Comparative tests on mobile devices is a major issue. Users find it very difficult to user test a comparative test where they are asked to compare two experiences.
• Users sometimes hurry on to complete the tests.
• Reusing a saved templated is sometimes tricky and qualifying questions are not saved properly.

Incentivized

• Compared with some other tools, because their video conferencing platform is web-based (vs. using Zoom, which has a desktop app), I find the connection buffers a lot and it's kind of annoying
• Their screening tool on the UserZoom side (not Go) is clunky. Just let me select May, Must, or Should not for criteria rather than the weird interface design they have now.
• Logic panel is a little confusing, sometimes I do a double-take, sometimes it's wonky and resets itself. It's just not as easy to use as it could be.
• They haven't integrated UserZoom and UserZoom Go (formerly Validately)
• It's expensive!
• We signed up for a high sample size license with unlimited tests, but we're finding their panel doesn't fill as fast as their biggest competitor, UserTesting. We've struggled to fill n=100 sample tests with fairly general criteria.
• A lot of their licenses only allow limited concurrent studies, whereas UserTesting had unlimited tests that you could launch at a time. It's slowed us down.

Incentivized

I'm very happy with my experience of the product and the level of service and learning resources they provide. If the service becomes more expensive than it currently is then we might not be able to justify additional cost - but this is theoretical. I would recommend UserTesting and would ideally renew our contract.

Incentivized

I'm actually trying to get a license for my current job at my current company (recently moved to a new company). I gave it this rating because I am about to go to our executive to ask that we purchase it! I know that there will be value because we are forecasting a high volume of research next year

Incentivized

Pretty hard because the videos needs to be diligently reviewed to make sure the screener worked (the 15% that just test for money and lie about their info get into the test). Then, I have to use excel sheets and pivot tables to bring the data together. It takes a very detailed and tenacious person to get correct insights

Incentivized

Overall, it was fairly easy to use. Especially if you are familiar with this type of product. We were able to use it for testing pretty much right after we got it (same day) and didn't have many issues figuring out how to invite, test, and share which was great.

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

The chat feature is great and I usually use it to reach out to replace at least one respondent every other study. I wish I didn't have to reach out and I could self-serve (e.g., replace bad participants who don't try or don't follow instructions) on my own, but because I do not have that option, at least they're responsive and generally helpful when I reach out

Incentivized

From my experience, the UserZoom team has really done a great job answering the limited questions we have given them thus far. I think the platform is popular enough that many of my questions have been answered by their help pages - or other online content with helpful tips and tricks. I think the community has done a nice job of providing end-user tutorials for those who are new to the platform.

Incentivized

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

UserTesting was clearly better based on the cohort of established users (1.6 Million, I believe), which is the largest in the industry. Their platform is mature and has all the features we need, including highlight reels, real-time transcription, and clips. They also have built-in analysis tools that make reporting on the findings virtually automatic, saving us a ton of time.

Incentivized

On several occasions, the participants claimed that TryMyUI was extremely laggy towards the end of the sessions, and got frustrated. We have trialed UserTesting and decided to make the switch. Our team especially like the variety of templates on the platform targetting various needs such as preference test, web/app usability, short tests, etc.

Incentivized

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• Increased speed and volume of research. We get to do three times more studies than before.
• Reduces to almost zero the time that researchers dedicate to recruitment for most B2C studies, allowing them to focus on more important tasks.
• Improved performance of our products - feedback is getting better and better over time.

Incentivized

• A must-have tool for any CPG UX website/path-to-purchase testing!
• App testing: easy enough to work with that there's no excuse for not testing early and often.
• Not inexpensive, but every great product must have as equally a great user experience designed in!

Incentivized