Eclipse AI vs. Lookback vs. UserTesting

Best suited to conduct remote interviews that are moderated and facilitated by the interviewer/researcher.

Not the best if you want to do it unmoderated, there are much more sophisticated tools out there. Unfortunately, for a design research team that does both these kids of research, it can be hard to get budgets to get two softwares and hence the Unmoderated Feature can seem super undercooked and doesn’t really do the job.

Otherwise it’s a great tool

Incentivized

UserTesting has been great for moderated customer interviews/usability testing as well as for unmoderated testing of messaging, imagery, prototypes and live experiences. I would say that the scope of what you want needs to be limited, as the participants are only paid so much and tests are supposed to not exceed a certain amount of time. For customer interviews, I think it can be difficult to onboard customers to UserTesting if they have never used it before. If I set up interviews, I don't even have them use the UserTesting scheduling tool, I actually set up all the interviews with the customers myself through the tool (being mindful of time zones!). When we run the meeting, they really don't even know UserTesting is involved. Might be nice for UserTesting to allow the upload/connecting to of a Zoom interview and let it do the transcription/analysis from there.

Incentivized

• Organization of user interviews
• Sharing of interviews across the team
• Creating highlights of insights

Incentivized

• Product Manager who follows up on your UserTesting usage and gives advice/support when you need it.
• UserTesting University is a great platform to learn how to use UT and general information about research.
• UserTesting can find participants quickly, so you won't need to wait long before you can start the analysis.

Incentivized

• Unmoderated interviews is still under cooked as a feature
• The process of how participants have to download an app to start an interview is a large friction point for us

Incentivized

• Sometimes there are restrictions around types of research that can be used for moderated user-testing with our own users.
• For tests on relatively small areas of a website or app, the AI analysis seems rather overblown, like it's trying too hard to come up with something insightful when the test is actually about something quite small (e.g. structure of a mobile app menu).
• It's difficult to invite our own users to unmoderated user-testing because they wouldn't know how the UserTesting interface works - this is particularly an issue for mobile research.

Incentivized

I'm very happy with my experience of the product and the level of service and learning resources they provide. If the service becomes more expensive than it currently is then we might not be able to justify additional cost - but this is theoretical. I would recommend UserTesting and would ideally renew our contract.

Incentivized

Once you understand how the interface works, it works great, but there is a learning curve

Incentivized

It's very good, I have used other tools in the past and this is by far the most intuitive and user friendly. Testament to this is the ease with which other non researchers who have been onboarded to the tool with our additional seat have found it easy to use

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

I have contacted UserTesting's customer service online, by email, or by phone a few times, and each time, I have encountered the same professionalism and expertise. Even in person during a work event, they were there, and it was the same experience.

Incentivized

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

Zoom was way more expensive and it o is designed to other things apart from just running qualitative interviews. It also requires a different kind of approval and different approval processes to go through when trying to get it simply for qualitative research purposes.

Lookback records, scribes, helps observe and provides a sentiment check as well in the price that it does

Incentivized

The quality of the participants: they usually have good feedback and act like "professional" users. Which is good when we want a few insights in a short amount of time. Also, the interface is good. I miss having more features, like a good transcription tool like we have in Condens

Incentivized

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• It allows us to understand our customers’ problems in a very team compatible way.

Incentivized

• Content is key to the sign up journey and UserTesting helps me improve that.
• UserTesting has helped me improve the Cashier on our site, making it easier for users to deposit money.
• UserTesting is helping me iterate all our content decisions, helping us improve the UX across all platforms.

Incentivized