HotGloo vs. Optimal vs. UserTesting

Overall, I am happy with HotGloo. It supports and fits well into my workflow. Here, I use HotGloo mainly during the prototyping scale. More preciously for wireframing. Eventhough, there are other tools - which I also use in subsequent steps - that would support wireframing as well, I like HotGloo and will keep using it during this stage. This is mainly because I think the elements and symbol library has just the right depth and detail for wireframing. It is important in wireframing to not include to much detail yet. Otherwise, testers get distracted by design aspects. Therefore, I like HotGloo and us it for different Product and Service design projects.

Incentivized

Optimal Workshop is great for UX testing for those with a budget to do so. This may be a little on the expensive side for smaller businesses, but definitely not anything crazy expensive. The insights that you get out of these tests are invaluable and can be the difference between launching a site and succeeding/failing.

Incentivized

UserTesting has been great for moderated customer interviews/usability testing as well as for unmoderated testing of messaging, imagery, prototypes and live experiences. I would say that the scope of what you want needs to be limited, as the participants are only paid so much and tests are supposed to not exceed a certain amount of time. For customer interviews, I think it can be difficult to onboard customers to UserTesting if they have never used it before. If I set up interviews, I don't even have them use the UserTesting scheduling tool, I actually set up all the interviews with the customers myself through the tool (being mindful of time zones!). When we run the meeting, they really don't even know UserTesting is involved. Might be nice for UserTesting to allow the upload/connecting to of a Zoom interview and let it do the transcription/analysis from there.

Incentivized

• Prototyping.
• Collaboration.
• Widget library.

Incentivized

• Tree Testing - it is a very simple and easy to use system, that provides the data needed from a tree test
• Card sorting - provides a system for users to participate in navigation menu layouts. We looked into several options, but this seemed very intuitive for users.

Incentivized

• Product Manager who follows up on your UserTesting usage and gives advice/support when you need it.
• UserTesting University is a great platform to learn how to use UT and general information about research.
• UserTesting can find participants quickly, so you won't need to wait long before you can start the analysis.

Incentivized

• logical structure of interface objects
• preview view does not scale frame on small screens
• Tool ribbon

Incentivized

• The recruitment panelists are not professional, nor do they take the tasks seriously. You are going to get a lot of bad data.
• They are HQ'd outside the US and must have a small team because the customer service is the absolute WORST I've experienced in their industry.
• They pride themselves on documentation, but when they fail to document something they blame the customer for the mistake.
• There are way too many limitations with the tool after you launch, limited integrations, and poor survey questionnaire options. The tool itself is far too basic for most sites, especially B2B.

• Sometimes there are restrictions around types of research that can be used for moderated user-testing with our own users.
• For tests on relatively small areas of a website or app, the AI analysis seems rather overblown, like it's trying too hard to come up with something insightful when the test is actually about something quite small (e.g. structure of a mobile app menu).
• It's difficult to invite our own users to unmoderated user-testing because they wouldn't know how the UserTesting interface works - this is particularly an issue for mobile research.

Incentivized

I'm very happy with my experience of the product and the level of service and learning resources they provide. If the service becomes more expensive than it currently is then we might not be able to justify additional cost - but this is theoretical. I would recommend UserTesting and would ideally renew our contract.

Incentivized

I would rate Optimal Workshop's overall usability 9 out of 10 due to several key factors. Firstly, the platform has a user-friendly interface makes navigation straightforward, even for first-time users. The tools and features are well-organized, ensuring users can quickly find what they need without unnecessary complexity. Secondly, the platform is highly intuitive, meaning users can easily understand how to perform tasks without extensive guidance. This is supported by clear and concise instructions throughout the application, reducing the learning curve significantly.

Additionally, the learnability of Optimal Workshop is exceptional. New users can become proficient in a short amount of time, thanks to its well-thought-out design and helpful onboarding materials. Even more advanced features are presented in a way that feels approachable and manageable. Finally, the platform supports a seamless workflow, allowing users to focus on their research or tasks rather than struggling with the software. These qualities collectively make Optimal Workshop a reliable and efficient tool for many projects, justifying its high usability rating.

Incentivized

It's very good, I have used other tools in the past and this is by far the most intuitive and user friendly. Testament to this is the ease with which other non researchers who have been onboarded to the tool with our additional seat have found it easy to use

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

We’ve never had to use much of their support services since the platform is very easy to use, we have however needed to transfer ownership between team members due to people leaving or other circumstances. Under those situations, the support offered to us has been been very quick and efficient and we never had to nudge them much to get the job done.

Incentivized

I have contacted UserTesting's customer service online, by email, or by phone a few times, and each time, I have encountered the same professionalism and expertise. Even in person during a work event, they were there, and it was the same experience.

Incentivized

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

Being able to export the finished wireframe to HTML was a huge time saver for me and my team. Getting to that next step quickly and seamlessly was a massive help. Not only that, but other tools that do this, we have not as much luck. HotGloo's functionality was a step above the others.

Incentivized

For the price as it is very convenient for first-time beginners, its intuitiveness both for the one who is designing the activities and for those who have to interact with them. The fact that it collects and gathers the data into insights of the overall responses collected by all users.

Incentivized

The quality of the participants: they usually have good feedback and act like "professional" users. Which is good when we want a few insights in a short amount of time. Also, the interface is good. I miss having more features, like a good transcription tool like we have in Condens

Incentivized

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• Quicker lead time in testing interactions with latest designs.
• Shorter build time through use of standard branding.

Incentivized

• Optimal Workshop has had a positive impact on investigating information architecture on several websites.
• Optimal Workshop has helped investigated the labeling on several websites.
• Optimal Workshop has also support in the investigation of UX in navigations.

Incentivized

• Content is key to the sign up journey and UserTesting helps me improve that.
• UserTesting has helped me improve the Cashier on our site, making it easier for users to deposit money.
• UserTesting is helping me iterate all our content decisions, helping us improve the UX across all platforms.

Incentivized