Hotjar vs. UserTesting

Hotjar is well suite for organizations that want to get a good glimpse into user behavior on their websites. The tool is easily installed through Google Tag Manager, and then users simply select which pages or paths they want the tool to analyze. After a few days, users can start seeing patterns develop, helping them understand what areas of the user journey flow they need to test out and improve. Hotjar is primarily for web-based experiences, not for mobile applications and other non-web digital applications.

Incentivized

UserTesting has been great for moderated customer interviews/usability testing as well as for unmoderated testing of messaging, imagery, prototypes and live experiences. I would say that the scope of what you want needs to be limited, as the participants are only paid so much and tests are supposed to not exceed a certain amount of time. For customer interviews, I think it can be difficult to onboard customers to UserTesting if they have never used it before. If I set up interviews, I don't even have them use the UserTesting scheduling tool, I actually set up all the interviews with the customers myself through the tool (being mindful of time zones!). When we run the meeting, they really don't even know UserTesting is involved. Might be nice for UserTesting to allow the upload/connecting to of a Zoom interview and let it do the transcription/analysis from there.

Incentivized

• Heat mapping is great on Hotjar. It is a good place to start when you are looking at the UX & CRO on your website. You can see the % of people clicking on elements on a page, how far they scroll, and mouse movements.
• Hotjar is great for session recordings. These record the mouse movements, clicks, pages and scrolls of a user in video format. You can watch these to investigate what works well on a site and identify potential roadblocks and bugs.
• Hotjar is great as it ensures that users details are anonymous; for instance, if you are watching a session recording, you cannot see what a user types in a form field, as Hotjar blanks this out.
• Hotjar has a poll function, so you can have polls on your website.

Incentivized

• Product Manager who follows up on your UserTesting usage and gives advice/support when you need it.
• UserTesting University is a great platform to learn how to use UT and general information about research.
• UserTesting can find participants quickly, so you won't need to wait long before you can start the analysis.

Incentivized

• The video recording feature is very slow to use. I know there is a very powerful process going on (saving your CSS and the DOM movements you make) but anyway it's slow to use.
• Hotjar itself is heavy and has effects on your load times. This is a very important issue and I hope they're working on that.
• Adding more segmentation would be nice. For example, being able to connect your API or more information to show relevant polls or feedback buttons to certain users. Aggregated info is hard to process.

Incentivized

• Quality of participant pool - many are career testers, and many are untruthful. Since sessions are auto-scheduled if the screener is past, you often don't know until they've completed the test. Allow double screening or be more stringent in removing users from the platform.
• Unfinished products - focus on making one product the best it can be before moving on to a new one. Unmoderated testing is still missing features (randomization of 3 or more prototypes, etc.)

Incentivized

Even though the heat maps and user recordings were useful, our website was significantly slowed down after we installed Hotjar, so much so, that it took over a minute for our blog to load. The data that we gathered was not worth the length that it took our website to load.

Incentivized

I'm actually trying to get a license for my current job at my current company (recently moved to a new company). I gave it this rating because I am about to go to our executive to ask that we purchase it! I know that there will be value because we are forecasting a high volume of research next year

Incentivized

So easy and simple to use! Straightforward anyone in the team is able to easily go in and set up anything in Hotjar. The UI is really simple. Whenever you give feedback to Hotjar they continously take on board the feedback and improve the tool.

Incentivized

It can be difficult to organize our tests and go back and find information. I think the AI tools are helping and will help with this, but for now it is time consuming to sort through all of the tests and information and then synthesize it and share it with others. It just takes a lot of time.

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

Hotjar is a SaaS-based company, and as such has a good support service. Users can quickly submit support tickets through Hotjar's online portal. Enterprise customers get access to additional support members and have SLAs to support their larger, more complex needs. Overall, Hotjar is extremely reliable and I've never had to reach out to customer support.

Incentivized

I have contacted UserTesting's customer service online, by email, or by phone a few times, and each time, I have encountered the same professionalism and expertise. Even in person during a work event, they were there, and it was the same experience.

Incentivized

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

Compared to Sprig and Usabilla, Hotjar has robust functionality. Again, as stated earlier, the ability to summarize rage clicks, trigger recordings for a/b experiments, and run intercept surveys on mobile is very useful. Hotjar is also noticeably more intuitive to use than Usabilla, with a cleaner interface and navigation.

Incentivized

We evaluated a range of research tools within the UX team, including UserZoom, Lookback, Maze, Optimal Workshop, and UserTesting, and, in the end, concluded that UserTesting had the most comprehensive offer in the market. The only issue we found was that UserTesting appeared to be prohibitively expensive at first glance. In the end, however, the deal struck to get UserTesting for the UX team proved to be sufficiently competitive for us to proceed.

Incentivized

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• Our UX team can now use hard data to back up and validate design decisions that we make. Our role as usability experts is becoming more respected and integral to business objectives because we now have data that can back up our field of study and prove that our roles are demonstrably useful and necessary.
• HotJar allows our small team of 3 UX designers to get research data as if we were a much larger team. Instead of painstakingly using our time to do guerrilla research, endless user observations, and other types of manual testing, we can now get a significant portion of our data from HotJar.
• Using HotJar is actually giving our team a sense of excitement and enjoyment in our day-to-day usability work. Instead of seeing UX as a chore, HotJar is making data gathering and analyzing more fun, because we can see tangible results from a much larger pool of user/user-data than we could in the past.

Incentivized

• It provides critical insights that increase our subscriptions, time spent and in a commerce frame, conversion
• It helps frame the need to pivot on products yet to launch to ensure the meet user expectations so reduces risk.
• It is integral to highlights areas of opportunity we can captialise on

Incentivized