Lucky Orange vs. UserTesting

Lucky Orange is one of the few players in the marketplace to provide real-time, live heatmaps along with navigation interactions, including at the secondary and tertiary levels. The Lucky Orange dashboard provides basic user behavioral metrics, and the user recordings allow you to get deeper insights into user behavior beyond the heatmap overlays. Also, the addition of real-time polling and chat capabilities enable you to engage with your users while they are on-page and push/promote special offers and promos, as well as survey website visitors about their experience.

Incentivized

UserTesting has been great for moderated customer interviews/usability testing as well as for unmoderated testing of messaging, imagery, prototypes and live experiences. I would say that the scope of what you want needs to be limited, as the participants are only paid so much and tests are supposed to not exceed a certain amount of time. For customer interviews, I think it can be difficult to onboard customers to UserTesting if they have never used it before. If I set up interviews, I don't even have them use the UserTesting scheduling tool, I actually set up all the interviews with the customers myself through the tool (being mindful of time zones!). When we run the meeting, they really don't even know UserTesting is involved. Might be nice for UserTesting to allow the upload/connecting to of a Zoom interview and let it do the transcription/analysis from there.

Incentivized

• Session recordings provide detailed playbacks of how people are using your website
• Heatmaps work well and display what people are clicking on over a range of screen sizes.
• Pricing makes this a great entry point to understand a range of tools that you can use to understand your customers better.
• Integrates well with other tools, from GA to Adobe Analytics to Optimizely.

Incentivized

• Product Manager who follows up on your UserTesting usage and gives advice/support when you need it.
• UserTesting University is a great platform to learn how to use UT and general information about research.
• UserTesting can find participants quickly, so you won't need to wait long before you can start the analysis.

Incentivized

• Deletes older data that we sometimes like to go back and reference. It would be nice to access an archive.
• Sometimes we get too many recordings that are very similar to one another. Would be nice to have a filter to reduce similar recordings.

Incentivized

• Quality of participant pool - many are career testers, and many are untruthful. Since sessions are auto-scheduled if the screener is past, you often don't know until they've completed the test. Allow double screening or be more stringent in removing users from the platform.
• Unfinished products - focus on making one product the best it can be before moving on to a new one. Unmoderated testing is still missing features (randomization of 3 or more prototypes, etc.)

Incentivized

The pricing options for large business are very lacking. The value of Lucky Orange doesn't really increase after your first 50,000 page visits but the service is on a sliding scale so the more traffic you have the more they charge. In addition, we got lots of useful information out of lucky orange in the beginning but after a while we knew what things needed to be fixed and are waiting on our developers to create the AB tests.

Incentivized

I'm actually trying to get a license for my current job at my current company (recently moved to a new company). I gave it this rating because I am about to go to our executive to ask that we purchase it! I know that there will be value because we are forecasting a high volume of research next year

Incentivized

It can be difficult to organize our tests and go back and find information. I think the AI tools are helping and will help with this, but for now it is time consuming to sort through all of the tests and information and then synthesize it and share it with others. It just takes a lot of time.

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

Good, timely responses from knowledgeable support team members.

Incentivized

I have contacted UserTesting's customer service online, by email, or by phone a few times, and each time, I have encountered the same professionalism and expertise. Even in person during a work event, they were there, and it was the same experience.

Incentivized

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

Lucky Orange and Hotjar are pretty similar in a lot of ways. One element that Lucky Orange definitely leads in is pricing. Much better and easily justified price points. Ultimately, it comes down to whether or not a new client has already had experience with one or the other and whether they're willing to switch to Lucky Orange if they're not already using it, based upon price.

Incentivized

We evaluated a range of research tools within the UX team, including UserZoom, Lookback, Maze, Optimal Workshop, and UserTesting, and, in the end, concluded that UserTesting had the most comprehensive offer in the market. The only issue we found was that UserTesting appeared to be prohibitively expensive at first glance. In the end, however, the deal struck to get UserTesting for the UX team proved to be sufficiently competitive for us to proceed.

Incentivized

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• It is hard to quantify into numbers how much their app helps us, but we know that each customer that we are able to help with the live view feature is much more likely to convert had we not been able to help them.
• Having a live chat on its own is useful and we see an average increase of 30% in conversions when our live chat is active.

Incentivized

• It provides critical insights that increase our subscriptions, time spent and in a commerce frame, conversion
• It helps frame the need to pivot on products yet to launch to ensure the meet user expectations so reduces risk.
• It is integral to highlights areas of opportunity we can captialise on

Incentivized