Lucky Orange is a conversion optimization tool with features including heatmaps, session recording, conversion funnels, form analytics, and chat.
$0
(tracks up to 100 monthly sessions)
UserTesting
Score 8.1 out of 10
N/A
UserTesting helps UX researchers, designers, product teams, and marketers gather actionable insights through research, testing, and feedback. With a network of real people ready to share their perspectives, UserTesting enables organizations to make customer-first decisions at scale.
Due to its price structure lick your ages best for smaller businesses it’s actually rather affordable. It also works best on WordPress Squarespace or Shopify websites. I would recommend that someone be in charge of managing the interface and be responsible for watching user behavior videos or you will lose out on Valuable insights. This product doesn’t want itself all that well two single page apps or websites with lots of website visitors one thing I wish that they would’ve let us do is only capture videos if a user did a specific action. Another issue is that the videos only were saved for 30 days.
Well suited to its original purpose- usability testing and interviews. This can be performed at pace, given the large audience (although our brands are very well known so this should not be a barrier) and there is a decent level of task customisation when conducting unmoderated testing. Its less appropriate for survey where you are looking to capture genuine intent/behaviour, even with screeners the data skews more positively than onsite survey, makes me question the quality of survey respondents.
Aggregated data for a particular page type or directory is clunky and requires multiple steps.
Heatmap access requires direct input of targeted pages - having quick links would be easier.
Lucky Orange's code snippet can result in a site's security settings blocking the real-time heatmaps, requiring you to disable your security settings, remove site code, or manually debug your site code to view your heatmap overlays.
Quality of participant pool - many are career testers, and many are untruthful. Since sessions are auto-scheduled if the screener is past, you often don't know until they've completed the test. Allow double screening or be more stringent in removing users from the platform.
Unfinished products - focus on making one product the best it can be before moving on to a new one. Unmoderated testing is still missing features (randomization of 3 or more prototypes, etc.)
The pricing options for large business are very lacking. The value of Lucky Orange doesn't really increase after your first 50,000 page visits but the service is on a sliding scale so the more traffic you have the more they charge. In addition, we got lots of useful information out of lucky orange in the beginning but after a while we knew what things needed to be fixed and are waiting on our developers to create the AB tests.
I'm very happy with my experience of the product and the level of service and learning resources they provide. If the service becomes more expensive than it currently is then we might not be able to justify additional cost - but this is theoretical. I would recommend UserTesting and would ideally renew our contract.
It can be difficult to organize our tests and go back and find information. I think the AI tools are helping and will help with this, but for now it is time consuming to sort through all of the tests and information and then synthesize it and share it with others. It just takes a lot of time.
I have contacted UserTesting's customer service online, by email, or by phone a few times, and each time, I have encountered the same professionalism and expertise. Even in person during a work event, they were there, and it was the same experience.
From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.
Pricing is another great feature from Lucky Orange. Even though they have increased it over time, they remain highly competitive and are still one of the only companies, if not the only one, that offers the combination of features that they have available on their site. So their overall value is going to be nearly impossible to beat. Besides their amazing value, the actual features that they include are very useful and not all companies included all of the features that they offered. For the pricing and the features, nobody else came close.
The quality of the participants: they usually have good feedback and act like "professional" users. Which is good when we want a few insights in a short amount of time. Also, the interface is good. I miss having more features, like a good transcription tool like we have in Condens
