Crazy Egg vs. UserTesting

Crazy Egg is great if you have static content and want to be able to easily set up heatmaps and scrollmaps to see how people interact with your webpages across different devices types. Straightforward and reliable. In circumstances when you want fast turnarounds, Crazy Egg isn't the right tool as the visualisations often take the better part of a day to generate. It also doesn't perform well if your site has dynamic content - either AJAX-driven or dynamically expanding.

Incentivized

UserTesting has been great for moderated customer interviews/usability testing as well as for unmoderated testing of messaging, imagery, prototypes and live experiences. I would say that the scope of what you want needs to be limited, as the participants are only paid so much and tests are supposed to not exceed a certain amount of time. For customer interviews, I think it can be difficult to onboard customers to UserTesting if they have never used it before. If I set up interviews, I don't even have them use the UserTesting scheduling tool, I actually set up all the interviews with the customers myself through the tool (being mindful of time zones!). When we run the meeting, they really don't even know UserTesting is involved. Might be nice for UserTesting to allow the upload/connecting to of a Zoom interview and let it do the transcription/analysis from there.

Incentivized

• Shows us exactly where users click on a page. Literally, the exact spot. This is useful in many different ways. You can see what links/buttons are clicked the most. You can see if a key CTA on the page IS NOT clicked - maybe you need a new design or the placement of that CTA is poor.
• You can see if users are clicking a spot on the page that is not actually actionable. Maybe your treatment of some text or an image makes it appear that an item is linked, but it is not actually linked. You can see that people are clicking on that item, and either go ahead and link it, or else change the design to look less 'clickable'.
• You can see what percentage of users actually view the different areas within your page. This is very useful when you run into a key stakeholder that demands certain content be above 'the fold'. Trying to explain to a non-technical person that 'the fold' is entirely dependent upon the user's screen size and resolution can be frustrating for both the stakeholder and yourself. Instead, using Crazy Egg's scrollmap feature, you can visually show that stakeholder that, for instance, 80% of users view the content that appears within the top 600 pixels of page height.
• The design of both the heatmaps and scrollmaps is fantastic.
• The 'page camera' software they offer works very well once you get the hang of it. This allows you to run tests on pages that include dynamic content (like a shopping cart product category page).

• Product Manager who follows up on your UserTesting usage and gives advice/support when you need it.
• UserTesting University is a great platform to learn how to use UT and general information about research.
• UserTesting can find participants quickly, so you won't need to wait long before you can start the analysis.

Incentivized

• Sometimes the snapshots record fewer visits as compared to another page variant even when traffic is evenly distributed between the two.
• Crazy Egg has limited heatmap visualizations.
• Need to delete snapshots after it reaches the max limit. It happens fast if you are taking both mobile and desktop views of pages.

Incentivized

• Quality of participant pool - many are career testers, and many are untruthful. Since sessions are auto-scheduled if the screener is past, you often don't know until they've completed the test. Allow double screening or be more stringent in removing users from the platform.
• Unfinished products - focus on making one product the best it can be before moving on to a new one. Unmoderated testing is still missing features (randomization of 3 or more prototypes, etc.)

Incentivized

It's a great tool considering how inexpensive it is. If used correctly and you have a plan for tracking your websites, this tool can make a world of a difference. If you are not going to sit down and take the time to make a plan for how to use this tool, I would say it is not worth your time. Yes, you can look at items on your website that need to be changed, but without a consistent plan, other important items that need changing can be lost in the mix. Make sure you have enough time and energy to invest in this and it will be well worth it

I'm actually trying to get a license for my current job at my current company (recently moved to a new company). I gave it this rating because I am about to go to our executive to ask that we purchase it! I know that there will be value because we are forecasting a high volume of research next year

Incentivized

Crazy Egg is extremely easy to set up and use, and very well done from a user experience standpoint. It is really helpful that I can give stakeholders access to the interface and get them interacting with it with minimal training. The A/B testing is the easiest I have ever used, with minimal performance impact to the website.

Incentivized

It can be difficult to organize our tests and go back and find information. I think the AI tools are helping and will help with this, but for now it is time consuming to sort through all of the tests and information and then synthesize it and share it with others. It just takes a lot of time.

Incentivized

I never had any issues with CrazyEgg being down or not working when i need it, and I use it pretty much everyday

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

I think support is an area where Crazy Egg is lacking. I would love to have a quarterly check-in with a Crazy Egg rep to understand what kinds of changes have been made to the platform and what is on the horizon. I also think a quick consulting sessions with a rep could be extremely beneficial, as I'm sure there are ways to use the tool that we haven't even thought about yet that would be extremely insightful for our team.

Incentivized

I have contacted UserTesting's customer service online, by email, or by phone a few times, and each time, I have encountered the same professionalism and expertise. Even in person during a work event, they were there, and it was the same experience.

Incentivized

Crazy Egg is the best CRO and LPO tool for performance marketers who have a limited budget!

It is simple. JavaScript code needs to be added to any pages where you want to run tests. That's it.

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

There are a lot of tools with similar feature and closely equal pricing- This factor is the most confusing. As we need something for our website and not every tool has everything and it took time for us to understand this. We choose Crazy Egg for its ease of using and anyone can be trained to use it. The main reason to chose Crazy Egg is the ease of creating snapshots and downloadable features. For me personally -the "confetti" feature helped a lot and its the main feature which is like a ALL IN 1.

Incentivized

We evaluated a range of research tools within the UX team, including UserZoom, Lookback, Maze, Optimal Workshop, and UserTesting, and, in the end, concluded that UserTesting had the most comprehensive offer in the market. The only issue we found was that UserTesting appeared to be prohibitively expensive at first glance. In the end, however, the deal struck to get UserTesting for the UX team proved to be sufficiently competitive for us to proceed.

Incentivized

Its reliability (not scaleability, as the question asks for, sorry) is pretty good but through our testing we know that some clicks do not get recorded. It doesn't bother us a lot because we look at the aggregate of thousands of visits, but we do know it misses things. As for scaleability, it's about right. You really don't want zillions of clicks per snapshot - the screen just turns to 100% dots and you lose the ability to differentiate different screen areas. We find that 25,000 clicks for a page gives us a really good view.

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• Positive Impact: Answering questions that analytics cannot. i.e. Are people seeing the PayPal button? We can measure how many people start the PayPal process on our site. However, its hard to know if low numbers are because of low interest or because our customers are missing the option.
• Positive Impact: Measuring user engagement for page types to determine what elements on the page are most important to our customers.
• Positive Impact: Lower cost than competitors to use helpful engagement tracking software. Currently, we're not consistently using Crazy Egg for user engagement so the $50 a month is perfect for our current needs.

Incentivized

• It provides critical insights that increase our subscriptions, time spent and in a commerce frame, conversion
• It helps frame the need to pivot on products yet to launch to ensure the meet user expectations so reduces risk.
• It is integral to highlights areas of opportunity we can captialise on

Incentivized