Your A/B Testing Team Will Thank You
March 16, 2016
Your A/B Testing Team Will Thank You
Score 8 out of 10
Vetted Review
Verified User
Overall Satisfaction with Crazy Egg
The primary use of Crazy Egg is heat mapping so we can determine whether a design is effective. It is also used for placement of material, and finding areas to test. A good example is we recently launched a page with a very large hero image that was not actually a clickable element. We found numerous clicks on it, which indicated that visitors believed it to be a banner. We're now testing adding CTAs to that hero image. In other instances, we've been able to determine that certain content was simply seen by no one and we were able to scrap it, leading to quicker load times and more concentrated content. Even more important has been finding material below the fold that was being viewed frequently, which let us know which content was truly important.
- Click Mapping - it is valuable to know where visitors are clicking and Crazy Egg does this.
- Scroll Mapping - I think this may actually be even more valuable. There's often a bias toward very long pages and being able to clearly show how this is damaging the ability to have a visitor receive the message has really helped our designers reorient expectations.
- Segmentation - In addition to mapping clicks, Crazy Egg does a good job of differentiating who has been clicking where based on technology, new/return visitors, and other visitor properties.
- Single Page Applications - if you have a single page application, it's difficult to get the click mapping to work for anything beyond the first view of that page. You need to be able to add very specific code, which detracts from the otherwise easy use of the tool.
- Exports - Exports take a really long time and are necessary as your ability to have teammates log in is extremely constrained by the pricing model.
- Responsive Pages - I recognize this is a big ask, but I'd like to be able to see how things are clicked when the page is in a different configuration. It's not served in the same manner on a phone as on a desktop, so seeing the snapshot reflect that configuration and the appropriate clicks would be great.
- The primary benefit has been in identifying what to test. It's much easier to identify what's not working when you see what's being seen and being clicked. I'd say that 60% of our new tests have their basis in data that Crazy Egg provides.
- It serves as a sanity check on new designs. It's much easier to say that a design shouldn't even make it off the drawing board if we can show that the majority of it won't be seen.
- It allows us to know that a new design is working. We've made changes that draw the visitor to continue and it's increased the number of visitors who will go below the fold on new pages.
I've used Tealeaf which does click tracking, but the shortcoming is that it does it only on truly clickable elements. You miss out on the non-clickable elements that are being clicked, which is really valuable information. IBM sells an upgrade that adds that, but it costs a fortune, and at the time we evaluated it, it also didn't contain the same segmentation out of the box like Crazy Egg. Tealeaf has many valuable uses, but is best used a replay tool, not a click tracker.