Crazy Egg vs. Optimizely Web Experimentation

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Crazy Egg
Score 7.6 out of 10
N/A
Crazy Egg is a heat map web analytics product.
$24
per month
Optimizely Web Experimentation
Score 8.7 out of 10
N/A
Optimizely Web Experimentation empowers teams to conduct experiments (without having to rely on developer resources) in order to test various user interactions, make website changes backed by data, and personalize customer experiences.N/A
Pricing
Crazy EggOptimizely Web Experimentation
Editions & Modules
Crazy Egg
$24.00
per month
No answers on this topic
Offerings
Pricing Offerings
Crazy EggOptimizely Web Experimentation
Free Trial
NoNo
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoYes
Entry-level Setup FeeNo setup feeOptional
Additional Details
More Pricing Information
Community Pulse
Crazy EggOptimizely Web Experimentation
Considered Both Products
Crazy Egg
Chose Crazy Egg
I have not used another software all that similar to Crazy Egg. I find Crazy Egg to be a unique tool to incorporate into your analytics, though I have seen similar software out there.
Chose Crazy Egg
Crazy Egg a bit low on features and has a not so friendly interface. But depending on the complexity of your team/projects/experience in digital marketing, it is a great place to start. It's budget friendly. If you have an advanced analytics or A/B testing solution it's a nice …
Chose Crazy Egg
We've never used ClickTale and it was obvious that they offered a lot for businesses. The reason why we chose Crazy Egg is because it fit our business needs and scale perfectly. We do not utilize the software as much as we should; however, when we do use it, we gain a lot of …
Chose Crazy Egg
The company actually still uses Optimizely and Google Analytics as well. Optimizely works well with Crazy Egg because we can do beta testing not only to see if the conversion rate goes up (Optimizely), but also see how the user is interacting with the change (Crazy Egg). Google …
Optimizely Web Experimentation
Chose Optimizely Web Experimentation
We use crazyegg in conjunction with optimizely. They aren't really direct competitors. Crazy is graphical heatmap tracking of a page and doesn't A|B test. We need Optimizely to split out our testing variations for us and then we use Crazy Egg to supplement our knowledge for a …
Chose Optimizely Web Experimentation
unbounce's Visual Editor is what I'd expect out of Optimizely Web Experimentation, but I believe it's missing. Otherwise, Optimizely Web Experimentation is better.
Chose Optimizely Web Experimentation
Monetate, but the tool was a little too far out of our budget. We picked Optimizely because it was cost effective and our ROI was justified based upon a defined baseline to increase conversion and continue the strategy of A/B testing.
Top Pros
Top Cons
Features
Crazy EggOptimizely Web Experimentation
Testing and Experimentation
Comparison of Testing and Experimentation features of Product A and Product B
Crazy Egg
-
Ratings
Optimizely Web Experimentation
8.0
92 Ratings
7% below category average
a/b experiment testing00 Ratings9.392 Ratings
Split URL testing00 Ratings8.574 Ratings
Multivariate testing00 Ratings8.877 Ratings
Multi-page/funnel testing00 Ratings8.272 Ratings
Cross-browser testing00 Ratings7.450 Ratings
Mobile app testing00 Ratings7.638 Ratings
Test significance00 Ratings8.584 Ratings
Visual / WYSIWYG editor00 Ratings8.076 Ratings
Advanced code editor00 Ratings7.568 Ratings
Page surveys00 Ratings7.017 Ratings
Visitor recordings00 Ratings8.418 Ratings
Preview mode00 Ratings8.082 Ratings
Test duration calculator00 Ratings6.956 Ratings
Experiment scheduler00 Ratings8.154 Ratings
Experiment workflow and approval00 Ratings6.537 Ratings
Dynamic experiment activation00 Ratings7.434 Ratings
Client-side tests00 Ratings9.250 Ratings
Server-side tests00 Ratings9.119 Ratings
Mutually exclusive tests00 Ratings8.437 Ratings
Audience Segmentation & Targeting
Comparison of Audience Segmentation & Targeting features of Product A and Product B
Crazy Egg
-
Ratings
Optimizely Web Experimentation
8.6
86 Ratings
2% below category average
Standard visitor segmentation00 Ratings8.985 Ratings
Behavioral visitor segmentation00 Ratings8.365 Ratings
Traffic allocation control00 Ratings9.481 Ratings
Website personalization00 Ratings7.957 Ratings
Results and Analysis
Comparison of Results and Analysis features of Product A and Product B
Crazy Egg
-
Ratings
Optimizely Web Experimentation
8.3
84 Ratings
3% below category average
Heatmap tool00 Ratings9.113 Ratings
Click analytics00 Ratings8.733 Ratings
Scroll maps00 Ratings8.017 Ratings
Form fill analysis00 Ratings8.326 Ratings
Conversion tracking00 Ratings8.744 Ratings
Goal tracking00 Ratings8.473 Ratings
Test reporting00 Ratings8.176 Ratings
Results segmentation00 Ratings8.048 Ratings
CSV export00 Ratings7.648 Ratings
Experiments results dashboard00 Ratings8.049 Ratings
Best Alternatives
Crazy EggOptimizely Web Experimentation
Small Businesses
Smartlook
Smartlook
Score 8.3 out of 10
Convert Experiences
Convert Experiences
Score 9.5 out of 10
Medium-sized Companies
Siteimprove
Siteimprove
Score 8.7 out of 10
Kameleoon
Kameleoon
Score 9.5 out of 10
Enterprises
Contentsquare
Contentsquare
Score 8.6 out of 10
Kameleoon
Kameleoon
Score 9.5 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Crazy EggOptimizely Web Experimentation
Likelihood to Recommend
7.3
(34 ratings)
8.7
(177 ratings)
Likelihood to Renew
8.5
(14 ratings)
8.5
(45 ratings)
Usability
6.0
(8 ratings)
9.0
(57 ratings)
Availability
7.1
(4 ratings)
10.0
(7 ratings)
Performance
2.0
(2 ratings)
7.3
(6 ratings)
Support Rating
5.0
(7 ratings)
10.0
(16 ratings)
Online Training
10.0
(1 ratings)
3.0
(1 ratings)
Implementation Rating
9.2
(3 ratings)
8.0
(11 ratings)
Configurability
-
(0 ratings)
6.0
(1 ratings)
Product Scalability
9.8
(2 ratings)
8.0
(89 ratings)
User Testimonials
Crazy EggOptimizely Web Experimentation
Likelihood to Recommend
Crazy Egg
+ I strongly believe that this tool helps when a firm has good user count (depends on business model) as most of these tools are data friends. More data - more valuable insights + Best fit if someone who is looking for deeper insights of individual page - Not suggested for very fewer visits of a website. Suggested to improve better visit count
Read full review
Optimizely
This is our second testing platform, and is by far the best we have leveraged. Its intuitive in how you are able to build tests. Tracking is easy to set up within the visual editor or as a capability in URL tracking. The reporting tab does need more filtering capabilities for custom metrics.
Read full review
Pros
Crazy Egg
  • Provides heatmaps that shows you the elements on your site that are and aren't performing well.
  • Provides scrollmaps so you can see how far down a page users are scrolling and which content never gets seen.
  • Screenshots show you how your website looks across a variety of different devices.
  • Provides a type of clickmap called confetti that enables you visualise clicks by segments - device, new/returning visitors, campaigns and other metrics.
Read full review
Optimizely
  • Considers every kind of experiment from simple code change, code additions, code removal, javascript functions, CSS changes, and split landing redirects.
  • Very friendly UC interface for easy navigation of implementation of pages, click events, experiment set up, and metric set up.
  • The ability to let me know when something has reach stat sig without having to do complicated math on my own
  • ability to carry UTM parameters through landing page redirects with a click of a button.
Read full review
Cons
Crazy Egg
  • The largest thing we've struggled with is the Optimizely integration. I've contacted customer service a few times to get it properly setup. Customer Service is always friendly and helpful; they provide clear steps to get it setup. Unfortunately despite clear instructions, they are tedious, and if not completed in the correct order, the integration with Optimizely does not work. My success rate with the integration is less than 55%.
Read full review
Optimizely
  • Hard to use extensions without some knowledge of HTML/CSS
  • Inconsistent user counts between GA & Optimizely when it comes to calculating MAUs, hard to be able to forecast budget and overages when our source of truth (GA) differs from our testing platform (Optimizely)
  • Impressions model doesn't support scaling personalization experiences - hard to run a serious data driven testing program when you have to cut tests short before 14 days (ideal length to get to any statistical read) in order to save on impressions
Read full review
Likelihood to Renew
Crazy Egg
It's a great tool considering how inexpensive it is. If used correctly and you have a plan for tracking your websites, this tool can make a world of a difference. If you are not going to sit down and take the time to make a plan for how to use this tool, I would say it is not worth your time. Yes, you can look at items on your website that need to be changed, but without a consistent plan, other important items that need changing can be lost in the mix. Make sure you have enough time and energy to invest in this and it will be well worth it
Read full review
Optimizely
Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.
Read full review
Usability
Crazy Egg
It's not clear what features there are. The navigation icon is not labeled. It's hard to know where to start when you're first logging in as a first-time user. It's hard to know how to set up anything and there aren't many helpful tutorials in-product. I don't want to be kicked out of a help center or read the documentation.
Read full review
Optimizely
Usability is mostly great. I like the WYSIWYG functionality and adding in real code is simple as well. It's easy to target specific pages or audiences. I've knocked a couple of points off because of how difficult it is to set up URL redirect experiments, confusion around creating pages, and lack of data that can be further analyzed.
Read full review
Reliability and Availability
Crazy Egg
It's slow to post data, and slow to get a snapshot to finally be active (i.e. not pending). Not intolerable, but would be nice to see data within a couple hours. Often have to wait to the next day.
Read full review
Optimizely
I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review
Performance
Crazy Egg
No answers on this topic
Optimizely
I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review
Support Rating
Crazy Egg
I think support is an area where Crazy Egg is lacking. I would love to have a quarterly check-in with a Crazy Egg rep to understand what kinds of changes have been made to the platform and what is on the horizon. I also think a quick consulting sessions with a rep could be extremely beneficial, as I'm sure there are ways to use the tool that we haven't even thought about yet that would be extremely insightful for our team.
Read full review
Optimizely
They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
Read full review
Online Training
Crazy Egg
Crazy Egg is the best CRO and LPO tool for performance marketers who have a limited budget!
Read full review
Optimizely
The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).
Read full review
Implementation Rating
Crazy Egg
It is simple. JavaScript code needs to be added to any pages where you want to run tests. That's it.
Read full review
Optimizely
In retrospect: - I think I should have stressed more demo's / workshopping with the Optimizely team at the start. I felt too confident during demo stages, and when came time to actually start, I was a bit lost. (The answer is likely I should have had them on-hand for our first install.. they offered but I thought I was OK.) - Really getting an understanding / asking them prior to install of how to make it really work for checkout pages / one that uses dynamic content or user interaction to determine what the UI does. Could have saved some time by addressing this at the beginning, as some things we needed to create on our site for Optimizely to "use" as a trigger for the variation test. - Having a number of planned/hoped-for tests already in-hand before working with Optimizely team. Sharing those thoughts with them would likely have started conversations on additional things we needed to do to make them work (rather than figuring that out during the actual builds). Since I had development time available, I could have added more things to the baseline installation since my developers were already "looking under the hood" of the site.
Read full review
Alternatives Considered
Crazy Egg
Hotjar is more expensive than Crazy Eggs, and we needed a tool to fit the budget for small comp. With more time, we could have tested it deeply also to have a better opinion, it seems to be great too
Read full review
Optimizely
Overall, the tools we compared against were great, but we went with Optimizely because it has all the features we needed and has the market leadership that gave us trust we would be successful in our experimentation efforts.
Read full review
Scalability
Crazy Egg
Its reliability (not scaleability, as the question asks for, sorry) is pretty good but through our testing we know that some clicks do not get recorded. It doesn't bother us a lot because we look at the aggregate of thousands of visits, but we do know it misses things. As for scaleability, it's about right. You really don't want zillions of clicks per snapshot - the screen just turns to 100% dots and you lose the ability to differentiate different screen areas. We find that 25,000 clicks for a page gives us a really good view.
Read full review
Optimizely
While granted, I am not the one making the changes to deploy the software; it seems basically as simple as placing the optimized snippet on your site. If you place it in the header, it should reach across your entire site easily. I do think the test setup can be a bit temperamental at times, and having too many cooks in the kitchen can lead to errors. So, I would caution how many people have the access needed to make actual changes.
Read full review
Return on Investment
Crazy Egg
  • Very Positive impact on ROI as it pointed towards some specific flaws of the website. These flaws were removed on a regular basis.
  • It constantly helps finetune our website to the requirements of the users. This helps in boosting our business development efforts.
  • It helps us to remove or modify the least visited sections of the website. Thus removing the limitations that hamper our growth.
Read full review
Optimizely
  • Customer retention: We've reduced subscription service client churn by 20%+ using optimized unsubscribe flows.
  • Risk mitigation: Testing into full site redesigns has saved clients millions of dollars.
  • Feature prioritization: Identifying what painted door changes add value has allowed developers to focus on changes that add hundreds of thousands or even millions to the bottom line.
Read full review
ScreenShots

Optimizely Web Experimentation Screenshots

Screenshot of the visual editor, used to make changes to the appearance and layout of a website.Screenshot of the results dashboard that displays experiment results.Screenshot of the integrations page, where integrations can be enabled.