Heap vs. Optimizely Web Experimentation

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Heap
Score 8.3 out of 10
Mid-Size Companies (51-1,000 employees)
Heap is a web analytics platform captures every user interaction on web iOS with no extra code. The tool allows you to track events and set up funnels to understand user flow and dropoff. It also provides visualization tools to track trends over time.
$0
per month
Optimizely Web Experimentation
Score 8.8 out of 10
N/A
Optimizely Web Experimentation empowers teams to conduct experiments (without having to rely on developer resources) in order to test various user interactions, make website changes backed by data, and personalize customer experiences.N/A
Pricing
HeapOptimizely Web Experimentation
Editions & Modules
Free
$0
Up to 10k sessions/month
Growth
Starting at $3,600 annually
Up to 300k sessions/year
Pro
Contact Heap Sales
Custom sessions per month and unlimited projects
Premier
Contact Heap Sales
Custom sessions per month
No answers on this topic
Offerings
Pricing Offerings
HeapOptimizely Web Experimentation
Free Trial
YesYes
Free/Freemium Version
YesNo
Premium Consulting/Integration Services
YesYes
Entry-level Setup FeeOptionalOptional
Additional DetailsHeap pricing is based on session volume. A session is a period of activity from a single user on your app or website. It can include many pageviews or events.
More Pricing Information
Community Pulse
HeapOptimizely Web Experimentation
Considered Both Products
Heap
Chose Heap
Heap had an edge over Google Analytics in many ways. Few points to consider Heap over GA.
1. Low code implementation and less involvement of engineering team.
2. Great reporting dashboard with additional feature of of showing user journey, that helps understand user behaviour
Chose Heap
From a startup perspective, Heap is one of the best and fastest ways to go from 0 analytics to nearly all of what one would need with the least amount of effort. It's faster and easier to implement than many above and it's better suited for quick quantifiable analytics that …
Chose Heap
So far Heap is better. Adobe is old and clunky, Mixpanel is similar in a lot of ways but I do like the user interface better.
Optimizely Web Experimentation

No answer on this topic

Top Pros
Top Cons
Features
HeapOptimizely Web Experimentation
Testing and Experimentation
Comparison of Testing and Experimentation features of Product A and Product B
Heap
-
Ratings
Optimizely Web Experimentation
8.0
110 Ratings
4% below category average
a/b experiment testing00 Ratings9.3110 Ratings
Split URL testing00 Ratings8.689 Ratings
Multivariate testing00 Ratings8.891 Ratings
Multi-page/funnel testing00 Ratings8.386 Ratings
Cross-browser testing00 Ratings7.459 Ratings
Mobile app testing00 Ratings7.645 Ratings
Test significance00 Ratings8.5101 Ratings
Visual / WYSIWYG editor00 Ratings8.090 Ratings
Advanced code editor00 Ratings7.682 Ratings
Page surveys00 Ratings6.617 Ratings
Visitor recordings00 Ratings8.418 Ratings
Preview mode00 Ratings8.099 Ratings
Test duration calculator00 Ratings7.069 Ratings
Experiment scheduler00 Ratings8.168 Ratings
Experiment workflow and approval00 Ratings6.548 Ratings
Dynamic experiment activation00 Ratings7.443 Ratings
Client-side tests00 Ratings9.162 Ratings
Server-side tests00 Ratings9.026 Ratings
Mutually exclusive tests00 Ratings8.746 Ratings
Audience Segmentation & Targeting
Comparison of Audience Segmentation & Targeting features of Product A and Product B
Heap
-
Ratings
Optimizely Web Experimentation
8.7
104 Ratings
0% below category average
Standard visitor segmentation00 Ratings8.9102 Ratings
Behavioral visitor segmentation00 Ratings8.481 Ratings
Traffic allocation control00 Ratings9.498 Ratings
Website personalization00 Ratings8.070 Ratings
Results and Analysis
Comparison of Results and Analysis features of Product A and Product B
Heap
-
Ratings
Optimizely Web Experimentation
8.4
100 Ratings
1% below category average
Heatmap tool00 Ratings9.313 Ratings
Click analytics00 Ratings8.833 Ratings
Scroll maps00 Ratings8.417 Ratings
Form fill analysis00 Ratings8.337 Ratings
Conversion tracking00 Ratings8.744 Ratings
Goal tracking00 Ratings8.587 Ratings
Test reporting00 Ratings8.191 Ratings
Results segmentation00 Ratings8.058 Ratings
CSV export00 Ratings7.461 Ratings
Experiments results dashboard00 Ratings8.049 Ratings
Best Alternatives
HeapOptimizely Web Experimentation
Small Businesses
Mixpanel
Mixpanel
Score 8.8 out of 10
Convert Experiences
Convert Experiences
Score 9.6 out of 10
Medium-sized Companies
Whatfix
Whatfix
Score 9.4 out of 10
Dynamic Yield
Dynamic Yield
Score 9.0 out of 10
Enterprises
Whatfix
Whatfix
Score 9.4 out of 10
Dynamic Yield
Dynamic Yield
Score 9.0 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
HeapOptimizely Web Experimentation
Likelihood to Recommend
8.2
(232 ratings)
8.8
(196 ratings)
Likelihood to Renew
9.1
(9 ratings)
8.4
(46 ratings)
Usability
8.9
(64 ratings)
9.0
(58 ratings)
Availability
9.1
(2 ratings)
10.0
(7 ratings)
Performance
8.4
(61 ratings)
7.3
(6 ratings)
Support Rating
9.0
(8 ratings)
10.0
(16 ratings)
Online Training
-
(0 ratings)
3.0
(1 ratings)
Implementation Rating
9.0
(3 ratings)
8.0
(11 ratings)
Configurability
9.1
(1 ratings)
6.0
(1 ratings)
Ease of integration
9.1
(1 ratings)
-
(0 ratings)
Product Scalability
7.3
(2 ratings)
8.0
(106 ratings)
Vendor post-sale
8.2
(1 ratings)
-
(0 ratings)
Vendor pre-sale
8.2
(1 ratings)
-
(0 ratings)
User Testimonials
HeapOptimizely Web Experimentation
Likelihood to Recommend
Heap
Scenarios when Heap was well suited: It is when a user claims that he encountered a bug without giving us the details of the error message. Scenarios where it is less appropriate: Its when we try to capture user interaction in our mobile app
Read full review
Optimizely
Let's start with not well suited. As a market-leading tool, they are not the cheapest option available. This means that in some cases, we cannot recommend them to clients as we know they will fall out of their budget. We would recommend them for enterprise and medium—to large businesses as we know we can trust the tool and it comes with a wide range of functionality.
Read full review
Pros
Heap
  • Realtime interactions which are captured automatically is a unique feature which no other product offers.
  • Low code implementation is a big plus for marketing teams, as there is less dependency on engineering
  • Detailed customer behaviours can be studied with captured replay sessions
  • Due to all the above points - it helped to improve customer experience
Read full review
Optimizely
  • Considers every kind of experiment from simple code change, code additions, code removal, javascript functions, CSS changes, and split landing redirects.
  • Very friendly UC interface for easy navigation of implementation of pages, click events, experiment set up, and metric set up.
  • The ability to let me know when something has reach stat sig without having to do complicated math on my own
  • ability to carry UTM parameters through landing page redirects with a click of a button.
Read full review
Cons
Heap
  • I think Heap can improve its onboarding; I would love to see some info that is helpful for someone who isn't in Heap every single day.
  • Sharing dashboards can be tricky, it feels like a huge learning curve that I already have forgotten how to do.
Read full review
Optimizely
  • Pricing model penalizes those just starting with experimentation.
  • High price and fees based on website traffic, not experiment impressions. so you are charged whether you experiment or not.
  • Integration with GA4 is subpar.
  • Documentation at times confusing, different products.
  • UX is confusing and too simple. It leads to errors by users. Lack of meganavs, too minimalistic, it becomes quite a frustration.
  • Not competitive pricing compared with other AB testing tools.
Read full review
Likelihood to Renew
Heap
It's a great platform. I'm glad that one of our product managers introduced it because it has allowed us to create all kinds of new functionality. We're not only able to create a better product experience from our communications because of Heap, but we're also able to generate all kinds of helpful analysis.
Read full review
Optimizely
Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.
Read full review
Usability
Heap
On a scale from 1-10, I find Heap to be incredibly user-friendly and easy to use. I enjoyed the training videos available and was quickly able to pick up how to create events and reports to track user interactions on our product. I would recommend Heap for its usability first and foremost.
Read full review
Optimizely
Optimizely Web Experimentation's visual editor is handy for non-technical or quick iterative testing. When it comes to content changes it's as easy as going into wordpress, clicking around, and then seeing your changes live--what you see is what you get. The preview and approval process for sharing built experiments is also handy for sharing experiments across teams for QA purposes or otherwise.
Read full review
Reliability and Availability
Heap
I've never run into any issues with Heap's availability, Heap is always there when I need it. I haven't run into any issues like application errors or unplanned outages during my 2+ years of using Heap. Each and every time I log in to Heap I have a completely functional experience
Read full review
Optimizely
I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review
Performance
Heap
Heap doesn't affect page load times considerably nor has a large impact [on] our overall score, as far as page loading times inside of the tool its pretty reliable to retrieve data as much as "instant" that it can be the delay seems to be on data getting tracked into the servers to be read but it's not significant.
Read full review
Optimizely
I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review
Support Rating
Heap
Heap support has allowed us to troubleshoot and test a lot of different items. Their support team is always helpful and friendly, even when we come to them with the most complicated questions. I think this greatly improves the value proposition of the product because their support team is knowledgable and friendly.
Read full review
Optimizely
They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
Read full review
Online Training
Heap
No answers on this topic
Optimizely
The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).
Read full review
Implementation Rating
Heap
The implementation was smooth and easy. The Heap team helped us with implementation and it went great! Within a few weeks, we were fully up and running and utilizing the platform to its full capability. This is an additional thing that has made this platform so great and we couldn't recommend it enough.
Read full review
Optimizely
In retrospect: - I think I should have stressed more demo's / workshopping with the Optimizely team at the start. I felt too confident during demo stages, and when came time to actually start, I was a bit lost. (The answer is likely I should have had them on-hand for our first install.. they offered but I thought I was OK.) - Really getting an understanding / asking them prior to install of how to make it really work for checkout pages / one that uses dynamic content or user interaction to determine what the UI does. Could have saved some time by addressing this at the beginning, as some things we needed to create on our site for Optimizely to "use" as a trigger for the variation test. - Having a number of planned/hoped-for tests already in-hand before working with Optimizely team. Sharing those thoughts with them would likely have started conversations on additional things we needed to do to make them work (rather than figuring that out during the actual builds). Since I had development time available, I could have added more things to the baseline installation since my developers were already "looking under the hood" of the site.
Read full review
Alternatives Considered
Heap
Heap offers a ton of functionality on a single platform.It also has an smart data science layer to offers suggestions for next steps in the analysis, allowing us to explore alternative paths we may not think to take. The low-code option for updating data is appealing, and there is a lot of automation with minimal engineering effort.
Read full review
Optimizely
Overall, the tools we compared against were great, but we went with Optimizely because it has all the features we needed and has the market leadership that gave us trust we would be successful in our experimentation efforts.
Read full review
Scalability
Heap
The most challenging part of using Heap in a growing organization is the naming and structure in which reports and dashboards are organized. I work within the marketing department and our Heap leader internally works within the IT/Product department, which makes it challenging because we often don't speak the same language, so the learning curve has been steep without any specific use-case examples to leverage online.
Read full review
Optimizely
This rating for Optimizely Web Experimentation is rooted in the more complicated builds that are not feasible with just Java and CSS. These require the featured experimentation add on, therefore the base level platform I am giving a lower rating. We have had issues with overly complex test builds, because we can only utilize Java and CSS to make the elements
Read full review
Return on Investment
Heap
  • It has helped us make decisions on what products to scope for our MVP based on the usage data.
  • It's allowed us to measure success with our beta product.
  • It's helped us view our conversion rates in an easy and usable manner.
Read full review
Optimizely
  • Customer retention: We've reduced subscription service client churn by 20%+ using optimized unsubscribe flows.
  • Risk mitigation: Testing into full site redesigns has saved clients millions of dollars.
  • Feature prioritization: Identifying what painted door changes add value has allowed developers to focus on changes that add hundreds of thousands or even millions to the bottom line.
Read full review
ScreenShots

Heap Screenshots

Screenshot of Dashboard in Heap (Use to get Product or User Behavior Insights)Screenshot of Effort Analysis provides the first-ever quantitative measurement of user friction, capturing the difficulty users face when moving through every step of every user flow across the digital experience.Screenshot of Heap Illuminate looks for the most common events between two steps in a funnel and generates a Top Events table that displays how well paths including different events convert to the next step so you can understand how that behavior is helping or hurting conversion.Screenshot of From Top Events you can choose an event and use Path Comparison to fork your funnel and see how the selected behavior impacts conversion downstream.

Optimizely Web Experimentation Screenshots

Screenshot of the visual editor, used to make changes to the appearance and layout of a website.Screenshot of the results dashboard that displays experiment results.Screenshot of the integrations page, where integrations can be enabled.Screenshot of Advanced Audience Targeting: Custom Real-Time Segments provide customers with the ability to create rapidly-updating segments which can be used as audiences for testing or personalization. These segments can be based on profile data, omni-channel behaviors, and AI-based observations.Screenshot of AI Content Suggestions: AI-powered suggestions in the Visual Editor accelerate ideation.Screenshot of Extensions for Edge: reusable elements minimize developer dependency when launching multiple tests with the same element.