Likelihood to Recommend Scenarios when Heap was well suited: It is when a user claims that he encountered a bug without giving us the details of the error message. Scenarios where it is less appropriate: Its when we try to capture user interaction in our mobile app
Read full review Let's start with not well suited. As a market-leading tool, they are not the cheapest option available. This means that in some cases, we cannot recommend them to clients as we know they will fall out of their budget. We would recommend them for enterprise and medium—to large businesses as we know we can trust the tool and it comes with a wide range of functionality.
Read full review Pros Realtime interactions which are captured automatically is a unique feature which no other product offers. Low code implementation is a big plus for marketing teams, as there is less dependency on engineering Detailed customer behaviours can be studied with captured replay sessions Due to all the above points - it helped to improve customer experience Read full review Considers every kind of experiment from simple code change, code additions, code removal, javascript functions, CSS changes, and split landing redirects. Very friendly UC interface for easy navigation of implementation of pages, click events, experiment set up, and metric set up. The ability to let me know when something has reach stat sig without having to do complicated math on my own ability to carry UTM parameters through landing page redirects with a click of a button. Read full review Cons I think Heap can improve its onboarding; I would love to see some info that is helpful for someone who isn't in Heap every single day. Sharing dashboards can be tricky, it feels like a huge learning curve that I already have forgotten how to do. Read full review Pricing model penalizes those just starting with experimentation. High price and fees based on website traffic, not experiment impressions. so you are charged whether you experiment or not. Integration with GA4 is subpar. Documentation at times confusing, different products. UX is confusing and too simple. It leads to errors by users. Lack of meganavs, too minimalistic, it becomes quite a frustration. Not competitive pricing compared with other AB testing tools. Read full review Likelihood to Renew It's a great platform. I'm glad that one of our product managers introduced it because it has allowed us to create all kinds of new functionality. We're not only able to create a better product experience from our communications because of Heap, but we're also able to generate all kinds of helpful analysis.
Read full review Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.
Read full review Usability On a scale from 1-10, I find Heap to be incredibly user-friendly and easy to use. I enjoyed the training videos available and was quickly able to pick up how to create events and reports to track user interactions on our product. I would recommend Heap for its usability first and foremost.
Read full review Optimizely Web Experimentation's visual editor is handy for non-technical or quick iterative testing. When it comes to content changes it's as easy as going into wordpress, clicking around, and then seeing your changes live--what you see is what you get. The preview and approval process for sharing built experiments is also handy for sharing experiments across teams for QA purposes or otherwise.
Read full review Reliability and Availability I've never run into any issues with Heap's availability, Heap is always there when I need it. I haven't run into any issues like application errors or unplanned outages during my 2+ years of using Heap. Each and every time I log in to Heap I have a completely functional experience
Read full review I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review Performance Heap doesn't affect page load times considerably nor has a large impact [on] our overall score, as far as page loading times inside of the tool its pretty reliable to retrieve data as much as "instant" that it can be the delay seems to be on data getting tracked into the servers to be read but it's not significant.
Read full review I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review Support Rating Heap support has allowed us to troubleshoot and test a lot of different items. Their support team is always helpful and friendly, even when we come to them with the most complicated questions. I think this greatly improves the value proposition of the product because their support team is knowledgable and friendly.
Read full review They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
Read full review Online Training The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).
Read full review Implementation Rating The implementation was smooth and easy. The Heap team helped us with implementation and it went great! Within a few weeks, we were fully up and running and utilizing the platform to its full capability. This is an additional thing that has made this platform so great and we couldn't recommend it enough.
Read full review In retrospect: - I think I should have stressed more demo's / workshopping with the Optimizely team at the start. I felt too confident during demo stages, and when came time to actually start, I was a bit lost. (The answer is likely I should have had them on-hand for our first install.. they offered but I thought I was OK.) - Really getting an understanding / asking them prior to install of how to make it really work for checkout pages / one that uses dynamic content or user interaction to determine what the UI does. Could have saved some time by addressing this at the beginning, as some things we needed to create on our site for Optimizely to "use" as a trigger for the variation test. - Having a number of planned/hoped-for tests already in-hand before working with Optimizely team. Sharing those thoughts with them would likely have started conversations on additional things we needed to do to make them work (rather than figuring that out during the actual builds). Since I had development time available, I could have added more things to the baseline installation since my developers were already "looking under the hood" of the site.
Read full review Alternatives Considered Heap offers a ton of functionality on a single platform.It also has an smart data science layer to offers suggestions for next steps in the analysis, allowing us to explore alternative paths we may not think to take. The low-code option for updating data is appealing, and there is a lot of automation with minimal engineering effort.
Read full review Overall, the tools we compared against were great, but we went with Optimizely because it has all the features we needed and has the market leadership that gave us trust we would be successful in our experimentation efforts.
Read full review Scalability The most challenging part of using Heap in a growing organization is the naming and structure in which reports and dashboards are organized. I work within the marketing department and our Heap leader internally works within the IT/Product department, which makes it challenging because we often don't speak the same language, so the learning curve has been steep without any specific use-case examples to leverage online.
Read full review This rating for Optimizely Web Experimentation is rooted in the more complicated builds that are not feasible with just Java and CSS. These require the featured experimentation add on, therefore the base level platform I am giving a lower rating. We have had issues with overly complex test builds, because we can only utilize Java and CSS to make the elements
Read full review Return on Investment It has helped us make decisions on what products to scope for our MVP based on the usage data. It's allowed us to measure success with our beta product. It's helped us view our conversion rates in an easy and usable manner. Read full review Customer retention: We've reduced subscription service client churn by 20%+ using optimized unsubscribe flows. Risk mitigation: Testing into full site redesigns has saved clients millions of dollars. Feature prioritization: Identifying what painted door changes add value has allowed developers to focus on changes that add hundreds of thousands or even millions to the bottom line. Read full review ScreenShots Optimizely Web Experimentation Screenshots