Deeper Analysis into A/B Tests
November 30, 2018

Deeper Analysis into A/B Tests

Jeff Blettner | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User
Review Source

Software Version

Enterprise

Overall Satisfaction with Heap

We use Heap with one of our enterprise CRO clients. It integrates seamlessly with Optimizely, so it can come in handy for doing deep dives into test data.
  • Integrates seamlessly with Optimizely, meaning all tests are automatically tracked and accessible in report generation.
  • Automatically tracks all user behavior, so very little setup out of the box.
  • User interface is simple and easy to use, though their naming schemes can be confusing. But overall, I would say it's a low learning curve.
  • Report generation can be confusing. Often times very simple data lookups aren't built the way you would expect. I wish they had more resources on common report types.
  • It's allowed us to take a deeper look into our AB tests for our client and given us better insight into our results, thereby avoiding the costly mistake of mis-diagnosing the data and moving in the wrong direction.
Heap is still the best option for detailed data analysis for Optimizely tests that I've seen. Google Analytics integration is too much of a pain to set up and maintain. Even then, Heap beats that out in report generation ease.