Reviewed Edition: Bronze

About the Reviewer

User Review: "eCommerce a/b Testing Tool: Optimizely"

4 out of 0 - 5 | published 10/15/2013

TrustRadius Review Summary

We use Optimizely for eCommerce conversion, increasing click through rates and engagement. The product has a simplistic UI, but allows you delve deep if necessary. Reporting and metrics are easy to explain to non technical people. Cost-effective and provides strong ROI.

Overall Satisfaction

Likelihood to Recommend Optimizely

8.0

Optimizely Pros

  • Simplistic UI, but allows you to get dirty in the JavaScript and HTML if necessary.
  • Reporting and validation metrics are easy to explain to non savvy analytic people.
  • Digestible "QA "

Optimizely Cons

  • Depending on the page scenario, sometimes loads pages very slowly.
  • Don't recommend inserting elements with this tool, the z-index will sometimes be off w/ different browsers.

ROI on Optimizely purchase

  • Validating treatments against controls that build a positive ROI.
  • Allows justification of development time where needed.

Likelihood to Renew Optimizely

8.0

Affordable and ease of use with a positive ROI.

Product Usage

Key Optimizely Use Cases

  • eCommerce conversion.
  • Increase click through rates / increase online conversion.
  • User engagements and how to increase them on landing pages.

Evaluation and Selection

Products Replaced by Optimizely

We used no prior technical software package.  But do have an in-house A/B testing platform and track with Google Analytics.
 - Being agile is important in A/B testing and Optimizely allowed us to get the results needed w/o major development contributions.

Optimizely Alternatives Considered

Monetate, but the tool WAS a little too far out of our budget. We picked Optimizely because it WAS cost effective and our ROI WAS justified based upon a defined baseline to increase conversion and continue the strategy of A/B testing.

Implementation

Optimizely Implementation Rating and Lessons

8.0

We use a third-party tagging tool that allows business users to insert JavaScript into pages.  I don't holistically recommend this because it can slow page loads.  It's best to implement directly on the page.

Also, it can be difficult to carry the reporting variables over to Google Analytics and Crazy Egg.

Optimizely Implementation Details / Implementation Partner

Implemented in-house

Training

Methods Used for Optimizely Training

Self-taught

Ease of Optimizely Training

Yes, this tool is similar to other A/B testing tools.  So if you have experience with them, you'll have no problems.

Support

Overall Support Rating for Optimizely

10.0

When I had question, I got a quick response with a solution.

Optimizely Premium Support

Not Sure - Tool is pretty easy to use, don't think we really need it.  The support QA is sufficient.