eCommerce a/b Testing Tool: Optimizely
October 15, 2013

eCommerce a/b Testing Tool: Optimizely

Colby Gilmore | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Software Version

Bronze

Overall Satisfaction

Pros

  • Simplistic UI, but allows you to get dirty in the JavaScript and HTML if necessary.
  • Reporting and validation metrics are easy to explain to non savvy analytic people.
  • Digestible "QA "

Cons

  • Depending on the page scenario, sometimes loads pages very slowly.
  • Don't recommend inserting elements with this tool, the z-index will sometimes be off w/ different browsers.
  • Validating treatments against controls that build a positive ROI.
  • Allows justification of development time where needed.
Affordable and ease of use with a positive ROI.

Product Usage

  • eCommerce conversion.
  • Increase click through rates / increase online conversion.
  • User engagements and how to increase them on landing pages.

Evaluation and Selection

We used no prior technical software package. But do have an in-house A/B testing platform and track with Google Analytics.
Monetate, but the tool was a little too far out of our budget. We picked Optimizely because it was cost effective and our ROI was justified based upon a defined baseline to increase conversion and continue the strategy of A/B testing.

Implementation

We use a third-party tagging tool that allows business users to insert JavaScript into pages. I don't holistically recommend this because it can slow page loads. It's best to implement directly on the page.

Also, it can be difficult to carry the reporting variables over to Google Analytics and Crazy Egg.
  • Implemented in-house

Training

  • Self-taught
Yes, this tool is similar to other A/B testing tools. So if you have experience with them, you'll have no problems.

Support

When I had question, I got a quick response with a solution.
Not Sure - Tool is pretty easy to use, don't think we really need it. The support QA is sufficient.

Comments

More Reviews of Optimizely Web Experimentation

  1. Home
  2. A/B Testing Tools
  3. Optimizely Web Experimentation Reviews
  4. User Review of Optimizely Web Experimentation