1. Home
  2. A/B Testing Tools
  3. Optimizely Web Experimentation Reviews
  4. User Review of Optimizely Web Experimentation
Optimizely is for beginners and experts
July 19, 2013

Optimizely is for beginners and experts

Jeremy Cox | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Software Version

Platinum

Overall Satisfaction

  • The product makes A/B Testing easy.
  • The technical support staff is very quick to respond and very helpful.
  • Most things require no knowledge of html, java or CSS.
  • There are discrepancies between the Optimizely visitor count and Google Analytics. I have been unable to resolve why these differences occur. The differences are small except with regards to mobile traffic.
  • I am not convinced the mobile tracking works as intended. Differences with Google Analytics are fairly large.
  • The product has allowed us to quantify $500k in revenue gains and saves (not implementing poor test outcomes). This number is soft, and will certainly decrease as gains become harder to realize.
Switching costs would be high, but the platform does what we require of it.

Product Usage

3 - Web Analytics.
3 - The people that use the platform are the ones who support it. IT does not need to support this system.
  • A/B Testing.
  • Conversion Rate Optimization.

Evaluation and Selection

This was our first A/B Testing platform.
I was not part of the implementation. The decision to go with Optimizely was made before I began working here.

Implementation

I am not very familiar with the implementation process. I did help set this up on sites after we had been using the service. I had no html background, but it was not difficult to implement using CMS.
  • Implemented in-house
I was not a part of this, but I know we implemented it by simply adding a script to each of our webpages. We even supplement the tests with in-house conversion data through a nightly feed. I'm not sure how difficult this part of the implementation was.

Training

  • Self-taught
The program is very easy to learn, and as more difficult tests are implemented, they have been very helpful in guiding us along the way.

Configuration

We have in-house (off-site) conversion data that we tie back to tests. This is accomplished through a nightly feed of data to Optimizely and helps us with test results.

Support

They are quick to respond and provide great help to get tests up and running.
Not Sure - We have purchased the platinum version. I'm not sure what level of service comes with it, but we have had outstanding service from Optimizely's staff. They are very knowledgeable and responsive.

Usability

In order to implement most tests, little knowledge of html, java and css are required. More complicated tests require some of this knowledge, but the tech staff provides outstanding guidance and is very responsive.

Reliability

I have not had any issues with availability.
The speed of implementing tests is instantaneous.

Integration

  • Google Analytics
  • In-house data
  • clicktale
This was fairly simple to implement.
  • Data warehouse
We are in the early stages of thinking about this. Ideally it would be nice to get clickstream data into our data warehouse from Optimizely tests.

Vendor Relationship

I was not involved in the sales process, but they have been great post-sale.