1. Home
  2. A/B Testing Tools
  3. Optimizely Web Experimentation Reviews
  4. User Review of Optimizely Web Experimentation
Please A/B test this review!
Updated January 11, 2019

Please A/B test this review!

Brian Nizinsky | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Software Version

Other

Overall Satisfaction with Optimizely

We use Optimizely for all of our A/B webpage testing across both our main website and any campaign landing pages. Only the Marketing department uses this tool. We use Optimizely to test out theories in order to see their effect on conversion rates and other relevant KPI's.
  • It makes it easy to set up the A/B testing parameters and allow us to focus on running multiple tests.
  • We love the ability to exclude audiences so that the test data is as pure as possible
  • We like the interface since its easy to see what version is "winning"
  • There is a bit of a learning curve with the interface, it's not that intuitive day 1.
  • You will need a web dev to help get these tests set up. It is not easy enough for a non-tech person to do.
  • It has a positive ROI overall on the organization. It has saved us from lowering our conversion rates due to the data we get from the test results.
We went with Optimizely over Lift because it was more flexible with creating variants outside of the "blocks" of content that Lift handles. So for instance, if you wanted to test an entirely new area of content you cannot do that with Lift. You can only test images/text in existing content areas.
Optimizely is well suited for your standard A/B testing scenarios. It does not do multivariate testing (at least the version we have does not). I would not look to Optimizely for any type of personalization for a website. There are better tools out there for that.

Using Optimizely

3 - Various marketing positions from Digital Marketing Manager to graphic designer. We usually have everything tested before its made live to ensure that there is no unexpected interruption in user flow on the website. The people who us Optimizely are almost always within the same department.
2 - You will need a designer who has a solid working knowledge of A/B testing to support it. Keep in mind that all designs must work across desktop and mobile and there are unexpected differences in the user experience that a designer can account for. You should also have a front end web developer on hand to make sure that what is being tested can be implemented if it proves to provide a lift.
  • To test an element to increase the conversion rate on a specific page.
  • To prove (or disprove) with data the idea that a person may have to "improve" a web page.
  • To see the impact of what a small change could have and at times be surprised how much something like a color change can affect user behavior.
  • Finding out what "little things" can do to move the needle and make a difference in the performance of a page.
  • Use it for ongoing personalization of content based on either 1st or 3rd party data.
  • Testing new elements to increase time on site or click troughs to content pieces.
Overall it it one of the best if not the best tool in the market. It has all the features we need and seems to be growing functionality so that there is a future with them as we grow our needs. The only issue could be price increases that we keep an eye on.