Optimizely: Best Bang for Your Buck
June 03, 2019

Optimizely: Best Bang for Your Buck

Anonymous | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely

Optimizely is being used across all verticals in my business. We primarily use it for testing new features and ads. But we also use it to implement quick fixes to minor issues on the site such as non-compliant text or typos until a final fix can be deployed.
  • Making the changes to your page is pretty simple, just click on an element and edit the code.
  • Has great scheduling functionality.
  • Partitioning of experiments by project makes it all run faster and is easier to organize.
  • Actual creation of an A/B test is confusing and difficult (like the differences between Pages vs URLs etc.).
  • Setting up a URL Redirect Experiment is so convoluted it seems like it's not even a feature Optimizely wants you to use. Instead, it's like I'm tricking Optimizely into alternating between 2 URLs. That really needs to be cleaned up as it would be very helpful.
  • Testing new design elements for the site has brought in much more revenue after the new element won and was deployed to production.
  • Time saved because the Tech team didn't need to deploy a feature just to test it and then have it fail, only to do another deployment to remove it.
  • Lets product people tinker with ideas before going live.
Very scalable, traffic allocation makes it easy to cast a wide but shallow net so I can more quickly gain insights without much risk. The reason it's not getting a full 10/10 is that the data isn't very granular and can't be exported in a way that allows for manual calculations.
Usability is mostly great. I like the WYSIWYG functionality and adding in real code is simple as well. It's easy to target specific pages or audiences. I've knocked a couple of points off because of how difficult it is to set up URL redirect experiments, confusion around creating pages, and lack of data that can be further analyzed.
Using Optimizely, my team ran a test to add a new design element to the site. We started it off with only 10% of overall site traffic entering the experiment and increased it as positive results came in. After we reached stat sig we verified across different segments of our site traffic and made the decision to deploy it as a permanent feature. This new feature increased our conversion rate by about 18% and our gross monthly revenue increased greatly.
Google Optimize is very similar in a lot of respects. It uses a similar editing tool, it targets pages the same way, etc. But, it is lacking in some other features and the UI is more difficult to navigate. Also if you are using the free version you don't get any assistance like you get with Optimizely.
Well suited for:
  1. Color and copy changes.
  2. Technical functionality that needs to deploy after the page loads.
  3. Deploying these changes across large sections of a site.
Not well suited for:
  1. Alternating between 2 URLs.
  2. Where tracking is needed at the user level.
  3. Implementing large changes on page load. You'll get a flash.

Optimizely Web Experimentation Feature Ratings

a/b experiment testing
9
Split URL testing
2
Multivariate testing
Not Rated
Multi-page/funnel testing
5
Cross-browser testing
Not Rated
Mobile app testing
Not Rated
Test significance
4
Visual / WYSIWYG editor
8
Advanced code editor
8
Page surveys
Not Rated
Visitor recordings
Not Rated
Preview mode
8
Test duration calculator
7
Experiment scheduler
10
Experiment workflow and approval
9
Dynamic experiment activation
Not Rated
Client-side tests
Not Rated
Server-side tests
Not Rated
Mutually exclusive tests
Not Rated
Standard visitor segmentation
9
Behavioral visitor segmentation
Not Rated
Traffic allocation control
10
Website personalization
Not Rated
Heatmap tool
Not Rated
Click analytics
Not Rated
Scroll maps
Not Rated
Form fill analysis
Not Rated
Conversion tracking
8
Goal tracking
8
Test reporting
5
Results segmentation
7
CSV export
2
Experiments results dashboard
7