1. Home
  2. A/B Testing Tools
  3. Optimizely Web Experimentation Reviews
  4. User Review of Optimizely Web Experimentation
Optimizely Saves Dev Time
October 12, 2019

Optimizely Saves Dev Time

Anonymous | TrustRadius Reviewer
Score 10 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely

Optimizely is used by our Marketing, Operations and Product teams to A/B test new features. It is valuable for self-building basic design changes and testing them, all without needing your development teams to help - this is extremely valuable to us given we have limited tech resources. It also helps for larger a/b tests that we do work with development on - they create a way to trigger large tests with cookies and then we use Optimizely to set the cookies and control test volumes.
  • Self code small design changes without dev help.
  • Quickly adjust test volumes or turn tests on/off.
  • Watching high-level test metrics to know when you have a Stat Sig winner.
  • We have had some issues with using it on Single Page App sites.
  • There is an initial learning curve.
  • Would benefit from improved online courses.
  • We have made MANY very large marketing/customer acquisition design changes that we proved out in Optimizely to have huge benefits.
  • We have used it to test microcopy and general site language to decrease customer questions.
  • Had great wins on home page design to increase conversion.
We use heap and ClickTale but for different reasons. They don't do a/b test creation but they are great additions to analyzing your Optimizely tests.
Well suited for teams that don't have dev capacity for developers to build their tests. Well suited for teams that are looking to test quickly and frequently. Generally good for any team to make quick, auto deployed, changes to a site. Not great for enhancing data analysis, you can pull out the data and then need to analyze it somewhere else, but high-level metrics are in it.

Optimizely Web Experimentation Feature Ratings

8.7
a/b experiment testing
10
Split URL testing
Not Rated
Multivariate testing
9
Multi-page/funnel testing
8
Cross-browser testing
10
Mobile app testing
Not Rated
Test significance
8
Visual / WYSIWYG editor
9
Advanced code editor
6
Page surveys
Not Rated
Visitor recordings
Not Rated
Preview mode
8
Test duration calculator
Not Rated
Experiment scheduler
10
Experiment workflow and approval
Not Rated
Dynamic experiment activation
9
Client-side tests
Not Rated
Server-side tests
Not Rated
Mutually exclusive tests
Not Rated
9.5
Standard visitor segmentation
9
Behavioral visitor segmentation
Not Rated
Traffic allocation control
10
Website personalization
Not Rated
8.0
Heatmap tool
Not Rated
Click analytics
Not Rated
Scroll maps
Not Rated
Form fill analysis
Not Rated
Conversion tracking
Not Rated
Goal tracking
Not Rated
Test reporting
8
Results segmentation
Not Rated
CSV export
Not Rated
Experiments results dashboard
Not Rated
Platform Integration Features ()
Not Rated

Using Optimizely

After the learning the curve, it is very easy to use.

Optimizely Reliability

I think it is awesome but it is also simple in terms of how we use it. It is a drag and drop editor that works really well and splitting tests really welll. I don't know what the boundary is for advance dev within it.