1. Home
  2. A/B Testing Tools
  3. Optimizely Web Experimentation Reviews
  4. User Review of Optimizely Web Experimentation
Time-Saving Split-Testing
October 02, 2019

Time-Saving Split-Testing

Anonymous | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely

We are using it extensively on the Marketing team for split testing. We often want to test 2 or more options of a designed/developed web page, and using Optimizely to split test is very helpful. It allows us to use data to see how changes to our website affect performance and user behavior.
  • Split Testing. It makes it very clear when one of many options is declared "the winner".
  • Targeting classes and other HTML/CSS elements when making changes.
  • Serving up different digital experiences to different demographics.
  • The preview window is very buggy. Often, tests will break, and something the bugs will cause the website to look wonky and broken as well--when it isn't actually broken. It really needs to be a more seamless experience, because it is sometimes hard to trust the preview window when you're trying to see how the test will look to hundreds of thousands of people.
  • Load times. Sometimes the load times for certain pages in the app are very long.
  • The HTML editor pane when clicking on an element that has a ton of nested HTML can often bug out and only show the first 10 - 20 lines of code before going completely blank. It would be really awesome if we could fully switch the view to HTML view, choose our elements and classes that way, and then switch back to the Visual view.
  • It has helped save a lot of time by either validating or disproving our design decisions and hypotheses.
We chose Optimizely specifically for its split testing and advanced audience segmentation capabilities. It makes it way easier to see which option objectively performs better.
Optimizely is extremely useful when trying to make an informed decision about a specific change or new direction for a digital product. It takes a lot of the guesswork out of a design or a piece of code and either validates it or disproves it with cold, hard data. It also does a great job of summarizing what the "winner" of a particular test is.

Optimizely Web Experimentation Feature Ratings

6.9
a/b experiment testing
8
Split URL testing
10
Multivariate testing
Not Rated
Multi-page/funnel testing
Not Rated
Cross-browser testing
5
Mobile app testing
Not Rated
Test significance
7
Visual / WYSIWYG editor
6
Advanced code editor
5
Page surveys
Not Rated
Visitor recordings
Not Rated
Preview mode
3
Test duration calculator
8
Experiment scheduler
10
Experiment workflow and approval
Not Rated
Dynamic experiment activation
Not Rated
Client-side tests
Not Rated
Server-side tests
Not Rated
Mutually exclusive tests
Not Rated
7.5
Standard visitor segmentation
8
Behavioral visitor segmentation
7
Traffic allocation control
10
Website personalization
5
8.8
Heatmap tool
8
Click analytics
10
Scroll maps
8
Form fill analysis
6
Conversion tracking
10
Goal tracking
9
Test reporting
10
Results segmentation
10
CSV export
Not Rated
Experiments results dashboard
8
Platform Integration Features ()
Not Rated

Using Optimizely

It works well and it looks great, but some major bugs in the preview and HTML editor modes really hold it back when setting up tests.

Optimizely Reliability

Seems to work well at a department level, but I would worry about scaling the account up to other departments without knowing for sure that we can limit access to certain groups of tests and experiments.