Optimizely is great for AB Testing!
March 20, 2023

Optimizely is great for AB Testing!

Anonymous | TrustRadius Reviewer
Score 7 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely Web Experimentation

I use Optimizely for all of our AB tests. This helps us validate new features and minor styling changes and gives us insight into our roadmap. It even allows us to make changes to the site without requiring developer support. We make sure everything is AB tested before launching, and Optimizely is a key part of making that happen.
  • AB Testing.
  • Data Analysis.
  • Web Editor.
  • User Interface.
  • Multi-project management.
  • Dynamic Website Set-up.
  • Increases to CVR from minor features.
  • > $50M in incremental revenue from successful tests.
  • 100s of developer hours saved by enabling PMs to set up tests without dev support.
It's easy to give access and set up multiple projects. From there, users can easily set up their own tests. It only requires coordination on your part to ensure tests aren't conflicting and proper testing hygiene is used.
It's been very useful for a single person to own a test from start to finish since they can create the events, identify the core metrics for testing and then actually make the changes they want to see on the site. This allows the team to move faster and explore many different avenues. It's an opportunity cost when you're hindered in how much you can test.
Of the tools we've explored, none have the full suite of testing with in depth results analysis that Optimizely provides so we have not switched.
Optimizely is well suited for on-site AB testing and experimentation. If you want to see how a change will impact your metrics, Optimizely can make that happen. It is not useful for feature flagging or product rollout and can be a bit tricky when trying to AB test a net new feature.

Optimizely Web Experimentation Feature Ratings

a/b experiment testing
10
Split URL testing
9
Multivariate testing
7
Multi-page/funnel testing
8
Test significance
10
Visual / WYSIWYG editor
8
Advanced code editor
7
Preview mode
9
Test duration calculator
9
Client-side tests
10
Mutually exclusive tests
10
Standard visitor segmentation
8
Behavioral visitor segmentation
8
Traffic allocation control
10
Website personalization
9
Click analytics
9
Conversion tracking
10
Goal tracking
10
Test reporting
10
Results segmentation
10
CSV export
10
Experiments results dashboard
10