Solid A/B Testing Tool for Small Teams
April 17, 2023

Solid A/B Testing Tool for Small Teams

Anonymous | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely Web Experimentation

We use Optimizely for A/B tests and for any urgent fixes that are required on the site when we don't want to wait for our normal CMS content push which is usually overnight. We can easily make front-end changes with Optimizely that update within minutes so if there is an incorrect image, spelling error, etc. we can hide it. We also use Optimizely to push changes at 100% until we are able to build them into our website, for example, keeping a test winner turned on while we wait for dev resources.
  • Quickly update your website
  • Fairly easy to use
  • Setting up custom metrics can be confusing
  • Only one way to track statistical significance of a test through the platform
  • Implemented experiences on the website that increased revenue per visitor
  • Stopped us from wasting resources to implement something that did not impact user experience
  • Allowed us to hide an error on the site that would have otherwise required a hot fix
Optimizely is well-suited to be used across multiple sites including desktop, mobile and app
It has allowed our company to take full control over our testing program because of its ease of use and to use our existing teams to create a testing program rather than requiring an entire team dedicated to testing.
We preferred Dynamic Yield for their in-house personalization capabilities but preferred the A/B testing and analytics results through Optimizely
It's well suited for A/B testing, pushing experiment winners to 100%, and last-minute adjustments on the website when your CMS isn't able to make changes ASAP

Optimizely Web Experimentation Feature Ratings

a/b experiment testing
10
Split URL testing
Not Rated
Multivariate testing
10
Multi-page/funnel testing
10
Cross-browser testing
10
Mobile app testing
Not Rated
Test significance
5
Visual / WYSIWYG editor
8
Advanced code editor
10
Page surveys
4
Visitor recordings
Not Rated
Preview mode
10
Test duration calculator
2
Experiment scheduler
10
Experiment workflow and approval
6
Dynamic experiment activation
9
Client-side tests
Not Rated
Server-side tests
Not Rated
Mutually exclusive tests
Not Rated
Standard visitor segmentation
10
Behavioral visitor segmentation
7
Traffic allocation control
10
Website personalization
6
Click analytics
10
Conversion tracking
7
Goal tracking
7
Test reporting
4
Results segmentation
6
CSV export
Not Rated
Experiments results dashboard
7