Ideal A/B testing platform for medium to Enterprise level companies
November 20, 2024
Ideal A/B testing platform for medium to Enterprise level companies

Score 9 out of 10
Vetted Review
Verified User
Overall Satisfaction with Optimizely Web Experimentation
We use Optimizely Web Experimentation for A/B and multivariate testing across multiple brands in the Colibri Group portfolio. The platform serves as a primary means of determining the most appropriate content, layout, and CTAs for our various pages. It's very useful for testing entirely new pages and checkout flows before putting them into Production.
Pros
- New test set up
- Viewing test results
- Test duplication
- Metrics set up
Cons
- Statistical significance calculator requires more test data than most other platforms.
- Turning off MAUs (monthly average users) requires a js component instead of a simpleon/off switch
- Unable to segment out new versus returning users in test results
- We're able to share definitive annualized revenue projections with our team, showing what would happen if we put a test into Production
- Showing the results of a test on a new page or feature prior to full implementation on a site saves developer time (if a test proves the new element doesn't deliver a significant improvement.
- Making a change via the WYSIWYG interface allows us to see multiple changes without developer intervention.
Having all of the end-to-end test elements within one platform is really the only way to go. Some of our design work on more complex tests does take place on design tools but with fairly simple changes, we can make the change, view it and or launch it fairly quickly.
Do you think Optimizely Web Experimentation delivers good value for the price?
Yes
Are you happy with Optimizely Web Experimentation's feature set?
Yes
Did Optimizely Web Experimentation live up to sales and marketing promises?
Yes
Did implementation of Optimizely Web Experimentation go as expected?
Yes
Would you buy Optimizely Web Experimentation again?
Yes

Comments
Please log in to join the conversation