Ideal A/B testing platform for medium to Enterprise level companies
November 20, 2024

Ideal A/B testing platform for medium to Enterprise level companies

Anonymous | TrustRadius Reviewer
Score 9 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely Web Experimentation

We use Optimizely Web Experimentation for A/B and multivariate testing across multiple brands in the Colibri Group portfolio. The platform serves as a primary means of determining the most appropriate content, layout, and CTAs for our various pages. It's very useful for testing entirely new pages and checkout flows before putting them into Production.

Pros

  • New test set up
  • Viewing test results
  • Test duplication
  • Metrics set up

Cons

  • Statistical significance calculator requires more test data than most other platforms.
  • Turning off MAUs (monthly average users) requires a js component instead of a simpleon/off switch
  • Unable to segment out new versus returning users in test results
  • We're able to share definitive annualized revenue projections with our team, showing what would happen if we put a test into Production
  • Showing the results of a test on a new page or feature prior to full implementation on a site saves developer time (if a test proves the new element doesn't deliver a significant improvement.
  • Making a change via the WYSIWYG interface allows us to see multiple changes without developer intervention.
We're using it across dozens of brands, and it is easy enough to implement onto additional brands with the code snippet. Additional tracking elements can be added through GTM.
Having all of the end-to-end test elements within one platform is really the only way to go. Some of our design work on more complex tests does take place on design tools but with fairly simple changes, we can make the change, view it and or launch it fairly quickly.
Optimizely Web Experimentation was more robust and able to handle the broad array of sites we run than VWO. It has been a great platform to easily add additional sites onto, but still providing a universal overview of all of them, making management a simple task.

Do you think Optimizely Web Experimentation delivers good value for the price?

Yes

Are you happy with Optimizely Web Experimentation's feature set?

Yes

Did Optimizely Web Experimentation live up to sales and marketing promises?

Yes

Did implementation of Optimizely Web Experimentation go as expected?

Yes

Would you buy Optimizely Web Experimentation again?

Yes

Well suited for WYSIWYG set up on "general" test implementations; i.e. moving objects on the page, changing copy/CTAs, tracking clicks on objects. Test results viewing is useful and fairly easy to navigate. A competent FE developer is a must have for some test set ups like moving multiple objects on a page or moving a functional component.

Optimizely Web Experimentation Feature Ratings

a/b experiment testing
9
Split URL testing
10
Multivariate testing
9
Multi-page/funnel testing
9
Cross-browser testing
9
Mobile app testing
10
Test significance
5
Visual / WYSIWYG editor
8
Advanced code editor
9
Preview mode
9
Test duration calculator
7
Experiment scheduler
10
Experiment workflow and approval
9
Dynamic experiment activation
9
Client-side tests
9
Server-side tests
9
Mutually exclusive tests
10
Standard visitor segmentation
7
Behavioral visitor segmentation
7
Traffic allocation control
10
Website personalization
8
Form fill analysis
8
Goal tracking
9
Test reporting
10
Results segmentation
7
CSV export
9

Comments

More Reviews of Optimizely Web Experimentation