Feature Experimentation helped us launch our experimentation program
May 07, 2025

Feature Experimentation helped us launch our experimentation program

Anonymous | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely Feature Experimentation

We use it for Product AB and MVT testing, to both assist us with splitting traffic between variants and also to provide standardised reporting and calling of results on those tests. The scope is any test within our Product that can be easily implemented within Optimizely 's interface, which typically applies to all UI/UX changes, but also some different algorithm or multichannel approaches

Pros

  • Splitting traffic between variants and enabling you to scale up or down the amount of traffic in each one
  • Giving a standardised report that you can share with a huge number of users
  • Showing a large variety of results/metrics you can then dive into

Cons

  • Would be nice to able to switch variants between say an MVT to a 50:50 if one of the variants is not performing very well quickly and effectively so can still use the standardised report
  • Interface can feel very bare bones/not very many graphs or visuals, which other providers have to make it a bit more engaging
  • Doesn't show easily what each variant that is live looks like, so can be hard to remember what is actually being shown in each test
  • Helped us start an experimentation program and get senior buy-in
  • Aiming to double experiments using Optimizely YoY from >20 to >50
  • Quantify impact of Product testing on overall metric achievement
Compared to other providers it is resilient, quick to teach to engineering teams and has plenty of documentation. The UI remains pretty basic and that makes it relatively easy to navigate and get top line metrics/see if they are stat sig, although more advanced visualisations of results usually need to be done offline.
We selected Optimizely as it was easy to use/understand, had clearly defined SLAs for keeping the platform up and was regarded as resilient within the industry. We needed something at our point in our experimentation journey that could be used for Product testing at scale and could be relied on

Do you think Optimizely Feature Experimentation delivers good value for the price?

Yes

Are you happy with Optimizely Feature Experimentation's feature set?

Yes

Did Optimizely Feature Experimentation live up to sales and marketing promises?

Yes

Did implementation of Optimizely Feature Experimentation go as expected?

Yes

Would you buy Optimizely Feature Experimentation again?

Yes

Good for standard Product UI/UX type experiments, such as changing the positioning of buttons on a page or how presented to user. Useful as well for adding in additional features and seeing how these are engaged with. Less useful for very complex testing that requires custom bucketing from DS/ML type teams, which may be easier to do offline

Comments

More Reviews of Optimizely Feature Experimentation

  1. Home
  2. Feature Management Software
  3. Optimizely Feature Experimentation Reviews
  4. User Review of Optimizely Feature Experimentation