Optimizely FX leads to quick stat sig on experiments to make informed decisions
March 17, 2025

Optimizely FX leads to quick stat sig on experiments to make informed decisions

Anonymous | TrustRadius Reviewer
Score 7 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely Feature Experimentation

Optimizely FX allows our org to invest the minimum amount of development possible to test whether our product assumptions how up and drive additional engagement (and ultimately revenue). We find it useful to direct specific user groups to interact with an experiment while leaving other user groups in the main flow. This level of control makes it possible for a broad group of stakeholders to use the platform, which means we do not rely on a specific expert with the Optimizely Feature Experimentation.

Pros

  • Set up dashboards with primary and secondary metrics to analyze how an experiment has performed
  • Segment by audiences who will be presented with an experiment
  • Customizeable feature flags with enough information to describe each one in case many folks in the org are using the same FX instance

Cons

  • Somewhat intimidating without tool tips because of the sheer amount of functionality that the UI presents
  • Shareability of reports in the UI to those without a license; would like to have a read-only view beyond downloading a spreadsheet with data
  • No change logs to see when a flag or audience was editing; somewhat hard to troubleshoot with many parties are manipulating and managing experiments
  • Reduction in dev investment before sinking resources into a new feature by looking at statistically significant experiment results first
  • 2 fold increase in add to cart rate, which is a key indicator of our shopping experience flow success
  • Decrease in abandoned shopping flow
Optimizely Feature Experimentation has a learning curve that can be mitigated via superb support from the customer success team. Once you understand the organization of needing to set up audiences, flags, and reports, it all comes naturally.
Optimizely offered both web experimentation (WSYWIG editor for nontechnical marketing folks) and Feature Experimentation. That made the decision easier to get max value across different stakeholder groups.

Do you think Optimizely Feature Experimentation delivers good value for the price?

Not sure

Are you happy with Optimizely Feature Experimentation's feature set?

Yes

Did Optimizely Feature Experimentation live up to sales and marketing promises?

Yes

Did implementation of Optimizely Feature Experimentation go as expected?

Yes

Would you buy Optimizely Feature Experimentation again?

Yes

Well suited:
- A/B tests where it's clear what segments should receive a certain distribution of traffic
- When there is a risk feature flag, Optimizely Feature Experimentation thrives when you need to ramp down traffic to 0% before getting the green light to turn on an experiment

Less appropriate:
1) Very complex criteria to create audiences; best to stick to one attribute like geography; 2) Events are sophisticated orders of engagement; best suited for a conversion event such as a button click.


Comments

More Reviews of Optimizely Feature Experimentation

  1. Home
  2. Feature Management Software
  3. Optimizely Feature Experimentation Reviews
  4. User Review of Optimizely Feature Experimentation