Item: Optimizely Feature Experimentation
Rating: 4
Author: Verified User

Use Cases and Deployment Scope

Decrease the load of our product analysts and make product managers more autonomous when running experiments.

We are a big organization with complex metrics that we calculate in our Google data warehouse. We have found that Optimizely Feature Experimentation does not have an integration with the warehouse. This is a negative point for us because we are not getting the benefits we originally thought we will.

Pros and Cons

Feature flag management
Feature flag as an object (we currently have boolean values)
Customer segmentation (audiences)
Great UI to manage experiments

Integration with Google data warehouse
Reusability of existing metrics so we don't duplicate source of truth
Web Experimentation could be extended to mobile apps

Return on Investment

Make people more conscious about experimentation
Validate ideas before building (we have found in one case that a feature was not bringing any extra benefit apart from flexibility to our client)

Alternatives Considered

We haven't evaluated other products. We have an in-house product that is missing a lot of features and is very behind from making the test process easier.

Instead of evolving our in-house product with limited resources, we decided to go with Optimizely Feature Experimentation when we saw that other big organisations are partnering with you.

Key Insights

Do you think Optimizely Feature Experimentation delivers good value for the price?

Are you happy with Optimizely Feature Experimentation's feature set?

Did Optimizely Feature Experimentation live up to sales and marketing promises?

I wasn't involved with the selection/purchase process

Did implementation of Optimizely Feature Experimentation go as expected?

I wasn't involved with the implementation phase

Would you buy Optimizely Feature Experimentation again?

Other Software Used

Contentful, CitrusAd, Contentsquare

Likelihood to Recommend

I would use Optimizely Feature Experimentation when we would like to run basic experiments where metrics to be tracked are impressions, revenue or clicks.

However, most of our experiments are tracking more complex metrics and this functionality is not enough. We still need to do work to analyse the data in our end.

Great solution, but we wish we could reuse our existing metrics source of truth

Overall Satisfaction with Optimizely Feature Experimentation