Item: Optimizely Feature Experimentation
Rating: 7
Author: Verified User

Overall Satisfaction with Optimizely Feature Experimentation

Use Cases and Deployment Scope

We use Optimizely Feature Experimentation to test new design options on our website.
As our brand and business evolve, we need a way to quickly test ideas and creative concepts. We also need data to help us inform these decisions.
Feature Experimentation allowed us to quickly test multiple hypotheses and variations, which has been key to improving our site's language and UX.

Pros and Cons

Pros

Delivers statistical data in easy to understand format
Easily allows us to create variations without involving developers
Quick to make multiple variations.

Cons

Difficult integration if your data is not front end
Costly MAU model needs to be based on experiments not on site visits
It's not easy to understand how to build an Experiment
Onboarding team is more focused on punching through their slides and not focused on your needs or understanding.

Return on Investment

It did not have a positive impact on our ROI
There was not a negative impact on our ROI
We used the tool to manage internal decision making

Usability

Optimizely Feature Experimentation takes some time to get acquainted with. The nomenclature is clumsy, and the ramp-up is slow. The team assigned to you during ramp-up is impersonal and not interested in having you understand how to use the tool, but is more interested in getting you through the slide deck they have presented. It's a one-size-fits-most approach, which is off-putting at best and rude at worst.

Alternatives Considered

Amplitude Analytics

Optimizely Feature Experimentation has similar features to Amplitude. As a matter of fact it looks like Amplitude copied Optimizely. However, Amplitude did not mimic the nomenclature issues.

Key Insights

Do you think Optimizely Feature Experimentation delivers good value for the price?

Yes

Are you happy with Optimizely Feature Experimentation's feature set?

Yes

Did Optimizely Feature Experimentation live up to sales and marketing promises?

Yes

Did implementation of Optimizely Feature Experimentation go as expected?

Would you buy Optimizely Feature Experimentation again?

Likelihood to Recommend

It's not as well suited for app testing, based on our experiences.
If there is a need for front-end web testing this is where it excels. There are capabilities to build complex implementations but those will require a developer and that is counter to the intent of WYSWYG editor, isn't it?

Comments

Please log in to join the conversation

Good Testing Tool for Gathering the Right Data