Optimizely doesn't disappoint - you get what you paid for
Use Cases and Deployment Scope
Primarily used for controlled introduction of a feature. Perform A/B testing and fairly quickly determine the effectiveness of a proposed change in user experience.
Pros
- Provides quicker release cycle for the way the product cards should be displayed.
- Provides feedback for new product introduction and how it'll be perceived.
- Allows rapid blackout from user experience changes that alters traffic flow.
Cons
- Can use better interface for managing test, including scheduling and notification.
- Feels too heavy for simple projects, though this isn't a factor once past the PoC stage.
- Notification on various aspects can be made more powerful and granular if such a need arise.
Most Important Features
- Speed to market.
- Richness of user interaction data and possible AI/ML analyses.
- Relatively quick learning curve for new team members.
Return on Investment
- Almost immediate payoff in terms of the benefit.
- Easy to justify the TTM benefits to upper management.
- Still somewhat hard to justify ROI, though this is not my expertise.
Alternatives Considered
Google Optimize
Other Software Used
Google Analytics, Dynatrace, Google Optimize
