Optimizely Web Experimentation - A Marketing Developer's Perspective
October 11, 2023

Optimizely Web Experimentation - A Marketing Developer's Perspective

Andrew Presnell | TrustRadius Reviewer
Score 9 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely Web Experimentation

We use web experimentation on both our web applications; uti.edu and our Paid Media Landing Page environment to increase conversion rates and to understand our audiences deeper. Optimizely Web Experimentation structures our thought process on how to think about new ideas and how to implement them, while giving us a safe way to actually find which ideas are successful and which ones aren't. At the end of the day, all experimentation is a value add for our business because even if a test fails, that failure can influence further decisions and give us insight into who and what our audiences like.

We currently split our CRO efforts into channel groups that are self managed, and look for problems and opportunities in the funnel and experience and then formulate hypotheses and prioritize based on an ICE method. Ideas are converted into project templates and worked through a pipeline all the way through to experiment creation. Once an experiment concludes we implement winners and iterate. Weekly, all of our channel members come together to discuss experimentation progress and successes, at which point successful ideas are shared across channel. The process then repeats itself.
  • Performance
  • A/B Testing
  • Reporting
  • Ease of Use
  • Improving the dashboard
  • Making organization and bulk updates a possibility
  • No current capability for bulk updates - which makes managing a lot of experiments tedious
  • Increased Conversion
  • In-Depth understanding of the persona
  • Improved CRO Structure inside the business
I currently use performance edge, which doesn't have nearly the amount of integrations that web has, which is unfortunate. It would be great for optimizely to integrate all features that web has in with performance edge. At the same time, I struggle with scaling experiments and performing bulk actions. In my opinion, I feel like experimentation has had no new updates since I've been using it with the exception of multi-armed bandit. There is much lacking for a UX perspective, and it makes me wonder if Optimizely even uses its own product.
It's absolutely fantastic that we are able to make visual changes on the fly, if we need to, from the visual editor. As well as having the code editor, I have not found a use case that Optimizely Web Experimentation hasn't been able to work in, with the exception of exclusionary tests from performance edge. It's amazing that we are able to create audiences, pages, and experiments and then see results all from the same application.
Web experimentation is suitable any time a business wants to make a change on the website. Any neutral or positive result should give the business further confidence that an idea is appropriate and successful.

Web experimentation is not suitable for sites where traffic is low - because statistical significance won't be reached.

Optimizely Web Experimentation Feature Ratings

a/b experiment testing
9
Split URL testing
9
Multivariate testing
9
Multi-page/funnel testing
Not Rated
Cross-browser testing
9
Mobile app testing
Not Rated
Test significance
9
Visual / WYSIWYG editor
9
Advanced code editor
5
Preview mode
4
Test duration calculator
3
Experiment scheduler
Not Rated
Experiment workflow and approval
Not Rated
Dynamic experiment activation
Not Rated
Client-side tests
Not Rated
Server-side tests
Not Rated
Mutually exclusive tests
Not Rated
Standard visitor segmentation
9
Behavioral visitor segmentation
Not Rated
Traffic allocation control
9
Website personalization
Not Rated
Form fill analysis
Not Rated
Goal tracking
Not Rated
Test reporting
7
CSV export
Not Rated