Google Optimize vs. Optimizely One

It is a little too limited for a full stack experimentation programme. Many times we required development support or tech advise but we were simply unable to get this due to it being google. This was a big problem for us. However it is quite good if you were looking to get started in experimentation and didn’t have the budgets for a wider tool

Incentivized

It is well suited for heavy-duty A/B testing where management would like to see and quantitatively determine the effect of a change. It is not so efficient to try for a single page simple form, except when the form is part of a larger workflow. The security model is not very well understood, including RBAC and protection against injection attacks.

Incentivized

• Easy to follow set up procedures. Once I walk a client through the process, it's effortless for them to emulate on subsequent tests.
• Lots of geo and user attribute customization features to be able to drill down into specific targeted audiences — all based on the power of Google's immense data system.
• Google Optimize is the logical choice for many people to start with since most are already familiar with and using GA.

Incentivized

• Provides quicker release cycle for the way the product cards should be displayed.
• Provides feedback for new product introduction and how it'll be perceived.
• Allows rapid blackout from user experience changes that alters traffic flow.

Incentivized

• Only works for browsers, not for the apps testing.
• Missing possibility to test complicated features.
• Audience division in groups is not always accurate.

Incentivized

• Can use better interface for managing test, including scheduling and notification.
• Feels too heavy for simple projects, though this isn't a factor once past the PoC stage.
• Notification on various aspects can be made more powerful and granular if such a need arise.

Incentivized

Google has always been known to make easy-to-use products. The Google Optimize interface is intuitive and easy to follow for anyone.

Incentivized

Google has well-documented resources and unlimited use cases that can be found online. Plus, their support is always helpful and available.

Incentivized

Google Optimize being part of the Google stack makes it great in reporting and analysis. Wish Google would add more features like dynamic tests, multi funnel tests, conversion calculator based on the total number of traffic of the page being tested instead of using the websites total traffic. Should integrate form analysis, heatmap, and page analytics.

Incentivized

There is a big difference between the two: Google Optimize uses Bayesian analysis while Optimizely uses Frequenting. There is a risk of counting multiple visits. Google Optimize data isn't available instantly (if I remember correctly). Optimizely's analyses dashboard is a lot richer and offers a better experience, though it may get intimidating.

Incentivized

• We were able to increase our main KPI for conversions by almost 50% by testing button copy.
• We were able to increase secondary KPIs for conversions by almost 30% by testing form design.

Incentivized

• Almost immediate payoff in terms of the benefit.
• Easy to justify the TTM benefits to upper management.
• Still somewhat hard to justify ROI, though this is not my expertise.

Incentivized