Google offers the Optimize A/B testing tool for testing website content and versions.
N/A
Optimizely Feature Experimentation
Score 8.3 out of 10
N/A
Optimizely Feature Experimentation unites feature flagging, A/B testing, and built-in collaboration—so marketers can release, experiment, and optimize with confidence in one platform.
Before we chose Optimizely, we looked at other options like Google Optimize. However, we decided on Optimizely because it excels at A/B testing, even compared to other A/B testing tools that only have basic capabilities. Since we were working on a controlled release project, we …
When Google Optimize goes off we searched for a tool where you can be sure to get a good GA4 implementation and easy to use for IT team and product team.
Optimizely Feature Experimentation seems to have a good balance between pricing and capabilities.
Google Optimize is great that it is an add on to an existing Analytics implementation, but only has a web version. Optimizely has the SDK so better option for testing new features
Optimizely FX is the only tool I've used that specifically allows for testing in the back-end. Most front end tools are great for simple tests, but there comes a time when you need to go a level deeper and that's not possible with front-end tools.
It is a little too limited for a full stack experimentation programme. Many times we required development support or tech advise but we were simply unable to get this due to it being google. This was a big problem for us. However it is quite good if you were looking to get started in experimentation and didn’t have the budgets for a wider tool
Based on my experience with Optimizely Feature Experimentation, I can highlight several scenarios where it excels and a few where it may be less suitable. Well-suited scenarios: - Multi-Channel product launches - Complex A/B testing and feature flag management - Gradual rollout and risk mitigation Less suited scenarios: - Simple A/B tests (their Web Experimentation product is probably better for that) - Non-technical team usage -
Easy to follow set up procedures. Once I walk a client through the process, it's effortless for them to emulate on subsequent tests.
Lots of geo and user attribute customization features to be able to drill down into specific targeted audiences — all based on the power of Google's immense data system.
Google Optimize is the logical choice for many people to start with since most are already familiar with and using GA.
It is easy to use any of our product owners, marketers, developers can set up experiments and roll them out with some developer support. So the key thing there is this front end UI easy to use and maybe this will come later, but the new features such as Opal and the analytics or database centric engine is something we're interested in as well.
Would be nice to able to switch variants between say an MVT to a 50:50 if one of the variants is not performing very well quickly and effectively so can still use the standardised report
Interface can feel very bare bones/not very many graphs or visuals, which other providers have to make it a bit more engaging
Doesn't show easily what each variant that is live looks like, so can be hard to remember what is actually being shown in each test
Easy to navigate the UI. Once you know how to use it, it is very easy to run experiments. And when the experiment is setup, the SDK code variables are generated and available for developers to use immediately so they can quickly build the experiment code
Google Optimize being part of the Google stack makes it great in reporting and analysis. Wish Google would add more features like dynamic tests, multi funnel tests, conversion calculator based on the total number of traffic of the page being tested instead of using the websites total traffic. Should integrate form analysis, heatmap, and page analytics.
When Google Optimize goes off we searched for a tool where you can be sure to get a good GA4 implementation and easy to use for IT team and product team. Optimizely Feature Experimentation seems to have a good balance between pricing and capabilities. If you are searching for an experimentation tool and personalization all in one... then maybe these comparison change and Optimizely turns to expensive. In the same way... if you want a server side solution. For us, it will be a challenge in the following years
We have a huge, noteworthy ROI case study of how we did a SaaS onboarding revamp early this year. Our A/B test on a guided setup flow improved activation rates by 20 percent, which translated to over $1.2m in retained ARR.
