Google Content Experiments (discontinued) vs. Google Optimize

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.

Incentivized

It is a little too limited for a full stack experimentation programme. Many times we required development support or tech advise but we were simply unable to get this due to it being google. This was a big problem for us. However it is quite good if you were looking to get started in experimentation and didn’t have the budgets for a wider tool

Incentivized

• Quick and easy to create and set up experiments
• Results are presented in a way that is familiar and easy for any Google Analytics user to understand. So is great for beginners to conversion testing
• Already integrated into Google Analytics and can measure results against your existing conversion goals
• Allows nine possible variants to be A/B tested
• Features more than one testing methodology, Bayesian (Multi-Armed Bandit,) and Full Factorial
• Allows the user to select one of three possible confidence thresholds to ensure that experiment results are robust
• Great value, it is free!

• Easy to follow set up procedures. Once I walk a client through the process, it's effortless for them to emulate on subsequent tests.
• Lots of geo and user attribute customization features to be able to drill down into specific targeted audiences — all based on the power of Google's immense data system.
• Google Optimize is the logical choice for many people to start with since most are already familiar with and using GA.

Incentivized

• Their documentation is not the best and it's quite a steep learning curve.
• They also don't tell you particularly well what sorts of things you should be testing.
• Compared to other suppliers of A/B testing tools- it needs a simpler interface. Optimize is starting to answer that - but is still quite Beta-like.

Incentivized

• Only works for browsers, not for the apps testing.
• Missing possibility to test complicated features.
• Audience division in groups is not always accurate.

Incentivized

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

Google has always been known to make easy-to-use products. The Google Optimize interface is intuitive and easy to follow for anyone.

Incentivized

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

Google has well-documented resources and unlimited use cases that can be found online. Plus, their support is always helpful and available.

Incentivized

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

Google Optimize being part of the Google stack makes it great in reporting and analysis. Wish Google would add more features like dynamic tests, multi funnel tests, conversion calculator based on the total number of traffic of the page being tested instead of using the websites total traffic. Should integrate form analysis, heatmap, and page analytics.

Incentivized

• CE has made efficient time use easy and fool-proof when it comes to learning the software
• Because it integrates with other Google programs there is a benefit to track with Google Analytics
• The learning curve can create initiate time investment that may go beyond what companies are willing to dedicate.

• We were able to increase our main KPI for conversions by almost 50% by testing button copy.
• We were able to increase secondary KPIs for conversions by almost 30% by testing form design.

Incentivized