Google Content Experiments (discontinued) vs. Google Optimize

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.

Incentivized

Google Optimize is well suited for testing small changes on the browser pages. You have the option of changing designs, texts, and some small features on the page. The audience can be divided using a long list of factors, so it makes it quite easy to set up the test. It is not well suited for complicated feature tests where you need to monitor the user over a long period or where the user is likely to use multiple sessions across multiple devices or browsers

Incentivized

• Quick and easy to create and set up experiments
• Results are presented in a way that is familiar and easy for any Google Analytics user to understand. So is great for beginners to conversion testing
• Already integrated into Google Analytics and can measure results against your existing conversion goals
• Allows nine possible variants to be A/B tested
• Features more than one testing methodology, Bayesian (Multi-Armed Bandit,) and Full Factorial
• Allows the user to select one of three possible confidence thresholds to ensure that experiment results are robust
• Great value, it is free!

• Easy to follow set up procedures. Once I walk a client through the process, it's effortless for them to emulate on subsequent tests.
• Lots of geo and user attribute customization features to be able to drill down into specific targeted audiences — all based on the power of Google's immense data system.
• Google Optimize is the logical choice for many people to start with since most are already familiar with and using GA.

Incentivized

• Their documentation is not the best and it's quite a steep learning curve.
• They also don't tell you particularly well what sorts of things you should be testing.
• Compared to other suppliers of A/B testing tools- it needs a simpler interface. Optimize is starting to answer that - but is still quite Beta-like.

Incentivized

• Track site performance with each test version; see if the resource timing of each test has anything to do with conversion rates.

Incentivized

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

Google has always been known to make easy-to-use products. The Google Optimize interface is intuitive and easy to follow for anyone.

Incentivized

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

Google has well-documented resources and unlimited use cases that can be found online. Plus, their support is always helpful and available.

Incentivized

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

Google Optimize being part of the Google stack makes it great in reporting and analysis. Wish Google would add more features like dynamic tests, multi funnel tests, conversion calculator based on the total number of traffic of the page being tested instead of using the websites total traffic. Should integrate form analysis, heatmap, and page analytics.

Incentivized

• CE has made efficient time use easy and fool-proof when it comes to learning the software
• Because it integrates with other Google programs there is a benefit to track with Google Analytics
• The learning curve can create initiate time investment that may go beyond what companies are willing to dedicate.

• We were able to increase our main KPI for conversions by almost 50% by testing button copy.
• We were able to increase secondary KPIs for conversions by almost 30% by testing form design.

Incentivized