What users are saying about
Likelihood to Recommend
Google Content Experiments
I'm a believer in ongoing website optimization. This being said, I would suggest every website owner run A/B tests at all times. Google Content Experiments is an easy and free way to get started
- Easy to use if you already use Google Analytics - literally a few minutes to set up a test
- Fully integrated with Google Analytics - so you can use your existing conversion goals, and no confusion over metrics.
- Should include a multivariate testing (MVT) option. Whilst the ability to test nine possible variants using A/B/n testing is great for strong bold tests, the ability test multiple elements on the same page is essential for a successful testing program
- Reliance on your IT department to code the variants you wish to test and also to insert the experiment code on the test page can be an issue which may slow the testing process for some businesses
- It is very easy to make the wrong decisions and find a false winner. A high level of conversion rate optimisation knowledge is needed to ensure that the results from the experiment are valid and of statistical significance
- Should not default to Bayesian (multi armed bandit,) methodology and a 95 percent confidence threshold as a those new to testing may not fully understand the impact of these setting and whilst these options can be changed in “Advanced Options” the combination of these two factors could easily find an incorrect winner
- Google Experiments should not declare the winning variant as it does not understand your business or business cycles, so can easily find a false winner. Although the option to set a minimum time for the experiment to run before declaring a winner goes some way towards mitigating this issue it is limited to a maximum of two weeks which may not be long enough for some businesses
Likelihood to Renew
Google Content Experiments7.5
Based on 10 answers
Unless a more powerful and equally cost-effective (free) alternative surfaces, Google Content Experiments is definitely serving our purposes at present.
We'd use content experiments as a complimentary testing tool alongside more comprehensive testing packages out there. As a free testing tool it does the job for basic A/B testing.
Return on Investment
- Helps us identify if new pages perform in terms of conversion
- Removes risk from deploying changes
- Provides real customer feedback