What users are saying about

AB Tasty

Top Rated
44 Ratings

AB Tasty

Top Rated
44 Ratings
Score 8.4 out of 101

Google Content Experiments

71 Ratings
Score 7.5 out of 101

Add comparison

Likelihood to Recommend

AB Tasty

A/B testing on a single page is straightforward (text, images, colors, positions are made very very easy to handle) while testing over full site combining different options is a bit tricky. Visualizing best users' responses in adequation to your plans is hence quite easy using their scenario and indicators very visual and comprehensive.
David Reymond profile photo

Google Content Experiments

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.
Salvatore Polizzi McDonagh profile photo

Pros

  • A/B and multi veritable testing.
  • Screen recording and targeting.
  • WYSIWYG editor to create page variations.
No photo available
  • Integrates well with Google Analytics to perform segmentation analysis
  • Capability of using server redirects rather than java script redirects unlike most testing tools.
  • Easy to set up
Lee Duong profile photo

Cons

  • Need their support or a developer on your team if you want to do some complicated tests
Melanie Pitkanitsos profile photo
  • No multivariate tests: Google Content Experiments tests on an A|B|n platform. As such, you must create full iterations of landing pages to test against each other. If you are testing a full layout change, the A|B|n model will suit your needs just fine. However, if you’d like to test multiple elements at one time or a small element, like button color, you would need to create a new landing page for each different color button you will test. This can become quite cumbersome.
  • Basic testing platform: This platform will also present challenges if you would like to test the influence of one element across multiple pages. You will need a much more sophisticated tool for this type of testing.
  • Content Experiments defaults to a Multi-Armed Bandit algorithm. This automatically adjusts the amount of traffic allocated to each variation based on sample size and performance metrics, resulting in less traffic to "under-performing" variations. In theory the Multi-Armed Bandit is much more efficient than your classic A|B testing method, concluding tests much quicker while reducing potential revenue loss. Unfortunately, we have found that for testing with small sample sizes, like those commonly conducted for B2Bs or SMBs, the multi-armed bandit has the potential to create an invalid test that will never declare a winner. This is because traffic to the variation is typically reduced so severely and so quickly that there is not a significant enough sample size to give it a competitive opportunity.
  • Testing on a specific segmentation is challenging: To test on a distinct segment of your visitors requires more advanced knowledge of Analytics to set up a new filter view and cannot be completed within Google Content Experiments.
  • Not ideal for marketers who want independence from IT: Content Experiments requires a snippet of code being placed on one experiment page for each test. It also requires a full version of the test page with a unique URL.
Jenny DeGraff profile photo

Likelihood to Renew

AB Tasty7.7
Based on 8 answers
AB Tasty's tool as well as the support team completely met my goals on A/B Testing. Editing a test is really easy and AB Tasty made the marketing team free to launch nearly any test. Reporting is also easy to set up and give us the information needed to keep improving transformation on landing pages and forms
No photo available
Google Content Experiments7.5
Based on 10 answers
Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.
Jenny DeGraff profile photo

Support

AB Tasty8.2
Based on 1 answer
People are avalaible and they know very well their product wich help to resolve quick issues. Also the benchmark they have help us to improve our own business
Fabrice Moncaut profile photo
No score
No answers yet
No answers on this topic

Alternatives Considered

About Google Analytics, Google Tag Manager and Hotjar, they are not the same product but we use them in our CRO strategy and we continue using them to complete AB Tasty capacities. Optimizely is a direct competitor and we worked with it for two years, it is a good tool too, but prefer AB Tasty's user enviroment and proactive support.
Javier Gómez de la Mata profile photo
I have not used any alternatives. I only use Content Experiments because it is in GA.
No photo available

Return on Investment

  • We got many insights and validated improvements to design our new website (+3% CR Desktop and +23% CR mobile).
  • We saved hundreds of hours on implementations without IT support.
  • We spent a lot of time with an initial incorrect CRO project.
Javier Gómez de la Mata profile photo
  • No hard numbers but it has been useful in identifying which content scores better conversions and learning from this
No photo available

Pricing Details

AB Tasty

General
Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Yes
Entry-level set up fee?
No
Additional Pricing Details

Google Content Experiments

General
Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
Additional Pricing Details