What users are saying about
55 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener noreferrer'>Customer Verified: Read more.</a>
Top Rated
375 Ratings
55 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.8 out of 101

Optimizely

<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener noreferrer'>Customer Verified: Read more.</a>
Top Rated
375 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.4 out of 101

Likelihood to Recommend

AB Tasty

AB Tasty is well suited to the organization where development and IT resources are tight - it's great to be able to utilize their development team to build tests that are outside the scope of the editor. It's also perfect for the company who wants to run quick, meaningful tests using the online editor.
Jeff Copetas profile photo

Optimizely

Optimizely is a great A/B testing tool for any size business. The Optimizely platform democratizes A/B testing through a simple interface, excellent training tools, easy implementation and low dependence on IT resources. Utilizing Optimizely I've been able to run robust experimentation programs with a variety of resources (acting as a 1-person team with limited access to IT resources as well as managing a team with high access to resources). Additionally, Optimizely is well-priced and positioned to be affordable for a variety of business sizes.
Emily Emmer profile photo

Feature Rating Comparison

Testing and Experimentation

AB Tasty
6.9
Optimizely
7.3
a/b experiment testing
AB Tasty
8.1
Optimizely
8.2
Split URL testing
AB Tasty
6.9
Optimizely
7.8
Multivariate testing
AB Tasty
7.6
Optimizely
7.9
Multi-page/funnel testing
AB Tasty
6.7
Optimizely
7.5
Mobile app testing
AB Tasty
4.5
Optimizely
6.8
Visual / WYSIWYG editor
AB Tasty
7.7
Optimizely
7.2
Cross-browser testing
AB Tasty
Optimizely
7.2
Test significance
AB Tasty
Optimizely
7.2
Advanced code editor
AB Tasty
Optimizely
6.7
Page surveys
AB Tasty
Optimizely
6.8
Visitor recordings
AB Tasty
Optimizely
7.2
Preview mode
AB Tasty
Optimizely
6.8
Test duration calculator
AB Tasty
Optimizely
6.6
Experiment scheduler
AB Tasty
Optimizely
8.0
Experiment workflow and approval
AB Tasty
Optimizely
7.2
Dynamic experiment activation
AB Tasty
Optimizely
7.5
Client-side tests
AB Tasty
Optimizely
7.4
Server-side tests
AB Tasty
Optimizely
6.8
Mutually exclusive tests
AB Tasty
Optimizely
6.8

Audience Segmentation & Targeting

AB Tasty
8.2
Optimizely
7.7
Standard visitor segmentation
AB Tasty
7.9
Optimizely
7.9
Behavioral visitor segmentation
AB Tasty
8.5
Optimizely
7.6
Traffic allocation control
AB Tasty
8.4
Optimizely
8.2
Website personalization
AB Tasty
7.9
Optimizely
7.1

Results and Analysis

AB Tasty
6.9
Optimizely
7.2
Heatmap tool
AB Tasty
5.5
Optimizely
6.7
Click analytics
AB Tasty
7.4
Optimizely
7.6
Scroll maps
AB Tasty
6.7
Optimizely
7.1
Conversion tracking
AB Tasty
7.5
Optimizely
7.6
Goal tracking
AB Tasty
7.3
Optimizely
7.6
Test reporting
AB Tasty
7.7
Optimizely
7.8
Results segmentation
AB Tasty
6.6
Optimizely
7.3
Form fill analysis
AB Tasty
Optimizely
6.6
CSV export
AB Tasty
Optimizely
6.6
Experiments results dashboard
AB Tasty
Optimizely
7.5

Pros

AB Tasty

  • Easy setup - Simple script insertion into site header.
  • Intuitive interface - It took very little training for our team to understand how to start running A/B tests. The reporting is much more comprehensive, yet easily digestible than other platforms we have used or considered. Confidence scores, flexible KPI inclusions/tracking allow us to understand the results or non-result quickly and with clarity to make decisions on next steps.
  • Customer support - Our CSM and tech support are always helpful and proactive when a question or issue arise. Our CSM keeps us on track when an idea might have dropped off the map due to other priorities, and brings great ideas to the table. We enjoy our monthly touchbases with her when we get to see new functionalities, how other clients successfully used them, and brainstorm ways we can use them for our experience.
No photo available

Optimizely

  • Optimizely makes it extremely easy to setup almost any type of split or multi-variate testing experiment. It has a variety of test triggers types & many ways to segment incoming visitors.
  • I believe Optimizely's results dashboard is one of the best among split testing software. It allowed my team to get insights into the running of tests, like time to significance and a view of metric changes over time.
  • Optimizely is very easy to use for non-engineers. It has a powerful visual interface that allows marketers and advertisers to setup complex variations without 1 line of code.
  • In terms of documentation and implementation, I believe Optimizely is ahead of its competitors in terms of its focus on reliability and speed.
Alec Dibble profile photo

Cons

AB Tasty

  • Sometimes when you're preparing a test the editor "crashes" and you need to re open it. It's just a matter of having to go back to the main dashboard a few times during your preparation.
  • Maybe to have the option to have pre-build templates of pages, buttons and assets that we can use to test experiments.
No photo available

Optimizely

  • Assistance with on-boarding the tool as opossed to using a partner.
  • Dedicated training on the tool for internal business users both on the development and consultancy side.
  • Impression usage should be applied to running AB tests only - Development teams need to take some time to implement a winning variation and so using impressions to temporarily run a winning experience is not ideal.
Ashley Smith profile photo

Likelihood to Renew

AB Tasty

AB Tasty 7.7
Based on 8 answers
AB Tasty's tool as well as the support team completely met my goals on A/B Testing. Editing a test is really easy and AB Tasty made the marketing team free to launch nearly any test. Reporting is also easy to set up and give us the information needed to keep improving transformation on landing pages and forms
No photo available

Optimizely

Optimizely 9.0
Based on 43 answers
Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.
Jeremy Bradford profile photo

Usability

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely

Optimizely 7.5
Based on 54 answers
I've heard great feedback from the Marketing and Development team who use the tool. I am not particularly great with code but find it easy to set up tests on my own and feel confident putting them live using the preview tool.
Fay Dawson profile photo

Reliability and Availability

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely

Optimizely 9.0
Based on 5 answers
Web interface is nearly always available. Javascript snippet (which actually runs the test) is distributed on a CDN for near-constant availability.
Albert Wavering profile photo

Performance

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely

Optimizely 6.0
Based on 5 answers
We have had some issues with screen flicker when loading experiment content. We had to dial back some of the creative changes to load smaller files.
Shawn Daley profile photo

Support

AB Tasty

AB Tasty 8.2
Based on 1 answer
People are avalaible and they know very well their product which helps to resolve quick issues. Also the benchmark they have helps us to improve our own business.
Fabrice Moncaut profile photo

Optimizely

Optimizely 9.0
Based on 14 answers
They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
Sean Cleveland profile photo

Implementation

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely

Optimizely 8.0
Based on 11 answers
Ensure that your Optimizely JS script is loaded in the header of the page. The reason for this is that the DOM loads the page, and if you are changing elements on the page in your variation, Optimizely needs to know this before the page loads so that it can make those changes for your variation.
Douglas Wright profile photo

Alternatives Considered

AB Tasty

Crazy Egg was mainly only used for heat mapping, which it does really well. I haven't used Google Optimize too much yet but it has most of the same functionality as A/B Tasty. Google Analytics is more used for reporting and a deeper look into data. AB Tasty by far has the best customer service and helpful staff to get your tests and reporting tuned up.
No photo available

Optimizely

I think that Optimizely is more user-friendly than Adobe and Monetate, for example - Adobe is really suited for people with deep pockets and a distinct technical acumen that may not be suitable for a small business. Montetate is not user-friendly - even for seasoned marketers. Apptemize is a pretty great product but they killed their free product. Like Optimzely, they seem to be shooting for enterprise-level clients.
Sylvia Flores profile photo

Scalability

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely

Optimizely 7.1
Based on 47 answers
Optimizely offers excellent testing features and incredible technical support and training resources enabling non-technical teams most benefited by experimentation to truly own this function. Optimizely is easy to implement and use, has simple integration with other technologies making it a staple in our marketing technology stack. Finally, Optimizely continues to innovate around its core technology to add new features and capabilities to improve the overall experimentation process (such as acquiring Experimentation Engine in 2018). In a dynamic and ever-changing marketing technology landscape expect to continue using Optimizely in my marketing technology stack for many years to come.
Emily Emmer profile photo

Return on Investment

AB Tasty

  • Since we use AB tasty our conversion rates have significantly increased on the Watch pages.
  • We can report positive comments about the evolutions of our interfaces, from our expert users. And so improved customer satisfaction.
  • The solution allows us to validate or invalidate without taking major risk while gaining in reactivity, our proposals relook pages.
  • Commitment rates are much higher, multiplied by 2 or 3, when we implement customizations that are relevant. These customizations are very relevant insofar as we are governed by the seasonality of events as a media site.
Valentin Viguier profile photo

Optimizely

  • Before using Optimizely, we were shooting in the dark with our design decisions. We'd make a change, then have to wait to see our user numbers drop over the course of a couple weeks, then roll back the changes. Our front end team would get frustrated with the wasted time, and try again. With Optimizely, our decisions are data-driven, morale doesn't take a hit, and we are always moving forward with our site.
Benjamin Himley profile photo

Pricing Details

AB Tasty

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Yes
Entry-level set up fee?
No

Optimizely

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Rating Summary

Likelihood to Recommend

AB Tasty
8.9
Optimizely
8.5

Likelihood to Renew

AB Tasty
7.7
Optimizely
9.0

Usability

AB Tasty
Optimizely
7.5

Reliability and Availability

AB Tasty
Optimizely
9.0

Performance

AB Tasty
Optimizely
6.0

Support

AB Tasty
8.2
Optimizely
9.0

Online Training

AB Tasty
Optimizely
3.0

Implementation

AB Tasty
Optimizely
8.0

Scalability

AB Tasty
Optimizely
7.1

Add comparison