What users are saying about
74 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 7.7 out of 100
404 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 7.5 out of 100

Feature Set Ratings

  • AB Tasty ranks higher in 3 feature sets: Testing and Experimentation, Audience Segmentation & Targeting, Results and Analysis

Testing and Experimentation

8.1

AB Tasty

81%
7.0

Optimizely Web Experimentation

70%
AB Tasty ranks higher in 10/19 features

a/b experiment testing

8.5
85%
17 Ratings
8.4
84%
48 Ratings

Split URL testing

8.6
86%
12 Ratings
8.7
87%
37 Ratings

Multivariate testing

8.0
80%
14 Ratings
6.0
60%
37 Ratings

Multi-page/funnel testing

7.4
74%
12 Ratings
5.2
52%
53 Ratings

Mobile app testing

7.8
78%
4 Ratings
7.7
77%
19 Ratings

Visual / WYSIWYG editor

8.0
80%
13 Ratings
7.0
70%
39 Ratings

Advanced code editor

8.2
82%
4 Ratings
7.6
76%
38 Ratings

Page surveys

7.3
73%
2 Ratings
7.8
78%
12 Ratings

Preview mode

8.0
80%
4 Ratings
6.9
69%
45 Ratings

Experiment scheduler

8.2
82%
3 Ratings
7.9
79%
29 Ratings

Client-side tests

8.9
89%
4 Ratings
6.3
63%
31 Ratings

Mutually exclusive tests

8.2
82%
2 Ratings
5.6
56%
20 Ratings

Cross-browser testing

N/A
0 Ratings
7.0
70%
27 Ratings

Test significance

N/A
0 Ratings
7.3
73%
42 Ratings

Visitor recordings

N/A
0 Ratings
7.0
70%
15 Ratings

Test duration calculator

N/A
0 Ratings
7.6
76%
24 Ratings

Experiment workflow and approval

N/A
0 Ratings
6.9
69%
20 Ratings

Dynamic experiment activation

N/A
0 Ratings
6.2
62%
19 Ratings

Server-side tests

N/A
0 Ratings
6.5
65%
10 Ratings

Audience Segmentation & Targeting

8.6

AB Tasty

86%
7.0

Optimizely Web Experimentation

70%
AB Tasty ranks higher in 4/4 features

Standard visitor segmentation

8.5
85%
15 Ratings
8.4
84%
44 Ratings

Behavioral visitor segmentation

8.5
85%
13 Ratings
6.5
65%
33 Ratings

Traffic allocation control

8.7
87%
16 Ratings
7.5
75%
42 Ratings

Website personalization

8.8
88%
14 Ratings
5.5
55%
25 Ratings

Results and Analysis

7.8

AB Tasty

78%
6.9

Optimizely Web Experimentation

69%
AB Tasty ranks higher in 7/10 features

Heatmap tool

7.0
70%
6 Ratings
7.9
79%
9 Ratings

Click analytics

8.1
81%
13 Ratings
6.5
65%
23 Ratings

Scroll maps

8.2
82%
6 Ratings
7.9
79%
12 Ratings

Conversion tracking

7.9
79%
16 Ratings
7.2
72%
33 Ratings

Goal tracking

7.9
79%
16 Ratings
7.3
73%
38 Ratings

Test reporting

8.2
82%
17 Ratings
7.2
72%
40 Ratings

Results segmentation

7.2
72%
15 Ratings
5.3
53%
36 Ratings

Experiments results dashboard

7.7
77%
4 Ratings
6.4
64%
35 Ratings

Form fill analysis

N/A
0 Ratings
6.6
66%
9 Ratings

CSV export

N/A
0 Ratings
6.2
62%
25 Ratings

Attribute Ratings

  • AB Tasty is rated higher in 1 area: Likelihood to Recommend
  • Optimizely Web Experimentation is rated higher in 2 areas: Likelihood to Renew, Support Rating

Likelihood to Recommend

8.6

AB Tasty

86%
48 Ratings
7.5

Optimizely Web Experimentation

75%
131 Ratings

Likelihood to Renew

7.7

AB Tasty

77%
8 Ratings
9.0

Optimizely Web Experimentation

90%
42 Ratings

Usability

AB Tasty

N/A
0 Ratings
8.0

Optimizely Web Experimentation

80%
57 Ratings

Availability

AB Tasty

N/A
0 Ratings
9.0

Optimizely Web Experimentation

90%
10 Ratings

Performance

AB Tasty

N/A
0 Ratings
6.0

Optimizely Web Experimentation

60%
10 Ratings

Support Rating

7.3

AB Tasty

73%
3 Ratings
9.1

Optimizely Web Experimentation

91%
28 Ratings

Online Training

AB Tasty

N/A
0 Ratings
3.0

Optimizely Web Experimentation

30%
1 Rating

Implementation Rating

AB Tasty

N/A
0 Ratings
8.0

Optimizely Web Experimentation

80%
22 Ratings

Product Scalability

AB Tasty

N/A
0 Ratings
8.5

Optimizely Web Experimentation

85%
50 Ratings

Likelihood to Recommend

AB Tasty

A/B Tasty tool allows us do easy testing without burdening our limited developer resources all the time. Reports are simple enough to interpret. Support has been excellent and proactive, also the onboarding was successful. It is also an advantage that we have the possibility to drive all our traffic to the test versions rather than being limited to specific user amount per month. We can recommend A/B Tasty for testing purposes, as the platform keeps it’s promises, doesn’t require too much technical knowledge and the support is excellent.
Laura Karhu | TrustRadius Reviewer

Optimizely Web Experimentation

Optimizely is a great A/B testing tool for any size business. The Optimizely platform democratizes A/B testing through a simple interface, excellent training tools, easy implementation and low dependence on IT resources. Utilizing Optimizely I've been able to run robust experimentation programs with a variety of resources (acting as a 1-person team with limited access to IT resources as well as managing a team with high access to resources). Additionally, Optimizely is well-priced and positioned to be affordable for a variety of business sizes.
Emily Emmer | TrustRadius Reviewer

Pros

AB Tasty

  • Customer-focused. Over the past year, AB Tasty has worked with us to overcome many obstacles (e.g. tracking hurdles, ITP issues, etc.). The team always finds a solution in a timely manner to ensure we're able to execute on experiments.
  • Reliability. One of the biggest hurdles earlier this year were the ITP regulations set out by Apple. Over 40% of our ad traffic was Safari users. AB Tasty was using 3rd party cookies but quickly migrated over to a local session storage solution that circumvented the issue.
Matt Mattson | TrustRadius Reviewer

Optimizely Web Experimentation

  • Optimizely makes it extremely easy to setup almost any type of split or multi-variate testing experiment. It has a variety of test triggers types & many ways to segment incoming visitors.
  • I believe Optimizely's results dashboard is one of the best among split testing software. It allowed my team to get insights into the running of tests, like time to significance and a view of metric changes over time.
  • Optimizely is very easy to use for non-engineers. It has a powerful visual interface that allows marketers and advertisers to setup complex variations without 1 line of code.
  • In terms of documentation and implementation, I believe Optimizely is ahead of its competitors in terms of its focus on reliability and speed.
Alec Dibble | TrustRadius Reviewer

Cons

AB Tasty

  • Sometimes the platform is a little glitchy and requires a refresh.
  • Would be great to be able to see the experiments and projects on a timeline with their status and main result to have an immediate view of ongoing and completed projects.
  • Email notification for when an experiment reaches a certain confidence level.
Anonymous | TrustRadius Reviewer

Optimizely Web Experimentation

  • Actual creation of an A/B test is confusing and difficult (like the differences between Pages vs URLs etc.).
  • Setting up a URL Redirect Experiment is so convoluted it seems like it's not even a feature Optimizely wants you to use. Instead, it's like I'm tricking Optimizely into alternating between 2 URLs. That really needs to be cleaned up as it would be very helpful.
Anonymous | TrustRadius Reviewer

Pricing Details

AB Tasty

General

Free Trial
Yes
Free/Freemium Version
Premium Consulting/Integration Services
Yes
Entry-level set up fee?
No

Starting Price

$40 per month

Optimizely Web Experimentation

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Starting Price

Likelihood to Renew

AB Tasty

AB Tasty 7.7
Based on 8 answers
AB Tasty's tool as well as the support team completely met my goals on A/B Testing. Editing a test is really easy and AB Tasty made the marketing team free to launch nearly any test. Reporting is also easy to set up and give us the information needed to keep improving transformation on landing pages and forms
Anonymous | TrustRadius Reviewer

Optimizely Web Experimentation

Optimizely Web Experimentation 9.0
Based on 42 answers
Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.
Jeremy Bradford | TrustRadius Reviewer

Usability

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely Web Experimentation

Optimizely Web Experimentation 8.0
Based on 57 answers
Without a doubt, after 8 years using various different testing tools, Optimizely is by far the easiest to use. Feedback from developers and more technical teams has always been positive, mostly due to the code editor allowing for easy implementation along with the creation of advanced audience segments using advanced javascript. For business users and non-technical people, the wysiwig editor allows for smaller changes to be made quickly whilst somewhat educating the user on the types of code changes that are being made.
Ashley Smith | TrustRadius Reviewer

Reliability and Availability

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely Web Experimentation

Optimizely Web Experimentation 9.0
Based on 10 answers
Web interface is nearly always available. Javascript snippet (which actually runs the test) is distributed on a CDN for near-constant availability.
Albert Wavering | TrustRadius Reviewer

Performance

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely Web Experimentation

Optimizely Web Experimentation 6.0
Based on 10 answers
We have had some issues with screen flicker when loading experiment content. We had to dial back some of the creative changes to load smaller files.
Shawn Daley | TrustRadius Reviewer

Support Rating

AB Tasty

AB Tasty 7.3
Based on 3 answers
Support is good, but it would be better if it was quicker or if AB Tasty provided a quicker SLA. At times, you require stuff urgently but AB Tasty support isn't as quick as I personally like it to be.
Halima Satheya | TrustRadius Reviewer

Optimizely Web Experimentation

Optimizely Web Experimentation 9.1
Based on 28 answers
They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
Sean Cleveland | TrustRadius Reviewer

Online Training

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely Web Experimentation

Optimizely Web Experimentation 3.0
Based on 1 answer
The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).
Anonymous | TrustRadius Reviewer

Implementation Rating

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely Web Experimentation

Optimizely Web Experimentation 8.0
Based on 22 answers
In retrospect:- I think I should have stressed more demo's / workshopping with the Optimizely team at the start. I felt too confident during demo stages, and when came time to actually start, I was a bit lost. (The answer is likely I should have had them on-hand for our first install.. they offered but I thought I was OK.)- Really getting an understanding / asking them prior to install of how to make it really work for checkout pages / one that uses dynamic content or user interaction to determine what the UI does. Could have saved some time by addressing this at the beginning, as some things we needed to create on our site for Optimizely to "use" as a trigger for the variation test.- Having a number of planned/hoped-for tests already in-hand before working with Optimizely team. Sharing those thoughts with them would likely have started conversations on additional things we needed to do to make them work (rather than figuring that out during the actual builds). Since I had development time available, I could have added more things to the baseline installation since my developers were already "looking under the hood" of the site.
Anonymous | TrustRadius Reviewer

Alternatives Considered

AB Tasty

We selected AB Tasty mostly because we got a sense that their dev and customer service teams were going to go above and beyond to help us out. We were right! The cost was also a factor as they came in a small bit lower, but cost wasn't the only factor.
Jeff Copetas | TrustRadius Reviewer

Optimizely Web Experimentation

I think that Optimizely is more user-friendly than Adobe and Monetate, for example - Adobe is really suited for people with deep pockets and a distinct technical acumen that may not be suitable for a small business. Montetate is not user-friendly - even for seasoned marketers. Apptemize is a pretty great product but they killed their free product. Like Optimzely, they seem to be shooting for enterprise-level clients.
Sylvia Flores | TrustRadius Reviewer

Scalability

AB Tasty

No score
No answers yet
No answers on this topic

Optimizely Web Experimentation

Optimizely Web Experimentation 8.5
Based on 50 answers
It's all you need to design, install, analyze and measure simple tests with Optimizely. When test complexity increases, it becomes necessary to integrate third party analytics tools to perform more detailed analysis such as additional details like page views, average time spent on each page, and bounce rates by variation. Optimizely has very straightforward integrations, so integration with analytics is straightforward.
Katie Goh | TrustRadius Reviewer

Return on Investment

AB Tasty

  • Since we use AB tasty our conversion rates have significantly increased on the Watch pages.
  • We can report positive comments about the evolutions of our interfaces, from our expert users. And so improved customer satisfaction.
  • The solution allows us to validate or invalidate without taking major risk while gaining in reactivity, our proposals relook pages.
  • Commitment rates are much higher, multiplied by 2 or 3, when we implement customizations that are relevant. These customizations are very relevant insofar as we are governed by the seasonality of events as a media site.
Valentin Viguier | TrustRadius Reviewer

Optimizely Web Experimentation

  • Optimizely has had a tremendous positive impact on the ROI of our clients. Whether you're just starting your testing program and just want to get your feet wet with a few simple WYSIWYG tests, or you're ready to dive in to complex MVT test designs and Personalization Campaigns, Optimizely has everything you need to create, and maintain, a highly successful testing center.
Anonymous | TrustRadius Reviewer

Screenshots

Add comparison