Based on 73 reviews and ratings
Optimizely and AB Tasty are both A/B testing tools designed to help businesses to test the performance of different versions of web content. Both A/B testing tools are used by businesses of all sizes, though Optimizely is more popular with larger enterprises while A/B Tasty is used more often by smaller to mid-sized businesses.
Optimizely and AB Tasty both include essential A/B testing features such as split testing and test scheduling, but they also each have standout features that set them apart from each other.
AB Tasty includes built-in heatmaps that allow businesses to see what parts of pages users interact with most often and what areas aren’t being used. Heatmaps help businesses see what features are getting the most attention and if any important features are not being noticed by users. Additionally, AB Tasty includes surveys businesses can use to directly ask users questions about the page they are using. AB Tasty also includes a widget library developers can use to make simple changes to a page without writing code.
Though Optimizely and AB Tasty both offer robust feature sets, they also have a few limitations that are important to consider.
Optimizely doesn’t have built-in Heatmaps, so it can be difficult to see what elements of a page users are interacting with most often. Optimizely does include an integration with Hotjar, but for businesses looking for a complete package, heatmaps aren’t available. Additionally, Optimizely doesn’t include surveys, so it can be more difficult to receive direct feedback from users compared to AB Tasty.
AB Tasty doesn’t include features for funnel analysis. As a result, when testing processes such as user registration, or product purchases it can be tricky to see where users drop off without additional analytics tools. AB Tasty’s visual editor is also not as robust as Optimizely’s which is a more complete development tool.
Both AB Tasty and Optimizely do not list complete pricing information, though quotes are available from their sales team. Optimizely includes three pricing tiers for businesses, including a cheaper “essentials” package, and a more feature-complete “enterprise” package. AB Tasty is priced depending on the business in question.
Provided by the TrustRadius Research Team
Published on May 1, 2020
Likelihood to Recommend
Feature Rating Comparison
a/b experiment testing
Split URL testing
Mobile app testing
Visual / WYSIWYG editor
Advanced code editor
Mutually exclusive tests
Test duration calculator
Experiment workflow and approval
Dynamic experiment activation
Standard visitor segmentation
Behavioral visitor segmentation
Traffic allocation control
Experiments results dashboard
Form fill analysis
- Customer-focused. Over the past year, AB Tasty has worked with us to overcome many obstacles (e.g. tracking hurdles, ITP issues, etc.). The team always finds a solution in a timely manner to ensure we're able to execute on experiments.
- Reliability. One of the biggest hurdles earlier this year were the ITP regulations set out by Apple. Over 40% of our ad traffic was Safari users. AB Tasty was using 3rd party cookies but quickly migrated over to a local session storage solution that circumvented the issue.
- Optimizely makes it extremely easy to setup almost any type of split or multi-variate testing experiment. It has a variety of test triggers types & many ways to segment incoming visitors.
- I believe Optimizely's results dashboard is one of the best among split testing software. It allowed my team to get insights into the running of tests, like time to significance and a view of metric changes over time.
- Optimizely is very easy to use for non-engineers. It has a powerful visual interface that allows marketers and advertisers to setup complex variations without 1 line of code.
- In terms of documentation and implementation, I believe Optimizely is ahead of its competitors in terms of its focus on reliability and speed.
- Sometimes the platform is a little glitchy and requires a refresh.
- Would be great to be able to see the experiments and projects on a timeline with their status and main result to have an immediate view of ongoing and completed projects.
- Email notification for when an experiment reaches a certain confidence level.
- Assistance with on-boarding the tool as opossed to using a partner.
- Dedicated training on the tool for internal business users both on the development and consultancy side.
- Impression usage should be applied to running AB tests only - Development teams need to take some time to implement a winning variation and so using impressions to temporarily run a winning experience is not ideal.
Likelihood to Renew
Reliability and Availability
Return on Investment
- Since we use AB tasty our conversion rates have significantly increased on the Watch pages.
- We can report positive comments about the evolutions of our interfaces, from our expert users. And so improved customer satisfaction.
- The solution allows us to validate or invalidate without taking major risk while gaining in reactivity, our proposals relook pages.
- Commitment rates are much higher, multiplied by 2 or 3, when we implement customizations that are relevant. These customizations are very relevant insofar as we are governed by the seasonality of events as a media site.
- Before using Optimizely, we were shooting in the dark with our design decisions. We'd make a change, then have to wait to see our user numbers drop over the course of a couple weeks, then roll back the changes. Our front end team would get frustrated with the wasted time, and try again. With Optimizely, our decisions are data-driven, morale doesn't take a hit, and we are always moving forward with our site.