TrustRadius: an HG Insights company

AB Tasty vs. Optimizely Web Experimentation vs. Signifyd Commerce Protection Platform

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    AB Tasty

    Score8.6 out of 10
    Mid-Size Companies (51-1,000 employees)
    AB Tasty is a SAAS application created for e-marketers that enables them to optimize their website and conversion rate without technical knowledge. They can test several versions of their pages to identify which one has the biggest impact on their business objectives, e.g. click-through rate on a call to action button, add-to-cart rate, global conversion rate of their website.N/A

    Optimizely Web Experimentation

    Score8.7 out of 10
    N/AWhether launching a first test or scaling a sophisticated experimentation program, Optimizely Web Experimentation aims to deliver the insights needed to craft high-performing digital experiences that drive engagement, increase conversions, and accelerate growth.N/A

    Signifyd Commerce Protection Platform

    Score5 out of 10
    N/AThe Signfyd Commerce Protection Platform is fraud protection software that aims to enable online retailers to provide a friction-free buying experience for their customers. Signifyd leverages big data, machine learning and domain expertise in order to provide a financial guarantee against fraud on approved orders that later turn out to be fraudulent. This effectively shifts the liability for fraud away from retailers, allowing them to increase sales and open new markets while reducing risk.…N/A
    Pricing
    AB TastyOptimizely Web ExperimentationSignifyd Commerce Protection Platform
    Editions & Modules
    No answers on this topic
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    AB TastyOptimizely Web ExperimentationSignifyd Commerce Protection Platform
    Free Trial
    NoYesNo
    Free/Freemium Version
    NoNoNo
    Premium Consulting/Integration Services
    NoYesNo
    Entry-level Setup FeeNo setup feeOptionalNo setup fee
    Additional Details
    More Pricing Information
    Community Pulse
    AB TastyOptimizely Web ExperimentationSignifyd Commerce Protection Platform
    Considered Multiple Products
    AB Tasty
    Chose AB Tasty
    AB Tasty is the king when it comes to cost/benefit. It is not the cheapest but not the most expensive. It is a very advanced tool and we like the fact of not having to pay extra fees for more advanced features that we may only use for one test. Also, the chat support …
    Incentivized
    Chose AB Tasty
    The product roadmap is interesting. Support is quite professional. Features are very useful.
    Incentivized
    Chose AB Tasty
    AB Tasty is great, probably the best optimizing tool you can use. Easy, loads of features, great support from CSM. Great variation editor whereas Monetate and VWO don't have a lot of features/widgets. Optimizely is good but again not a lot of capability without a dev. Whereas …
    Incentivized
    Chose AB Tasty
    AB Tasty has very aggressive pricing and a simple-to-use toolset. We feel that AB Tasty gives us what we need and the other vendors don't provide additional value to justify the cost.
    Incentivized
    Chose AB Tasty
    We selected AB Tasty mostly because we got a sense that their dev and customer service teams were going to go above and beyond to help us out. We were right! The cost was also a factor as they came in a small bit lower, but cost wasn't the only factor.
    Incentivized
    Chose AB Tasty
    AB Tasty is far more affordable than most of them, but with the same functionality and better reporting (reporting looks similar to Optimizely). Monetate requires an agency or a dedicated CRO team to manage and run tests, and is best for large companies with a lot of traffic …
    Incentivized
    Chose AB Tasty
    We selected AB Tasty over other leading A/B Testing platforms due to its huge list of features, dedicated account support and competitive licensing model.
    Incentivized
    Chose AB Tasty
    It's a different tool - and could probably borrow some of the UI and ease of use from the other tools, but excels in providing prebuilt functionality and more detailed targeting. It also needs a lot more learning - when the other tools are pretty much pick up and go.
    Incentivized
    Chose AB Tasty
    We benchmarked AB Tasty vs. Kameleoon and Optimizely - the clear 3 leaders for me at the time I made the survey. Optimizely was and is still too expensive compared to the other two.

    We then tested AB Tasty against Kameleoon with the acquisition team for 8 weeks. I was using Kame…
    Incentivized
    Chose AB Tasty
    About Google Analytics, Google Tag Manager and Hotjar, they are not the same product but we use them in our CRO strategy and we continue using them to complete AB Tasty capacities. Optimizely is a direct competitor and we worked with it for two years, it is a good tool too, but …
    Incentivized
    Chose AB Tasty
    We used Webtrends Optimize before AB Tasty. We needed to change because, with Webtrends, you had to be a developer to use it. It was in 2015, I think Webtrends can now be used by non-technical users. In 2015, we made a request for proposals and AB Tasty was the most affordable …
    Incentivized
    Chose AB Tasty
    AB Tasty compared to Optimizely has a better GUI, support including code development is included, updates are made monthly.
    Incentivized
    Chose AB Tasty
    AB testing tool are all converging. Be focused on price and roadmap.
    Optimizely
    Chose Optimizely Web Experimentation
    I do not have any issues with AB Tasty. They are great. We went with Optimizely because they have several other products that will work together with our business model. Optimizely has grown and it now offers many other products that work with experimentation like CMS, CMP, ODP …
    Incentivized
    Chose Optimizely Web Experimentation
    we used Optimizely Web Experimentation then AB Tasty but came back to Optimizley because of its robust stat sig and features as well as all of the products we will be able to work in synchronization.
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely Web Experimentation appeared to be much more user friendly and easier to self-manage than AB Tasty
    Incentivized
    Chose Optimizely Web Experimentation
    > Adobe's pretty cool for its recomentation / AI / ML engine > VWO's wysiwyg is pretty solid and the heatmapping is nice > abtasty's consent features are pretty cool to launch patch and AB Test Consent Rate > Monetate & Dynamic Yield's pre-built personalization features help …
    Incentivized
    Chose Optimizely Web Experimentation
    Better UI, more integrated with our enterprise
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely is my favorite due to its ease of use and exceptional testing capabilities. It is not the cheapest tool, but the other tools that could be compared are not cheap—you get what you pay for. Some of the smaller tools are making gains, though!
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely has the best combination of all the best features of all the personalization platforms I've ever evaluated or used on a regular basis.
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely Web Experimentation is perfect for medium or advance use but not for basic use. For basic use or new users VWO would be a better fit, or for users who would do a test once per month with low traffic. Optimizely is more for users or companies who use cro or do …
    Incentivized
    Chose Optimizely Web Experimentation
    Analytics are vastly superior, platform UI is by far the easiest to use, and capabilities are best in class. If your organization has any budget for a web experimentation tool, it should be using Optimizely Web Experimentation.
    Incentivized
    Chose Optimizely Web Experimentation
    More complex
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely has a more robust toolset and is also more affordable.
    Incentivized
    Chose Optimizely Web Experimentation
    Better documentation releases new features and a better UI experience.
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely has better customer service if you need to talk to a person and a great library of documentation if you run into issues and want to troubleshoot yourself. Web Experimentation has allowed for our testing capabilities to grow as our research program develops. …
    Incentivized
    Signifyd
    No answer on this topic
    Key User Insights
    Would buy again
    100%
    Would buy again
    6 Answers
    95%
    Would buy again
    89 Answers
    No answers on this topic
    Delivers good value for the price
    100%
    Delivers good value for the price
    6 Answers
    96%
    Delivers good value for the price
    69 Answers
    No answers on this topic
    Happy with the feature set
    100%
    Happy with the feature set
    6 Answers
    95%
    Happy with the feature set
    89 Answers
    No answers on this topic
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    5 Answers
    91%
    Lived up to sales and marketing promises
    52 Answers
    No answers on this topic
    Implementation went as expected
    100%
    Implementation went as expected
    6 Answers
    87%
    Implementation went as expected
    58 Answers
    No answers on this topic
    Features
    AB TastyOptimizely Web ExperimentationSignifyd Commerce Protection Platform
    Testing and Experimentation
    Comparison of Testing and Experimentation features of AB Tasty and Optimizely Web Experimentation and Signifyd Commerce Protection Platform
    Feature
    AB Tasty
    8.2
    22 Ratings
    2% below category average
    Optimizely Web Experimentation
    8.0
    163 Ratings
    5% below category average
    Signifyd Commerce Protection Platform
    -
    Ratings
    a/b experiment testing8.122 Ratings9.0163 Ratings00 Ratings
    Split URL testing8.315 Ratings8.5135 Ratings00 Ratings
    Multivariate testing8.119 Ratings8.4139 Ratings00 Ratings
    Multi-page/funnel testing7.416 Ratings7.9126 Ratings00 Ratings
    Mobile app testing7.05 Ratings8.075 Ratings00 Ratings
    Test significance7.73 Ratings8.4147 Ratings00 Ratings
    Visual / WYSIWYG editor10.018 Ratings8.1133 Ratings00 Ratings
    Advanced code editor8.78 Ratings7.9125 Ratings00 Ratings
    Page surveys7.33 Ratings6.217 Ratings00 Ratings
    Preview mode7.49 Ratings7.6145 Ratings00 Ratings
    Test duration calculator10.02 Ratings7.9112 Ratings00 Ratings
    Experiment scheduler9.16 Ratings8.2112 Ratings00 Ratings
    Client-side tests9.49 Ratings7.896 Ratings00 Ratings
    Server-side tests7.01 Ratings7.250 Ratings00 Ratings
    Mutually exclusive tests8.04 Ratings8.280 Ratings00 Ratings
    Cross-browser testing00 Ratings8.197 Ratings00 Ratings
    Visitor recordings00 Ratings8.418 Ratings00 Ratings
    Experiment workflow and approval00 Ratings7.890 Ratings00 Ratings
    Dynamic experiment activation00 Ratings7.574 Ratings00 Ratings
    Audience Segmentation & Targeting
    Comparison of Audience Segmentation & Targeting features of AB Tasty and Optimizely Web Experimentation and Signifyd Commerce Protection Platform
    Feature
    AB Tasty
    8.5
    21 Ratings
    3% below category average
    Optimizely Web Experimentation
    8.2
    152 Ratings
    7% below category average
    Signifyd Commerce Protection Platform
    -
    Ratings
    Standard visitor segmentation9.120 Ratings8.4147 Ratings00 Ratings
    Behavioral visitor segmentation7.418 Ratings7.6122 Ratings00 Ratings
    Traffic allocation control9.121 Ratings9.1144 Ratings00 Ratings
    Website personalization8.319 Ratings7.8111 Ratings00 Ratings
    Results and Analysis
    Comparison of Results and Analysis features of AB Tasty and Optimizely Web Experimentation and Signifyd Commerce Protection Platform
    Feature
    AB Tasty
    8.5
    22 Ratings
    2% below category average
    Optimizely Web Experimentation
    8.3
    149 Ratings
    4% below category average
    Signifyd Commerce Protection Platform
    -
    Ratings
    Heatmap tool7.38 Ratings9.313 Ratings00 Ratings
    Click analytics9.116 Ratings8.833 Ratings00 Ratings
    Scroll maps9.18 Ratings8.517 Ratings00 Ratings
    Conversion tracking8.121 Ratings8.744 Ratings00 Ratings
    Goal tracking9.021 Ratings8.2127 Ratings00 Ratings
    Test reporting8.222 Ratings7.9137 Ratings00 Ratings
    Results segmentation8.219 Ratings7.7103 Ratings00 Ratings
    Experiments results dashboard9.19 Ratings8.049 Ratings00 Ratings
    Form fill analysis00 Ratings8.072 Ratings00 Ratings
    CSV export00 Ratings7.9102 Ratings00 Ratings
    Best Alternatives
    AB TastyOptimizely Web ExperimentationSignifyd Commerce Protection Platform
    Small Businesses
    Google Optimize
    Score6.7 out of 10
    Google Optimize
    Score6.7 out of 10
    No answers on this topic
    Medium-sized Companies
    Kameleoon
    Score9.4 out of 10
    AB Tasty
    Score8.6 out of 10
    No answers on this topic
    Enterprises
    Google Content Experiments (discontinued)
    Score7.3 out of 10
    Google Content Experiments (discontinued)
    Score7.3 out of 10
    No answers on this topic
    All AlternativesView all alternativesView all alternativesView all alternatives
    User Ratings
    AB TastyOptimizely Web ExperimentationSignifyd Commerce Protection Platform
    Likelihood to Recommend
    9.5
    (53 ratings)
    8.7
    (254 ratings)
    10.0
    (2 ratings)
    Likelihood to Renew
    7.7
    (8 ratings)
    9.5
    (51 ratings)
    -
    (0 ratings)
    Usability
    8.8
    (3 ratings)
    10.0
    (58 ratings)
    -
    (0 ratings)
    Availability
    -
    (0 ratings)
    10.0
    (7 ratings)
    -
    (0 ratings)
    Performance
    -
    (0 ratings)
    7.3
    (6 ratings)
    -
    (0 ratings)
    Support Rating
    7.3
    (2 ratings)
    10.0
    (16 ratings)
    -
    (0 ratings)
    Online Training
    8.0
    (1 ratings)
    3.0
    (1 ratings)
    -
    (0 ratings)
    Implementation Rating
    -
    (0 ratings)
    8.0
    (11 ratings)
    -
    (0 ratings)
    Configurability
    -
    (0 ratings)
    6.0
    (1 ratings)
    -
    (0 ratings)
    Product Scalability
    -
    (0 ratings)
    8.0
    (163 ratings)
    -
    (0 ratings)
    User Testimonials
    AB TastyOptimizely Web ExperimentationSignifyd Commerce Protection Platform
    Likelihood to Recommend
    AB Tasty
    A/B Tasty tool allows us do easy testing without burdening our limited developer resources all the time. Reports are simple enough to interpret. Support has been excellent and proactive, also the onboarding was successful. It is also an advantage that we have the possibility to drive all our traffic to the test versions rather than being limited to specific user amount per month. We can recommend A/B Tasty for testing purposes, as the platform keeps it’s promises, doesn’t require too much technical knowledge and the support is excellent.
    Incentivized
    Read full review
    Optimizely
    I think it can serve the whole spectrum of experiences from people who are just getting used to web experimentation. It's really easy to pick up and use. If you're more experienced then it works well because it just gets out of the way and lets you really focus on the experimentation side of things. So yeah, strongly recommend. I think it is well suited both to small businesses and large enterprises as well. I think it's got a really low barrier to entry. It's very easy to integrate on your website and get results quickly. Likewise, if you are a big business, it's incrementally adoptable, so you can start out with one component of optimizing and you can build there and start to build in things like data CMS to augment experimentation as well. So it's got a really strong a pathway to grow your MarTech platform if you're a small company or a big company.
    Incentivized
    Read full review
    Signifyd
    I think Signifyd is well suited for any eCommerce store that delivers physical goods to an address. You will be protected if they approve the order and it turns out to be fraud, and you can take comfort knowing you won't ship any orders that are declined. It is not well suited for companies selling digital goods or services as they won't protect anything that's not physically shipped.
    Incentivized
    Read full review
    Pros
    AB Tasty
    • Customer-focused. Over the past year, AB Tasty has worked with us to overcome many obstacles (e.g. tracking hurdles, ITP issues, etc.). The team always finds a solution in a timely manner to ensure we're able to execute on experiments.
    • Reliability. One of the biggest hurdles earlier this year were the ITP regulations set out by Apple. Over 40% of our ad traffic was Safari users. AB Tasty was using 3rd party cookies but quickly migrated over to a local session storage solution that circumvented the issue.
    Incentivized
    Read full review
    Optimizely
    • The Platform contains drag-and-drop editor options for creating variations, which ease the A/B tests process, as it does not require any coding or development resources.
    • Establishing it is so simple that even a non-technical person can do it perfectly.
    • It provides real-time results and analytics with robust dashboard access through which you can quickly analyze how different variations perform. With this, your team can easily make data-driven decisions Fastly.
    Incentivized
    Read full review
    Signifyd
    • High approval rate.
    • Find the fraud.
    • Always responsive to escalations.
    Incentivized
    Read full review
    Cons
    AB Tasty
    • Sometimes the platform is a little glitchy and requires a refresh.
    • Would be great to be able to see the experiments and projects on a timeline with their status and main result to have an immediate view of ongoing and completed projects.
    • Email notification for when an experiment reaches a certain confidence level.
    Incentivized
    Read full review
    Optimizely
    • JavaScript is hard to implement sometimes especially for JQuery elements
    • ROI reporting should be part of the overall experimentation reporting
    • CMP integration: where we can easily show status of test on the HPT request
    • CMS integration
    • More widgets like social proof banners, etc.
    Incentivized
    Read full review
    Signifyd
    • I am completely satisfied.
    Incentivized
    Read full review
    Likelihood to Renew
    AB Tasty
    AB Tasty's tool as well as the support team completely met my goals on A/B Testing. Editing a test is really easy and AB Tasty made the marketing team free to launch nearly any test. Reporting is also easy to set up and give us the information needed to keep improving transformation on landing pages and forms
    Read full review
    Optimizely
    I rated this question because at this stage, Optimizely does most everything we need so I don't foresee a need to migrate to a new tool. We have the infrastructure already in place and it is a sizeable lift to pivot to another tool with no guarantee that it will work as good or even better than Optimizely
    Incentivized
    Read full review
    Signifyd
    No answers on this topic
    Usability
    AB Tasty
    The tool’s usability is excellent, with a smooth and intuitive interface. It is continuously updated with new features and improvements aimed at enhancing the user experience. Setting up experiments and personalizations is straightforward, thanks to a well-structured process that even less experienced users can easily follow. There are sometimes small issues with the QA section which slows the QA process but it is so much better now compared to 2024.
    Incentivized
    Read full review
    Optimizely
    Optimizely Web Experimentation's visual editor is handy for non-technical or quick iterative testing. When it comes to content changes it's as easy as going into wordpress, clicking around, and then seeing your changes live--what you see is what you get. The preview and approval process for sharing built experiments is also handy for sharing experiments across teams for QA purposes or otherwise.
    Incentivized
    Read full review
    Signifyd
    No answers on this topic
    Reliability and Availability
    AB Tasty
    No answers on this topic
    Optimizely
    I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
    Incentivized
    Read full review
    Signifyd
    No answers on this topic
    Performance
    AB Tasty
    No answers on this topic
    Optimizely
    I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
    Incentivized
    Read full review
    Signifyd
    No answers on this topic
    Support Rating
    AB Tasty
    Support is good, but it would be better if it was quicker or if AB Tasty provided a quicker SLA. At times, you require stuff urgently but AB Tasty support isn't as quick as I personally like it to be.
    Incentivized
    Read full review
    Optimizely
    They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
    Read full review
    Signifyd
    No answers on this topic
    Online Training
    AB Tasty
    There is a vast amount of training available on their online platform, including their university area of which you can get certified for (and then share this with your connections on platforms such as Linkedin). There is also specific hand created training which can be provided by your customer success manager if that is requested by yourself.
    Incentivized
    Read full review
    Optimizely
    The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).
    Read full review
    Signifyd
    No answers on this topic
    Implementation Rating
    AB Tasty
    No answers on this topic
    Optimizely
    In retrospect: - I think I should have stressed more demo's / workshopping with the Optimizely team at the start. I felt too confident during demo stages, and when came time to actually start, I was a bit lost. (The answer is likely I should have had them on-hand for our first install.. they offered but I thought I was OK.) - Really getting an understanding / asking them prior to install of how to make it really work for checkout pages / one that uses dynamic content or user interaction to determine what the UI does. Could have saved some time by addressing this at the beginning, as some things we needed to create on our site for Optimizely to "use" as a trigger for the variation test. - Having a number of planned/hoped-for tests already in-hand before working with Optimizely team. Sharing those thoughts with them would likely have started conversations on additional things we needed to do to make them work (rather than figuring that out during the actual builds). Since I had development time available, I could have added more things to the baseline installation since my developers were already "looking under the hood" of the site.
    Read full review
    Signifyd
    No answers on this topic
    Alternatives Considered
    AB Tasty
    We selected AB Tasty mostly because we got a sense that their dev and customer service teams were going to go above and beyond to help us out. We were right! The cost was also a factor as they came in a small bit lower, but cost wasn't the only factor.
    Incentivized
    Read full review
    Optimizely
    The ability to do A/B testing in Optimizely along with the associated statistical modelling and audience segmentation means it is a much better solution than using something like Google Analytics were a lot more effort is required to identify and isolate the specific data you need to confidently make changes
    Incentivized
    Read full review
    Signifyd
    We did an RFQ 3 years ago and the value proposition for Signifyd was the best. We have never looked back.
    Incentivized
    Read full review
    Scalability
    AB Tasty
    No answers on this topic
    Optimizely
    We can use it flexibly across lines of business and have it in use across two departments. We have different use cases and slightly different outcomes, but can unify our results based on impact to the bottom line. Finally, we can generate value from anywhere in the org for any stakeholders as needed.
    Incentivized
    Read full review
    Signifyd
    No answers on this topic
    Return on Investment
    AB Tasty
    • Since we use AB tasty our conversion rates have significantly increased on the Watch pages.
    • We can report positive comments about the evolutions of our interfaces, from our expert users. And so improved customer satisfaction.
    • The solution allows us to validate or invalidate without taking major risk while gaining in reactivity, our proposals relook pages.
    • Commitment rates are much higher, multiplied by 2 or 3, when we implement customizations that are relevant. These customizations are very relevant insofar as we are governed by the seasonality of events as a media site.
    Read full review
    Optimizely
    • We're able to share definitive annualized revenue projections with our team, showing what would happen if we put a test into Production
    • Showing the results of a test on a new page or feature prior to full implementation on a site saves developer time (if a test proves the new element doesn't deliver a significant improvement.
    • Making a change via the WYSIWYG interface allows us to see multiple changes without developer intervention.
    Incentivized
    Read full review
    Signifyd
    • Positive ROI
    • No fear of being delisted.
    • I am able to sleep at night.
    Incentivized
    Read full review
    ScreenShots

    AB Tasty Screenshots

    Screenshot of the reporting interface.Screenshot of the dynamic widget library.Screenshot of AB Tasty's WYSIWYG editorScreenshot of the campaign management dashboardScreenshot of targeting criteria, available so users can target specific user segments

    Optimizely Web Experimentation Screenshots

    Screenshot of AI-Powered Experimentation with Opal:

- Instant Test Ideas: Generates high-quality A/B test ideas based on any goals and audience insights.
- Smarter Experimentation: The AI can suggest impactful variations, reducing guesswork and increasing test velocity.
- More Than Just Ideas: From hypothesis generation to analyzing results, Opal helps optimize every stage of the experimentation process.Screenshot of the new Visual Editor with an AI Variation Development Agent

Create simple or advanced website changes fast without writing a line of code with our AI Development Agent.

Use natural language to build out your ideas and apply brand styles to your experiments instantly.Screenshot of Advanced Audience Targeting:

- Delivers personalized experiences by targeting users based on behaviors, attributes, and real-time conditions.
- Defines precise audience segments using first-party data, geolocation, and device type.
- Can test and optimize for different audience groups to maximize impact and engagement.Screenshot of Variation Template

Library of experience templates that you can access right within the Visual Editor. Customize these templates or create your own to easily reuse throughout your experimentation program.

- Offers pre-built templates for common test setups.
- Standardized variations and maintains brand integrity with reusable templates.
- Templates can be customized visually or tweak them with code for full flexibility.Screenshot of Web Experimentation Results Page:

- Data visualizations help interpret experiment performance.
- Displays which variations are winning with built-in statistical significance calculations.
- Results can be filtered by audience segments, events, and conversions to uncover key trends.Screenshot of the custom code editor for JavaScript & CSS changes, used to build complex tests.