A/B Testing Tools
These products won a Top Rated award for having excellent customer satisfaction ratings. The list is based purely on reviews; there is no paid placement, and analyst opinions do not influence the rankings. Read more about the Top Rated criteria.
A/B Testing Tools TrustMap
TrustMaps are two-dimensional charts that compare products based on trScore and research frequency by prospective buyers. Products must have 10 or more ratings to appear on this TrustMap.
Oracle CX Marketing (formerly Oracle Marketing Cloud) is a solution designed to enable marketers to plan and execute automated marketing campaigns via email, display search, video advertising, and mobile while delivering a personalized customer experience for their prospects.
Optimizely Web Experimentation is a website optimization platform, providing A/B and multivariate testing. It enables users with and without technical expertise to make dynamic changes to their websites, test the variations to live traffic and gather immediate results.
VWO is an A/B testing and conversion optimization platform that enables growing businesses to conduct qualitative and quantitative visitor research, build an experimentation roadmap and run continuous experiments on their digital properties.With its 5 capabilities Plan, Track, Test,…
Kibo Personalization (the product based on the former Monetate) is an ecommerce personalization software for consumer-facing brands. It is used by QVC, adidas, J. Crew Group Inc., The North Face, and hundreds of other retailers according to the vendor. Kibo Personalization enables…
Dynamic Yield calls itself an AI-powered Experience Optimization platform that promises to deliver individualized experiences at every customer touchpoint: web, apps, email, kiosks, IoT, and call centers. The platform’s data management capabilities provide for a unified view of the…
Kameleoon boasts users among 500 corporate and enterprise companies across North America, Europe, and Asia Pacific to help brands deliver digital experiences and products to their customers. GDPR, CPPA, and HIPPA compliant, Kameleoon’s A/B testing, full stack, and AI-powered…
Unbounce is a landing page builder for marketers. Marketers can use the drag and drop platform to create customized, responsive landing pages for their marketing campaigns.
AB Tasty is a SAAS application created for e-marketers that enables them to optimize their website and conversion rate without technical knowledge. They can test several versions of their pages to identify which one has the biggest impact on their business objectives, e.g. click-…
Adobe Test and Target is an A/B, multi-variate testing platform which Adobe acquired as part of the Omniture platform in 2009. It is now part of the Adobe Marketing Cloud. It offers tight integration with Adobe analytics and content management products.
Instapage, by Postclick aims to be the leader in post-click automation, and promises to help digital advertisers create more relevant and impactful advertising by unifying the post-click stage of the advertising funnel. With Instapage, marketers can maximize conversions by creating,…
Convert Experiences is a flicker-free A/B testing & personalization tool boasting users across 5000+ websites by brands like Sony, Unicef & Jabra.Convert Experiences’ offers enterprise-ready advanced features like multi-page testing, post-segmentation, advanced targeting…
Contentsquare is a digital experience analytics cloud designed to help companies understand hidden customer behaviors, and use those insights to drive more successful experiences. It includes functionality from the former Clicktale heatmap, session recording, and A/B testing tool…
Google offers the Optimize A/B testing tool for testing website content and versions.
Gtmetrix is an analytics tool focused on determining website performance with features like page load speed details, video capture, and the ability to test from multiple regions around the world.
Campaigner is an email marketing solution built by marketers that is designed to help small, medium and large businesses strengthen customer relationships and drive sales. The vendor's value proposition is that Campaigner provides advanced features such as industry-leading A/B split…
What is A/B Testing?
A/B or split testing divides web traffic among multiple versions of a webpage and provides information on which version performs better at achieving a desired outcome, such as signups, downloads, demo requests, or purchases.
The testing process aims to optimize a website’s ability to convert visitors into leads or customers. There are two primary goals associated with A/B testing:
To increase revenue without spending more money to acquire traffic.
To prove that a new design concept or feature is worth creation before budgeting engineering and design resources to create it.
A/B Testing Software Features
All A/B testing tools include the following features:
Splitting traffic among the different variations being tested
Calculating conversion rates
Measuring statistical likelihood that one variation will consistently outperform the other
Basic A/B testing tools may require custom design and code. Some advanced tools offer a WYSIWYG interface for creating variations without needing to use HTML or CSS. This works well for non-technical users.
More sophisticated tools can run targeted campaigns. These tools display different versions based on demographics, device type, web visitor behavior, or referral source. They can also perform multi-page campaigns. This means testing one element (like a banner) on multiple pages during a session. These advanced tools help create a personalized user experience, with the goal of maximizing conversions.
A/B Test Best Practices
It is generally best to change one element of a page at a time so that any change in outcome can be attributed to that specific change. With this approach, you’ll know which element results in better conversion.
Elements to test include:
Certain split testing tools allow multivariate testing. This allows you to change multiple elements on one page, creating countless combinations. An analyst can then measure the impact of each variable on conversion.
Split testing should run long enough to reach statistical significance - at least 95% confidence. The amount of time needed varies depending on the amount of traffic to the page. Because they involve many versions, multivariate tests require more time and traffic to reach statistical significance. So if you plan on running multivariate tests, budget more time for the experiment than you would for a simpler A/B test.
A/B Testing and Conversion Rate Optimization (CRO)
A/B testing is often part of conversion rate optimization. CRO refers to the process of continually improving a website’s effectiveness at reaching its goal and increasing conversions. Usually, the goal is to turn visitors into customers or leads. However, other CRO goals can be things like downloading a whitepaper or increasing the number of event registrations.
It is usually a cyclical workflow, involving multiple steps:
Monitoring website visitor behavior
Gathering insight and visitor feedback
Testing a hypothesis for improving conversions
Key technologies in the CRO workflow include:
In-page web analytics (heat mapping, visitor recordings, etc.)
A/B testing tools
A/B Testing Software Comparison
Before investing in an A/B Testing solution, consider these three key factors:
Use case: who will be using the tool the most within your organization and what goals are they trying to achieve? For example, will the marketing team be the primary users of the A/B testing tool? Or will web developers use the tool to help test out new feature ideas too? This matters because not all tools are equally as user-friendly for both types of users. WYSIWYG editors are a must-have feature for marketing teams, while developers and engineers users likely need access to advanced A/B testing capabilities.
Support options: what customer support options are available for each A/B testing tool you’re considering? Vendors may provide various levels of support, such as phone, email, documentation, live chat, or automated support. If you’re new to the world of A/B testing, training, courses, and certifications can be valuable resources.
In-house vs. agency route: does your business need an in-house A/B testing solution, or would it be better served by working with a conversion rate optimization (CRO) agency? If you decide to go the in-house route, you’ll need to purchase an A/B testing platform and make sure you have the resources set aside to manage the tool. In contrast, all the operating costs and resources will be taken care of if you decide to work with a CRO agency. However, CRO services can be substantially more expensive than basic A/B testing tools.
Another thing to consider is that agencies will have a wealth of knowledge and experience behind them, while your in-house A/B testing program may not. But your own A/B testing program will be solely focused on your own business goals in a way that an agency will not be.
Getting pricing information for a specific A/B testing tool typically requires asking for a quote. You can find basic plans for as little as $50 per month. The more sophisticated tools can run up to $18,000 per year.
Frequently Asked Questions
A/B testing is important because it helps companies make evidence-based decisions about how to design and structure their website. Making decisions based only on intuitions or the most popular idea can lead to bad design choices, and ultimately cost your website in terms of organic traffic or other key performance indicators (KPIs).
A/B testing can also help engineering and development teams test out new feature ideas before devoting resources to producing the new feature. This way, teams can get a preview of how the new feature will be received and work out any kinks before creating the new feature.
There are many different A/B testing tips and tricks you can find on the internet. But some of the most important best practices to keep in mind are:
- If you’re just starting your A/B testing program, get buy-in from executive stakeholders
- When you can help it, only test one element at a time
- Make sure to let your experiments run long enough to reach statistical significance
- Think about how the test variations will render on different device types (e.g. desktop, mobile, tablet)
For more information on these tools and what features they include, see our A/B testing software category page.
According to end-user feedback collected on TrustRadius.com, the top-rated A/B testing tools include:
For more information about which products are better suited for specific company sizes, view our A/B Testing Software TrustMap. TrustRadius also has hundreds of reviews of over 50 A/B testing solutions that include detailed information about product pros and cons.
The price of A/B testing tools can vary depending on the number of features included. More basic tools can start at $50 per month while more comprehensive platforms can cost upwards of multiple thousands of dollars per month.
Many A/B testing vendors don’t directly disclose pricing information on their website but will provide a quote upon request.