Features
Top Performing Features
Split URL testing
Test out larger design changes by splitting your site traffic across two different landing pages to identify which site performs the best. It can be used to test the impact and feasibility of things such as new designs, personalization efforts, and new site architecture.
Category average: 8.4
Advanced code editor
Allows users to create and edit experiments with HTML, CSS, JS.
Category average: 8
Standard visitor segmentation
Ability to segment, or target audiences based on criteria you set (e.g. URL, cookies, IP address, custom javascript, traffic source, device, browser, language, ad campaign, geo-targeting, time of day) and enable tests to run for specific visitor segments.
Category average: 8.6
Traffic allocation control
Ability to set what percentage of website traffic receives specific test variants in order to roll out code only to a subset of site visitors.
Category average: 9
Testing and Experimentation
These features enable companies to plan, set up, and execute different types of tests (e.g. A/B, A/B/n, multivariate, split URL tests).
a/b experiment testing
Create and test variations of a website, changing site elements such as headlines, CTAs, images, page design and layout, technical SEO changes, and new feature additions and collect statistical results of each variation’s conversion rates or other metrics.
Category average: 8.9
Split URL testing
Test out larger design changes by splitting your site traffic across two different landing pages to identify which site performs the best. It can be used to test the impact and feasibility of things such as new designs, personalization efforts, and new site architecture.
Category average: 8.4
Multivariate testing
Ability to test multiple site design changes at once across one or multiple variations and identify which variation impacts conversion rates, or other predefined goals, the most.
Category average: 8.3
Multi-page/funnel testing
Create an experiment that makes changes across multiple pages, like a funnel or a site-wide experience.
Category average: 8
Cross-browser testing
Preview your experiments across multiple browsers at once.
Category average: 7.2
Test significance
Ability to set the statistical significance level, or confidence interval, of a given test, for example at the 90% or 95% level.
Category average: 8.3
Visual / WYSIWYG editor
Set up A/B testing campaigns using a WYSIWYG editor to create site versions and preview design changes before testing them. These editors often don’t require coding knowledge in order to operate them.
Category average: 7.9
Advanced code editor
Allows users to create and edit experiments with HTML, CSS, JS.
Category average: 8
Visitor recordings
Watch recordings of user sessions to gain insights on site visitor behavior and identify areas to improve site visitor experience.
Category average: 8.5
Preview mode
Preview your experiment before running it live on your site or app.
Category average: 7.7
Test duration calculator
Automatic calculation of the estimated test duration needed to gain statistically significant results.
Category average: 7.9
Audience Segmentation & Targeting
A set of tools used for website optimization experiments (e.g. A/B, A/B/n, funnel, split URL, multivariate tests) that can help users segment their audience in to different groups for the purpose of exposing specific audiences to tests or personalization efforts.
Standard visitor segmentation
Ability to segment, or target audiences based on criteria you set (e.g. URL, cookies, IP address, custom javascript, traffic source, device, browser, language, ad campaign, geo-targeting, time of day) and enable tests to run for specific visitor segments.
Category average: 8.6
Behavioral visitor segmentation
Ability to segment, or target audiences based on whether or not they have performed certain actions, such as clicking on a CTA, and enable tests to run for specific visitor segments.
Category average: 7.8
Traffic allocation control
Ability to set what percentage of website traffic receives specific test variants in order to roll out code only to a subset of site visitors.
Category average: 9
Website personalization
Ability to optimize user experience for individual site visitors based on certain characteristics and past actions (e.g. past purchases, geolocation, demographics, device type, referral source, etc..). An example of this is product and/or content recommendations based on visitor characteristics.
Category average: 8.4
Results and Analysis
Tools that allow users to evaluate the results of website optimization tests (e.g. A/B, A/B/n, multivariate, and split URL tests), or view visitor interaction with webpages and specific site elements.
Heatmap tool
A tool that shows which elements of the page generate the most visitor engagement.
Category average: 8.2
Click analytics
Click analytics reports display how many clicks certain page elements receive and provides visitor engagement insights.
Category average: 8.7
Scroll maps
Scroll maps display how far down the page users scroll.
Category average: 8.6
Conversion tracking
Enables users to set up and customize conversion funnels to track site visitors' journeys and determine areas that see the most visitor drop-off.
Category average: 8.6
Goal tracking
Enables users to set up key website/mobile performance metrics on their landing pages and track them.
Category average: 8.5
Test reporting
Provides users with reports for each test that record the performance of each variation tested against selected metrics such as conversion rate. These reports indicate when a given test variation has performed statistically better than the original (control) site version.
Category average: 8.2
Results segmentation
The ability to segment test results by specific criteria (e.g. browser type, device type, source, time of day, campaign).
Category average: 8.2
Experiments results dashboard
Provides users with a dashboard displaying test results for all live tests. Some products may also include test result histories accessible from the dashboard.
Category average: 8.5