It allows us to make business decisions around the wording of text that's shown, or the user experience around a new UI.
- General overview of which test variation is doing better
- Simple A/B and Split URL tests
- Simple testing mechanics (e.g. blanking the page before simple tests are run like with the WYSIWYG editor)
- UI/UX for finding certain options are confusing. Even having used the tool for a bit, can't remember where certain editing options are .
- Bugs with the visual editor and preview mode (having to refresh the page until it works)
- More complicated tests (which may involve mechanics specific to certain companies)
Simple tests like hiding and showing a button, text, etc.
Adding text onto the page
Changing the color of things
Split tests where the whole page can change
Want a smarter visual editor (e.g. we can change the layout and the test would still work, by class or id selectors)
- Heat maps
- Easy set up of A/B tests
- Easy implementation of the tool
- Last time I wanted to add a B-variant in a A/B-test on our homepage. I changed the existing content (that was separated in two columns), but in the preview it kept showing elements I already deleted. In the end I decided to skip this test, because I couldn't find a solution.
- Integration of Google Analytics can be more easy, so I can easily use my existing measurement goals for example.
- Exporting of the made heat maps into images.
If you use an iframe, in our case it will not be tracked. Probably if you add the VWO code in the iframe, but it is something you should be aware of.
- Live previews of changes as you make them
- Direct HTML access or a simple UI, as needed
- Google Analytics integration
- The first-party analytics are harder to use than the Google Analytics integration and show more inconsistent results - would be nice if these were improved
- The web editor is sometimes slow to load or reflect changes, and occasionally locks up
- Preview screenshots seem to be spliced together, so they often show multiple instances of the site header spaced down the page
- You have the ability to have heatmaps recorded on any A/B or Split URL test, allowing you to investigate where users are concentrating most of their time within a control or variation.
- VWO's ability to allow custom conversion tags to be placed and triggered on the website allows for more robust conversion tracking.
- VWO's UI is very easy to use and navigate allowing users who are not familiar with coding the ability to test a website without the need of a developer in most cases.
- Creating more technical documentation in the library, not just high level information. Example would be documentation on how you can run a test on your internal network before having a test go live.
- Organization and management of multiple A/B tests paused or running at once is very well laid out and intuitive.
- Heatmaps have provided a huge amount of actionable data in focused testing areas.
- A/B test overview data is very easy to make inferences from because of its simple and visually outstanding presentation.
- The Chrome extension tends to have issues loading Heatmaps. It's not uncommon to go to a Heatmaps page and have to refresh the page at least once in order for the extension to load correctly.
- The visual editor for making variations for A/B tests feels clunky and often doesn't appear in the final version (previewing the variation as a page on its own) as it does in the editor. At times the undo button has caused erratic behavior such as duplicating or "redoing" several of the same action at once rather than stepping backward.
- Overall, if there were any way to decrease the amount of time that the Chrome extension takes to load, I could see workflow across several areas being greatly improved.
- Setting up tests is fairly easy, setting up URL's, saved goals, and experiment-wide JS
- Predictive text for CSS
- Good response time with general questions about the product, live chat is much appreciated
- There should be a preview button within the visual/code editor. Sometimes I need to see a page outside of the VWO window and it is a hassle to back out of the editor, click on the preview tab, open a preview, go back to the variation tab, and reopen the the editor.
- Sometimes hard to remember where certain settings are in the menu layout. Customize traffic allocation can be difficult to find, and the 'other' tab in settings is not the most intuitive name.
- Opening the test editor should be more prominent, since that is the main tool used for developers.
VWO Review: "Great Website Optimisation Tool to help inform product decisions and improve user onboarding"
- Relatively easy for people without a developer background to make tactical changes to website content that may influence customer behaviour while comparing effects on both desktop and mobile.
- VWO provides a good overview of results and data captured, allowing teams to collaborate and structure multiple tests simultaneously with endless segmentation options that are particularly useful when optimising certain user groups.
- The A/B testing feature is particularly useful with clear indications of when results are significant and easy interfaces to compare versions.
- I only use A/B testing because that's the only thing someone has taught me hands-on to do.
- I know there is more functionality available but it is not clear when you're logged in which features require an upgrade vs. which ones you can access.
- The Demo that was organised previously was not practical with poor connectivity and not tailored to the audience (ie. our CTO and Head of Customer support were attending but learned nothing useful other than the things I had already shared previously by going through the platform.)
A lot less suited for more advanced tests that require developer support/html/code editing. The Hypothesis tool is not very practical and could be a lot more user-friendly and should not be a premium tool...
- Visitor segmentation. There is a good amount of metrics that can be used to target those visitors you desire.
- Estimation service. The provided results sometimes look strange. It is hard to figure out if the estimated run-time of a test is a result of a buggy calculation or you simply put in the wrong numbers for calculation.
- Allows for easy split URL testing and goal tracking through an intuitive user interface
- Provides easy to interpret analytics and graphs on all the various research and testing components that the VWO platform offers
- Includes a research component which tracks a subset of overall visitors which helps us decide what to test and why
- The VWO team is very knowledgable and provides excellent customer support
- Really easy to implement and start testing with their tracking code
- Setting testing parameters can be confusing sometimes (or I just have no idea what I'm doing)
- Billing and upgrading your account can be challenging, although it seems like they are figuring it out with the latest release of their platform
- When QAing experiments, it is extremely quick as goals fire immediately greatly reducing the time it takes to QA.
- Dashboards are easy to understand.
- The enterprise package has comprehensive add ons.
- Redirect experiments are difficult to create and the wildcard rules are often incorrect and can create problems for the user of the platform as well as the visitors.
- The main dashboard for experiments is actually based on cumulative transactions, not conversion rates of the specific variations which is confusing for newer users. Not communicated very well.
- The support and resources center are not very robust and often I find myself with more questions than answers.
- The support has been fantastic and they really do all they can to explain or help you set up experiments or account settings. The chat access is awesome because I can get help immediately while I'm setting up my account, whereas other companies only have email support, which disrupts my flow.
- The options for testing is practically endless. They've thought of almost everything! I've trialed other A/B testing tools which did have limits on how I could set up the tests, which is one of the reasons why I chose VWO instead even though the other ones were cheaper.
- The additional features besides A/B testing made this a very useful and valuable tool, such as heat maps, form analysis and website surveys, where I didn't have to purchase other tools, and they were pretty full featured in themselves that I didn't find much shortcomings that would make me look elsewhere for a better solution.
- I have to admit, the phone support was difficult for me to use because of the language "barrier". I use that in quotes because even though they know English fluently, the thick Indian accents made it very very difficult for me to understand what they were saying, and I was trying really really hard to understand.
- Their visual editor didn't work as well as I had hoped for. For some copy changes, doing a direct text edit didn't work. They ended up giving me code to use in their CSS editor, which inadvertently, messed up our popup trial signup form (which we didn't realize it was messing it up until months later).
- I think the "quota" amounts are pretty low, especially when using them for their research features, when compared to the competitors I was trying out.
- Easy to design and implement tests
- Hypothesis feature makes it easy to keep track of tests
- The A/B test designer doesn't always work well with pages that involve multiple steps to get to (i.e., the last page of an order flow)
- The dashboard doesn't seem to change based on what level subscription you have, which is confusing
We also use user recordings in order to locate potential problems in our flows.
We use heatmaps the least, because the info is not that actionable - we get the same data from GA and recordings
- Intuitive UI
- Easy to set up A/B tests
- Integration with different tools for more detailed insights
- Testing preview functionality is weak
- Products behind general paywall - I need to pay $300/mo more in order to get scroll maps for the heatmaps
- Support could be faster and take more of a personal approach
- VWO is suited for most websites - The tool works with classical websites as well as SPAs.
- Tests are easy to implement and success metrics are defined for each test individually - which gives accurate insights.
- We run A/B tests for page design changes.
- We also run split URL tests for major page redesigns.
- We run ongoing conversion campaigns.
- I've found that creating a campaign which involves multiple pages is extremely time-consuming to set up. I haven't done this in a while so maybe the process has improved, but I'm not aware if it has.
- Form analysis is pretty cool.
- Targeting and segmentation is quite extensive.
- Implementing A/B tests works well.
- More filtering options for form analysis.
- Increase sampling ratio for heatmaps.
- Increase sampling ratio for recordings.
- Easily track test performance and stats as it runs
- Seeing heatmaps and user recordings
- Form usage statistics
- Integration with Google Analytics
- Split URL tests with multiple pages are notoriously difficult to setup
- Form usage statistics, while helpful, are incomplete
- Screen recording (if you want based on specific actions)
- Personalisation (show this version only at location XY at this time range)
- Set up A/B testings easily
- Implementation not that easy (depending of technology)
- Setting up an A/B Test that is affecting one element that occurs to be on several items (e.g. price comparison cards)
- Adding VWO to 3rd party analytics tools
- Easy to use dashboard/interface
- Relatively quick/simple to install VWO on site
- Easy to quickly setup variants
- Lack of default reporting information - goals have to be specified per campaign
- In coding view for variants - lack of live preview of changes
- Easy to implement and get going
- Support is very helpful and easy to work with via the chat box on the VWO platform
- Quick to set up tests and preview them before going live
- I haven't used it enough to have much feedback on this
- Great customer support
- Great Interface
- Comprehensive testing quiver
- I love all kinds of testing
- We haven't been using it long enough to find holes.
- Great documentation - I would expand on it a little though.
VWO Scorecard Summary
VWO is an A/B testing and conversion optimization platform that enables growing businesses to conduct qualitative and quantitative visitor research, build an experimentation roadmap and run continuous experiments on their digital properties.
With its 5 capabilities Plan, Track, Test, Analyze, and Target, it brings the entire CRO (conversion rate optimization) process at one place. VWO helps online businesses follow the process- and data-driven conversion optimization to boost their conversion rates.
With features like heatmaps, surveys, visitor recordings, and others, VWO enables businesses to develop an in-depth understanding of on-site visitor behavior. VWO facilitates conducting research-driven A/B testing to optimize web experience across desktop, mobile, and other devices, to deliver a unique experience based on visitor preferences.
According to the vendor, VWO has helped more than 4,500 brands across the globe to run over 600,000 experiments to date. VWO’s global customer base includes brands like Vodafone, Samsung, Toyota, and eBay.
|TESTING||Get a Demo||The classic VWO A/B testing solution|
|CONVERSION OPTIMIZATION||Get a Demo||The all-in-one platform for all your optimization needs|
|ENTERPRISE||Get a Demo||Customized solution with advanced AB testing and conversion optimization capabilities|
For any additional information about pricing and plans, visit https://vwo.com/pricing/
VWO Support Options
|Free Version||Paid Version|
|Video Tutorials / Webinar|
VWO Technical Details