Useful for simple changes, but developers needed for complex tests
March 01, 2019

Useful for simple changes, but developers needed for complex tests

Anonymous | TrustRadius Reviewer
Score 7 out of 10
Vetted Review
Verified User
Review Source

Overall Satisfaction with VWO

VWO is used by the UX & CRO department of our digital marketing agency to facilitate running A/B tests on client websites. It solves the business problem of not needing to much developer resource to run tests, allowing our team members to mostly set up tests themselves rather than needing complex code.
  • Quick to set up AB tests on sites, with multiple variations allowed and the ability to use segments to control who sees the test.
  • Easily links with GA for accurate analysis
  • Heatmaps are included which allow you to see differences between test variations
  • Setting up multivariate tests can be very difficult, particularly if you want to test something which requires custom code rather than using the VWO editor.
  • Using the VWO editor to create tests can create excessive amounts of code to do quite simple changes, compared to if custom code written by a developer was used.
  • The heatmaps could be more detailed, and seeing how far users had scrolled would be useful.
  • Integration with more tools, such as Hotjar, would be very handy
  • The ability to offer a CRO service is greatly enhanced by VWO, as it allows us to run tests for clients
  • The editor means to some extent we don't need much developer resource to run the tests, lowering costs of doing so
VWO is useful when you need to run AB tests on websites which have been set up well. Problems can arise when the tests are more complicated, especially multivariate tests, or when the website is quite old/doesn't function as well as it should. Then tests can become quite buggy. It can also be difficult previewing tests via the preview tool, as that sometimes doesn't display the test correctly. It is also difficult allowing clients to preview live tests when there is more than one variation. The test can be set live to the client's IP, but to guarantee them seeing a specific variation it has to be set to 100%, so you can only show one variation at a time.