Google Optimize vs. Lyssna vs. VWO

It is a little too limited for a full stack experimentation programme. Many times we required development support or tech advise but we were simply unable to get this due to it being google. This was a big problem for us. However it is quite good if you were looking to get started in experimentation and didn’t have the budgets for a wider tool

Incentivized

UsabilityHub is well suited for remote unmoderated testing. Responses are captured very quickly and live updates allow the user to keep track of how the test is performing. The types of testing that make the most sense to use on UsabilityHub are preference test, first click test, navigational, and design surveys. It is less appropriate for one-on-one testing and lengthy questionnaires.

Incentivized

It works better for either small or big companies because small companies can start with the free plan which is very decent and has everything they need. Also for big companies who get the best paid plans they get a lot of premium functionalities, the insight module, outstanding reports. But for medium size companies who can only afford the basic paid plan, it may not be the best tool as it is very limited. For example, they cannot analize a/b tests for new and ruturning visitors, neither based on the users device category.

Incentivized

• Easy to follow set up procedures. Once I walk a client through the process, it's effortless for them to emulate on subsequent tests.
• Lots of geo and user attribute customization features to be able to drill down into specific targeted audiences — all based on the power of Google's immense data system.
• Google Optimize is the logical choice for many people to start with since most are already familiar with and using GA.

Incentivized

• Rapid user feedback
• Demographic targeting
• Well presented results
• Easy to use
• Relatively inexpensive

Incentivized

• VWO is pretty easy to implement on websites and doesn't require a heavy technology lift
• The VWO interface is pretty intuitive and let's non-technical users make variants for testing
• The VWO reporting dashboard is excellent for determining statistical significance and understanding whether differences in conversion rates are meaningful or not

Incentivized

• Only works for browsers, not for the apps testing.
• Missing possibility to test complicated features.
• Audience division in groups is not always accurate.

Incentivized

• Add additional demographic sorting options for the audience to better meet the needs of B2B users - for example include industry type, functional area, etc.
• Bring back the navigation test type
• Add additional test types

Incentivized

• The user interface within VWO does take a bit of time to get used to, especially as it pertains to switching back and forth between tests. When running multiple experiments on a site at a time, a clear and succinct dashboard for everything in one place would be helpful (as opposed to needing to switch between A/B, multivariate, etc).

Incentivized

It's great value and we think we've ironed out all the major teething troubles. However, if we experience any more bugs or problems that significantly slow us down then we're seriously considering switching to Optimizely, which I haven't personally tested but have heard great things about from my CRO peers

Google has always been known to make easy-to-use products. The Google Optimize interface is intuitive and easy to follow for anyone.

Incentivized

Due to its simplicity and design it is really easy to navigate. You can clearly understand which sections you have completed and which are still left to be done. It is also really easy to change ordering of content etc, which I have found hasn’t been an option in other tools which means it is a really lengthy task of rewriting all of the tasks or questions to get them in the correct order that is desired.

Incentivized

I gave Visual Website Optimizer a rating of 8 because it is overall a great product to use. Setting up and keeping track of various tests is easy and straight forward. The only reason why this product is not rated higher is because the support documents online leave a lot of room for improvement.

I have not experienced an application error or unplanned outage with VWO.

Incentivized

VWO doesn't appear to slow down our website at all, though some customers with adblockers like UBlock Origin have been known to not see entire pages if VWO is making changes to the page at a macro level (background, font, etc). This is rare though.

Incentivized

Google has well-documented resources and unlimited use cases that can be found online. Plus, their support is always helpful and available.

Incentivized

While their online document support is lacking a simple email to their support team will almost always get responded to the next day. It has however taken more than one email to explain the problem to the support team till they understood the problem. The solution I was given also only half fixed the problem the rest I figured out on my own.

Training was good, just limited to the onboarding process. They walked through all of the steps it takes to get started in VWO and each of the modules, along with giving us ideas for starting our first test. I feel like it could be better if there was a guided process within the VWO program to continue to educate you along the way, and a way to turn that off for experienced users.

Incentivized

Overall, the implementation of VWO is straightforward. If you've got a straightforward way of deploying code to all of your test pages, either a good CMS or a TMS, then implementation should be a breeze. There is no tweaking to be done to the code itself, and once deployed it has the flexibility to cope with different VWO modules (tracking, conversion analysis, session analysis) without modification.

Incentivized

Google Optimize being part of the Google stack makes it great in reporting and analysis. Wish Google would add more features like dynamic tests, multi funnel tests, conversion calculator based on the total number of traffic of the page being tested instead of using the websites total traffic. Should integrate form analysis, heatmap, and page analytics.

Incentivized

UsabilityHub provides very fast, short responses to specific questions about a static image of a website. This is useful for checking what is most prominent on a page, what they would click on, what they see/read within the first 5 seconds of landing etc. WhatUsersDo is a broader tool, that records the screen and audio as a user navigates the website. You can set tasks and ask questions, but it much more about the user journey experience and their opinion, rather than testing a particular feature. Feedback also takes a bit longer. Hotjar is a combination of both, its a screen recording which helps you to see where users click and move to, but there is no audio or text feedback, just heatmaps/click maps for watching user behaviour.

Incentivized

There are significant differences in each platform when it comes to Optimizely and vwo. From a functionality and performance perspective they each have their pros and cons. It is important to go through the feature sets of each and ensure the solution you select will work specifically with your business objectives and conversion rate optimization goals

Incentivized

The product seems infinitely scalable for our needs (small business) and we've never had any issue with loading VWO-edited elements. I will say, though, that online customers with ad blockers have been known to not see certain VWO elements as their third-party scripts are disabled.

Incentivized

• We were able to increase our main KPI for conversions by almost 50% by testing button copy.
• We were able to increase secondary KPIs for conversions by almost 30% by testing form design.

Incentivized

• Increase in testing frequency per quarter.
• Increase in approved projects for developments.
• Few reverts per project.

Incentivized

• The ability to offer a CRO service is greatly enhanced by VWO, as it allows us to run tests for clients
• The editor means to some extent we don't need much developer resource to run the tests, lowering costs of doing so

Incentivized