Google Content Experiments (discontinued) vs. Mouseflow vs. VWO

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.

Incentivized

Mouseflow is a great when you're working in a busy product development or conversion optimisation environment, and want to understand exactly how customers are interacting with your site or app so you can respond. It's a capable tool that offers some great insight at a fraction of the cost of competitors like SessionCam or ClickTale. It has occasional problems in captures that its competitors suffer from less often, but if you're looking for a general understanding of usage then this is a great tool. It doesn't have built-in integrations with all A/B testing tools, but it does have a built-in Google Tag Manager tag so its very easy to set up without assistance. If you've got the budget to select reliability over cost, then you may choose to opt for a more mature, enterprise offering. But if your budget is limited, or you're just looking to prove the value of session recording as a concept, then Mouseflow will more than do the job.

Incentivized

It works better for either small or big companies because small companies can start with the free plan which is very decent and has everything they need. Also for big companies who get the best paid plans they get a lot of premium functionalities, the insight module, outstanding reports. But for medium size companies who can only afford the basic paid plan, it may not be the best tool as it is very limited. For example, they cannot analize a/b tests for new and ruturning visitors, neither based on the users device category.

Incentivized

• Quick and easy to create and set up experiments
• Results are presented in a way that is familiar and easy for any Google Analytics user to understand. So is great for beginners to conversion testing
• Already integrated into Google Analytics and can measure results against your existing conversion goals
• Allows nine possible variants to be A/B tested
• Features more than one testing methodology, Bayesian (Multi-Armed Bandit,) and Full Factorial
• Allows the user to select one of three possible confidence thresholds to ensure that experiment results are robust
• Great value, it is free!

• Mouseflow does a great job creating wonderful Heat Maps. These allow you to really see how people are interacting with a page. Great data if you want to create better flow in your pages.
• The User Session Recordings are also especially useful and when used in conjunction with the heat maps you can really get a feel and a look at how a page is working. This lets you see where people get stuck, elements that might be distracting, etc.
• In the area of the heat maps Mouseflow can handle A/B testing which I think is priceless.
• Another advantage to Mouseflow is that unlike many of these types of tools Mouseflow integrates with most Web platforms, well beyond WordPress.

Incentivized

• VWO is pretty easy to implement on websites and doesn't require a heavy technology lift
• The VWO interface is pretty intuitive and let's non-technical users make variants for testing
• The VWO reporting dashboard is excellent for determining statistical significance and understanding whether differences in conversion rates are meaningful or not

Incentivized

• Their documentation is not the best and it's quite a steep learning curve.
• They also don't tell you particularly well what sorts of things you should be testing.
• Compared to other suppliers of A/B testing tools- it needs a simpler interface. Optimize is starting to answer that - but is still quite Beta-like.

Incentivized

• Free version could have more features.
• Should be optimized for a better view on mobile devices.
• Although it provides a complete list of data, it is not able to capture certain sessions.

• The user interface within VWO does take a bit of time to get used to, especially as it pertains to switching back and forth between tests. When running multiple experiments on a site at a time, a clear and succinct dashboard for everything in one place would be helpful (as opposed to needing to switch between A/B, multivariate, etc).

Incentivized

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

It's great value and we think we've ironed out all the major teething troubles. However, if we experience any more bugs or problems that significantly slow us down then we're seriously considering switching to Optimizely, which I haven't personally tested but have heard great things about from my CRO peers

Mouseflow is pretty easy to use. You need to be a core technical person to implement it on your site. Mouseflow provided us a tracking code that need to be installed on the website, and if do not have the knowledge of how to work on the backend of the website, you will not be able to install it. Here you will need the help of a technical person who has a good knowledge of your website platform to install the code on the website. There are also videos available giving insight on how to use the Mouseflow platform. I personally haven't faced any problem while using Mouseflow. Just login to this tool and a dashboard will open in front of you.

I gave Visual Website Optimizer a rating of 8 because it is overall a great product to use. Setting up and keeping track of various tests is easy and straight forward. The only reason why this product is not rated higher is because the support documents online leave a lot of room for improvement.

I have not experienced an application error or unplanned outage with VWO.

Incentivized

VWO doesn't appear to slow down our website at all, though some customers with adblockers like UBlock Origin have been known to not see entire pages if VWO is making changes to the page at a macro level (background, font, etc). This is rare though.

Incentivized

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

This is an area where Mouseflow is quite strong. Not only is the support good but they also have some very good training on the use of the product. There is a nicely laid out section of videos that not only cover the use of the tools functions but also how to use the data that Mouseflow produces. They are doing well in the support area.

Incentivized

While their online document support is lacking a simple email to their support team will almost always get responded to the next day. It has however taken more than one email to explain the problem to the support team till they understood the problem. The solution I was given also only half fixed the problem the rest I figured out on my own.

Training was good, just limited to the onboarding process. They walked through all of the steps it takes to get started in VWO and each of the modules, along with giving us ideas for starting our first test. I feel like it could be better if there was a guided process within the VWO program to continue to educate you along the way, and a way to turn that off for experienced users.

Incentivized

Overall, the implementation of VWO is straightforward. If you've got a straightforward way of deploying code to all of your test pages, either a good CMS or a TMS, then implementation should be a breeze. There is no tweaking to be done to the code itself, and once deployed it has the flexibility to cope with different VWO modules (tracking, conversion analysis, session analysis) without modification.

Incentivized

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

Mouseflow is a supplement to Google Analytics and improves on some Analytics functions. Mouseflow adds qualitative data to the quantitative data that Analytics provides to help marketers better understand their website visitors

Incentivized

There are significant differences in each platform when it comes to Optimizely and vwo. From a functionality and performance perspective they each have their pros and cons. It is important to go through the feature sets of each and ensure the solution you select will work specifically with your business objectives and conversion rate optimization goals

Incentivized

The product seems infinitely scalable for our needs (small business) and we've never had any issue with loading VWO-edited elements. I will say, though, that online customers with ad blockers have been known to not see certain VWO elements as their third-party scripts are disabled.

Incentivized

• CE has made efficient time use easy and fool-proof when it comes to learning the software
• Because it integrates with other Google programs there is a benefit to track with Google Analytics
• The learning curve can create initiate time investment that may go beyond what companies are willing to dedicate.

• MouseFlow makes a positive impact on our future marketing decisions. We recently had a change in formula for a product and added a variety of ways for people to read about the changes via our website. Mouseflow allowed us to see which method was effective in communicating our message. We were able to replicate the style on other digital platforms.
• Mouseflow allows us to save time we would normally spend in developing a website. For example, before building a new website I will spend a couple of weeks analyzing user data via mouseflow. I can clearly see what features are not currently working and where we are loosing people in the current process. This cuts down website revisions by about 10%

Incentivized

• The ability to offer a CRO service is greatly enhanced by VWO, as it allows us to run tests for clients
• The editor means to some extent we don't need much developer resource to run the tests, lowering costs of doing so

Incentivized