Google Content Experiments (discontinued) vs. Hotjar vs. Mixpanel

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.

Incentivized

Hotjar is good for a first pass at understanding user sentiment or locating potential usability issues. There are features such as "rage clicked" which shows recordings or instances when a user rage clicked or had an issue with your site. Hotjar has also been helpful to launch intercept surveys on mobile, desktop, and app, which not all competitor software allow. Hotjar recordings are fun to watch. "Watching Hotjar like Netflix" is a favorite pastime at work.

Incentivized

As a worker in the sales area, I see closely how complex it can be to evaluate the commercial funnel and Mixpanel has been an indispensable guide to prioritize above all what customers expect to receive from our company, and thus be able to determine the main service we offer. Without a doubt, Mixpanel has special functions to be the one that guides the route and marks the objectives much more clearly.

Incentivized

• Quick and easy to create and set up experiments
• Results are presented in a way that is familiar and easy for any Google Analytics user to understand. So is great for beginners to conversion testing
• Already integrated into Google Analytics and can measure results against your existing conversion goals
• Allows nine possible variants to be A/B tested
• Features more than one testing methodology, Bayesian (Multi-Armed Bandit,) and Full Factorial
• Allows the user to select one of three possible confidence thresholds to ensure that experiment results are robust
• Great value, it is free!

• Heat mapping is great on Hotjar. It is a good place to start when you are looking at the UX & CRO on your website. You can see the % of people clicking on elements on a page, how far they scroll, and mouse movements.
• Hotjar is great for session recordings. These record the mouse movements, clicks, pages and scrolls of a user in video format. You can watch these to investigate what works well on a site and identify potential roadblocks and bugs.
• Hotjar is great as it ensures that users details are anonymous; for instance, if you are watching a session recording, you cannot see what a user types in a form field, as Hotjar blanks this out.
• Hotjar has a poll function, so you can have polls on your website.

Incentivized

• Mixpanel is a daily use application for everyone in my organization; it helps us have a better flow of information and interaction between work teams.
• The user interface of this platform is simple and has a wide variety of functions and resources to help us work in the most organized way, have better team coordination, and keep efficiency high.
• I love that it is so easy to program our calendar to our liking, so we can prioritize our activities and know what is pending, and the best thing is that I can update the calendar if necessary.
• The chat function is great to improve the interaction between colleagues and share work schedules and any information with third parties.

Incentivized

• Their documentation is not the best and it's quite a steep learning curve.
• They also don't tell you particularly well what sorts of things you should be testing.
• Compared to other suppliers of A/B testing tools- it needs a simpler interface. Optimize is starting to answer that - but is still quite Beta-like.

Incentivized

• Hotjar is primarily used for web-based experiences. Not that easy to use on mobile apps.
• I'd love to see Hotjar integrated with Google Analytics for an even deeper view.
• Hotjar is primarily used by smaller organizations...pricing can get steep quickly for larger organizations.

Incentivized

• Mixpanel requires an explicit setting of events from your app. This means you need to be very thoughtful in the design of your events because missing one means you aren't collecting any data from it. Inserting it into the process later on then brings challenges in tracking when certain events came online.
• A tool like Mixpanel comes packed with features that sometimes are harder to discover. It's very easy to get sucked into one part of its toolset and not be aware of other tools which may be very useful.

Incentivized

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

Even though the heat maps and user recordings were useful, our website was significantly slowed down after we installed Hotjar, so much so, that it took over a minute for our blog to load. The data that we gathered was not worth the length that it took our website to load.

Incentivized

It's not an all encompassing solution like Google Analytics tries to be, but MixPanel offers much easier to use and understandable data insights. That's valuable when juggling many responsibilities as startup life demands, so a renewal would be easily justified.

So easy and simple to use! Straightforward anyone in the team is able to easily go in and set up anything in Hotjar. The UI is really simple. Whenever you give feedback to Hotjar they continously take on board the feedback and improve the tool.

Incentivized

Relativity easy to use. Once you get the hang of it, very easy to create dashboards for different use cases. I split my dashboards between customers or use cases

Incentivized

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

Hotjar is a SaaS-based company, and as such has a good support service. Users can quickly submit support tickets through Hotjar's online portal. Enterprise customers get access to additional support members and have SLAs to support their larger, more complex needs. Overall, Hotjar is extremely reliable and I've never had to reach out to customer support.

Incentivized

We have only ever had to use their support once, when we were setting up the account, but their responses were prompt and the solutions were well documented. The people who solved our issues were helpful, even to non-tech people.

Incentivized

Mixpanel has a great resource about their product, with videos on how to use it and real world examples from other companies on how they integrate Mixpanel into their business processes.

Again, somewhat annoying to be charged based on data points when many other analytics providers have one flat fee. Implementation was good, but I might have tracked a few more detailed points if I had the option.

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

HotJar was selected for a few reasons:

• Video Capture - HotJars video capture of user sessions is nothing short of amazing. It is so useful (not to mention cool) to see, in real time, how users interact with our software. It makes our jobs so much easier and more enjoyable to get this type of d
• User Surveys - The ease and flexibility of surveys we can make available on our website are an awesome tool to get additional data.
• Simple implementation - Adding a very small amount of code to our website gives us the ability to use all of HotJars features without having to touch our code again.

Incentivized

• There was not really any other competitors for this specific use case that had a chance
• We used Google Analytics for some things but obviously, GA is anonymous data so not useful for product teams with users
• Other solutions out there seemed to be too expensive and this was the most recommended
• Heap seemed to be the best OTHER option but didn't take the time to evaluate

Incentivized

• CE has made efficient time use easy and fool-proof when it comes to learning the software
• Because it integrates with other Google programs there is a benefit to track with Google Analytics
• The learning curve can create initiate time investment that may go beyond what companies are willing to dedicate.

• We have fixed many issues, for example, checkout usability problems with the video recording feature. You can catch bugs and get an overall idea of how a particular page is working.
• Polls have helped us pair intent with the video sessions, so we can understand better why certain users answered different things. You get greedy and try to ask everything but that won't work. Keep it simple and it will give you small but important insights.

Incentivized

• We've been able to increase the funnel conversions of one of our new product funnels from a 1% conversion rate to a 5% conversion rate.
• We've been able to increase the CTR on another of our main product pages from ~3% to ~10% (so far)
• We've been able to segment out how users from different traffic sources behave, allowing us to eliminate thousands of dollars of wasteful spending on advertising campaigns that weren't working.

Incentivized