Google Content Experiments (discontinued) vs. Mixpanel

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.

Incentivized

As a worker in the sales area, I see closely how complex it can be to evaluate the commercial funnel and Mixpanel has been an indispensable guide to prioritize above all what customers expect to receive from our company, and thus be able to determine the main service we offer. Without a doubt, Mixpanel has special functions to be the one that guides the route and marks the objectives much more clearly.

Incentivized

• Quick and easy to create and set up experiments
• Results are presented in a way that is familiar and easy for any Google Analytics user to understand. So is great for beginners to conversion testing
• Already integrated into Google Analytics and can measure results against your existing conversion goals
• Allows nine possible variants to be A/B tested
• Features more than one testing methodology, Bayesian (Multi-Armed Bandit,) and Full Factorial
• Allows the user to select one of three possible confidence thresholds to ensure that experiment results are robust
• Great value, it is free!

• Mixpanel is a daily use application for everyone in my organization; it helps us have a better flow of information and interaction between work teams.
• The user interface of this platform is simple and has a wide variety of functions and resources to help us work in the most organized way, have better team coordination, and keep efficiency high.
• I love that it is so easy to program our calendar to our liking, so we can prioritize our activities and know what is pending, and the best thing is that I can update the calendar if necessary.
• The chat function is great to improve the interaction between colleagues and share work schedules and any information with third parties.

Incentivized

• Their documentation is not the best and it's quite a steep learning curve.
• They also don't tell you particularly well what sorts of things you should be testing.
• Compared to other suppliers of A/B testing tools- it needs a simpler interface. Optimize is starting to answer that - but is still quite Beta-like.

Incentivized

• Mixpanel requires an explicit setting of events from your app. This means you need to be very thoughtful in the design of your events because missing one means you aren't collecting any data from it. Inserting it into the process later on then brings challenges in tracking when certain events came online.
• A tool like Mixpanel comes packed with features that sometimes are harder to discover. It's very easy to get sucked into one part of its toolset and not be aware of other tools which may be very useful.

Incentivized

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

It's not an all encompassing solution like Google Analytics tries to be, but MixPanel offers much easier to use and understandable data insights. That's valuable when juggling many responsibilities as startup life demands, so a renewal would be easily justified.

Relativity easy to use. Once you get the hang of it, very easy to create dashboards for different use cases. I split my dashboards between customers or use cases

Incentivized

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

We have only ever had to use their support once, when we were setting up the account, but their responses were prompt and the solutions were well documented. The people who solved our issues were helpful, even to non-tech people.

Incentivized

Mixpanel has a great resource about their product, with videos on how to use it and real world examples from other companies on how they integrate Mixpanel into their business processes.

Again, somewhat annoying to be charged based on data points when many other analytics providers have one flat fee. Implementation was good, but I might have tracked a few more detailed points if I had the option.

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

• There was not really any other competitors for this specific use case that had a chance
• We used Google Analytics for some things but obviously, GA is anonymous data so not useful for product teams with users
• Other solutions out there seemed to be too expensive and this was the most recommended
• Heap seemed to be the best OTHER option but didn't take the time to evaluate

Incentivized

• CE has made efficient time use easy and fool-proof when it comes to learning the software
• Because it integrates with other Google programs there is a benefit to track with Google Analytics
• The learning curve can create initiate time investment that may go beyond what companies are willing to dedicate.

• We've been able to increase the funnel conversions of one of our new product funnels from a 1% conversion rate to a 5% conversion rate.
• We've been able to increase the CTR on another of our main product pages from ~3% to ~10% (so far)
• We've been able to segment out how users from different traffic sources behave, allowing us to eliminate thousands of dollars of wasteful spending on advertising campaigns that weren't working.

Incentivized