Amplitude Analytics vs. Google Content Experiments (discontinued) vs. Mixpanel

Amplitude Analytics is an excellent solution for anyone with a mobile app and you want to track what users are doing, are they completing conversion steps, and are they coming back more often. This all helps you visual your customer bases engagement and help project future engagement and create goals. This also helps with prioritizing products to address drop-off points in the product to increase conversions.

Incentivized

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.

Incentivized

As a worker in the sales area, I see closely how complex it can be to evaluate the commercial funnel and Mixpanel has been an indispensable guide to prioritize above all what customers expect to receive from our company, and thus be able to determine the main service we offer. Without a doubt, Mixpanel has special functions to be the one that guides the route and marks the objectives much more clearly.

Incentivized

• Feature analytics - measuring frequency of usage
• Time taken by users to convert in funnels
• Actions that drive certain user behaviors in funnels via correlation
• Actions that lead to user drop off in funnels via correlation
• Comparing behavior of two custom user cohorts

Incentivized

• Quick and easy to create and set up experiments
• Results are presented in a way that is familiar and easy for any Google Analytics user to understand. So is great for beginners to conversion testing
• Already integrated into Google Analytics and can measure results against your existing conversion goals
• Allows nine possible variants to be A/B tested
• Features more than one testing methodology, Bayesian (Multi-Armed Bandit,) and Full Factorial
• Allows the user to select one of three possible confidence thresholds to ensure that experiment results are robust
• Great value, it is free!

• Mixpanel is a daily use application for everyone in my organization; it helps us have a better flow of information and interaction between work teams.
• The user interface of this platform is simple and has a wide variety of functions and resources to help us work in the most organized way, have better team coordination, and keep efficiency high.
• I love that it is so easy to program our calendar to our liking, so we can prioritize our activities and know what is pending, and the best thing is that I can update the calendar if necessary.
• The chat function is great to improve the interaction between colleagues and share work schedules and any information with third parties.

Incentivized

• Some offerings seem duplicative, like dashboards and notebooks, which only seem to differ in that one can subscribe to dashboards
• The messaging on valid vs invalid property types could be better explained to clarify which types (string, Boolean, integer, etc) are expected in particular scenarios. Though the type is usually set during event creation, we've often seen examples where the data received in production is different, leading to 'invalid type' errors

Incentivized

• Their documentation is not the best and it's quite a steep learning curve.
• They also don't tell you particularly well what sorts of things you should be testing.
• Compared to other suppliers of A/B testing tools- it needs a simpler interface. Optimize is starting to answer that - but is still quite Beta-like.

Incentivized

• Mixpanel requires an explicit setting of events from your app. This means you need to be very thoughtful in the design of your events because missing one means you aren't collecting any data from it. Inserting it into the process later on then brings challenges in tracking when certain events came online.
• A tool like Mixpanel comes packed with features that sometimes are harder to discover. It's very easy to get sucked into one part of its toolset and not be aware of other tools which may be very useful.

Incentivized

Great product Good value for the cost/initiate Support docs and FAQs are great - they limit the necessity of reaching out to in-person support. So when you do call them ... it is for a legit question/issue, no just a "where is it" or a "how to I do xyz123?"

Incentivized

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

It's not an all encompassing solution like Google Analytics tries to be, but MixPanel offers much easier to use and understandable data insights. That's valuable when juggling many responsibilities as startup life demands, so a renewal would be easily justified.

It's a fairly straightforward platform that's beginner friendly. The biggest usability hurdle is most often created by your own team, as it's imperative to know what event sources are being sent to Amplitude and what those event names are. Within being properly onboarded by a team member it can be hard to get started using Amplitude. It takes time to understand what data your company may be sending to the product, the naming conventions of events (especially if there are old or deprecated events names

Incentivized

Relativity easy to use. Once you get the hang of it, very easy to create dashboards for different use cases. I split my dashboards between customers or use cases

Incentivized

Alway up and running, or if there is a problem we can get back in the game right away. The reliability was a big selling point for me, and it was true when this company got it. Rollouts can be tough, but this was pretty seamless. Good support throughout the process, good documentation to handle questions/tips

Incentivized

No issues, problems, or negative remarks from us!! We had a plan, vendor support was rock solid, our data folks have experience, OCM supported as needed, and we got the rollout done on time, on budget, and with only minor hiccups. SInce the rollout, most of us have already forgotten the hiccups and generally speak highly of the product

Incentivized

I haven't used the Amplitude support other than their training docs so I can't speak too much to the in-person support but the docs are serviceable. Nothing too crazy but between the user tips, email notifications, and the decent number of docs I was able to get the support I needed to ramp up on the tool.

Incentivized

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

We have only ever had to use their support once, when we were setting up the account, but their responses were prompt and the solutions were well documented. The people who solved our issues were helpful, even to non-tech people.

Incentivized

Virtual Not bad considering the timeframe and turnaround. The biggest benefit was for my end-users to hear a voice (other than mine/ours! LOL) telling them about the new features and capabilities. The in-person training was really good for having an expert that knows the answers and could refer to past experiences, problems, solutions. THey were a great resource to ease the transition ... basically a "you are gonna be okay with this change ... you got this etc.!" kinda vibe

Incentivized

Good enough to get strong baseline. I always make sure our our users go to and/or focus on the vebndor-provided support docs rather than any formal training. Our instructors come and go, but written policy and how-to docs live much longer in a corporate setting. That said, the online training is sufficient. I like that the training curric is stacked and progressive.

Incentivized

Mixpanel has a great resource about their product, with videos on how to use it and real world examples from other companies on how they integrate Mixpanel into their business processes.

My team members all have background as data analysts, so Amp was pretty easy to for them. There was sufficient online training available. We also used the available support documents. The actual rollout went well. We did significant testing beforehand. We did a phased rollout, with partial silent rollout (part of OCM's plan) for the smallest line of business. THe silent one was "silent" b/c it was done without fanfare or public notices ... it was just a "we're doing some things, it wont impact your work or workday

Incentivized

Again, somewhat annoying to be charged based on data points when many other analytics providers have one flat fee. Implementation was good, but I might have tracked a few more detailed points if I had the option.

Amplitude Analytics provides much more granular data than Google Analytics and gives you much more flexibility in how you can segment and splice the data. It also provides the ability to create closed funnels, which I have yet to find out how to do in Google Analytics. Amplitude has a very similar interface to Mixpanel, with a few handy additions, like the ability to name and categorize your events.

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

• There was not really any other competitors for this specific use case that had a chance
• We used Google Analytics for some things but obviously, GA is anonymous data so not useful for product teams with users
• Other solutions out there seemed to be too expensive and this was the most recommended
• Heap seemed to be the best OTHER option but didn't take the time to evaluate

Incentivized

It is a good product. You have to pay for quality ... kinda like buying a Lexus or a Toyota instead of a Buick or a Chevy

Incentivized

Like all the other grades, it was mostly an easy implementation ... we have experience people, the rollout in general is well planned, and the vendor was very supportive

Incentivized

• It collects data of great importance which allows to make product improvements.
• It easily identifies problems a user may have with the product.
• The flow of users who have used the product has improved, thus being able to generate more income thanks to the improvements and new functions.

Incentivized

• CE has made efficient time use easy and fool-proof when it comes to learning the software
• Because it integrates with other Google programs there is a benefit to track with Google Analytics
• The learning curve can create initiate time investment that may go beyond what companies are willing to dedicate.

• We've been able to increase the funnel conversions of one of our new product funnels from a 1% conversion rate to a 5% conversion rate.
• We've been able to increase the CTR on another of our main product pages from ~3% to ~10% (so far)
• We've been able to segment out how users from different traffic sources behave, allowing us to eliminate thousands of dollars of wasteful spending on advertising campaigns that weren't working.

Incentivized