Mixpanel vs. Optimizely Feature Experimentation

Mixpanel is a versatile platform that integrates features to connect every work team and get the best out of them in productivity and results. Moreover, it will improve the flow of information and interaction between all your company staff; it will unify and help promote collaboration between the different work areas. Without a doubt, I highly recommend this software

Incentivized

Based on my experience with Optimizely Feature Experimentation, I can highlight several scenarios where it excels and a few where it may be less suitable. Well-suited scenarios: - Multi-Channel product launches - Complex A/B testing and feature flag management - Gradual rollout and risk mitigation Less suited scenarios: - Simple A/B tests (their Web Experimentation product is probably better for that) - Non-technical team usage -

Incentivized

• Mixpanel's ease of use is easily their best feature, allowing you to quickly create graphs with a few point and clicks. Their UI is also fairly snappy and well-designed.
• Tying together events with user attributes allows you to properly segment users into cohorts which can then be tracked individually. Proper segmentation is where most analytics solutions earn their keep.
• Live view is a nice perk that gives you a good feel for who's on your site and what they're doing at any single point in time. This can be further filtered to focus on particular events of interest.
• Mixpanel has flexible plans that work for smaller startups as well.
• Their documentation is top notch.

Incentivized

• Splitting traffic between variants and enabling you to scale up or down the amount of traffic in each one
• Giving a standardised report that you can share with a huge number of users
• Showing a large variety of results/metrics you can then dive into

Incentivized

• I didn't use the engagement features at all but it seems like they could have a better WYSIWYG editor for the emails for non-technical people using Mixpanel.
• The custom reports feature seems to be really powerful but I wish they had more resources/templates for creating custom reports. I don't code so it was really hard for me to use this feature...BUT the reports I was able to get help with, were really powerful.
• I wanted a dashboard area for all of my reports in one view. It seems like they were implementing this when I was moving jobs. If it's not available yet, they definitely need to add a master dashboard page for arranging saved reports.

Incentivized

• Difficult integration if your data is not front end
• Costly MAU model needs to be based on experiments not on site visits
• It's not easy to understand how to build an Experiment
• Onboarding team is more focused on punching through their slides and not focused on your needs or understanding.

Incentivized

It's not an all encompassing solution like Google Analytics tries to be, but MixPanel offers much easier to use and understandable data insights. That's valuable when juggling many responsibilities as startup life demands, so a renewal would be easily justified.

Competitive landscape

Incentivized

Relativity easy to use. Once you get the hang of it, very easy to create dashboards for different use cases. I split my dashboards between customers or use cases

Incentivized

Easy to navigate the UI. Once you know how to use it, it is very easy to run experiments. And when the experiment is setup, the SDK code variables are generated and available for developers to use immediately so they can quickly build the experiment code

Incentivized

There is no support at all for free-plan users. There used to be a good support but something changed. If everything had gone great we could've considered upgrading but it is so bad that we'll look for an alternative once we finish the current project. Given that the documentation is very poor, there are some aspects in which customer support could have helped a lot, but with no support, we are left with some needs unfulfilled.

Support was there but it was pretty slow at most times. Only after escalation was support really given to our teams

Incentivized

Mixpanel has a great resource about their product, with videos on how to use it and real world examples from other companies on how they integrate Mixpanel into their business processes.

Mixpanel is a simple JS script installation. For adding events to track, its simply a matter of adding the code where you want it. Their API and documentation are easy to understand and use.

It’s straightforward. Docs are well written and I believe there must be a support. But we haven’t used it

Incentivized

Datanomix is an excellent tool, with similar characteristics; however, Mixpanel has been our preference for two main reasons: one, to have customization and to be able to adapt the interface and tools to our use, and two, to be able to count on reports that it automates the work of sales analysis and being able to evaluate progress.

Incentivized

In previous companies I've used Monetate which is a similar A/B testing kind of feature experimentation engine that is very similar from my memory, but again, back to the point of these new features of the analytics engine and Opal, it kind of cuts it above Monetate from my experience. Obviously Monetate may have improved since when I lost use it, but from what I can see, yeah.

Incentivized

had troubles with performance for SSR and the React SDK

Incentivized

• User event data has helped us improve our product, which has increased subscriptions.
• Being able to send helpful messages to some users who drop off after certain events has helped us reduce our churn.
• We have been able to identify the Monthly super-active users, understand their usage of our product, which we use to conduct focus groups to help us shape the product.

Incentivized

• We have improved various metrics throughout the course of our experimentation program with Optimizely and therefore sharing numbers is tricky. Essentially we only implement versions of the product that perform the best in terms of CVR, revenue/visitor, ATV, average order value, average basket size and so forth dependent on the north star we are trying to move with each release.

Incentivized