Mixpanel vs. Optimizely Feature Experimentation

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Mixpanel
Score 8.7 out of 10
N/A
Mixpanel helps companies measure what matters, make decisions fast, and build better products through data. With self-serve product analytics solution, teams can analyze how and why people engage, convert, and retain—in real-time, across devices—to improve their user experience. Mixpanel serves over 26,000 companies from different industries around the world, including Expedia, Uber, Ancestry, DocuSign, and Lemonade. Headquartered in San Francisco, Mixpanel has offices in New York,…
$0
per month
Optimizely Feature Experimentation
Score 7.5 out of 10
N/A
Optimizely Feature Experimentation combines experimentation, feature flagging and built for purpose collaboration features into one platform.N/A
Pricing
MixpanelOptimizely Feature Experimentation
Editions & Modules
Free
$0
per month
Growth
$17
per month
Enterprise
Contact sales
No answers on this topic
Offerings
Pricing Offerings
MixpanelOptimizely Feature Experimentation
Free Trial
NoNo
Free/Freemium Version
YesYes
Premium Consulting/Integration Services
NoYes
Entry-level Setup FeeNo setup feeRequired
Additional DetailsMixpanel uses MTU (Monthly Tracked User) pricing, which is designed to scale with your company. MTUs are roughly equivalent to the number of unique visitors on your product and each user is counted once per month, even if they use multiple devices. If Events based pricing makes more sense for your business, reach out to us and we can work with you!
More Pricing Information
Community Pulse
MixpanelOptimizely Feature Experimentation
Considered Both Products
Mixpanel

No answer on this topic

Optimizely Feature Experimentation
Chose Optimizely Feature Experimentation
We used Firebase remote config as well to try to test different behaviorus on the same screen, using boolean flags to determine which one to show, but it was too cumbersone and difficult so we pivoted to only use optimizely as it was much better suited for that,
Top Pros
Top Cons
Best Alternatives
MixpanelOptimizely Feature Experimentation
Small Businesses
Fullstory
Fullstory
Score 8.4 out of 10
Kameleoon
Kameleoon
Score 9.5 out of 10
Medium-sized Companies
Whatfix
Whatfix
Score 9.3 out of 10
Kameleoon
Kameleoon
Score 9.5 out of 10
Enterprises
Whatfix
Whatfix
Score 9.3 out of 10
Kameleoon
Kameleoon
Score 9.5 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
MixpanelOptimizely Feature Experimentation
Likelihood to Recommend
8.2
(49 ratings)
7.4
(21 ratings)
Likelihood to Renew
10.0
(13 ratings)
8.0
(1 ratings)
Usability
9.0
(1 ratings)
9.0
(1 ratings)
Support Rating
1.0
(8 ratings)
-
(0 ratings)
Online Training
8.0
(2 ratings)
-
(0 ratings)
Implementation Rating
8.9
(3 ratings)
10.0
(1 ratings)
Product Scalability
-
(0 ratings)
5.0
(1 ratings)
User Testimonials
MixpanelOptimizely Feature Experimentation
Likelihood to Recommend
Mixpanel
As a worker in the sales area, I see closely how complex it can be to evaluate the commercial funnel and Mixpanel has been an indispensable guide to prioritize above all what customers expect to receive from our company, and thus be able to determine the main service we offer. Without a doubt, Mixpanel has special functions to be the one that guides the route and marks the objectives much more clearly.
Read full review
Optimizely
Optimizely Feature Experimentation works really well for setting up feature flags with an easy UI for turning them on and off or ramping up a gradual rollout. It also works really well to set up split tests where you can split your traffic by percentage as well as almost any custom data attribute you wish to define. This is more for robust features and less for visual changes - Optimzely Edge or Web are better suited for that.
Read full review
Pros
Mixpanel
  • Mixpanel is a daily use application for everyone in my organization; it helps us have a better flow of information and interaction between work teams.
  • The user interface of this platform is simple and has a wide variety of functions and resources to help us work in the most organized way, have better team coordination, and keep efficiency high.
  • I love that it is so easy to program our calendar to our liking, so we can prioritize our activities and know what is pending, and the best thing is that I can update the calendar if necessary.
  • The chat function is great to improve the interaction between colleagues and share work schedules and any information with third parties.
Read full review
Optimizely
  • Its ability to run A/B tests and multivariate experiments simultaneously allows us to identify the best-performing options quickly.
  • Optimizely blends into our analytics tools, giving us immediate feedback on how our experiments are performing. This tool helps us avoid interruptions. With this pairing, we can arrive at informed decisions quickly.
  • Additionally, feature toggles enable us to introduce new features or modifications to specific user groups, guaranteeing a smooth and controlled user experience. This tool helps us avoid interruptions.
Read full review
Cons
Mixpanel
  • Mixpanel requires an explicit setting of events from your app. This means you need to be very thoughtful in the design of your events because missing one means you aren't collecting any data from it. Inserting it into the process later on then brings challenges in tracking when certain events came online.
  • A tool like Mixpanel comes packed with features that sometimes are harder to discover. It's very easy to get sucked into one part of its toolset and not be aware of other tools which may be very useful.
Read full review
Optimizely
  • Splitting feature flags from actual experiments is slightly clunky and can be done either as part of the same page or better still you can create a flag on the spot while starting an experiment and not always needing to start with a flag.
  • Recommending metrics to track based on description using AI
Read full review
Likelihood to Renew
Mixpanel
It's not an all encompassing solution like Google Analytics tries to be, but MixPanel offers much easier to use and understandable data insights. That's valuable when juggling many responsibilities as startup life demands, so a renewal would be easily justified.
Read full review
Optimizely
No answers on this topic
Usability
Mixpanel
great, slick and clean interface
Read full review
Optimizely
All features that we used were pretty clear. They have a good documentation
Read full review
Support Rating
Mixpanel
We have only ever had to use their support once, when we were setting up the account, but their responses were prompt and the solutions were well documented. The people who solved our issues were helpful, even to non-tech people.
Read full review
Optimizely
No answers on this topic
Online Training
Mixpanel
Mixpanel has a great resource about their product, with videos on how to use it and real world examples from other companies on how they integrate Mixpanel into their business processes.
Read full review
Optimizely
No answers on this topic
Implementation Rating
Mixpanel
Again, somewhat annoying to be charged based on data points when many other analytics providers have one flat fee. Implementation was good, but I might have tracked a few more detailed points if I had the option.
Read full review
Optimizely
It’s straightforward. Docs are well written and I believe there must be a support. But we haven’t used it
Read full review
Alternatives Considered
Mixpanel
  • There was not really any other competitors for this specific use case that had a chance
  • We used Google Analytics for some things but obviously, GA is anonymous data so not useful for product teams with users
  • Other solutions out there seemed to be too expensive and this was the most recommended
  • Heap seemed to be the best OTHER option but didn't take the time to evaluate
Read full review
Optimizely
Optimizely Feature Experimentation is better for building more complex experiments than Optimizely Web. However, Optimizely Web is much easier to kickstart your experimentation program with as the learning curve is much lower, and dedicated developer resources are not always necessary (marketers can build experiments quickly with Optimizely Web without developers' help).
Read full review
Scalability
Mixpanel
No answers on this topic
Optimizely
had troubles with performance for SSR and the React SDK
Read full review
Return on Investment
Mixpanel
  • We've been able to increase the funnel conversions of one of our new product funnels from a 1% conversion rate to a 5% conversion rate.
  • We've been able to increase the CTR on another of our main product pages from ~3% to ~10% (so far)
  • We've been able to segment out how users from different traffic sources behave, allowing us to eliminate thousands of dollars of wasteful spending on advertising campaigns that weren't working.
Read full review
Optimizely
  • Experimentation is key to figuring out the impact of changes made on-site.
  • Experimentation is very helpful with pricing tests and other backend tests.
  • Before running an experiment, many factors need to be evaluated, such as conflicting experiments, audience, user profile service, etc. This requires a considerable amount of time.
Read full review
ScreenShots

Mixpanel Screenshots

Screenshot of Mixpanel's Insights report enables you to see how often users perform meaningful actions, monitor growth of key user cohorts, like power users, and slice and dice trends by any attribute.Screenshot of Mixpanel's powerful Flows report enables you to identify top user paths to see where people get stuck, and discover actions users take before, after, or between key events.Screenshot of Mixpanel's Retention report helps you understand how often users return and visualize feature stickiness. You can also slice and dice retention data to identify user groups that retain best and to find out what causes churn.

Optimizely Feature Experimentation Screenshots

Screenshot of AI Variable suggestions: AI helps to develop higher quality experiments. Optimizely’s Opal suggests content variations in experiments, and helps to increase test velocity  and improve experiment qualityScreenshot of Integrations: display of the available integrations in-app.Screenshot of Reporting used to share insights, quantify experimentation program performance using KPIs like velocity and conclusive rate across experimentation projects, and to drill down into the charts and figures to see an aggregate list of experiments. Results can be exported into a CSV or Excel file, and KPIs can be segmented using project filters, experiment type filters, and date rangesScreenshot of Collaboration: Centralizes tracking tasks in the design, build, and launch of an experiment to ensure experiments are launched on time . Includes calendar, timeline, and board views in customizable views that can be saved to share with other stakeholdersScreenshot of Scheduling: Users can schedule a Flag or Rule to toggle on/off,  traffic allocation percentages, and achieve faster experimentation velocity and smoother progressive rolloutsScreenshot of Metrics filtering: Dynamic event properties to filter through events. Dynamic events provide better insights for experimenters who can explore metrics in depth for more impactful decisions