Amplitude Analytics is an analytics platform for mobile and web. It is designed to help organizations segment users and analyze funnels,
retention and revenue. Amplitude Analytics helps you achieve actionable insights from customer digital journeys and uses behavioral graphs to build customer-focused products. Amplitude also optimizes digital products for increased quality engagements, increased conversion rates, and long-term customer loyalty.
$59
per month
Optimizely Feature Experimentation
Score 7.8 out of 10
N/A
Optimizely Feature Experimentation unites feature flagging, A/B testing, and built-in collaboration—so marketers can release, experiment, and optimize with confidence in one platform.
We selected Optimizely as it was easy to use/understand, had clearly defined SLAs for keeping the platform up and was regarded as resilient within the industry. We needed something at our point in our experimentation journey that could be used for Product testing at scale and …
Optimizely Feature Experimentation has similar features to Amplitude. As a matter of fact it looks like Amplitude copied Optimizely. However, Amplitude did not mimic the nomenclature issues.
Optimizely offered both web experimentation (WSYWIG editor for nontechnical marketing folks) and Feature Experimentation. That made the decision easier to get max value across different stakeholder groups.
Overall, Optimizely Feature Experimentation is an industry leader in terms of experimentation across web and mobile. For apps I would say amplitude does slightly a better job as it is tailored to that niche.
Amplitude Analytics is an excellent solution for anyone with a mobile app and you want to track what users are doing, are they completing conversion steps, and are they coming back more often. This all helps you visual your customer bases engagement and help project future engagement and create goals. This also helps with prioritizing products to address drop-off points in the product to increase conversions.
Based on my experience with Optimizely Feature Experimentation, I can highlight several scenarios where it excels and a few where it may be less suitable. Well-suited scenarios: - Multi-Channel product launches - Complex A/B testing and feature flag management - Gradual rollout and risk mitigation Less suited scenarios: - Simple A/B tests (their Web Experimentation product is probably better for that) - Non-technical team usage -
Some offerings seem duplicative, like dashboards and notebooks, which only seem to differ in that one can subscribe to dashboards
The messaging on valid vs invalid property types could be better explained to clarify which types (string, Boolean, integer, etc) are expected in particular scenarios. Though the type is usually set during event creation, we've often seen examples where the data received in production is different, leading to 'invalid type' errors
Great product Good value for the cost/initiate Support docs and FAQs are great - they limit the necessity of reaching out to in-person support. So when you do call them ... it is for a legit question/issue, no just a "where is it" or a "how to I do xyz123?"
It's a fairly straightforward platform that's beginner friendly. The biggest usability hurdle is most often created by your own team, as it's imperative to know what event sources are being sent to Amplitude and what those event names are. Within being properly onboarded by a team member it can be hard to get started using Amplitude. It takes time to understand what data your company may be sending to the product, the naming conventions of events (especially if there are old or deprecated events names
Easy to navigate the UI. Once you know how to use it, it is very easy to run experiments. And when the experiment is setup, the SDK code variables are generated and available for developers to use immediately so they can quickly build the experiment code
Alway up and running, or if there is a problem we can get back in the game right away. The reliability was a big selling point for me, and it was true when this company got it. Rollouts can be tough, but this was pretty seamless. Good support throughout the process, good documentation to handle questions/tips
No issues, problems, or negative remarks from us!! We had a plan, vendor support was rock solid, our data folks have experience, OCM supported as needed, and we got the rollout done on time, on budget, and with only minor hiccups. SInce the rollout, most of us have already forgotten the hiccups and generally speak highly of the product
I haven't used the Amplitude support other than their training docs so I can't speak too much to the in-person support but the docs are serviceable. Nothing too crazy but between the user tips, email notifications, and the decent number of docs I was able to get the support I needed to ramp up on the tool.
Virtual Not bad considering the timeframe and turnaround. The biggest benefit was for my end-users to hear a voice (other than mine/ours! LOL) telling them about the new features and capabilities. The in-person training was really good for having an expert that knows the answers and could refer to past experiences, problems, solutions. THey were a great resource to ease the transition ... basically a "you are gonna be okay with this change ... you got this etc.!" kinda vibe
Good enough to get strong baseline. I always make sure our our users go to and/or focus on the vebndor-provided support docs rather than any formal training. Our instructors come and go, but written policy and how-to docs live much longer in a corporate setting. That said, the online training is sufficient. I like that the training curric is stacked and progressive.
My team members all have background as data analysts, so Amp was pretty easy to for them. There was sufficient online training available. We also used the available support documents. The actual rollout went well. We did significant testing beforehand. We did a phased rollout, with partial silent rollout (part of OCM's plan) for the smallest line of business. THe silent one was "silent" b/c it was done without fanfare or public notices ... it was just a "we're doing some things, it wont impact your work or workday
Amplitude Analytics provides much more granular data than Google Analytics and gives you much more flexibility in how you can segment and splice the data. It also provides the ability to create closed funnels, which I have yet to find out how to do in Google Analytics. Amplitude has a very similar interface to Mixpanel, with a few handy additions, like the ability to name and categorize your events.
When Google Optimize goes off we searched for a tool where you can be sure to get a good GA4 implementation and easy to use for IT team and product team. Optimizely Feature Experimentation seems to have a good balance between pricing and capabilities. If you are searching for an experimentation tool and personalization all in one... then maybe these comparison change and Optimizely turns to expensive. In the same way... if you want a server side solution. For us, it will be a challenge in the following years
Like all the other grades, it was mostly an easy implementation ... we have experience people, the rollout in general is well planned, and the vendor was very supportive
We have improved various metrics throughout the course of our experimentation program with Optimizely and therefore sharing numbers is tricky. Essentially we only implement versions of the product that perform the best in terms of CVR, revenue/visitor, ATV, average order value, average basket size and so forth dependent on the north star we are trying to move with each release.
