Convert Experiences is an experimentation platform that offers features and support to run A/B tests across multiple growth channels. Its enterprise-ready advanced features include full stack experimentation, multi-page testing, post-segmentation, sequential testing, targeting with 40+ filters, triggering tests based on data in other apps (data sources), dynamic triggers, complex goal tracking, and a secure API. It includes 90+ out-of-the box integrations in a…
$399
per month up to 100k tested users per month
LaunchDarkly
Score8.7 out of 10
N/A
LaunchDarkly provides a feature management platform that enables DevOps and Product teams to use feature flags at scale. This allows for greater collaboration among team members, and increased usability testing before full-scale feature deployment.
$12
per month
Pricing
Convert Experiences
LaunchDarkly
Editions & Modules
Growth
$399
per month 100k tested users per month
Pro
$5040
per year 1.5M tested users/year
Enterprise
Pricing available on request
From 1M tested users/mo (billed annually)
Foundation
$12
per month per Service Connection per month, or $10 per 1k client-side MAU per mo
Enterprise
Custom
Guardian
Custom
Offerings
Pricing Offerings
Convert Experiences
LaunchDarkly
Free Trial
Yes
Yes
Free/Freemium Version
No
No
Premium Consulting/Integration Services
No
Yes
Entry-level Setup Fee
No setup fee
Optional
Additional Details
1. Annual contract or monthly payments available
2. Pricing is not feature dependent. Some features like integrations, goals, Live Logs are necessary to test successfully. This is why Convert caps by unique tested users - basically visitors who have been bucketed to see a variation and are unique to that variation. As a result the app tested users are always </= the site's net traffic.
Discount available on the Foundation plan for annual pricing.
Definitely well suited for budget conscious companies that want a solid array of functionality but without having to pay an exorbitant amount. Great for marketing and analytics team members that need the ability to get in and set up tests w/o dev assistance. But, functionality is there for developers to get in and set up more complicated tests.
If a new feature should be added but unsure of how it will actually work or how users will accept the new enhancement or change, this tool allows you test and measure initial results. This saves so much time and energy knowing the results before it is deployed and might have low user adoption or acceptance.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info
Over the top powerful Javascript enabled targeting. This feature is called DMP Profiling and is available in the Pro Plan, currently only +$100 more than the plus plan. An article explaining this feature is here for further reading: https://convert.zendesk.com/hc/en-us/articles/206631623-Target-experiment-based-on-a-custom-Javascript-condition-that-evaluates-true-at-a-later-stage. I wrote up a much longer explanation but TR broke it up weirdly. The gist is that you can powerfully use JS to target. This allows me to target users in our SPA in incredibly advanced ways. I can walk their entire history model and assign them an audience value, or I can exclude them. It's MUCH more powerful than just a "Site Area" tool. We recently used it against 900K users to check if they had written a review of their apartment or not yet. This allowed me to only expose the user on the homepage to an experiment that prompted them to write a review while excluding users that couldn't write a review from the experiment (because they had already written one). The experiment converted 50% better than what we do now, generating 9k reviews in a matter of hours.
Audience targeting IN ADDITION to all that fancy DMP targeting. This means I can define demographics or other data as a qualifier AS WELL as the previously mentioned qualifier. This can be setup in so many ways: Traffic source, Visitor Data, Include / Exclude users part of a current experiment (!!), Date/Time, Device/Browser/OS, JS Conditon
Real-time reporting that makes sense to the whole company to view. Seriously, I can share a Convert Report to any level of intelligence on my team and they understand what's happening.
Audiences and Goals are saved as presets, so your entire team can use them. Using the example above, we have an audience called "Wrote a Review" that we exclude from the Review Prompt treatments.
Their customer support is seriously fast at answering questions. I've never had to wait more than a day.
A/B or Multi Variant Testing as a methodology to gather insight from customer usage. Experimentation as a feature within LaunchDarkly offers information around the success of one variant over another and whether the experiment has reached statistical significance.
Being able to decouple deployment of code from the release of a feature is hugely valuable.
Development teams are empowered to manage features within their production applications for reliability or testing purposes.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. TR verified that a representative sample of customers was invited. More Info
We are aggressive testers and have demanding clients, and if there was any part of the Convert platform where I'd like to see improvement, it would be in the reporting section where I feel a vertical report could present in a more readable fashion to the users.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. TR verified that a representative sample of customers was invited. More Info
To use the platform in the context of developing enhanced tests that stretch the platform there is as with most things a learning curve. However, if you're a casual user or have standard experiments that you wish to run you would be easily able to hit the ground running.
It's very easy to create new feature flags and set them properly. It is more difficult to get LaunchDarkly integrated within a distributed system so that flags can be used. Especially on stateless servers where gating features by user is not easy. Overall though, it is very easy to get started and I like how simple it is to use.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. TR verified that a representative sample of customers was invited. More Info
From what I have seen, LaunchDarkly integrates well with your code and also services you might have in your tech ecosystem. We use Jenkins for automation and we were able to use it to build pipelines to automate the control of LaunchDarkly toggles in our code.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. TR verified that a representative sample of customers was invited. More Info
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. TR verified that a representative sample of customers was invited. More Info
Convert was selected based on price point, feature set, and UI/UX. All three are very friendly to new testers and small to mid-market size companies. Their UI and tool workflow is the best out of all of the non-enterprise solutions that I have tried. There is some small room for improvement, but that only really affects power users or tests that require significant coding/development work to execute.
Have used a custom feature flag application created inhouse. All the basic functionality was same as the ones that LaunchDarkly provides. But as time progressed, it required more and more tracking capabilities like which user has turned on/off a feature flag, what are the statuses of different feature flags that are being used across the application etc., So, all and all maintenance of such tracking has become cumbersome.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. TR verified that a representative sample of customers was invited. More Info
Using Convert has allowed us to make quick decisions on site edits and price changes. Seeing and sharing quick results makes our operations much more profitable.
Connecting the tests with Shopify has produced very valuable and timely results that we can act upon as soon as we see statistically significant results.
Improved developer experience with some teams moving to Trunk-based Development.
Increased deployment frequency due to smaller code releases.
Validation of the technical and business value of work is achieved more quickly through smaller pieces of work and through experimenting with a small group of users before a feature gets to 100% of customers.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. TR verified that a representative sample of customers was invited. More Info
