ConfigCat vs. Google Content Experiments (discontinued) vs. LaunchDarkly

If you are looking for an experimentation/feature flag style tool that is quick to adopt and provides enough functionality for light/medium use cases, then this is the tool for you. Additionally, they are growing and expanding their functionality and feature set so they can grow alongside you and your needs. The publicly accessible roadmap is also a great benefit to see where time is being spent on which feature next.

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.

Incentivized

If a new feature should be added but unsure of how it will actually work or how users will accept the new enhancement or change, this tool allows you test and measure initial results. This saves so much time and energy knowing the results before it is deployed and might have low user adoption or acceptance.

Incentivized

• Fast and easy feature toggling that gets developers developing
• World class support in both speed and quality for how to best use the service
• Great ear for customer needs and fast paced development

• Quick and easy to create and set up experiments
• Results are presented in a way that is familiar and easy for any Google Analytics user to understand. So is great for beginners to conversion testing
• Already integrated into Google Analytics and can measure results against your existing conversion goals
• Allows nine possible variants to be A/B tested
• Features more than one testing methodology, Bayesian (Multi-Armed Bandit,) and Full Factorial
• Allows the user to select one of three possible confidence thresholds to ensure that experiment results are robust
• Great value, it is free!

• A/B or Multi Variant Testing as a methodology to gather insight from customer usage. Experimentation as a feature within LaunchDarkly offers information around the success of one variant over another and whether the experiment has reached statistical significance.
• Being able to decouple deployment of code from the release of a feature is hugely valuable.
• Development teams are empowered to manage features within their production applications for reliability or testing purposes.

Incentivized

• No automatic push for flag changes - have to write our own webhooks
• No scheduling interface for flipping flags automatically on a schedule
• Interface is a bit cluttered for people who are just flipping flags

• Their documentation is not the best and it's quite a steep learning curve.
• They also don't tell you particularly well what sorts of things you should be testing.
• Compared to other suppliers of A/B testing tools- it needs a simpler interface. Optimize is starting to answer that - but is still quite Beta-like.

Incentivized

• Limited number of users on cheaper plans that is limiting our ability to audit log who is making changes.
• Some of our engineers are confused between flags and segments and have set up items incorrectly.
• Better documented support for React with Typescript.

Incentivized

ConfigCat has done the job, and has been great to work with.

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

It fits out business case

Incentivized

Just everything from the website to locating what i need (docs) specific to my platforms is super easy. Not to mention the support articles answering previous questions

It's very easy to create new feature flags and set them properly. It is more difficult to get LaunchDarkly integrated within a distributed system so that flags can be used. Especially on stateless servers where gating features by user is not easy. Overall though, it is very easy to get started and I like how simple it is to use.

Incentivized

No issue with availability at all

Incentivized

From what I have seen, LaunchDarkly integrates well with your code and also services you might have in your tech ecosystem. We use Jenkins for automation and we were able to use it to build pipelines to automate the control of LaunchDarkly toggles in our code.

Incentivized

They have a community Slack channel that is open to anyone. They always seem to have people in there, even over the weekends and are always happy to answer any questions you have,

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

The overall support is very responsive

Incentivized

Yes I do.

Incentivized

At iBinder we searched for and vetted several suppliers of a feature toggle service to handle feature toggling in our production environment. In addition to our functional requirements, it was crucial for us to find a partner that could deliver an EU-compliant service. We finally decided to sign a service agreement with ConfigCat. This has been a real success story for us – in addition to being compliant, ConfigCat delivers an amazing, flexible, and reliable service. They continue to impress by also being very transparent and having a fantastic support and they are very solution oriented and accommodating when it comes to our feature requests etc. We have now used ConfigCat for approximately 2 years and we give our warmest recommendations to anyone who needs a stable, reliable and EU-compliant feature toggle service.

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

LaunchDarkly stood out to us because it put control of the application within the hands of our engineers. We didn't want to allow business users to manipulate the production site via a third-party tool. Instead, our focus was on delivering faster as an engineering team.

Incentivized

The platform didn't go down since we implemented it

Incentivized

• Allowed us to migrate seamlessly from a major customer communication system to another, reducing end-user friction and production bugs by being able to turn features off if they didn't work as intended.
• We went from zero experimentation to running 10-20 experiments concurrently across systems. Engineering teams are thinking in an experimentation mindset.

• CE has made efficient time use easy and fool-proof when it comes to learning the software
• Because it integrates with other Google programs there is a benefit to track with Google Analytics
• The learning curve can create initiate time investment that may go beyond what companies are willing to dedicate.

• Improved developer experience with some teams moving to Trunk-based Development.
• Increased deployment frequency due to smaller code releases.
• Validation of the technical and business value of work is achieved more quickly through smaller pieces of work and through experimenting with a small group of users before a feature gets to 100% of customers.

Incentivized