LaunchDarkly vs. VWO

Great for rolling out features slowly for beta testing in production. I would say it is less well suited for toggling features permanently for users as this requires more integration with our backend and billing systems that would be a lot of work to set up.

Incentivized

Our marketing team does a lot of creative testing around messaging and imagery. VWO is well suited for this type of testing and can yield great results if you define your conversion goals correctly. However, when we have tried to do more substantial/advanced changes through VWO (such as re-positioning content or modifying elements in a form), we have had some challenges and not been able to get the desired tests working correctly.

Incentivized

• Feature Flag Management: It's like magic. With a flip of a switch, you can manage feature rollouts to visitors or accounts across the web and mobile applications!
• Segmentation: Create a segment of visitors or accounts and then use that to target a feature flag rule. Really easy to use and saves so much time.
• Ease of Use: Seamless copy/paste functionality, really clear status indicators so you can find what is on and for whom.

Incentivized

• VWO has a strong support team willing to help provide answers to questions during the setup process. During setup, we had some questions regarding implementation across a significant number of sites and they were able to ease dev team concerns and provide detailed best practices to streamline integration.
• Some of the initial results of a few of the initial tests raised some questions internally. We setup a call and were able to quickly address the questions and find some opportunities to leverage moving forward.
• I discovered a bug within the UI that lead to some questions internally. I was able to report it and the problem was fixed rather quickly and their team followed up with a thank you for reporting it and to report the issue was now resolved.

Incentivized

• It would be nice to see a feature flag's settings against all environments at once.
• It would be to have a "array" type flag for related but different settings (eg, enableA and enableB could be enable: [a, b]).
• It would be nice have customizable columns on the Users page (eg, if I want to inject a new meta data).

Incentivized

• The heatmaps within A/B tests are overlayed on the live website. Unfortunately, these don't work properly when scrolling down the site.
• I am missing an overview of all my custom conversions. I can only see a list of frequently used goals while setting up an A/B test, which may or may not include all custom conversions.

Incentivized

It fits out business case

Incentivized

Visual Website Optimizer is a easy to use and powerful tool for testing web pages. We use it to test lead generation websites to increase the number of people that complete a form. Before we decided to go with Visual Website Optimizer we did research into other options and found Visual Website Optimizer to be one of the best.

It's very easy to create new feature flags and set them properly. It is more difficult to get LaunchDarkly integrated within a distributed system so that flags can be used. Especially on stateless servers where gating features by user is not easy. Overall though, it is very easy to get started and I like how simple it is to use.

Incentivized

Overall VWO is quite good with general user usability, and every person who has had to take up the mantle of using the tool itself has found it manageable. However there is definitely some room for improvement - again, perhaps this is particularly the case because we are running a large number of tests in a number of different languages (and markets, and countries!) which requires a lot of upkeep.

Incentivized

No issue with availability at all

Incentivized

I have not experienced an application error or unplanned outage with VWO.

Incentivized

From what I have seen, LaunchDarkly integrates well with your code and also services you might have in your tech ecosystem. We use Jenkins for automation and we were able to use it to build pipelines to automate the control of LaunchDarkly toggles in our code.

Incentivized

VWO doesn't appear to slow down our website at all, though some customers with adblockers like UBlock Origin have been known to not see entire pages if VWO is making changes to the page at a macro level (background, font, etc). This is rare though.

Incentivized

The overall support is very responsive

Incentivized

While their online document support is lacking a simple email to their support team will almost always get responded to the next day. It has however taken more than one email to explain the problem to the support team till they understood the problem. The solution I was given also only half fixed the problem the rest I figured out on my own.

Training was good, just limited to the onboarding process. They walked through all of the steps it takes to get started in VWO and each of the modules, along with giving us ideas for starting our first test. I feel like it could be better if there was a guided process within the VWO program to continue to educate you along the way, and a way to turn that off for experienced users.

Incentivized

Yes I do.

Incentivized

Overall, the implementation of VWO is straightforward. If you've got a straightforward way of deploying code to all of your test pages, either a good CMS or a TMS, then implementation should be a breeze. There is no tweaking to be done to the code itself, and once deployed it has the flexibility to cope with different VWO modules (tracking, conversion analysis, session analysis) without modification.

Incentivized

Rollout is another dedicated feature flag tool that can be used to manage features. LaunchDarkley offers all the features of an enterprise level tool, unlike Rollout, reserves the security features for the Enterprise plan. Out of box integrations are limited but they do have a well documented REST API.

Incentivized

VWO is by far the easiest tool to use among all experimentation tools. It is like the experimentation tool for dummies and works as well as the others. A highlight would be the reports on every test because compared to the others, in VWO is way much easier to understand the metrics and the test performance.

Incentivized

The platform didn't go down since we implemented it

Incentivized

The product seems infinitely scalable for our needs (small business) and we've never had any issue with loading VWO-edited elements. I will say, though, that online customers with ad blockers have been known to not see certain VWO elements as their third-party scripts are disabled.

Incentivized

• Improved developer experience with some teams moving to Trunk-based Development.
• Increased deployment frequency due to smaller code releases.
• Validation of the technical and business value of work is achieved more quickly through smaller pieces of work and through experimenting with a small group of users before a feature gets to 100% of customers.

Incentivized

• Our clients have seen significant increases in engagement and conversion rates through changes we recommended after using VWO to test our hypotheses.
• Our clients and internal teams have appreciated the level of granular detail available within the platform, as more information leads to more reliable optimization suggestions.

Incentivized