Adobe Target vs. Statsig

We recommend this application because it allows us to segment and track the traffic of our domain under an analysis of their behavior, ranging from counting the number of clicks they make on a single element to the most complete action within our page in real time.

Incentivized

Statsig is well suited for running straightforward a/b tests on frontend deployments. We've actually used it to log events on our backend and used the HTTP API to integrate with tools like Hubspot to evaluate email campaigns

Incentivized

• Because the software is established there is lots of online help available and most of the bugs have been worked out
• Adobe has a vast supply of resources if your pockets are deep enough.
• The dashboard is easy to follow and is getting more user-friendly. You no longer have to be an HTML wizard to implement changes.

Incentivized

• Clear experimentation insights and details
• Experimentation health and performance ratings
• Statistical analysis of in flight work

Incentivized

• There should be some more clarity around what makes a test significant. While this can be decided by the client themselves, some direction from the tool would be helpful.
• Also, if there was an easier way to organize campaigns and search for them it would be helpful. Right now there is just a long list of campaigns and you have to rely on search to find a specific campaign. What if you don't know the name of the test?

• Complex data science focussed UI

Incentivized

Once you get started with your testing program, you realize that it is necessary to continue. You must keep optimizing in order to remain a vital competitor in today's marketing world. Even if you're not using Test & Target or any other user experience testing software, you ought to be performing comparison tests on your own, simply by routing your audience to different experiences and quantifying the aggregate of the results.

The recent UI update is a complete mess. It is difficult to navigate and find features that previously existed. The reactiveness of the page depending on window size is also ridiculous and it is absurd that depending on how large your window is, entire columns of functions will disappear with no indication that they are missing. The usability of the tool has fallen off a cliff.

Incentivized

For the most part it is pretty easy to use. - There are some quirks with the javascript SDK (getExperiment().getValue?). - The Events vs. Metrics design pattern is complex, and creating new Metrics from Events can be frustrating if you are trying to use event metadata - It's really frustrating not to be able to link Static IDs (before a user signs up) to User IDs, in order to follow users all the way through onboarding, or to log events that occur for signed in users when you are exposing the experiment to users before they've signed up

Incentivized

i don't think we use the full functionalities of the tool, but to use the full functions, it's almost impossible (Too hard)

The bottleneck is never the software program

On several occasions, we have had the need to ask for help from the Adobe Target support team, and I must say that they have provided us with an excellent experience, as they take care of solving the problems quickly and with high precision

Incentivized

The instructor that came to train us was awesome and this training was very useful. I would recommend it for anyone who is going to be using this software. I only mark it lower because it is an added expense to an already expensive product, and a lot of the training covered the "Target" portion of the software (which again, we didn't use)

The training was very easy to understand, however it would have been more useful to my development team than me. It was also primarily over-the-phone, which is never as easy to follow as in-person. We ended up scheduling and paying for an in-person training session to supplement the online/phone training because it wasn't helpful enough.

Implement using a global mBox on the page so you can change any and everything over the traditional method. Traditional method is good if you do not have technical web dev resources, do not know Javascript/jQuery, or you have money to blow on mBox calls. Global deployment reduces mBox calls and allows you to touch many parts of the page easily. A lot more customizable

For us, the decision was very straightforward. We chose to invest in the Adobe stack and utilize tools that are developed to integrate together and complement each other. Ex: Adobe Target 'A4T' integration within Adobe Analytics. Optimizely appears to be a great tool, but for us aligning with the Adobe suite, ensuring that future product enhancements and tools would work well together was a very important key factor in our decision

Incentivized

Incentivized

• This is something we've been working to improve on, as far as how we're calculating and tracking this, but Target has had a substantial ROI on our business.
• I will say specific to our efforts, we could have probably done similar work if not the same work using a different testing tool (Optimizely for example), but Target has been good for us.

Incentivized

• We uncovered several feature releases that were causing a negative impact on our product activation rate by running exclusion experiments

Incentivized