Google Content Experiments (discontinued) vs. Webtrends Optimize

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.

Incentivized

Independently Invited by TrustRadius

A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info

Webtrends optimize is a marketing solution aimed squarely at transactional and eCom based websites. I would only recommend a colleague to engage with the solution once the marketing dept is at a point where their website is fully optimized in regards to SEO and all the other fundamentals in order to truly build upon what Webtrends can offer. This shows you an easier way of measuring your ROI and the money you will invest with the tool-moving forward.

Incentivized

Independently Invited by TrustRadius

A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info

• Quick and easy to create and set up experiments
• Results are presented in a way that is familiar and easy for any Google Analytics user to understand. So is great for beginners to conversion testing
• Already integrated into Google Analytics and can measure results against your existing conversion goals
• Allows nine possible variants to be A/B tested
• Features more than one testing methodology, Bayesian (Multi-Armed Bandit,) and Full Factorial
• Allows the user to select one of three possible confidence thresholds to ensure that experiment results are robust
• Great value, it is free!

• Intuitive test set-up makes for a low learning curve.
• Ability to create custom data tables which enable exporting of visitor level data for more in-depth analysis outside of the Webtrends Optimize platform.
• Visual Editor WYSIWYG interface enables non-technical users to easily execute basic tests.

• Their documentation is not the best and it's quite a steep learning curve.
• They also don't tell you particularly well what sorts of things you should be testing.
• Compared to other suppliers of A/B testing tools- it needs a simpler interface. Optimize is starting to answer that - but is still quite Beta-like.

Incentivized

Independently Invited by TrustRadius

A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info

• The cost is a factor. When you're trying to save money, particularly as a startup (a lot of our clients are up-and-comers) it has to be seen as an investment...but the cost to implement the system is fairly large.
• There's a bit of a steep learning curve, you can't just dive into the program.
• It's not impossible but it's not as easy as snapping your fingers to easily implement the program cross-platform.

Incentivized

Independently Invited by TrustRadius

A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

Difficulty was getting business units to take the time and spend the money to test, and then implement, best options.

Set up of basic tests that do not use segmentation or targeting is an intuitive experience that can be learned quickly by new users. However, as the need for segmentation and other more advanced capabilities arise, the experience begins to degrade.

zero complaints. I'm not aware of it ever failing.

Zero complaints. It seemed to do its job quickly and accurately.

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

Independently Invited by TrustRadius

A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info

The support from the team at Webtrends Optimize is unparalleled. There is always someone to consult should there be any issues.

Online training was ok. Because every test is a custom test, there's only so much that can be covered in a generic lesson.

Implementation was pretty straightforward

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

Independently Invited by TrustRadius

A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info

Webtrends Optimize can be used for much more complex tests, allows better conversion tracking and data collection. Visual Website Optimizer (VWO) is suitable for smaller, simple projects. Webtrends Optimize comes with an excellent consultancy that could save you a lot of time and resources

• CE has made efficient time use easy and fool-proof when it comes to learning the software
• Because it integrates with other Google programs there is a benefit to track with Google Analytics
• The learning curve can create initiate time investment that may go beyond what companies are willing to dedicate.

• So far we haven't seen an ROI that we can accurately measure due to only running a couple of tests that haven't resulted in direct, site wide changes. However, we have learnt a lot about how to set up the right processes and documentation.