Easy to use for starting an A/B testing program
July 25, 2017

Easy to use for starting an A/B testing program

Anonymous | TrustRadius Reviewer
Score 9 out of 10
Vetted Review
Verified User

Modules Used

  • Test & Segment
  • Product Recommendations
  • Product Badging
  • Open-Time Email

Overall Satisfaction with Kibo Personalization (Monetate + Certona)

It's used by one department to A/B test the website in order to optimize the customer experience and conversion rate.
  • Easy to use with out knowledge of coding
  • Easy to make your own actions using the action builder
  • Easy to target specific segments, and good account services
  • Production could be faster, and more thorough QA before handing over a monetate-built experience. Or, if it is mostly in miscommunication between client and technical, a tutorial or briefing template to ensure higher first-time success rate.
  • An account strategist or consultant that can recommend optimizations or tests to run on a quarterly basis based on what is trending or working well with other clients.
  • A mobile emulator would dramatically help in building mobile friendly actions - currently have to rely on a third party emulator. Or make a version of the website that is mobile friendly in order to build and preview actions on phone.
  • Increases conversion rate on the website through optimization, focusing on the lower half of the funnel
It is great for simple testing such as banner replacement etc., but unable to handle larger tests such as changing the navigation. We end up needing to hire another agency to run those tests. It also does not make it easy to set up tests for mobile, which is increasingly more important than desktop.
It is hard to preview or verify some of the tests, especially if it is outside the home country, or it requires caching on the site. Additionally, using the IP filter for my office wide IP does not execute well, sometimes working to target my IP, and sometimes not.
It is not clear how to use this, even after some light training.
Analytics needs to be more flexible to include more custom metrics, as well as ability to link to other platforms such as GA for fuller reporting and assessment.
A/B testing topical changes to the website is very easy, however, it doesn't execute as well on slower internet connections. The analytics could be improved in terms of action tracking as well as selecting time frames for metric results, and sometimes changing the time frame change whether the test reaches significance, but it's not clear why that is the case when I have downloaded the raw data results.