Monetate - Digital Magic Tape!
Anonymous | TrustRadius Reviewer
December 20, 2018

Monetate - Digital Magic Tape!

Score 7 out of 10
Vetted Review
Verified User
Review Source

Modules Used

  • Test & Segment

Overall Satisfaction with Monetate

We use Monetate across the business to create tests to improve conversation rates on our retail site, deliver marketing promotions and personalise peoples website experiences. We also use it as a temporary fix for issues that go into the business in full development phase. It allows us to test development work quickly and turn it off if it doesn't work.
  • Relatively easy user interface to use. We have separated our Monetetate hub by site - very easy to use.
  • Building tests or experiences has a good builder addressing what you are building, where it is targeting, when the experience should run and why
  • The majority fit setting provides a good low risk way of determining if a fix is a 'winner' or not
  • A very helpful and extensive Knowledge Hub
  • Searching through all the experiences or tests you put online is reliant on a very robust naming convention
  • We would like an easier place for notes for each experience or test to be stored so that these are searchable. This allows things like project briefs to be summarised for the purpose of the wider team
  • It would be great if Monetate had an improved preview function to allow you to view an experience on the device and screen resolution of your choice. Currently, to fully test your experiences, you'll need a few browser apps which allows you to mimic devices, clear cookies...
  • A smarter way of building out variations for tests would be useful. Occasionally, a test that has a lot of different variables (but ultimately quite similar) will require you to setup multiple experiences to achieve this
  • We have run many a test which have demonstrated the financial benefit of a UX test. I cannot provide exact figures unfortunately, but we have been able to run tests that we can apply a financial value to.
  • Aside from financial benefits, all of our tests run on Monetate are designed to improve site performance. Reduced bounce rates, improved take up of offers, and increased website browsing rates are all things that have had a beneficial impact on our business.
  • The downside of Monetate is experiences that occasionally slow down the website. There are usually ways of developing an experience in a better way, but its important to keep this in mind.
A/B testing is the key strength of Monetate. It does this really well, without many issues. I am impressed by the depth of the metrics you are given from A/B tests. It guides you through the setup process pretty well. It's worth keeping in mind that the structure of your test needs to be well thought out to get the benefit from it. We have had numerous situations where you need to create multiple tests to represent what is one A/B test from our perspective.
Segmentation and targeting works well. We regularly have to upload separate datasets to target the users we want, but the process of uploading this data is reasonably straight forward. If you are uploading a lot of user data, the system does appear to hang even though the upload may have been completed. So this could be improved.
We really like Majority Fit - this is the only machine learning capability we have used. Ideally, it would be great if this could be built in a way where we can understand how long an experience should run for. The advice on the Knowledge Hub does not suggest an end point for Majority Fit experiences. This means that other than diverting traffic to a positive experience, we have no definitive way of knowing how long they should be online. Also, we can't assess the results of a Majority Fit experience, only that it was a success or a failure.
I can see that the analytics and reports are extremely detailed. I think it could do a better job in helping a user digest this information. It is very easy to get analytics paralysis! The system could perhaps do with a page which summarises the results of the experience in plain English for the non-technical or analytical being. This could perhaps form a print out that could be shared around our business.
It's quite difficult for me to assess integrations as I don't use this too much. Monetate connects with some other analytical tools we use (Google Analytics, Session Cam among others) - from my current experience, it hasn't been completely straight forward but I know it does work even if they are not completely issue free.
A simple A/B test is Monetate's bread and butter. Providing you have a developer with the technical ability to acheive what you want, you can easily manipulate page layouts, insert content , remove content to achieve a test.

Whilst the majority fit works well as a low risk way of showing that a test will work, it does not give you learning or insight as to why something does or does not work.