Monetate vs. Optimizely Web Experimentation

Monetate is a fully functional space to generate multiple marketing campaigns for your company on the web, many of the functions found in this program are a contribution to manage your content correctly and give it the space you are looking for, we We recommend it one hundred percent. We feel very comfortable with everything we have been able to achieve thanks to this program.

Incentivized

This is our second testing platform, and is by far the best we have leveraged. Its intuitive in how you are able to build tests. Tracking is easy to set up within the visual editor or as a capability in URL tracking. The reporting tab does need more filtering capabilities for custom metrics.

Incentivized

• Audience segmentation is relatively painless. They provide a robust way to granularly target visitors by device type, location, weather, demographics, etc.
• Our CSM has been very engaged and detailed in supporting our partnership. She provides very prompt responses and clearly works hard to push the Kibo team when possible.
• The User Interface to develop new actions is not terrible.
• Supports Single Sign On, which is the preferred method of managing users at my organization.

Incentivized

• Considers every kind of experiment from simple code change, code additions, code removal, javascript functions, CSS changes, and split landing redirects.
• Very friendly UC interface for easy navigation of implementation of pages, click events, experiment set up, and metric set up.
• The ability to let me know when something has reach stat sig without having to do complicated math on my own
• ability to carry UTM parameters through landing page redirects with a click of a button.

Incentivized

• We'd like to be able to use the Monetate resources to help us set up tests that require web dev (to get it out of our backlog), but they also have wait times similar to our internal ones. I realize resources are hard to come by, but this is an area we'd love to be able to utilize more if the turnaround were quicker.
• IE is always a problem. I know it's not Monetate-specific though, and many tools struggle with IE.
• We have a large percentage of our users who use IE, and I'd like to provide more experiences in IE without and additional hassle.

Incentivized

• Hard to use extensions without some knowledge of HTML/CSS
• Inconsistent user counts between GA & Optimizely when it comes to calculating MAUs, hard to be able to forecast budget and overages when our source of truth (GA) differs from our testing platform (Optimizely)
• Impressions model doesn't support scaling personalization experiences - hard to run a serious data driven testing program when you have to cut tests short before 14 days (ideal length to get to any statistical read) in order to save on impressions

Incentivized

I had never worked within a company that had a tool like this. It made my life as a designer and a creative manager much easier with it's easy to use interface and limitless possibilities in terms of creative. I would highly recommend taking Monetate for a test drive, you will not be disappointed.

Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.

Part of what I love about Monetate is how intuitive the tool is. Very very easy to use - based on the basics - Who/What/When/Where concept. Anyone can jump right in and start using the tool. And very easy to copy campaigns and tweak to continue to build experiences. We recently added Monetate on mobile and similar experience - easy to jump back and forth between platforms. Also love the analytics dashboard...easily quantifiable and easy to get tidbits that are digestible for others not as familiar with tool.

Usability is mostly great. I like the WYSIWYG functionality and adding in real code is simple as well. It's easy to target specific pages or audiences. I've knocked a couple of points off because of how difficult it is to set up URL redirect experiments, confusion around creating pages, and lack of data that can be further analyzed.

Incentivized

I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

Monetate support team meets with use weekly, answers emails daily and promptly. They are proactive about getting answers for us when we need it and offering suggestions based on observations they have or learnings they want to share from other partners. Monetate's support is top notch.

They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.

The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).

Monetate installs easily and sets up personalization with just a few clicks. We never used the recommendation engine but the multivariant testing was great.

Incentivized

In retrospect: - I think I should have stressed more demo's / workshopping with the Optimizely team at the start. I felt too confident during demo stages, and when came time to actually start, I was a bit lost. (The answer is likely I should have had them on-hand for our first install.. they offered but I thought I was OK.) - Really getting an understanding / asking them prior to install of how to make it really work for checkout pages / one that uses dynamic content or user interaction to determine what the UI does. Could have saved some time by addressing this at the beginning, as some things we needed to create on our site for Optimizely to "use" as a trigger for the variation test. - Having a number of planned/hoped-for tests already in-hand before working with Optimizely team. Sharing those thoughts with them would likely have started conversations on additional things we needed to do to make them work (rather than figuring that out during the actual builds). Since I had development time available, I could have added more things to the baseline installation since my developers were already "looking under the hood" of the site.

At the time of selection, it was the best tool to fit our business needs. The day-to-day users were able to create some experiences on their own and did not require much oversight. We also had developer support built into our contract along with internal developer support so most experiences were achievable. We believed it was as good and in some ways better than the other comparable tools on the market.

Incentivized

Overall, the tools we compared against were great, but we went with Optimizely because it has all the features we needed and has the market leadership that gave us trust we would be successful in our experimentation efforts.

Incentivized

While granted, I am not the one making the changes to deploy the software; it seems basically as simple as placing the optimized snippet on your site. If you place it in the header, it should reach across your entire site easily. I do think the test setup can be a bit temperamental at times, and having too many cooks in the kitchen can lead to errors. So, I would caution how many people have the access needed to make actual changes.

Incentivized

• We are really starting to understand our audience and what they prefer on our website. One example is on our product display pages, we learned that our visitors convert about 35% more when content is laid out in one fashion versus another. Another example is our promotional banners perform better when it takes up the width of the page versus the margins pulled in more.
• At first, Monetate was a negative ROI - we were paying for a service we weren't getting, and not understanding the full power of the program. With the new optimization firm however, we are now really able to churn out more tests, have a clean and direct test plan, and finally seeing tangible results.
• As an aside, Monetate has helped us just save time and money on creating our promotional banners now so we don't have to get with our development team each time we want to put one up. Even without running a test, it has let us add content to our site when we need to (as we already have the experiments set up as we need it to and we can quickly duplicate it) without our developers getting in there to make those short-lived changes.

Incentivized

• Customer retention: We've reduced subscription service client churn by 20%+ using optimized unsubscribe flows.
• Risk mitigation: Testing into full site redesigns has saved clients millions of dollars.
• Feature prioritization: Identifying what painted door changes add value has allowed developers to focus on changes that add hundreds of thousands or even millions to the bottom line.

Incentivized