Likelihood to Recommend It depends on who you are. If you are very small it won't be worth the money. If you have a very cranky site with nested tables coming out of every orifice, maybe you should look at a replatform or desktop rewrite first. If you have a site with vast numbers of custom content pages, it will work but may not be cost effective. Moovweb is well suited to you if you need the ability to control mobile experiences and respond to changes in mobile and the demands of mobile aware executives who want to move more quickly than your current IT processes allow. It is well suited if you need something quickly but also want the option to bring mobile development and support in-house some time in the next year or two (which you should). It is well suited if your desire to improve a responsive experience has been thwarted by internal fears over the impact that it might have on desktop. It is well suited if you want to experiment on mobile but do more than just change the color of a button or make a font larger. It's very good at letting a UX team try things out and see what real customers do.
Read full review Optimizely Web Experimentation is appropriate if you have a big budget and your company is mature enough in experimentation to take all the advantage of a such an expensive price model. If you are just starting into AB testing, or not enough budget, I do not recommend Optimizely Web Experimentation, as it becomes quite frustrating to manage usage limits and technical set up to avoid extra charges.
Read full review Pros Moovweb takes the time to really understand your needs and challenges and is willing to work with and address them. They are partners during and AFTER implementation. Moovweb and their implementation partner 64Labs has a fantastic response time and work ethic. They really will do what it takes. Moovweb takes the time to share their product road map with customers. Read full review Considers every kind of experiment from simple code change, code additions, code removal, javascript functions, CSS changes, and split landing redirects. Very friendly UC interface for easy navigation of implementation of pages, click events, experiment set up, and metric set up. The ability to let me know when something has reach stat sig without having to do complicated math on my own ability to carry UTM parameters through landing page redirects with a click of a button. Read full review Cons Depending on how your site is built and maintained, there may be a different solution that will be a better option for your business and customer needs. At the end of the day, this is another layer that is added to your development plan and time to ensure updates work across multiple devices. Moovweb is really good about the turn-time for these updates, but there still needs to be the added QA step for M&T optimization per release. Read full review Filtering capabilities in the reporting tab. To be able to filter based on a custom metric Tracking scroll depth within the reporting tab A more interactive graph within the reporting tab. Ability to manipulate there vs having to update the whole page Read full review Likelihood to Renew Personally as a Mobile Architect I am a huge proponent of building mobile-first responsive websites. I will always fight for a lobby for businesses to build sites with all devices in mind and not focus their attention on desktop driven sites which are then adaptively scaled to meet the demands of the business, in my opinion leading to a never ending cycle of building separate media queries to compensate for every device the business chooses to market to
Read full review Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.
Read full review Usability Usability is mostly great. I like the WYSIWYG functionality and adding in real code is simple as well. It's easy to target specific pages or audiences. I've knocked a couple of points off because of how difficult it is to set up URL redirect experiments, confusion around creating pages, and lack of data that can be further analyzed.
Read full review Reliability and Availability I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review Performance I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review Support Rating Good set of customer success people combined with the flexibility to use high-quality onshore partners if workload increases at busy times. I think Moovweb's support efforts are pretty solid.
Read full review They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
Read full review Online Training The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).
Read full review Implementation Rating Don't spend weeks in design. Because of the way the technology works nuances of design can change very quickly further down the line. We have changed the look of the product list for a client a week before launch. Push for getting the project into UAT within four weeks of the kickoff of the project. There are few retailer projects that need to take more than that. In my experience the more concentrated the timeline the more effective the implementation. Check that there are no major changes planned on desktop during the time of your implementation (another reason to keep the development to four weeks). If you have custom mobile content requirements, get them to your implementer at the start. Moovweb is great at heavy-lifting existing content, but your implementer will need to recommend solutions for custom content that will need to be tested. Get these requirements out at the start. Make a list of your desktop plugins. Moovweb can handle them all, but they can be handled in different ways If you have Paypal/Google Wallet and want it on mobile as part of your project, talk about that early on. Read full review In retrospect: - I think I should have stressed more demo's / workshopping with the Optimizely team at the start. I felt too confident during demo stages, and when came time to actually start, I was a bit lost. (The answer is likely I should have had them on-hand for our first install.. they offered but I thought I was OK.) - Really getting an understanding / asking them prior to install of how to make it really work for checkout pages / one that uses dynamic content or user interaction to determine what the UI does. Could have saved some time by addressing this at the beginning, as some things we needed to create on our site for Optimizely to "use" as a trigger for the variation test. - Having a number of planned/hoped-for tests already in-hand before working with Optimizely team. Sharing those thoughts with them would likely have started conversations on additional things we needed to do to make them work (rather than figuring that out during the actual builds). Since I had development time available, I could have added more things to the baseline installation since my developers were already "looking under the hood" of the site.
Read full review Alternatives Considered This is the only mobile technology we have used. We went through an extensive research and vetting process. In the end Moovweb was the best choice for technology and business needs. We considered the following companies: Moovweb,Mobify, Usablenet, Mad Mobile, SKAVA, Wompmobile. Forrester has a mobile infrastrucutre services report that could be very helpful.
Read full review Overall, the tools we compared against were great, but we went with Optimizely because it has all the features we needed and has the market leadership that gave us trust we would be successful in our experimentation efforts.
Read full review Scalability While granted, I am not the one making the changes to deploy the software; it seems basically as simple as placing the optimized snippet on your site. If you place it in the header, it should reach across your entire site easily. I do think the test setup can be a bit temperamental at times, and having too many cooks in the kitchen can lead to errors. So, I would caution how many people have the access needed to make actual changes.
Read full review Return on Investment The implementation was 4 months from start to finish. Mobile is about 10% of our visits today and our mobile revenue for the first half is about $200K so we will have a payback in 1 -2 years. Moovweb is not the most economical solution out there. It is one of the most comprehensive for sites needing all their content available for mobile. Read full review Customer retention: We've reduced subscription service client churn by 20%+ using optimized unsubscribe flows. Risk mitigation: Testing into full site redesigns has saved clients millions of dollars. Feature prioritization: Identifying what painted door changes add value has allowed developers to focus on changes that add hundreds of thousands or even millions to the bottom line. Read full review ScreenShots Optimizely Web Experimentation Screenshots