Overall Satisfaction
- The product interface is very easy to use. Tests are easy to set up and manage.
- From the development standpoint, tests are not any easier to set up than they would be manually. They actually are more complicated and provide more work to our development team.
- The software is extremely expensive. You cannot segment your tests or campaigns by geo-targeting, for example, unless you pay extra for that portion of the package.
- Customer service was easy to get into contact with, but your consulting time with them is very limited, and they weren't always knowledgeable about the issues you needed help with.
- The software is mainly centered around the "Target" portion of the product (I would say about 75% of the product is devoted to this). Once testing completes, there are many options to push your winning campaigns live and target them to specific segments. Unfortunately this adds to the expense of the software; you pay by impressions. We also use an external ad display software. For these reasons, we did not use any of the targeting portion of the product, which left 75% of it unusable.
- Test results are real-time, but we found they weren't always accurate. For example, when we would implement the winning campaign from a test, we often found no drastic improvement in conversion, or sometimes it even converted worse.
- Our site is primarily motivated to generate more traffic and conversions (leads) for our clients. In using this software, we had hoped to optimize our traffic and lead generating pieces so that we maximized signups.
Product Usage
- This product is used for A/B testing to help optimize conversions across our site.
Evaluation and Selection
We did all of our a/b testing manually through the development team.
Implementation
- Implemented in-house
Training
- Online training
- In-person training
- Self-taught
You can get the basics from self-training, but you miss a lot of the additional features and details without doing a formal training. If a company is going to seriously invest and use this software, I highly recommend you pay for a trainer to come and help you.
Support
Not Sure - We did get support hours as part of our package, but based on the price we paid we were limited in those hours. Our support representatives did schedule weekly calls with our company, but they typically were unnecessary, not helpful, and only succeeded in eating up the precious hours we had paid for.