eCommerce a/b Testing Tool: Optimizely
We use Optimizely for eCommerce conversion, increasing click through rates and engagement. The product has a simplistic UI, but allows you delve deep if necessary. Reporting and metrics are easy to explain to non technical people. Cost-effective and provides strong ROI.
On a scale of 1-10, how likely are you to recommend Optimizely if asked by a colleague?
Please provide some examples of things that Optimizely does particularly well.
- Reporting and validation metrics are easy to explain to non savvy analytic people.
- Digestible "QA "
Please provide some examples of areas where Optimizely has room for improvement.
- Depending on the page scenario, sometimes loads pages very slowly.
- Don't recommend inserting elements with this tool, the z-index will sometimes be off w/ different browsers.
What positive or negative impact (i.e. Return on Investment or ROI) has Optimizely had on your overall business objectives?
- Validating treatments against controls that build a positive ROI.
- Allows justification of development time where needed.
On a scale of 1-10, how likely are you to renew your use of Optimizely? Why do you give it this rating?
Affordable and ease of use with a positive ROI.
How many people in your company use Optimizely?
How many people do you have in-house to support Optimizely on an on-going basis.
What are the 3-5 most important use cases for this product in your organization?
- eCommerce conversion.
- Increase click through rates / increase online conversion.
- User engagements and how to increase them on landing pages.
What are some unexpected or innovative ways that your organization has been able to use Optimizely?
What are some additional ways that your organization might be able to use Optimizely in the future?
Evaluation and Selection
Did Optimizely replace another product in your organization? What products did you replace and why did you want to replace them?
We used no prior technical software package. But do have an in-house A/B testing platform and track with Google Analytics.
- Being agile is important in A/B testing and Optimizely allowed us to get the results needed w/o major development contributions.
Which other products were on your short list as alternatives to Optimizely? What made you choose Optimizely over the alternatives?
, but the tool was a little too far out of our budget. We picked Optimizely because it was cost effective and our ROI was justified based upon a defined baseline to increase conversion and continue the strategy of A/B testing.
Which factors were most important in your decision to purchase Optimizely?
If you had it to do over, how might you change the evaluation and selection process that you went through?
On a scale of 1-10, how satisfied were you with the implementation? Do you have any key insights regarding implementation of Optimizely?
Also, it can be difficult to carry the reporting variables over to Google Analytics
and Crazy Egg.
How did your organization implement Optimizely?
Was the implementation broken up into phases?
Was organizational change management a big part of the implementation?
What were the most significant issues encountered during implementation?
What kind of training did your organization get on Optimizely?
On a scale of 1-10, how would you rate the in-person training?
On a scale of 1-10, how would you rate the online training?
Was the product easy to learn without training? Would you recommend this approach to others?
Yes, this tool is similar to other A/B testing tools. So if you have experience with them, you'll have no problems.
On a scale of 1-10, how would you rate the overall support for Optimizely? Why do you give it this rating?
When I had question, I got a quick response with a solution.
Please rate customer support for Optimizely for each of these factors .
If available, do you pay for premium support? Why or why not?
Not Sure - Tool is pretty easy to use, don't think we really need it. The support QA is sufficient.
Have you ever reported a bug with Optimizely?
Can you describe a time when Optimizely provided you with exceptional support for this product?