Optimizely lets you test easily with low overhead.
April 04, 2016

Optimizely lets you test easily with low overhead.

Brynn Arego | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Software Version

Other

Modules Used

  • Magento

Overall Satisfaction with Optimizely

We utilize Optimizely to test our clients UX on the Magento platform. It is easy to install and there is a handy module for Magento that makes it easy for clients to add the snippet to their site. Optimizely is very easy to use and even better if you have jQuery knowledge. It loads fast and allows you to test many things on the site without a lot of overhead and minimal effort. If you are a savvy user it is easy to work with. If someone isn't savvy and tries to use the editor there is a risk of breaking your site. For example, if working with a product detail page template, be wary of using their WYSIWYG editor on any dynamic information like pricing. It can turn it into a static html element on the page. Overall it's a great tool that allows you to be nimble with your testing and has great reporting on the results of your test.

Pros

  • Test setup is easy and doesn't take a lot of company resources.
  • The impact on page speed is incredibly small.
  • The results dashboard gives great insights to how your test is performing and you can track multiple goals.

Cons

  • I'd like to see more tools comparable to Visual Website Optimizer (VWO). Like user recordings and in page analytics.
  • If you have a dynamic area of information and edit it you pose a risk to making the page templates dynamic data static across the site. Pricing is a great example of this.
  • Increased click through rates from homepages for clients.
  • Improved conversion rates from product detail pages.
  • Tested category pages and increased conversions.
Optimizely is lacking a lot of the tools that VWO offers. My favorite being user recordings because of the valuable insight you get on the UX.
If you want better insight into how users are specifically interacting with a page, a different tool would be able to do this whereas Optimizely is lacking.

Using Optimizely

1 - UX / CRO
1 - Front-end development, jQuery, HTML, CSS
  • Testing CRO for clients
  • Testing internal lead generation
  • Testing our lead generation funnel using mutliple landing pages / funnels.
  • Testing checkout processes for our clients.
I'm starting to lean more towards VWO because of the added value and pricing.

Evaluating Optimizely and Competitors

  • Price
  • Product Features
  • Product Usability
  • Product Reputation
  • Vendor Reputation
None, but they change their pricing structure too often and we are considering other vendors.

Optimizely Implementation

If you use Magento they have a module to help with implementation.
Change management was a small part of the implementation and was well-handled

Optimizely Training

It was easy and I became Optimizely platform certified.

Configuring Optimizely

The configuration is right for the product.
Implement the snippet high up in the <head> so you avoid any flashing while loading the test.
No - we have not done any customization to the interface
No - we have not done any custom code

Optimizely Support

I've only had to use it a couple of times but response time isn't the fastest.
ProsCons
Good followup
Knowledgeable team
Problems get solved
No escalation required
Support cares about my success
Not kept informed
Difficult to get immediate help
Need to explain problems multiple times
They provided a great detailed explanation on testing pricing using a workaround method.

Using Optimizely

It is easy to use and quickly learn. Setup is simple with the snippet and tracking is easy to interpret.
ProsCons
Like to use
Relatively simple
Easy to use
Technical support not required
Well integrated
Convenient
Feel confident using
Lots to learn
  • Changing static text or css elements.
  • Viewing the results. They are easy to interpret.
  • Editing anything dynamic.

Comments

More Reviews of Optimizely Web Experimentation