The wonder of Optimizely
May 29, 2019

The wonder of Optimizely

Ashley Smith | TrustRadius Reviewer
Score 10 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely

Optimizely is currently being used for our CRO programme to run A/B testing as well as smaller personalisation campaigns. This currently sits solely within the product team to make quick front end changes and testing. This helps to address and resolve user experience issues, styling and formatting issues as well as ensure we are testing within the right areas.

Pros

  • Easy to use platform with an easy to use WYSIWYG editor for non-technical people.
  • Specific personalisation suite to enable effective use of 1:1 personalisation on landing pages.
  • Accurate statistcal modelling to ensure confidence in results.

Cons

  • Assistance with on-boarding the tool as opossed to using a partner.
  • Dedicated training on the tool for internal business users both on the development and consultancy side.
  • Impression usage should be applied to running AB tests only - Development teams need to take some time to implement a winning variation and so using impressions to temporarily run a winning experience is not ideal.
  • Increase in conversion rate and an immediate ROI
  • Ease of implementation ensuring only positive site changes are sent through to development
  • Allowing wider business users to get involved with CRO and generate and share ideas
With the option to add specific personalisation campaigns and targeting to the existing web testing tool the product is extremely scalable for all business usage and needs. For retailers, on site recommendations is also another valuable feature which can be added as part of the personalisation suite. Intelligent algorthims, to generate specific product recommendations to users is vital to our business.
Without a doubt, after 8 years using various different testing tools, Optimizely is by far the easiest to use. Feedback from developers and more technical teams has always been positive, mostly due to the code editor allowing for easy implementation along with the creation of advanced audience segments using advanced javascript. For business users and non-technical people, the wysiwig editor allows for smaller changes to be made quickly whilst somewhat educating the user on the types of code changes that are being made.
Optimizely has allowed multiple users from across the business to involve themselves with CRO and get a good understanding of the types of experiements we could run. As we are only in the intial stages of using the platform to its full potential the most abundant benefit Optimizely has had so far is the education piece. The online knowledge base is also very useful for sharing and educating in an easy to understand manner.
Maxymiser - The statistical significance engine used by Optimizely helps to reduce the detection of false positives. These were noticed on many occasions within the maxymiser tool.

Adobe Target - The ease of use is non-comparable between Optimizely and Adobe Target. The UI of Adobe Target is not as intuitive as Optimizely making it more difficult for non-technical users.

Monetate - Reporting. Optimizely allow for an easy-to-see comparison of variation performance when there is more than 1 variation. Monetate only allows for the comparison of 2 variations at any one time meaning you reguarly have to flick between comparisons to get an understanding of performance.
Well suited to make quick amends to existing issues on site. Althought I don't believe the platform should be used for this purpose for too long. With the program management tool, Optimizely enables users from across the business to share ideas and collobarate and prioritise testing efficiently. There are many ways to QA an experience but changes to the QA tool such as being able to trigger different experiences and/or variations on or off would be ideal.

Optimizely Web Experimentation Feature Ratings

8.3
a/b experiment testing
10
Split URL testing
10
Multivariate testing
10
Multi-page/funnel testing
10
Cross-browser testing
10
Mobile app testing
7
Test significance
9
Visual / WYSIWYG editor
9
Advanced code editor
9
Page surveys
7
Visitor recordings
7
Preview mode
6
Test duration calculator
6
Experiment scheduler
6
Experiment workflow and approval
8
Dynamic experiment activation
7
Client-side tests
9
Server-side tests
Not Rated
Mutually exclusive tests
9
8.8
Standard visitor segmentation
10
Behavioral visitor segmentation
7
Traffic allocation control
10
Website personalization
8
9.1
Click analytics
10
Conversion tracking
10
Goal tracking
10
Test reporting
10
Results segmentation
9
CSV export
5
Experiments results dashboard
10
Platform Integration Features ()
Not Rated

Comments

More Reviews of Optimizely Web Experimentation

  1. Home
  2. A/B Testing Tools
  3. Optimizely Web Experimentation Reviews
  4. User Review of Optimizely Web Experimentation