Optimizely Reviews

<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener noreferrer'>Customer Verified: Read more.</a>
375 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.4 out of 101

Do you work for this company? Manage this listing

TrustRadius Top Rated for 2019

Overall Rating

Reviewer's Company Size

Last Updated

By Topic

Industry

Department

Experience

Job Type

Role

Filtered By:

Reviews (1-25 of 129)

Jon Lindemann profile photo
Score 6 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Insert code as the page is rendering. This can be helpful for quick visual fixes or inserting code for testing.
  • Performing A/B testing for minor visual changes to the site.
  • Collecting all tests in a single interface that allows multiple people to see what's being tested.
  • It slows down the rendering of a webpage because it's a third-party script. If you set it to render asynchronously or after the page is rendered, you see flickering.
  • This may be how it's implemented, but our web team typically has no idea when tests are going live as there are no notifications set up. Things can get broken on the site without us knowing.
  • There's no easy way to see what tests are running and what they affect without going into the management interface.
Read Jon Lindemann's full review
Emily Emmer profile photo
Score 10 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Simple technical interface that allows for marketing-centric A/B testing, it pulls the power of experimentation back into Marketing's wheelhouse.
  • Excellent support resources: It's easy to get customer support on the phone and they're fully equipped to resolve issues.
  • Great training and certification resources.
  • Limited visibility to product roadmap and ability to influence that roadmap.
  • Mandatory transition to new platform with no access to previous testing was inconvenient (2018).
  • Creating swim-lane testing for tests with the same conversion metric is a bit cumbersome.
Read Emily Emmer's full review
Rafael Zorrilla profile photo
Score 8 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • The ability for general business users to build experiments. No direct need for coding necessary. Caveat, complex feature or product rollouts may need development effort.
  • relatively real-time statistical review of the experiment data.
  • API output.
  • Management of large volume of experimentation. The ability to review the large scale of the experiment is a convenient manner.
  • The incremental increase in page load time due to the Optimizely snippet.
Read Rafael Zorrilla's full review
César Costas Carrera profile photo
Score 6 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • The traffic reports don't seem to be far from our internal traffic reports.
  • Non-coders appreciate the interface and graphs.
  • It's slow at loading and it's blocking, so it damages your site performance.
  • It uses a naive approach, where two tests running in the same page are still two A/B tests, not an A/B/C, damaging the results due to interference.
Read César Costas Carrera's full review
No photo available
September 11, 2019

Optimizely Review

Score 10 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Extremely intuitive interface with excellent usability, without sacrificing features. You could almost just read and use some common sense, and be able to use 80%+ of the features the first time you load the tool - incredibly intuitive.
  • Drag and Drop/Click and Pull functionality that is present throughout the tool, allows for seamless changes and updates, which can be much more cumbersome in other tools - potentially leading to more errors in campaign setup.
  • The WYSIWYG (What You See Is What You Get) Editor is the best that I have personally used.
  • Optimizely technical support is second to none, in both their expertise, as well as their friendliness and willingness to help.
  • Integrates well with Adobe Analytics.
  • One specific point, is I wish Optimizely gave you the ability to copy an audience. It's an extremely simple feature, and one that we've requested, but probably just on the back log currently.
  • Sometimes it can take quite some time to upload changes from a campaign to the CDN. It varies by client and implementation, but can be a pain point at times.
Read this authenticated review
No photo available
Score 8 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • The user interface is relatively straightforward, making adopting across the company easier.
  • Customer Support is very responsive.
  • Optimizely X Web integrates with digital analytics tools (such as Google Analytics) relatively smoothly.
  • Optimizely Full Stack is difficult to integrate with digital analytics tools (such as Google Analytics).
  • Events can be hard to configure, depending on what kinds of tests you're running.
  • It's not the best solution when you're dealing with users who log in and out of a platform frequently, especially across devices. Sometimes the user IDs get confused and you end up with people seeing a control AND variant version (across different experiences).
Read this authenticated review
No photo available
October 21, 2019

Optimizely Grows With Us

Score 8 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Account Service - We have had an exceptional experience with our account team.
  • Advanced targeting capabilities - There have been several instances where we have questioned how we are going to segment and target a specific set of users, and thus far Optimizely has always been able to deliver upon our targeting goals.
  • Resources for learning - We've found there to be a considerable amount of documentation on Optimizely's capabilities which has enabled us to look into specific topics on our own.
  • None at the moment.
Read this authenticated review
No photo available
Score 10 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • It does a great job reporting experiment results and showing when a test wins or loses.
  • The UI is designed very well and it super easy to use.
  • The customer support is really responsive and helpful.
  • The documentation is very deep and helpful.
  • Single Page Application testing is a little more difficult than traditional sites.
  • API documentation could use more examples.
  • QA of experiments could be a little easier. Sometimes the preview links don't load in browser windows or incognito windows.
Read this authenticated review
No photo available
Score 6 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Developers seem to be able to set up experiments fairly easily.
  • The dashboard allows users to control settings for individual devices for testing purposes.
  • Functional on both iOS and Android.
  • At least in our implementation, there didn't seem to be a great way to scale the number of individual testers who are able to individually control experiment settings.
  • Differences in the experiment stage weren't terribly intuitive to figure out.
  • When we first started using it, there was no support for booleans to define the audience. If we wanted to enable an experiment for anyone on version N or higher, we couldn't just say "if version >= N", but had to add each subsequent version individually. I believe this has been addressed in the new version.
Read this authenticated review
No photo available
Score 10 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Self code small design changes without dev help.
  • Quickly adjust test volumes or turn tests on/off.
  • Watching high-level test metrics to know when you have a Stat Sig winner.
  • We have had some issues with using it on Single Page App sites.
  • There is an initial learning curve.
  • Would benefit from improved online courses.
Read this authenticated review
No photo available
Score 6 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Lots of documentation and support articles
  • Optimizely X for server-side experiments is nice, especially with GDPR and ITP etc.
  • Constant updates to the technology
  • Can be overly complex
  • Not the best for personalization
  • Not a lot of auto-integrations with other products like Google Analytics and advertising channels
Read this authenticated review
No photo available
October 04, 2019

Optimizely Web

Score 7 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Easy to use for less technically inclined individuals
  • Ability to target very specific audiences
  • Ability to change traffic allocation of an experiment at any time
  • Limited flexibility for developers (Optimizely Web)
  • Certain usages can result in performance degradation and/or page flickering, which is detrimental to the user experience
  • Lack of support for persistent / longer running experiments in Optimizely Web
Read this authenticated review
No photo available
Score 8 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Split Testing. It makes it very clear when one of many options is declared "the winner".
  • Targeting classes and other HTML/CSS elements when making changes.
  • Serving up different digital experiences to different demographics.
  • The preview window is very buggy. Often, tests will break, and something the bugs will cause the website to look wonky and broken as well--when it isn't actually broken. It really needs to be a more seamless experience, because it is sometimes hard to trust the preview window when you're trying to see how the test will look to hundreds of thousands of people.
  • Load times. Sometimes the load times for certain pages in the app are very long.
  • The HTML editor pane when clicking on an element that has a ton of nested HTML can often bug out and only show the first 10 - 20 lines of code before going completely blank. It would be really awesome if we could fully switch the view to HTML view, choose our elements and classes that way, and then switch back to the Visual view.
Read this authenticated review
No photo available
Score 10 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Customer support.
  • Training.
  • Making testing simple.
  • I would like the ability to force a cache clear on the snippet each time the snippet changes, instead of based on time settings. This may be possible with Optimizely Edge.
  • The ability to see changes made to each test individually (not just all changes made).
Read this authenticated review
No photo available
Score 9 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • With Optimizely we can make changes in the user interface of any web page. So let's say if you notice any UI related issue of a web page then you can directly fix it through Optimizely with deploying any production build.
  • With Optimizely we can implement AB Testing through which we can compare the different versions of the same web page for performance and for better customer experience.
  • You can easily enable and disable Optimizely on the website through highly configurable Admin panel.
  • Training on the tool for internal business users both on the development and consultancy side.
  • Increase in page load time due to the Optimizely snippet.
Read this authenticated review
No photo available
Score 9 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • A/B Testing
  • Testing Reporting
  • User Roles
  • Has become more complex over time for marketers to use without IT support.
  • Tracks conversions really well, but not as strong with testing recurring billing or B2B down funnel when the converter isn't the purchaser.
  • Can add page load time since it's render-blocking.
Read this authenticated review
No photo available
Score 10 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Swapping out content, such as banners or icons.
  • Personalizing a landing page based on URL parameters for non-organic or direct traffic.
  • Testing new site experiences before developing them fully to validate the business case for the change.
  • The integration with Google Analytics is not great.
  • Designing changes for responsive design usually requires building a custom extension.
  • It can slow down page loads if you don't do a good job archiving audiences and experiments when no longer in use.
Read this authenticated review
No photo available
Score 10 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • A user-friendly (usability) interface for day to day experience setup and monitoring.
  • A novice can easily set up simple experiments, but an advanced user can set up more complex experiments with code/etc.
  • Customer service, customer support, and support architects are impressively responsive and knowledgable.
  • I just received an auto-generated notification that we've used 80% of our impressions in the first three months of our contract (yikes!!!!). I had mistakenly been going off visitors and thought we were ok. I had to dig for a while to even find where these this logged, and even then I'm not sure which experiments are burning through the impressions. I had to negotiate (internally) to get the budget for the expanded contract to the higher tier with more impressions, so I'm not sure whether I'll be able to talk my way into a mid-year budget review to further expand/extend my contract. Otherwise, I'm guessing I'll have to shut down Optimizely for the next nine months. Bottom line: I felt entirely blindsided by the lack of visibility for how many impressions we were burning through.
Read this authenticated review
No photo available
Score 9 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Easy set up of simpler A/B tests.
  • Semi real-time results dashboard.
  • Easy integration with in-house analytics.
  • Good API documentation.
  • No i18n support by default - we had to build it for ourselves.
  • For ease of use, some complexity is hidden away which you would need to understand in order to optimize your site's page load time.
  • The audit trail is almost unusable, as the history view lacks a lot of basic features.
  • There's no way to do a proper approval workflow.
Read this authenticated review
No photo available
Score 9 out of 10
Vetted Review
Verified User
Review Source

Pros and Cons

  • Tech support.
  • Great WYSIWYG.
  • Reliable results.
  • Larger footprint than IT is happy with (Slower Page Speed).
  • Conflicts between varying running experiments and our current tech stack running.
  • Content flash (Page loads then changes in front of user).
Read this authenticated review

Feature Scorecard Summary

a/b experiment testing (44)
8.2
Split URL testing (34)
7.8
Multivariate testing (34)
7.9
Multi-page/funnel testing (49)
7.5
Cross-browser testing (26)
7.2
Mobile app testing (17)
6.8
Test significance (38)
7.2
Visual / WYSIWYG editor (36)
7.2
Advanced code editor (35)
6.7
Page surveys (10)
6.8
Visitor recordings (14)
7.2
Preview mode (41)
6.8
Test duration calculator (22)
6.6
Experiment scheduler (26)
8.0
Experiment workflow and approval (18)
7.2
Dynamic experiment activation (17)
7.5
Client-side tests (28)
7.4
Server-side tests (10)
6.8
Mutually exclusive tests (18)
6.8
Standard visitor segmentation (40)
7.9
Behavioral visitor segmentation (29)
7.6
Traffic allocation control (38)
8.2
Website personalization (22)
7.1
Heatmap tool (8)
6.7
Click analytics (20)
7.6
Scroll maps (11)
7.1
Form fill analysis (9)
6.6
Conversion tracking (32)
7.6
Goal tracking (37)
7.6
Test reporting (39)
7.8
Results segmentation (34)
7.3
CSV export (24)
6.6
Experiments results dashboard (33)
7.5

About Optimizely

Optimizely is one of the leaders in digital experience optimization, allowing businesses to dramatically drive up the value of their digital products, commerce and campaigns through its experimentation software platform.

According the the vendor, by replacing digital guesswork with evidence-based results, Optimizely enables product and marketing professionals to accelerate innovation, lower the risk of new features, and drive up the return on investment from digital by up to 10X.

Over 26 of the Fortune 100 companies choose Optimizely to power their global digital experiences, including eBay, FOX, IBM, The New York Times and many more global enterprises.

Optimizely Integrations

SessionCam, AdBasis, Oracle DMP (Bluekai)

Optimizely Competitors

Optimizely Technical Details

Operating Systems: Unspecified
Mobile Application:No