What users are saying about
<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener noreferrer'>Customer Verified: Read more.</a>
Top Rated
386 Ratings
196 Ratings

Optimizely

<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener noreferrer'>Customer Verified: Read more.</a>
Top Rated
386 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.7 out of 100
196 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.9 out of 100

Likelihood to Recommend

Optimizely

Optimizely is a great A/B testing tool for any size business. The Optimizely platform democratizes A/B testing through a simple interface, excellent training tools, easy implementation and low dependence on IT resources. Utilizing Optimizely I've been able to run robust experimentation programs with a variety of resources (acting as a 1-person team with limited access to IT resources as well as managing a team with high access to resources). Additionally, Optimizely is well-priced and positioned to be affordable for a variety of business sizes.
Emily Emmer | TrustRadius Reviewer

Qubit

Qubit is well suited to a medium size organisation with enough resources to fire tests frequently and act on findings as they become available. An important detail to remember is that final implementation is often quite different to testing, so the ability to then transfer winning variations to your live projects is crucial
Gideon Caspi | TrustRadius Reviewer

Feature Rating Comparison

Testing and Experimentation

Optimizely
7.1
Qubit
a/b experiment testing
Optimizely
8.0
Qubit
Split URL testing
Optimizely
7.7
Qubit
Multivariate testing
Optimizely
7.6
Qubit
Multi-page/funnel testing
Optimizely
7.4
Qubit
Cross-browser testing
Optimizely
7.2
Qubit
Mobile app testing
Optimizely
6.4
Qubit
Test significance
Optimizely
6.9
Qubit
Visual / WYSIWYG editor
Optimizely
7.1
Qubit
Advanced code editor
Optimizely
6.6
Qubit
Page surveys
Optimizely
6.4
Qubit
Visitor recordings
Optimizely
7.2
Qubit
Preview mode
Optimizely
6.7
Qubit
Test duration calculator
Optimizely
6.2
Qubit
Experiment scheduler
Optimizely
7.9
Qubit
Experiment workflow and approval
Optimizely
7.0
Qubit
Dynamic experiment activation
Optimizely
7.4
Qubit
Client-side tests
Optimizely
7.4
Qubit
Server-side tests
Optimizely
6.8
Qubit
Mutually exclusive tests
Optimizely
6.4
Qubit

Audience Segmentation & Targeting

Optimizely
7.5
Qubit
Standard visitor segmentation
Optimizely
7.7
Qubit
Behavioral visitor segmentation
Optimizely
7.3
Qubit
Traffic allocation control
Optimizely
8.0
Qubit
Website personalization
Optimizely
6.8
Qubit

Results and Analysis

Optimizely
7.1
Qubit
Heatmap tool
Optimizely
6.7
Qubit
Click analytics
Optimizely
7.3
Qubit
Scroll maps
Optimizely
7.1
Qubit
Form fill analysis
Optimizely
6.5
Qubit
Conversion tracking
Optimizely
7.5
Qubit
Goal tracking
Optimizely
7.5
Qubit
Test reporting
Optimizely
7.6
Qubit
Results segmentation
Optimizely
7.1
Qubit
CSV export
Optimizely
6.5
Qubit
Experiments results dashboard
Optimizely
7.1
Qubit

Pros

Optimizely

  • Optimizely makes it extremely easy to setup almost any type of split or multi-variate testing experiment. It has a variety of test triggers types & many ways to segment incoming visitors.
  • I believe Optimizely's results dashboard is one of the best among split testing software. It allowed my team to get insights into the running of tests, like time to significance and a view of metric changes over time.
  • Optimizely is very easy to use for non-engineers. It has a powerful visual interface that allows marketers and advertisers to setup complex variations without 1 line of code.
  • In terms of documentation and implementation, I believe Optimizely is ahead of its competitors in terms of its focus on reliability and speed.
Alec Dibble | TrustRadius Reviewer

Qubit

  • Market sector and industry knowledge. Using this, they have given us some excellent advice of what experiences to try, and using the data they gather from all clients are able to provide continual feedback and suggestions. This is a a credit to the staff they have exposed us to.
  • The platform performs amazingly well. We have almost zero issues or downtime in the time we have been using them.
  • Web experiences produced by Qubit always come out at a very high standard.
Neil Majithia | TrustRadius Reviewer

Cons

Optimizely

  • Assistance with on-boarding the tool as opossed to using a partner.
  • Dedicated training on the tool for internal business users both on the development and consultancy side.
  • Impression usage should be applied to running AB tests only - Development teams need to take some time to implement a winning variation and so using impressions to temporarily run a winning experience is not ideal.
Ashley Smith | TrustRadius Reviewer

Qubit

  • I have yet to be "impressed" by any of the design elements supplied by the design team. I know that they are working from a billable clock perspective, but many of the designs require two or three rounds of refinement before I have been happy with their finalized work. Even then, the design itself seems somewhat vapid. It may be that they have not been empowered to challenge formats or pages more specifically, but more often than not, I wonder what their background is, as many adjustments seem like design 101 from an eCommerce perspective.
  • The timeliness of design turnaround is the least expedient of the group. Tara's ability to launch a project is excellent, her developers and QA team seem to have legitimate 48-72 business hour turnaround times, but the design feels like it takes much longer. This is then compounded by the aforementioned required set of approvals during which additional adjustments are made. Again, I do not know what requirements are provided, but it is the only part of the relationship that I would deem a "pain point."
  • I would like to see a more Robust Customer Feedback tool or the addition of a automated report. There are plenty of false negatives or false positives in the reporting and so the breakdown within the tool doesn't help a great deal. Segmenting by type is more helpful, but the positive negative is often not correct.
Zach Shelley | TrustRadius Reviewer

Likelihood to Renew

Optimizely

Optimizely 9.0
Based on 43 answers
Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.
Jeremy Bradford | TrustRadius Reviewer

Qubit

Qubit 8.1
Based on 29 answers
Qubit helps out immensely and lays out in plain English the profitability of each of our A-B tests. Say Qubit has provided us overall with a 5% profit increase this year (that is a completely arbitrary figure for illustration only), then if we didn't renew it could be seen as us taking a 5% loss as Qubit wouldn't be there. The results of our tests are showing no slowing down and as Qubit and Toast grow to understand each other better we can only see our performance getting better as the years go on.
James Morris | TrustRadius Reviewer

Usability

Optimizely

Optimizely 7.3
Based on 56 answers
I've heard great feedback from the Marketing and Development team who use the tool. I am not particularly great with code but find it easy to set up tests on my own and feel confident putting them live using the preview tool.
Fay Dawson | TrustRadius Reviewer

Qubit

Qubit 7.1
Based on 17 answers
Overall navigation on Qubit is very user friendly and requires a minimal training to be up and running. Be it reviewing existing experiences or setting up new experiences, the process is pretty simple for business user. Add some basic development skills to your kitty, you can do magic with Qubit and make your website do wonders!
Kim Jacob | TrustRadius Reviewer

Reliability and Availability

Optimizely

Optimizely 9.0
Based on 5 answers
Web interface is nearly always available. Javascript snippet (which actually runs the test) is distributed on a CDN for near-constant availability.
Albert Wavering | TrustRadius Reviewer

Qubit

Qubit 9.0
Based on 3 answers
I would say that the Qubit account managers are always available for any request. We have a lot of different promotions that could always do with last minute optimizing or changes and Qubit can be relied on to get this changes up and running in an impressive amount of time, so that we don't need to patch live or wait for the next IT sprint. Invaluable to our business.
Miriam Isaac | TrustRadius Reviewer

Performance

Optimizely

Optimizely 6.0
Based on 5 answers
We have had some issues with screen flicker when loading experiment content. We had to dial back some of the creative changes to load smaller files.
Shawn Daley | TrustRadius Reviewer

Qubit

Qubit 7.3
Based on 21 answers
Continued excellent service from Qubit, including a number of last-minute bug fixes and last-minute jobs completed.They've gone above and beyond the last few months.
Stuart Brown | TrustRadius Reviewer

Support Rating

Optimizely

Optimizely 9.1
Based on 14 answers
They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
Sean Cleveland | TrustRadius Reviewer

Qubit

Qubit 6.8
Based on 19 answers
We were considering adding a new 3rd party supplier to our website. Qubit came to us with ideas of how to measure and test the success of the 3rd party. The report we were able to generate gave us the result split by different aspects, not only general conversion rate but also a few others interesting numbers, which helped the company to make a decision to renew the contract or look for a better solution.
Art Bukowski | TrustRadius Reviewer

In-Person Training

Optimizely

No score
No answers yet
No answers on this topic

Qubit

Qubit 8.0
Based on 6 answers
The training that we received was great due to a number of reasons; to start with the audience that was receiving the training were from different departments of the company, ranging from the technical minded developers to the analytics teams and yet the training still managed to be engaging and useful for everyone. The training was also done by a wide variety of people from Qubit which meant not only were many different aspects covered in the training but any question posed to them could be promptly answered.
Adam Rooney | TrustRadius Reviewer

Implementation Rating

Optimizely

Optimizely 8.0
Based on 11 answers
Ensure that your Optimizely JS script is loaded in the header of the page. The reason for this is that the DOM loads the page, and if you are changing elements on the page in your variation, Optimizely needs to know this before the page loads so that it can make those changes for your variation.
Douglas Wright | TrustRadius Reviewer

Qubit

Qubit 7.4
Based on 8 answers
Implementation couldn't be easier. All we needed to do was insert the tag. (easy) and set up the data layer. (dev required)This was pretty smooth in comparison to some of the other tools we use on our site, and was done in less than a day.Note : Data needs to be collected for a set period of time before you can accurately rely on the data that you are receiving. This is normal though with everyone else that we have used
Joe Dingley | TrustRadius Reviewer

Alternatives Considered

Optimizely

I think that Optimizely is more user-friendly than Adobe and Monetate, for example - Adobe is really suited for people with deep pockets and a distinct technical acumen that may not be suitable for a small business. Montetate is not user-friendly - even for seasoned marketers. Apptemize is a pretty great product but they killed their free product. Like Optimzely, they seem to be shooting for enterprise-level clients.
Sylvia Flores | TrustRadius Reviewer

Qubit

Qubit is a great choice for A/B testing where advanced JavaScript capabilities are required. This is especially true for large "legacy" sites that have a ton of on-site JavaScript that has culminated over years, often overriding changes made in a WYSIWYG or "basic mode" editor found in other platforms. In these cases, a developer must use JavaScript to override and/or extend methods on-site in order to ensure that changes made for a variation will remain so and not be overridden/destroyed by the on-site JS. QA'ing Qubit tests is also nice given their slick preview tool and the ability to leverage some Qubit JavaScript objects with experiment metadata.
Sean Emmel | TrustRadius Reviewer

Scalability

Optimizely

Optimizely 7.0
Based on 49 answers
Optimizely offers excellent testing features and incredible technical support and training resources enabling non-technical teams most benefited by experimentation to truly own this function. Optimizely is easy to implement and use, has simple integration with other technologies making it a staple in our marketing technology stack. Finally, Optimizely continues to innovate around its core technology to add new features and capabilities to improve the overall experimentation process (such as acquiring Experimentation Engine in 2018). In a dynamic and ever-changing marketing technology landscape expect to continue using Optimizely in my marketing technology stack for many years to come.
Emily Emmer | TrustRadius Reviewer

Qubit

Qubit 8.7
Based on 6 answers
Our requirements change throughout the year like most E Commerce retailers. At Christmas and Peak we're dealing with around ten times the usual traffic on the site. Qubit had no problems with this at all, tests continued to fire, and stats were still reported accurately. I don't think that it is the most server intensive .js anyway, but we have seen no issues at all.
Joe Dingley | TrustRadius Reviewer

Return on Investment

Optimizely

  • Before using Optimizely, we were shooting in the dark with our design decisions. We'd make a change, then have to wait to see our user numbers drop over the course of a couple weeks, then roll back the changes. Our front end team would get frustrated with the wasted time, and try again. With Optimizely, our decisions are data-driven, morale doesn't take a hit, and we are always moving forward with our site.
Benjamin Himley | TrustRadius Reviewer

Qubit

  • Faster recognition of customer needs - finding out exactly what customers are doing when they come on site.
  • Assessment of online assets for effectiveness and improvements - facilitated the analysis of 500 online feedback questionnaires for a campaign.
  • Mapping out lead conversion and helping identify opportunities to improve it.
Dennis Wildman | TrustRadius Reviewer

Screenshots

Pricing Details

Optimizely

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Qubit

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Rating Summary

Add comparison