Lyssna vs. Optimizely Web Experimentation

I think it's well suited to any scenario where something requires feedback, whether it's exploratory feedback of current designs or validation that a new design solves a problem & additional feedback can be gathered to make it even better. I'd recommend UsabilityHub to anybody who isn't 100% sure on a design, and if they are, they need to use it to confirm that certainty.

Incentivized

I think it can serve the whole spectrum of experiences from people who are just getting used to web experimentation. It's really easy to pick up and use. If you're more experienced then it works well because it just gets out of the way and lets you really focus on the experimentation side of things. So yeah, strongly recommend. I think it is well suited both to small businesses and large enterprises as well. I think it's got a really low barrier to entry. It's very easy to integrate on your website and get results quickly. Likewise, if you are a big business, it's incrementally adoptable, so you can start out with one component of optimizing and you can build there and start to build in things like data CMS to augment experimentation as well. So it's got a really strong a pathway to grow your MarTech platform if you're a small company or a big company.

Incentivized

• Very fast - you can have responses in minutes.
• Very easy and straightforward to use. The interface is clear and intuitive.
• They offer suggestions for questions that are effective, which is very helpful for a first time user.

Incentivized

• The Platform contains drag-and-drop editor options for creating variations, which ease the A/B tests process, as it does not require any coding or development resources.
• Establishing it is so simple that even a non-technical person can do it perfectly.
• It provides real-time results and analytics with robust dashboard access through which you can quickly analyze how different variations perform. With this, your team can easily make data-driven decisions Fastly.

Incentivized

• More targeted screening
• A portal of all opportunities rather than email invites

Incentivized

• The results view is dense and difficult to package easily for leadership, and when filtering by segment it's hard to read comparative outcomes without clearing or swapping filters
• The organization of experiments and statuses is a cluttered list and the search is limited in use - would love to see that improve with time
• There are so many other MarTech products out there, would love to see more dedicated integrations so we don't have to invest in something like Zapier or Tray to build hacky automations

Incentivized

Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.

Due to its simplicity and design it is really easy to navigate. You can clearly understand which sections you have completed and which are still left to be done. It is also really easy to change ordering of content etc, which I have found hasn’t been an option in other tools which means it is a really lengthy task of rewriting all of the tasks or questions to get them in the correct order that is desired.

Incentivized

Optimizely Web Experimentation's visual editor is handy for non-technical or quick iterative testing. When it comes to content changes it's as easy as going into wordpress, clicking around, and then seeing your changes live--what you see is what you get. The preview and approval process for sharing built experiments is also handy for sharing experiments across teams for QA purposes or otherwise.

Incentivized

I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.

The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).

The implementation through the tag management system took a bit of trial and error at first, mostly due to the asynchronous nature of the TMS. We had to manipulate the implementation to assure that the Optimizely code was written to the page at the right time to allow the experiment content load in the browser without showing any of the original content first. We also needed to make some adjustments to the TMS code to get the integration with Site Catalyst timed appropriately.

Maze has a more comprehensive reporting presentation compared to Usabilityhub. Maze's interface is clean and modern but it lacks a simple intuitive testing set found in UsabilityHub. The terminology of a Maze is slightly confusing, flow tests are integrated with only Figma, Xd, Invision, Sketch, and Marvel prototypes. The final test interface shown to users is confusing and could have been simpler like UsabilityHub.

Incentivized

The ability to do A/B testing in Optimizely along with the associated statistical modelling and audience segmentation means it is a much better solution than using something like Google Analytics were a lot more effort is required to identify and isolate the specific data you need to confidently make changes

Incentivized

It's incredibly flexible and adapts well to organizations of all sizes, whether you’re running a single site or managing multiple departments and platforms. The ability to deploy experiments seamlessly across different environments is a huge plus, especially for growing businesses. While it’s highly scalable, the last point would depend on the right team leveraging its full potential.

Incentivized

• Positive - It would give us responses significantly faster than testing out a concept on a live site
• Positive - It allowed us to reach a wider audience for our tests (beyond our website traffic)
• Positive - The quick turnaround time and quality of feedback encouraged other internal units to want to test more as they saw the return quickly.

Incentivized

• we saved money by not implementing certain copy/design
• we learned that customers from different states react different to a variation
• we are slowly learning where conversion happens and where to fix the frictions
• Testing shorter vs longer journeys increased funnel conversion in some states - we avoided implementing this nationwide

Incentivized