Following scenarios, Optimizely Feature Experimentation is well-suited Experimentation tests require results to be measured, like pricing tests and UI tests. feature flags and variables can be used as dynamic configs. etc... Following scenarios, Optimizely Feature Experimentation is not well-suited Experimentation without code changes, such as CSS changes or text changes on the page, supported by Optimizely Web, is not well suited for Optimizely Feature Experimentation. If this functionality is also supported by Optimizely Feature Experimentation, then it can be really helpful.
UserZoom is well suited for usability testing, I found specifically around test websites and marketing materials. I was able to invite others to participate and watch as well as screen share so that it was an interactive session. Other tools I have used have been a little better with the video output and transcripts of each session so that we could capture notes quickly, but overall it was a good tool to use to test.
Its ability to run A/B tests and multivariate experiments simultaneously allows us to identify the best-performing options quickly.
Optimizely blends into our analytics tools, giving us immediate feedback on how our experiments are performing. This tool helps us avoid interruptions. With this pairing, we can arrive at informed decisions quickly.
Additionally, feature toggles enable us to introduce new features or modifications to specific user groups, guaranteeing a smooth and controlled user experience. This tool helps us avoid interruptions.
Quantitative testing can be done on the cheap compared to other quant tools or vendors... once you buy the license, you only pay for additional recruiting and you are managing the project, so there isn't the high cost of having other vendors doing the project management or running a survey etc.
Farily robust means of tracking and recording data. I also relied heavily on the excel spreadsheet of all the raw data, which you can have UZ customize for you to get what you need.
Great support system from the UserZoom team - they have researchers who can help with coding and also provide research support for a very good price.
Also they have tree testing, card sorting, survey capabilities (in addition to usability testing)... and mobile testing. and they seem to be continously be developing the tool to support additional methods.
Compared with some other tools, because their video conferencing platform is web-based (vs. using Zoom, which has a desktop app), I find the connection buffers a lot and it's kind of annoying
Their screening tool on the UserZoom side (not Go) is clunky. Just let me select May, Must, or Should not for criteria rather than the weird interface design they have now.
Logic panel is a little confusing, sometimes I do a double-take, sometimes it's wonky and resets itself. It's just not as easy to use as it could be.
They haven't integrated UserZoom and UserZoom Go (formerly Validately)
It's expensive!
We signed up for a high sample size license with unlimited tests, but we're finding their panel doesn't fill as fast as their biggest competitor, UserTesting. We've struggled to fill n=100 sample tests with fairly general criteria.
A lot of their licenses only allow limited concurrent studies, whereas UserTesting had unlimited tests that you could launch at a time. It's slowed us down.
I'm actually trying to get a license for my current job at my current company (recently moved to a new company). I gave it this rating because I am about to go to our executive to ask that we purchase it! I know that there will be value because we are forecasting a high volume of research next year
Overall, it was fairly easy to use. Especially if you are familiar with this type of product. We were able to use it for testing pretty much right after we got it (same day) and didn't have many issues figuring out how to invite, test, and share which was great.
From my experience, the UserZoom team has really done a great job answering the limited questions we have given them thus far. I think the platform is popular enough that many of my questions have been answered by their help pages - or other online content with helpful tips and tricks. I think the community has done a nice job of providing end-user tutorials for those who are new to the platform.
Google Tag Manager was less flexible for the business and required the Google Analytics tool for analysis and metric tracking. Optimizely allows the building of use cases. Optimizely provides real-time data and metrics that are easier to use. GTM provides tracking capabilities on marketing campaigns, however, Google Analytics could potentially store user personal data.
Client selected it due to how they used it, pricing, and what it could do for them. It's about the same as these other tools but UsabilityHub let's you run multiple types of task in one test, and UserTesting still has a bigger panel I think
Experimentation is key to figuring out the impact of changes made on-site.
Experimentation is very helpful with pricing tests and other backend tests.
Before running an experiment, many factors need to be evaluated, such as conflicting experiments, audience, user profile service, etc. This requires a considerable amount of time.
Making informed decisions: repeat testing before launching the app/website to reduce errors in the future
Guarantee customers' satisfaction: ensure the errors are reduced to the minimum so that the purchase process is smooth and there will be no need to reach out to our customer support team
