Spend research time doing research - not recruiting
October 31, 2020
Spend research time doing research - not recruiting
Score 10 out of 10
Overall Satisfaction with UserTesting
UserTesting is used by our Digital Team to influence decisions across the organization - specifically within Marketing, Sales, and Customer Service. UserTesting is used to get feedback on the value of potential digital projects, identify the best solution to customer problems, competitive research, and to improve the usability of public-facing websites and customer-facing portals.
- Creating tests
- Sharing insights
- Scaling research through templates
- Organizing tests
- Robust review process (e.g., legal review, product manager review)
- Variety of question types
- Ability to use for survey / quantitative research
- Reduced time / money spent in recruiting costs
- Increased the amount of research able to be completed within a sprint
- Identified major errors / usability bugs that would have been costly to conversion rates
Overall support has been excellent. UserTesting is super responsive and has resolved any open issues quickly and are pleasant to talk to. In addition, I think they do a great job reaching out to customers to get insights on how to make the platform better and are quick to include people in POCs for new features.
Overall, its really easy to get started. A few things that have caused issues are:
- Limited types of questions to use when creating tests
- Difficult to organize tests
- Preview options are limited (have to download a separate app / plugin)
We've used customer insights to bring a lot of benefits to our organization. First, it has improved organizational empathy for a particular group of customers or for customers in a particular experience. Secondly, it has allowed us to move with greater speed and confidence in decision making (and to include a customer-centric POV during the design and development of key features). Finally, customer insights has helped build alignment across various teams and rally the organization around a clear picture of an issue.
We compared UserTesting with a few tools, most notably UserZoom. UserTesting was selected for the simpler price structure (one annual, flat fee) vs. the pay-per-play of UserZoom. UserTesting also stood out in the thought leadership space and new features like the ability to recruit from an internal list of customers are additional distinctives.
UserTesting is well suited for
- Getting user feedback on a concept / topic when the intended users are a generic, easy-to-come by persona (e.g., homeowners)
- Usability testing
- Preference testing
- Customer journey mapping / user requirements gathering
- Recruiting very specific types of people or conducting testing where background knowledge is key (e.g., architects, surgeons, etc.)
- Conducting tests where more than 10 people are needed to reach significance (e.g., information architecture, surveys, etc.)
- Tests with login credentials or checkout processes where each participant will need an (you can do these, but they can be cumbersome)
4 - We all work in our IT Department as part of the Digital Team supporting our marketing and customer service organizations.
2 - Currently we have two people actively supporting UserTesting. One person (myself) supports the user management side (e.g., creating accounts, giving basic training, creating templates for tests, etc.) another person supports our SSO and provisioning process from the IT security side. Neither of us are fully dedicated to the UserTesting project and it accounts for a very small portion of our overall time.
- Getting usability feedback on prototypes and concepts
- Validating which option, among many, works best for customers
- Comparative research to see how we rank against competitors
- Getting user requirements for a project up-front
- Benchmarking existing user experience and re-indexing those benchmarks after making improvements
- To test the comprehension of print materials
- To have customers show us the non-digital experience (e.g., using a product, showing their living space, etc.)
- To recruit for information architecture or surveys
- To recruit from our own customer base vs. a general population audience
- To recruit for more quantitative research methods
UserTesting has drastically changed the way we research. We are now conducting research at a scale and pace that would be impossible to replicate using our traditional recruitment methods. Additionally, the ease of sharing information and findings out of UserTesting has made our research more dynamic and engaging to stakeholders. We can't imagine a situation in which we step backwards now that we have demonstrated the expansion capability UserTesting provides to an in-house UX research practice.
Evaluating UserTesting and Competitors
- Product Features
- Product Usability
The most important qualification for us was both pricing as well as the breadth of the user base that we could poll in UserTesting. We needed to find a vendor who had a broad enough audience to fit our various recruitment segments and receive feedback in a timely manner. UserTesting fit those requirements and had a lot of feature-adds that, while we didn't initially ask for them, definitely made them stand out from competitors.
From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.
Change management was minimal - For us, the change management was minimal. We were not using any tool like this before, so it replaced a manual recruitment process that no one within the organization liked. So all of the change was welcome!
Problems get solved
Kept well informed
No escalation required
Immediate help available
Support understands my problem
Support cares about my success
Quick Initial Response
No - So far, we haven't found a need for premium support. Any issue we raise gets acknowledged and resolved quickly and issues are very infrequent.
We were once a participant in a beta program for a feature. The feature was still being worked on and there wasn't a lot of documentation available. One of the primary developers for the feature was extremely responsive via email to help me get the feature enabled and working for my setup. It was clear that he was highly knowledgeable and actually the person working on the feature. Was great to be able to have that kind of connectivity to the company and we got an issue resolved in two days that, in my opinion, could easily have taken 2 months with the more traditional support system (e.g., where your request goes to a generic inbox and then gets passed around to different people to try and find an answer). Was a wonderful experience and felt like UserTesting was really committed to my personal success.
Like to use
Easy to use
Technical support not required
Quick to learn
Feel confident using