TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    UserTesting

    Score8.1 out of 10
    N/AUserTesting helps UX researchers, designers, product teams, and marketers gather actionable insights through research, testing, and feedback. With a network of real people ready to share their perspectives, UserTesting enables organizations to make customer-first decisions at scale.N/A

    Visual Studio Test Professional

    Score7 out of 10
    N/AAn add-on for the Visual Studio IDE, Visual Studio Test Professional subscription helps teams drive quality and speed. It includes test case management and collaboration features that streamline quality control and support continuous delivery.

    $2,169

    for the first year (renews at $869)

    Pricing
    UserTestingVisual Studio Test Professional
    Editions & Modules
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    UserTestingVisual Studio Test Professional
    Free Trial
    YesNo
    Free/Freemium Version
    NoNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    UserTestingVisual Studio Test Professional
    Considered Both Products
    UserTesting
    No answer on this topic
    Microsoft
    No answer on this topic
    Key User Insights
    Would buy again
    95%
    Would buy again
    128 Answers
    100%
    Would buy again
    12 Answers
    Delivers good value for the price
    92%
    Delivers good value for the price
    94 Answers
    91%
    Delivers good value for the price
    10 Answers
    Happy with the feature set
    92%
    Happy with the feature set
    126 Answers
    100%
    Happy with the feature set
    12 Answers
    Lived up to sales and marketing promises
    95%
    Lived up to sales and marketing promises
    82 Answers
    100%
    Lived up to sales and marketing promises
    9 Answers
    Implementation went as expected
    97%
    Implementation went as expected
    90 Answers
    100%
    Implementation went as expected
    12 Answers
    Best Alternatives
    UserTestingVisual Studio Test Professional
    Small Businesses
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    Dovetail
    Score8.6 out of 10
    No answers on this topic
    Enterprises
    Optimal
    Score8.5 out of 10
    No answers on this topic
    All AlternativesView all alternativesView all alternatives
    User Ratings
    UserTestingVisual Studio Test Professional
    Likelihood to Recommend
    8.5
    (196 ratings)
    7.0
    (15 ratings)
    Likelihood to Renew
    8.4
    (8 ratings)
    -
    (0 ratings)
    Usability
    8.6
    (174 ratings)
    7.0
    (10 ratings)
    Availability
    9.1
    (1 ratings)
    -
    (0 ratings)
    Performance
    9.1
    (1 ratings)
    -
    (0 ratings)
    Support Rating
    8.3
    (173 ratings)
    8.5
    (10 ratings)
    Implementation Rating
    4.6
    (4 ratings)
    -
    (0 ratings)
    Configurability
    7.3
    (1 ratings)
    -
    (0 ratings)
    Product Scalability
    7.3
    (1 ratings)
    -
    (0 ratings)
    Vendor post-sale
    9.1
    (1 ratings)
    -
    (0 ratings)
    Vendor pre-sale
    9.1
    (1 ratings)
    -
    (0 ratings)
    User Testimonials
    UserTestingVisual Studio Test Professional
    Likelihood to Recommend
    UserTesting
    UserTesting has been great for moderated customer interviews/usability testing as well as for unmoderated testing of messaging, imagery, prototypes and live experiences. I would say that the scope of what you want needs to be limited, as the participants are only paid so much and tests are supposed to not exceed a certain amount of time. For customer interviews, I think it can be difficult to onboard customers to UserTesting if they have never used it before. If I set up interviews, I don't even have them use the UserTesting scheduling tool, I actually set up all the interviews with the customers myself through the tool (being mindful of time zones!). When we run the meeting, they really don't even know UserTesting is involved. Might be nice for UserTesting to allow the upload/connecting to of a Zoom interview and let it do the transcription/analysis from there.
    Incentivized
    Read full review
    Microsoft
    It would be well suited if we used it with Azure DevOps as we can effortlessly integrate the test cases and even stories or tasks to stay on track with our work. Those test cases can even be reused across multiple projects. Using any other third-party tools, such as Jira, can be less appropriate, as it's not a Microsoft tool, and its capabilities will be limited.
    Incentivized
    Read full review
    Pros
    UserTesting
    • Product Manager who follows up on your UserTesting usage and gives advice/support when you need it.
    • UserTesting University is a great platform to learn how to use UT and general information about research.
    • UserTesting can find participants quickly, so you won't need to wait long before you can start the analysis.
    Incentivized
    Read full review
    Microsoft
    • Availability of the desktop client or the web interface. The web interface being the favorite and providing a better experience.
    • It enables you to write unit tests with so much ease.
    • Allows the recording and repeating of manual tests
    • It can be set up for collaboration.
    Incentivized
    Read full review
    Cons
    UserTesting
    • Sometimes there are restrictions around types of research that can be used for moderated user-testing with our own users.
    • For tests on relatively small areas of a website or app, the AI analysis seems rather overblown, like it's trying too hard to come up with something insightful when the test is actually about something quite small (e.g. structure of a mobile app menu).
    • It's difficult to invite our own users to unmoderated user-testing because they wouldn't know how the UserTesting interface works - this is particularly an issue for mobile research.
    Incentivized
    Read full review
    Microsoft
    • The user community of the Visual Studio Test product is weak. For instant problems with this product, it is necessary to quickly reach the source of the error.
    • Licence fees need to be more reasonable. License prices need to be reduced so that they can easily compete with free testing tools.
    Incentivized
    Read full review
    Likelihood to Renew
    UserTesting
    I'm very happy with my experience of the product and the level of service and learning resources they provide. If the service becomes more expensive than it currently is then we might not be able to justify additional cost - but this is theoretical. I would recommend UserTesting and would ideally renew our contract.
    Incentivized
    Read full review
    Microsoft
    No answers on this topic
    Usability
    UserTesting
    It's very good, I have used other tools in the past and this is by far the most intuitive and user friendly. Testament to this is the ease with which other non researchers who have been onboarded to the tool with our additional seat have found it easy to use
    Incentivized
    Read full review
    Microsoft
    It is very usable if you are familiar with Visual Studio to begin with. If you are new to the interface, it can be a long ramp up period for Testers not used to the GUI. There is always the web option which seems to be more intuitive for many Testers.
    Incentivized
    Read full review
    Reliability and Availability
    UserTesting
    Never encountered any problems
    Incentivized
    Read full review
    Microsoft
    No answers on this topic
    Performance
    UserTesting
    Perfectly fine. Never had any problems.
    Incentivized
    Read full review
    Microsoft
    No answers on this topic
    Support Rating
    UserTesting
    I have contacted UserTesting's customer service online, by email, or by phone a few times, and each time, I have encountered the same professionalism and expertise. Even in person during a work event, they were there, and it was the same experience.
    Incentivized
    Read full review
    Microsoft
    Visual Studio Test Professional is backed up by the full support of the Microsoft Corporation. That means twenty-four/seven customer support by quality, highly-trained professionals who understand every possible issue that you have experienced before. They are nice, efficient, and highly professional. I recommend them.
    Incentivized
    Read full review
    Implementation Rating
    UserTesting
    From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.
    Incentivized
    Read full review
    Microsoft
    No answers on this topic
    Alternatives Considered
    UserTesting
    The quality of the participants: they usually have good feedback and act like "professional" users. Which is good when we want a few insights in a short amount of time. Also, the interface is good. I miss having more features, like a good transcription tool like we have in Condens
    Incentivized
    Read full review
    Microsoft
    The visual Studio Test tool is faster than other tools. Since the development and testing processes are in one tool, it is more profitable in terms of cost. It is more inconvenient to write a test case in DevOps.
    Read full review
    Scalability
    UserTesting
    The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.
    Incentivized
    Read full review
    Microsoft
    No answers on this topic
    Return on Investment
    UserTesting
    • Content is key to the sign up journey and UserTesting helps me improve that.
    • UserTesting has helped me improve the Cashier on our site, making it easier for users to deposit money.
    • UserTesting is helping me iterate all our content decisions, helping us improve the UX across all platforms.
    Incentivized
    Read full review
    Microsoft
    • One of the positive ROIs of Visual Studios is the fact that it makes producing our work at a quick rate, things like Intellisense make our work get produced at a much higher rate which is good for our return of investment.
    • Testing by the developers has increased by 23%, we now take the time to actually test our product before we send it to our QA people.
    • I am not aware of any negative ROI aspects to our company that have been found.
    Incentivized
    Read full review
    ScreenShots

    UserTesting Screenshots

    Screenshot of UserTesting's several solutions for gathering rich customer experience narratives.Screenshot of Interactive Path Flows
Built on recent research in data mining, the Interactive Path Flow aggregates interaction data across multiple participant sessions to visualize the customer journey, surface unexpected behaviors, and locate key moments in the customer journey.Screenshot of Keyword Mapping
Similar keywords are automatically grouped based on overall sentiment (positive, negative, or neutral) to identify themes. Highlight reels associated with each keyword are grouped together, to discover the why behind each sentiment.Screenshot of Video capture and live streaming
Digital and real-world customer experiences are recorded on desktop and mobile devices or live streamed for in-platform viewing.Screenshot of Audience targeting
Audiences are specified by screening contributors from UserTesting’s global network of contributors or connecting to any preferred network.