TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Sauce Labs

    Score6.8 out of 10
    N/ASauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple virtual machines across many different browser, platform and device combinations, testing time is reduced and developer time is freed up from managing infrastructure.) The Sauce Labs testing cloud is intended to be paired…

    $19

    per month

    Visual Studio Test Professional

    Score7 out of 10
    N/AAn add-on for the Visual Studio IDE, Visual Studio Test Professional subscription helps teams drive quality and speed. It includes test case management and collaboration features that streamline quality control and support continuous delivery.

    $2,169

    for the first year (renews at $869)

    Pricing
    Sauce LabsVisual Studio Test Professional
    Editions & Modules
    Live Testing
    $19.00
    per month
    Virtual Cloud
    $149.00
    per month
    No answers on this topic
    Offerings
    Pricing Offerings
    Sauce LabsVisual Studio Test Professional
    Free Trial
    YesNo
    Free/Freemium Version
    YesNo
    Premium Consulting/Integration Services
    YesNo
    Entry-level Setup FeeOptionalNo setup fee
    Additional DetailsFree service available for Open Source projects.—
    More Pricing Information
    Community Pulse
    Sauce LabsVisual Studio Test Professional
    Considered Both Products
    Sauce Labs
    No answer on this topic
    Microsoft
    No answer on this topic
    Key User Insights
    Would buy again
    90%
    Would buy again
    19 Answers
    100%
    Would buy again
    12 Answers
    Delivers good value for the price
    100%
    Delivers good value for the price
    19 Answers
    91%
    Delivers good value for the price
    10 Answers
    Happy with the feature set
    95%
    Happy with the feature set
    20 Answers
    100%
    Happy with the feature set
    12 Answers
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    11 Answers
    100%
    Lived up to sales and marketing promises
    9 Answers
    Implementation went as expected
    90%
    Implementation went as expected
    18 Answers
    100%
    Implementation went as expected
    12 Answers
    Best Alternatives
    Sauce LabsVisual Studio Test Professional
    Small Businesses
    TestComplete
    Score8 out of 10
    No answers on this topic
    Medium-sized Companies
    OpenText UFT One
    Score8 out of 10
    No answers on this topic
    Enterprises
    SoapUI Open Source
    Score8.3 out of 10
    No answers on this topic
    All AlternativesView all alternativesView all alternatives
    User Ratings
    Sauce LabsVisual Studio Test Professional
    Likelihood to Recommend
    5.6
    (158 ratings)
    7.0
    (15 ratings)
    Likelihood to Renew
    9.3
    (20 ratings)
    -
    (0 ratings)
    Usability
    8.4
    (20 ratings)
    7.0
    (10 ratings)
    Availability
    10.0
    (4 ratings)
    -
    (0 ratings)
    Performance
    8.0
    (4 ratings)
    -
    (0 ratings)
    Support Rating
    8.3
    (15 ratings)
    8.5
    (10 ratings)
    Implementation Rating
    7.5
    (6 ratings)
    -
    (0 ratings)
    Configurability
    8.2
    (3 ratings)
    -
    (0 ratings)
    Ease of integration
    9.1
    (2 ratings)
    -
    (0 ratings)
    Product Scalability
    10.0
    (4 ratings)
    -
    (0 ratings)
    Vendor post-sale
    9.0
    (4 ratings)
    -
    (0 ratings)
    Vendor pre-sale
    9.0
    (4 ratings)
    -
    (0 ratings)
    User Testimonials
    Sauce LabsVisual Studio Test Professional
    Likelihood to Recommend
    Sauce Labs
    Having used some of the competitor's tools over the year I would say that SauceLabs provides a lot of value for money if you plan to run long sets of tests with high frequencies. Paying for a single slot means you can run tests whenever you want without creeping costs but it does make running tests in parallel require an extra slot. Currently, our test suite takes over three hours to run and at the moment it is cost prohibitive to purchase an extra slot. However, having access to live testing and integration with Appium is great.
    Incentivized
    Read full review
    Microsoft
    It would be well suited if we used it with Azure DevOps as we can effortlessly integrate the test cases and even stories or tasks to stay on track with our work. Those test cases can even be reused across multiple projects. Using any other third-party tools, such as Jira, can be less appropriate, as it's not a Microsoft tool, and its capabilities will be limited.
    Incentivized
    Read full review
    Pros
    Sauce Labs
    • Provides a comprehensive selection of browser and platform versions for test automation and CI/CD pipeline support
    • Provides a rich selection of browser/platform availability for customer issue reproduction
    • Provides a comprehensive set of virtual mobile device configurations for automation and availability
    • Sauce Labs' SaaS and self service tools work and perform well
    Incentivized
    Read full review
    Microsoft
    • Availability of the desktop client or the web interface. The web interface being the favorite and providing a better experience.
    • It enables you to write unit tests with so much ease.
    • Allows the recording and repeating of manual tests
    • It can be set up for collaboration.
    Incentivized
    Read full review
    Cons
    Sauce Labs
    • I've had four changes in account managers over the past couple of years. They ranged from super experienced/advocate to some that seems relatively junior/a bit removed. I understand this happens but clarity on what I can expect with these partnerships would be valuable. What I've gotten in the end has varied dramatically.
    Incentivized
    Read full review
    Microsoft
    • The user community of the Visual Studio Test product is weak. For instant problems with this product, it is necessary to quickly reach the source of the error.
    • Licence fees need to be more reasonable. License prices need to be reduced so that they can easily compete with free testing tools.
    Incentivized
    Read full review
    Likelihood to Renew
    Sauce Labs
    As we currently know, there's nothing on the market with a big feature set like saucelabs at their current price point. Along with the business not having to learn a whole new tool to use again and the ability to refresh our private devices and the continuously growing number of public devices available and features.
    Incentivized
    Read full review
    Microsoft
    No answers on this topic
    Usability
    Sauce Labs
    It is an incredibly easy service to use for what its primary intention is. The only reason a point is deducted is because more feature enrichment can be done around the Sauce Connect Proxy utility and the Jenkins Sauce OnDemand plugin. User Account administration also needs more work, such as the addition of user groups, rather than a simple hierarchy of users.
    Incentivized
    Read full review
    Microsoft
    It is very usable if you are familiar with Visual Studio to begin with. If you are new to the interface, it can be a long ramp up period for Testers not used to the GUI. There is always the web option which seems to be more intuitive for many Testers.
    Incentivized
    Read full review
    Reliability and Availability
    Sauce Labs
    Yes, Sauce labs is always there, and it is easy to troubleshoot when you are having any connectivity issue, they always keep you informed when they plan to perform any type of maintenance window on their side in advance, so you can plan and will not affect your current work. I do not recall any outage.
    Incentivized
    Read full review
    Microsoft
    No answers on this topic
    Performance
    Sauce Labs
    The time where they acquired TestObject and were trying to integrate their services would probably be the most annoying time. Annoying as features were in two separate places (websites) for example. But since the introduction of their unified platform, we haven't run into any issues as of yet and we've used them for at least 5-6 years now.
    Incentivized
    Read full review
    Microsoft
    No answers on this topic
    Support Rating
    Sauce Labs
    The people here are just so friendly and personable. For instance, Tristan Lombard answered every single email with a very cheery tone and not only did he diagnose my issue, he also made sure to ask how my day was going. Keep it up
    Incentivized
    Read full review
    Microsoft
    Visual Studio Test Professional is backed up by the full support of the Microsoft Corporation. That means twenty-four/seven customer support by quality, highly-trained professionals who understand every possible issue that you have experienced before. They are nice, efficient, and highly professional. I recommend them.
    Incentivized
    Read full review
    Implementation Rating
    Sauce Labs
    I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started
    Read full review
    Microsoft
    No answers on this topic
    Alternatives Considered
    Sauce Labs
    We have also tested out Browser Stack, which at the time was more geared towards manual testing. Although it appeared to support more mobile devices/browsers, we also wanted something that can plugin in easily with our existing Selenium test scripts. Sauce Labs was definitely more geared towards our goals at the moment which were to automation functional/regression testing and build it into our release pipeline.
    Incentivized
    Read full review
    Microsoft
    The visual Studio Test tool is faster than other tools. Since the development and testing processes are in one tool, it is more profitable in terms of cost. It is more inconvenient to write a test case in DevOps.
    Read full review
    Scalability
    Sauce Labs
    With private devices, you have full reign over usage of them, so no complaints there. Public devices are available if no one else is using it, which is understandable. Browser VMs are based on number of open sessions and Saucelabs give you a certain number depending on what you need. If you need more, then you pay for more. It is as simple as that. You need more devices, then you can pay for more private ones too. A workaround for public devices is to pick the first available one and not be too picky, that's if you are able to of course.
    Incentivized
    Read full review
    Microsoft
    No answers on this topic
    Return on Investment
    Sauce Labs
    • Eh... Negligible? Being on AWS West makes it quite a few hops for us, so the process times out every now and again. That is frustrating.
    • I can't really speak to the dollars, as I am not privy to the information.
    Incentivized
    Read full review
    Microsoft
    • One of the positive ROIs of Visual Studios is the fact that it makes producing our work at a quick rate, things like Intellisense make our work get produced at a much higher rate which is good for our return of investment.
    • Testing by the developers has increased by 23%, we now take the time to actually test our product before we send it to our QA people.
    • I am not aware of any negative ROI aspects to our company that have been found.
    Incentivized
    Read full review
    ScreenShots

    Sauce Labs Screenshots

    Screenshot of Sauce Labs UI optimized for continuous integration workflows.