TrustRadius Insights
Sauce Labs has proved to be a valuable tool for various teams and departments within organizations. Users appreciate the seamless …
Starting at $19 per month
View PricingOverview
What is Sauce Labs?
Sauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple…
Recent Reviews
Awards
Products that are considered exceptional by their customers based on a variety of criteria win TrustRadius awards. Learn more about the types of TrustRadius awards to make the best purchase decision. More about TrustRadius Awards
Reviewer Pros & Cons
Video Reviews
1 video
Sauce Labs Provides Details for Android Developer and Engineer
02:10
Pricing
Live Testing
$19.00
Cloud
per month
Virtual Cloud
$149.00
Cloud
per month
Entry-level set up fee?
- Setup fee optional
For the latest information on pricing, visithttps://saucelabs.com/pricing
Offerings
- Free Trial
- Free/Freemium Version
- Premium Consulting/Integration Services
Product Demos
WebdriverIO + Appium + Sauce Labs = Success? - Live Stream
YouTube
Automated Mobile Testing with Sauce Labs
YouTube
Parallel Testing with Sauce Labs
YouTube
Cross Browser Testing with Selenium, Sauce & Node.js
YouTube
Product Details
- About
- Integrations
- Competitors
- Tech Details
- Downloadables
- FAQs
What is Sauce Labs?
Sauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple virtual machines across many different browser, platform and device combinations, testing time is reduced and developer time is freed up from managing infrastructure.) The Sauce Labs testing cloud is intended to be paired with a CI system. According to the vendor, this combination allows developers to easily test desktop and hybrid, native and mobile web applications early on in their development cycles, continuously and affordably.
Sauce Labs provides enterprise-grade security via Sauce Connect™, its secure tunneling protocol for testing behind a firewall while maintaining control of proxy and access policies. Tests are run in the company’s secure data center and VMs are destroyed (not “wiped”) after each run, ensuring customer data is never exposed to future sessions. After tests are completed the Sauce Labs’ dashboard provides a unique build-oriented report with metadata, access to Selenium logs, screenshots, video recordings, and a complete list of commands and responses. Support for SSO lets customers provision new user accounts on the fly with centralized user account management, access control, and usage reporting.
Sauce Labs Features
- Supported: Automated Cross-Browser Testing
- Supported: Automated Mobile Testing
- Supported: Manual Testing
- Supported: Real device cloud
- Supported: Integrations with all CI servers and JIRA
- Supported: Enterprise Security
- Supported: Proprietary Data Center
- Supported: Support for Selenium, Appium and JUnit Testing
- Supported: Professional Services & Onboarding
- Supported: Instructor-led Selenium and Appium training
Sauce Labs Screenshots
Sauce Labs Integrations
Sauce Labs Competitors
Sauce Labs Technical Details
| Deployment Types | Software as a Service (SaaS), Cloud, or Web-Based |
|---|---|
| Operating Systems | Unspecified |
| Mobile Application | No |
Sauce Labs Downloadables
- Sauce Labs Automated Testing Platform Datasheet
- Sauce Connect - Security in the Sauce Labs Cloud
- Sharecare Scales from Manual to Mobile with Sauce Labs - Case Study
- OKTA Increases Developer Productivity 80% with Sauce Labs - Case Study
- Campus Explorer Reduces Testing Time from 72 Hours to 72 Minutes with Sauce Labs - Case Study
Frequently Asked Questions
Reviewers rate Availability and Product Scalability highest, with a score of 10.
The most common users of Sauce Labs are from Enterprises (1,001+ employees) and the Computer Software industry.
Comparisons
Compare with
Reviews and Ratings
(285)
Community Insights
TrustRadius Insights are summaries of user sentiment data from TrustRadius reviews and, when necessary, 3rd-party data sources. Have feedback on this content? Let us know!
- Business Problems Solved
- Pros
- Cons
- Recommendations
Sauce Labs has proved to be a valuable tool for various teams and departments within organizations. Users appreciate the seamless integration of the platform with Jenkins CI servers, enabling continuous testing of web applications in real browsers and Dockerized environments. The ability to easily configure proxy tunnels and access firewalled environments and desired browsers via the Sauce OnDemand Jenkins plugin has been a major selling point.
One key use case for Sauce Labs is running regression test suites against different OS and browser combinations, which saves time and effort in maintaining test environments. Developer teams utilize Sauce Labs for running end-to-end Selenium tests, while the testing team manages its usage across the organization. Customer Service and Email Marketing teams also benefit from Sauce Labs, using it to identify and address customer issues and bugs before or after deployment. Additionally, the QA team relies on Sauce Labs for executing daily automation test cases on various platforms including mobile and web.
Best solution for deep automated browser testing: Users find Sauce Labs to be the best solution for integrating deep automated browser testing in a CI/CD pipeline, with multiple reviewers stating this as a key advantage of using the platform.
Ability to run test runs faster: Many users appreciate the ability to run test runs faster by using as many VMs as required, which is particularly helpful for CD/CI processes. This feature has been praised by multiple reviewers for its contribution to improving efficiency and reducing execution time.
Sauce Connect Proxy enables testing in firewalled environments: The Sauce Connect Proxy feature is highly valued by users as it allows companies to test in firewalled environments and localhost. Several reviewers have mentioned how this feature enables easy testing of applications behind a firewall, making it a valuable option for conducting tests securely.
Confusing and Difficult User Interface: Users have consistently found the user interface of the tool to be confusing and difficult to navigate, which has made it challenging for them to perform tasks efficiently. Several reviewers have expressed frustration with the complexity of the setup and configuration process, indicating a lack of user-friendliness.
Stability Issues: Some users have experienced stability issues with Sauce Labs, reporting that the tool is not reliable. These instances of instability can negatively impact the testing process for users, causing delays and uncertainties.
Limited Reporting and Customization Options: The lack of comprehensive reporting and customization options for dashboards is a drawback for users who require more detailed analytics and integration with APIs. This limitation has been mentioned by multiple reviewers, highlighting a need for improved functionality in this area.
Based on user reviews, users commonly recommend the following for Sauce Labs:
-
Request a trial and take advantage of fast support. Users highly recommend asking for a trial of Sauce Labs. They praise the company's fast support, which is beneficial in getting started with the tool.
-
Use Sauce Labs for multi-browser and multi-device automation. Sauce Labs is considered the best tool for cloud testing, particularly for testing web applications in different browsers, devices, and operating systems. Users mention its easy adoption and interface as strong points.
-
Consider test architecture and logging for effective automation testing. Users suggest putting at least 2 retries in the test configuration when performing parallel mobile testing with Sauce Labs. They also advise considering test architecture and test logging to enhance the automation testing process.
Overall, users highly recommend Sauce Labs as a top service provider in the market, especially for continuous automated testing and serious mobile or desktop testing. It is praised for its secure nature and integration with real devices on the cloud. However, users also suggest trying other services like BrowserStack for comparison purposes.
Attribute Ratings
Reviews
(1-2 of 2)Companies can't remove reviews or game the system. Here's why
July 11, 2022
Get Saucy!
We are using it across many teams for test automation across multiple browsers. It makes our lives much easier as we do not have to maintain multiple browsers, drivers, and platforms for testing.
- SauceConnect is great to allow tunnelling to test systems that are behind a firewall. There are many great features and they are adding more all the time.
- The fact that they maintain all WebDrivers and every version of browsers in invaluable. If we have a need for a specific platform, they have it.
- They have been having increased unexpected downtime lately. This is interruptive at times.
- Cut down on environment setup immensely
- Reduce the need for manual testing, which is expensive and slower
Sauce Labs' platform seemed to be the most flexible and I really haven't used much else. Haven't had a need to.
2
Software QA
2
development/devOps/QA
- cross-browser testing
- user flow validations
- automating webdriver maintenance
- Nothing yet
- Device emulation
No
- Price
- Product Features
- Product Usability
- Existing Relationship with the Vendor
Ease of use
Evaluate a few more
- Implemented in-house
Yes
POC, single test, then suite, then adding all tests
Change management was a big part of the implementation and was well-handled
Sauce concepts will help drive us to have more automation
- Nothing yet!
- no training
It was depending on your level of experience. The resources on Saucelabs' website and the Internet were sufficient for me. However, I'm a senior resource and testing manager, so your experience may vary!
Definitely follow their documentation on the website. Between the setup docs and the forums, you can find anything you need! Their support is also top-notch and is very responsive.
No - we have not done any custom code
Not Sure
No
They provide personalized support - they want to know YOUR use case and setup and work within it. This type of support is not common.
- The UI for representing test results is great
- Integration with CI tools is tight and seamless
- Nothing with the product itself - just learning the concepts
Yes
As we began architecting a CI/CD pipeline in our SDLC, a need quickly arose for left-shifted, continuous testing of our web applications in real browsers. Specifically, a service that could integrate seamlessly with our Jenkins CI servers and executing tests continuously against our Dockerized applications and firewalled environments. Furthermore, our company does not have the resources to implement and maintain a proprietary Selenium Grid for test distribution. Sauce Labs addresses all of these concerns, and furthermore offers a platform for manually debugging applications in any combination of platforms, browsers, and devices needed, either from an automated test script or from a manual test session. The largest selling point for our needs is its relatively seamless integration with our Jenkins CI servers, including detailed playback and test reports per build job, as well as easy configuration of the proxy tunnel used to access our firewalled environments and desired browsers-under-test, right from the Jenkins UI via their Sauce OnDemand Jenkins plugin.
- Sauce Labs offers the single best solution for integrating deep automated browser testing in a CI/CD pipeline, and integrates best with Jenkins over their competition.
- The Sauce Connect Proxy is a necessary technology for companies who have firewalled testing environments, as well as localhost testing.
- The Jenkins UI plugin offers a way to easily configure browser settings for tests being executed continuously.
- Browser support is quick to be updated as new versions of browsers are released.
- The custom capabilities that can be provided to Sauce Labs VMs during automated testing sessions are a valuable option for experimental or niche testing.
- The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports. Currently, in order to tap into these capabilities, a programatic solution is required from test code, rather than being able to configure them via the Jenkins plugin UI. For example, things like desktop resolution, browser automation binary versions, remote Selenium version, and browser console logs.
- Some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt. Better documentation, logging, and more intuitive configuration around the Sauce Connect Proxy would take what is already an industry leading feature to the next level.
- User account management needs an overhauls, allowing for user groups, rather than just a hierarchy structure.
- Test job queuing is first-come-first-serve, meaning there is no in-built way to queue batches of jobs from, say, different Jenkins servers/accounts.
BrowserStack captures more market share than Sauce Labs does as of this writing, and thus has a much larger support network. During testing, it was also a little faster to spin-up virtual machines, and substantially quicker spinning-up mobile simulators and emulators. Pricing models were very similar in the enterprise tier. However, while BrowserStack may have been a better choice for manual testing or manually-executed automated tests, Sauce Labs offered a better product and better vision for tests that were left-shifted in a continuous delivery pipeline, which is the architectural direction or company has gone. Their service was proven to better integrate with this pipeline than BrowserStack.
No
- Price
- Product Features
- Product Usability
- Positive Sales Experience with the Vendor
- Third-party Reviews
The features of Sauce Labs over its primary competition are ultimately what drove the purchase decision. Sauce Labs offers a far-better solution for integrating deep user interface testing into a continuous delivery pipeline, that takes care to allow for testing of firewalled environments. The Jenkins support, specifically, informed our decision quite a bit, since we use Jenkins CI servers for our CI/CD model.
Reaching out to Sauce Labs representatives to get a timeline estimate on development of new features might have been an addition to the process we considered. Furthermore, a lengthier trial implementation to better determine some of the shortcoming of features we liked might have been beneficial, such as relatively restrictive user account management.
30
Software Architects, Software Development Engineers, Business Analysts, and Software Test Engineers all leverage the Sauce Labs service in some way.
2
Most support required for Sauce Labs involves coding test automation solutions that interface with Sauce Labs and Jenkins in the ways that are expected of our CI/CD model, and evolve along with it. There are also the administrative tasks surround user account, including creation of new users in the Sauce Labs service, as well as managing their privileges.
- Functional and Regression testing of our web applications via the user interface
- A VM grid supporting all necessary platforms, devices, and browsers that tests can be executed in from our CI servers that is maintenance-free
- Ability to debug browsers, platforms, or devices that are not readily available in-office
- Integration with our continuous delivery pipeline
- Detailed test reports and playback
- The ability to test the responsiveness of our user interfaces against smaller resolutions (either desktop or mobile)
- The ability to test multiple independent browser sessions within the execution of a single test, such as for testing session independence for Single Sign-On cases, or for testing concurrent usage of an application across multiple browser sessions
- The ability to execute automated or manual tests in Sauce Labs against localhost
- Continuous and left-shifted performance testing of the User Experience
- Real Device testing, rather than mobile simulators or emulators
- More extensive mobile testing
- Implemented in-house
No
Change management was minimal
N/A
- Ensuring that implemented automated test scrips could interface with Sauce Labs from either a local workstation or a Jenkins CI server
- Determining a solution for test job queuing. Sauce Labs does not support batch job queuing, but rather test jobs are queuing by first-come-first-server. What this means is that if your organization has multiple CI servers, each with their own Sauce Labs account and each wanting to execute a batch of test jobs, your organization must internally implement a solution to ensure that those concurrent batches of tests do not collide with each other.
- Self-taught
Product is extremely easy to learn on one's own, and requires little technical knowledge unless you are attempting to interface with the service from an in-house test automation framework. The documentation is well done, and updated with an acceptable frequency. Furthermore, they have a knowledge base and community that can be used to research more niche issues or questions.
Ensure that automated test source code and leverage all of Sauce Labs features from either a local workstation or a CI server, and that (if applicable) the Jenkins Sauce OnDemand plugin's configurations take priority over source code configurations, unless source code configs explicitly override the Jenkins plugin configs. This is the best way to ensure that specific test cases can have specific configurations without blanketing them with a configuration for the entire suite, as well as ensure that capabilities Sauce supports that aren't reflected in the Jenkins plugin can be leveraged.
No - there is no facility to customize the interface
No - the product does not support adding custom code
An internal solution needs to be implemented that organized batches of automated tests from multiple CI servers, such that if batches are executing concurrently, their individual tests do not collide with one another in the Sauce Labs service and unexpectedly subtract from the available concurrency pool. Sauce Labs does not support such batch queuing natively.
Yes
Premium support comes with entry into the enterprise license tier, which our company is a part of for legal reasons.
No
Our trial period before we decided to purchase Sauce Labs was extensive. At this time, we were still entertaining the idea of their main competitor as well. We mostly needed to vet what service would best work with our continuous delivery pipeline, and we needed time to prove this out. The Sauce Labs representative we were working with at the time was more than helpful and went above and beyond to ensure that our trial period was extended to as long as we needed to make an informed decision.
- Manual test sessions are very easy to spin up, and customize your platform, device, and browser and its version
- Test playback and metadata viewing is incredibly intuitive, for both manual and automated testing sessions
- Sometimes the Sauce Connect Proxy on a Jenkins server can be inexplicable flaky and fail to start during a build job. When this occurs, debugging the cause is difficult, and it breaks the intention of the CI/CD model.
- To execute a test in Sauce Labs from a local workstation against an application/environment that is firewalled requires starting the Sauce Connect Proxy utility on the local machine. This is a command line utility that may be unwieldy for non-technical people.
- The Jenkins Sauce OnDemand plugin is, as of this writing, relatively restrictive in what capabilities it can set for test execution. If your automated tests wish to tap into more granular capabilities that Sauce Labs supports (such as desktop resolutions, Selenium version in remote VM, automated driver binary version, etc), then a programatic solution is required, as these capabilities cannot be configured from the Jenkins plugin user interface.
Yes, but I don't use it
N/A
- API (e.g. SOAP or REST)
N/A
N/A
Know that the enterprise pricing is flexible and can be negotiated.
No
- N/A, cloud-based
- Hopefully more configurations for user account administration
- More features implemented for the Jenkins Sauce OnDemand plugin
- More fleshed-out Sauce Connect Proxy utility
No
No