TrustRadius Insights
Sauce Labs has proved to be a valuable tool for various teams and departments within organizations. Users appreciate the seamless …
Starting at $19 per month
View PricingOverview
What is Sauce Labs?
Sauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple…
Recent Reviews
Awards
Products that are considered exceptional by their customers based on a variety of criteria win TrustRadius awards. Learn more about the types of TrustRadius awards to make the best purchase decision. More about TrustRadius Awards
Reviewer Pros & Cons
Video Reviews
1 video
Sauce Labs Provides Details for Android Developer and Engineer
02:10
Pricing
Live Testing
$19.00
Cloud
per month
Virtual Cloud
$149.00
Cloud
per month
Entry-level set up fee?
- Setup fee optional
For the latest information on pricing, visithttps://saucelabs.com/pricing
Offerings
- Free Trial
- Free/Freemium Version
- Premium Consulting/Integration Services
Product Demos
WebdriverIO + Appium + Sauce Labs = Success? - Live Stream
YouTube
Automated Mobile Testing with Sauce Labs
YouTube
Parallel Testing with Sauce Labs
YouTube
Cross Browser Testing with Selenium, Sauce & Node.js
YouTube
Product Details
- About
- Integrations
- Competitors
- Tech Details
- Downloadables
- FAQs
What is Sauce Labs?
Sauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple virtual machines across many different browser, platform and device combinations, testing time is reduced and developer time is freed up from managing infrastructure.) The Sauce Labs testing cloud is intended to be paired with a CI system. According to the vendor, this combination allows developers to easily test desktop and hybrid, native and mobile web applications early on in their development cycles, continuously and affordably.
Sauce Labs provides enterprise-grade security via Sauce Connect™, its secure tunneling protocol for testing behind a firewall while maintaining control of proxy and access policies. Tests are run in the company’s secure data center and VMs are destroyed (not “wiped”) after each run, ensuring customer data is never exposed to future sessions. After tests are completed the Sauce Labs’ dashboard provides a unique build-oriented report with metadata, access to Selenium logs, screenshots, video recordings, and a complete list of commands and responses. Support for SSO lets customers provision new user accounts on the fly with centralized user account management, access control, and usage reporting.
Sauce Labs Features
- Supported: Automated Cross-Browser Testing
- Supported: Automated Mobile Testing
- Supported: Manual Testing
- Supported: Real device cloud
- Supported: Integrations with all CI servers and JIRA
- Supported: Enterprise Security
- Supported: Proprietary Data Center
- Supported: Support for Selenium, Appium and JUnit Testing
- Supported: Professional Services & Onboarding
- Supported: Instructor-led Selenium and Appium training
Sauce Labs Screenshots
Sauce Labs Integrations
Sauce Labs Competitors
Sauce Labs Technical Details
| Deployment Types | Software as a Service (SaaS), Cloud, or Web-Based |
|---|---|
| Operating Systems | Unspecified |
| Mobile Application | No |
Sauce Labs Downloadables
- Sauce Labs Automated Testing Platform Datasheet
- Sauce Connect - Security in the Sauce Labs Cloud
- Sharecare Scales from Manual to Mobile with Sauce Labs - Case Study
- OKTA Increases Developer Productivity 80% with Sauce Labs - Case Study
- Campus Explorer Reduces Testing Time from 72 Hours to 72 Minutes with Sauce Labs - Case Study
Frequently Asked Questions
Reviewers rate Availability and Product Scalability highest, with a score of 10.
The most common users of Sauce Labs are from Enterprises (1,001+ employees) and the Computer Software industry.
Comparisons
Compare with
Reviews and Ratings
(286)
Community Insights
TrustRadius Insights are summaries of user sentiment data from TrustRadius reviews and, when necessary, 3rd-party data sources. Have feedback on this content? Let us know!
- Business Problems Solved
- Pros
- Cons
- Recommendations
Sauce Labs has proved to be a valuable tool for various teams and departments within organizations. Users appreciate the seamless integration of the platform with Jenkins CI servers, enabling continuous testing of web applications in real browsers and Dockerized environments. The ability to easily configure proxy tunnels and access firewalled environments and desired browsers via the Sauce OnDemand Jenkins plugin has been a major selling point.
One key use case for Sauce Labs is running regression test suites against different OS and browser combinations, which saves time and effort in maintaining test environments. Developer teams utilize Sauce Labs for running end-to-end Selenium tests, while the testing team manages its usage across the organization. Customer Service and Email Marketing teams also benefit from Sauce Labs, using it to identify and address customer issues and bugs before or after deployment. Additionally, the QA team relies on Sauce Labs for executing daily automation test cases on various platforms including mobile and web.
Best solution for deep automated browser testing: Users find Sauce Labs to be the best solution for integrating deep automated browser testing in a CI/CD pipeline, with multiple reviewers stating this as a key advantage of using the platform.
Ability to run test runs faster: Many users appreciate the ability to run test runs faster by using as many VMs as required, which is particularly helpful for CD/CI processes. This feature has been praised by multiple reviewers for its contribution to improving efficiency and reducing execution time.
Sauce Connect Proxy enables testing in firewalled environments: The Sauce Connect Proxy feature is highly valued by users as it allows companies to test in firewalled environments and localhost. Several reviewers have mentioned how this feature enables easy testing of applications behind a firewall, making it a valuable option for conducting tests securely.
Confusing and Difficult User Interface: Users have consistently found the user interface of the tool to be confusing and difficult to navigate, which has made it challenging for them to perform tasks efficiently. Several reviewers have expressed frustration with the complexity of the setup and configuration process, indicating a lack of user-friendliness.
Stability Issues: Some users have experienced stability issues with Sauce Labs, reporting that the tool is not reliable. These instances of instability can negatively impact the testing process for users, causing delays and uncertainties.
Limited Reporting and Customization Options: The lack of comprehensive reporting and customization options for dashboards is a drawback for users who require more detailed analytics and integration with APIs. This limitation has been mentioned by multiple reviewers, highlighting a need for improved functionality in this area.
Based on user reviews, users commonly recommend the following for Sauce Labs:
-
Request a trial and take advantage of fast support. Users highly recommend asking for a trial of Sauce Labs. They praise the company's fast support, which is beneficial in getting started with the tool.
-
Use Sauce Labs for multi-browser and multi-device automation. Sauce Labs is considered the best tool for cloud testing, particularly for testing web applications in different browsers, devices, and operating systems. Users mention its easy adoption and interface as strong points.
-
Consider test architecture and logging for effective automation testing. Users suggest putting at least 2 retries in the test configuration when performing parallel mobile testing with Sauce Labs. They also advise considering test architecture and test logging to enhance the automation testing process.
Overall, users highly recommend Sauce Labs as a top service provider in the market, especially for continuous automated testing and serious mobile or desktop testing. It is praised for its secure nature and integration with real devices on the cloud. However, users also suggest trying other services like BrowserStack for comparison purposes.
Attribute Ratings
Reviews
(126-150 of 159)Companies can't remove reviews or game the system. Here's why
May 17, 2017
Sauce Labs Review
It is used by one department, with multiple sub-teams across the world. We run client tests on sauce labs to make sure our code has high quality.
- VMs are set up quickly, clean and stable.
- REST API is easy to use and stable.
- It has videos for test failure investigation.
- They don't have different packages of services to choose from. Service/fees are flat.
- They recommend services we don't need but ignore the real requests/help we need.
May 16, 2017
Sauce Labs way to go for QA
I did a POC on sauce labs and BrowserStack. I found sauce labs is more efficient and better than BrowserStack. I asked top management to get licenses of sauce labs. Now it is a very important part of our CI/CD process. We run more than 10K tests weekly. These tests run in parallel and across browsers.
- Parallel execution
- Ability to monitor tests from anywhere
- Easy integration with Jenkins
- Good customer support
- It would be good if, the performance of a VM can be increased.
May 15, 2017
Sauce Labs from automation point of view
Generally Sauce Labs is a good service, but what I found most problematic is the wait time for the emulators to start up. If the test is just a simple check, it was not uncommon that over 70% of the test execution time was spent on waiting for the environment.
Another issue that is problematic in my experience is the tunnel for local work. I personally didn't have much issues with it, but members of my team spent some time debugging why it's not working.
Another issue that is problematic in my experience is the tunnel for local work. I personally didn't have much issues with it, but members of my team spent some time debugging why it's not working.
- Once it's all connected, it's very easy to run the tests on multiple devices.
- The logs/screenshots/screen recordings are very helpful when debugging an issue.
- Depending on the subscription the tests can run parallelly, reducing the run time.
- The failures can be tried manually later, and with the provided screenshot/recordings it's quite easy to reproduce them
- Slowness is the biggest issue I would say. Sometimes a big portion of the test execution time is purely waiting on stuff to start/tear down.
- Restricted number of parallel threads can be a bottle neck if you have a big test suite.
May 15, 2017
Sauce Labs is awesome
I am currently working for major home improvement retail clients on Selenium automation [and have been] for more than 4 years. Initially when we started automation we were not using Sauce labs, the execution time for a regression suite used to take 4 to 5 hours and 1 to 1.5 hours for failure analysis. After using Sauce Labs the execution time reduced significantly from 4 hours to 20 mins. Also we were able to execute scripts on different browsers and platforms. We run test cases on iPhone, iPad and android devices. Sauce Labs is being used across the organization.
- Provides variety of browser versions and a platform to execute scripts.
- We can execute test cases in parallel. This has reduced our execution time. We can do same with grid set up but it's not that easy to have infrastructure provided by Sauce Labs.
- Ability to capture videos. We can integrate video in an HTML report and show to developers how to reproduce.
- Start up time for iPhone and iPad devices takes more time. This could be reduced.
May 12, 2017
Improved Automation Testing Speeds and coverage!
Sauce Labs is used by our company to spin up different permutations of operating systems and machines to run automation across multiple threads. This helps the company save valuable resources from a time and resource perspective. Thanks to Sauce Labs, the QA team is able to effectively run tests to improve the quality of the platform, whether that is done manually or automatically.
- Support for multiple permutations of operating systems and browsers
- Enable performance testing via threading
- Ease of use
- The lag time when interacting with the VM manually
- Shortcut support
May 09, 2017
Sauce Labs review
We use sauce labs in our scrum team to conduct automated UI tests for the main feature flows of our application. We run from 4-5 tests using 3 browser configurations after each commit to development branch.
- It's a great tool for getting a quick, on-demand test environment for doing a manual test.
- It integrates well with commonly used task runners (MVN, Grunt).
- It's easy to write executable tests based on Selenium engine.
- The tests commands are sent by individual HTTP requests - it could be improved by sending more data at once to speed the overall remote test execution.
- In our case the tests executed on a Safari browser are unstable. The results are non-deterministic - random fails, random successes.
It is used by more than a few departments mainly for projects that are customer facing and need cross browser testing. We at Capital One follow CICD pipeline and Sauce labs helps us automate cross browser testing end to end. We have at times faced issues with regards to connectivity due to which our pipeline fails, but most of the time the team at Sauce labs has been pretty responsive in helping is resolve the issue.
- Automated end to end cross browser testing
- Connectivity issues
- Off hours support
May 05, 2017
Sauce Labs Review
We use Sauce labs for running our automated test cases on different browsers. It is used by our software division and mainly helps in cross browser testing. The video playback feature is very useful and helps us analyze the failed test cases step by step. The logs are very detailed.
- Video play back feature
- Excellent customer support
- Sauce Connect - for secure testing
- Quicker response time on manual testing
- Hard to use keypad if you have a Mac OS and you test on a sauce labs Window machine
May 03, 2017
Great way to play with browsers.
Sauce Labs is used in various ways across our organization, from unit tests to functional testing. Primarily it's used to address supporting our product on various browsers, specifically the browsers that are hard to set up internal infrastructure for, such as Safari.
- Ability to run against different browsers.
- Provide consistent environment for tests to run on.
- Provide playback and screenshots for tests.
- Connectivity, a lot of our fails are due to the inability to connect properly to the browsers
- How to solve latency for tests and how to improve on latency
We've been successfully leveraging Sauce Labs, by our SDETs and DEVs to verify our end-to-end testing across the latest and "legacy" platforms across multiple organizations. Sauce Labs provides QA/DEV teams the ability to automate UI/UX with a focus on our automation and less on managing the infrastructure, e.g. Selenium Grid, while fitting in with our CI/CD methodologies. At times, the test execution can be "slow", however, the big-picture of executing in parallel and saved-time per resource management is a win.
In addition, our UI/UX teams require visual test coverage, not just "functional" - the seamless integration between SauceLabs/Selenium/Applitools' Eyes works really well for our team - since it requires very little effort to leverage visual testing in our existing automated tests!
In addition, our UI/UX teams require visual test coverage, not just "functional" - the seamless integration between SauceLabs/Selenium/Applitools' Eyes works really well for our team - since it requires very little effort to leverage visual testing in our existing automated tests!
- Documentation on using Sauce Labs has improved, specifically, the examples and excerpts for different programming languages are helpful and thoughtful.
- The Git repo (examples) have helped my team to quickly explore and experiment with the provided examples by Sauce Labs.
- The "Dashboard" has greatly improved .. helps us to manage and see how our teams are utilizing Sauce Labs and automation, including the device coverage that our automated tests are covering.
- Sauce Labs' plugin to Jenkins is improving, this helps our SDETs quickly and reliably add/update automated tests with less coding and boilerplate scripting!
- On occasion, Sauce Labs, was off-line due to unexpected outage (or planned outage). When our tests failed due to these outages, we weren't notified in a timely manner. For example, after 2 hours, we finally realized it wasn't our environment/tests that were failing, but Sauce Labs was down. We were reminded to visit the "status" page, however, that doesn't seem pro-active enough. It'll be great if "sauce-connect" provided immediate feedback of such circumstances.
- Selenium's success is tied directly with Sauce Labs, whereas "cross-browser" testing is one of the selling points to use Sauce. However, the differences and nuances of APIs per Selenium, with regards to, IE11, Edge, Firefox, and Chrome should be better highlighted in their documentation.
- For example, keyboard navigation and active-focus requires different approaches w.r.t browsers. This is especially important for testing scenarios with keyboard vs. mouse.
- Consistency in test execution.
- At times, without any changes to our automate testware, the execution results are not consistent, this places doubt on our existing automated tests. There should be a "performance-expectation" thermometer.
We use sauce labs to run tests against various browsers/devices. It's being used by multiple orgs in our company.
- Having ability to run tests against various browser on demand
- Maybe mobile devices can be faster.
We use it to test all of our web and mobile apps for the 5 services we provide. We utilize the cross browser and device testing features. It's a test lab in the cloud that we don't have to maintain. We have 20 VMs and run roughly 1200 tests a day.
- Cross Browser/Platform testing.
- Keeping up with the latest technologies.
- Supporting issues when problems occur.
- Mobile Test take 10 times longer to run than their web counterparts. It seems like it takes roughly 7 minutes to just spin up an instance of iOS.
- Appium support and development. The tool isn't stable, hard to set up and configure.
- Reporting, provide more with the API integrations and allow us to customize our dashboards. Allow users to see all test run results not just their own.
April 04, 2017
Sauce Review
Used for testing our Cloud UI at Salesforce.
- Service availability
- Breath of coverage
- Integration
- Metrics of usage
- Reporting
- Breath of portfolio
April 01, 2017
Amazing Sauce Labs!
We are using Sauce Labs for Test Automation purposes. It is being used by different departments in the organization. It helps in cross browser testing.
- user friendly. it is easy for test automation as it can be used to test applications in different browsers.
- good return of ROI.
- reliable and bug free environment.
- expensive for long term use.
Currently, it is being used by one of the projects within the department and not across the whole organization. Sauce Labs helps to run our tests in parallel and reduce our build time. Also, it helps us with cross-browser regression tests.
- Parallel Execution of Tests
- Reliability and Stability of the cloud VMs and Overall Infrastructure including Sauce Connect Tunnel
- Good Support Staff
- Emulator (iOS/Android) are slow and sometimes unreliable
- Need real devices to be available for execution (may be with test object that will be soon expected)
- Manual Testing experience is slow (may be non US region)
- Replay of Tests experience is not great
We use sauce labs to run our selenium tests for our CI/CD automated test suites. Pretty much all of our selenium testing is done using sauce labs.
- Run tests against all of the browsers and OSs that we support.
- Handles scaling our tests for us.
- Is available to help us make our testing setups and processes better.
- When sauce labs has problems, they become the single point of failure.
- When you have a large number of tests, even moderate performance issues will cause test suite failures.
- When it rains, it pours. Performance issues tend to come in batches that recur over multiple days.
March 27, 2017
Magic Sauce to Agile Testing Environment
Currently at Act-On we use Sauce Labs to get into different browser platforms for testing, that is the purpose of my QA team. Sauce Labs acts as an analytic tool for the Sales and Marketing teams.
- Used for Selenium testing.
- Parallel functional testing.
- Well secured although its usages are in cloud are encrypted.
- Increases test coverage by multi platform testing at a much faster rate.
- Sometimes the app gets very slow during multi session testing period.
- It saves password and next time sign in it auto fills. But this is okay since we use fake logins.
March 24, 2017
Reliable but troublesome to use
We use it in one of our departments. We use it for our end to end on our web pages since it is our minimal requirements.
- Multiple environments
- Able to use with Nightwatch
- Reliable
- Better Internet Explorer support
- Safari support
- Random 500 fails, hang ups
March 17, 2017
Awesome Sauce!
Sauce Labs is being used for performing functional tests for web and mobile. It is currently being used by the whole organization, with the mobile teams lagging behind a bit. We needed to have a SaaS solution and deprecate the in-house Selenium Grid due to maintenance hassles.
- Sauce is SaaS and hence you do not need to maintain your on-prem Selenium Grids.
- Sauce operates through a secure tunnel and hence the security reviews to on-board this vendor in your company should be smooth.
- Sauce has good docs.
- Sauce support through tickets is sub-optimal, with the responses being less than helpful or insightful.
- Sauce VMs are pricey while mobile devices are prohibitively expensive.
- Sauce has data centers in the West Coast and hence installations in the East Coast undergo severe network latency issues. This is okay when scheduled, however, this hurts in a Continuous Delivery Pipeline.
March 17, 2017
Sauceness Awesomeness
Sauce labs being used across the wider organization. We have an enterprise account which allows us to run tests across multiple browsers and OS devices. Also having access to different browser versions for exploratory testing/checking bugs in different versions gives a lot of flexibility. It allows us to run large numbers of tests concurrently.
- Video recording
- How quickly the browsers get provisioned
- The API to pull out extra test information
- The availability of real devices
- Better filtering of the JSON results
- The UI was better before changes
March 13, 2017
Sauce Labs Review
We use sauce labs as a small team (3-6) of people to run all of our UI tests. We especially like its multi-browser support.
- Automatic
- Ability to replay sessions
- Multi-browser support
- Adding new user accounts
- Managing current accounts
March 10, 2017
Sauce Labs. Do it.
The product my team owns is a mobile first web app. I configured our build pipeline to run all of our Javascript Jasmine tests in IE10, IE11, Safari, FireFox (FF), Chrome, iOS, and Android. On top of that we have a build that runs all of our Capybara behavioral tests against IE10, IE11, Safari, FF, Chrome, iPad, and iPhone (Android was tricky for this one so it is left out at the moment). And then on top of that I added a visual testing suite that uses sauce labs with applitools eyes to test how numerous pages on our site look on IE10, IE11, Safari, Chrome, iPad horizontal, iPad vertical, iPhone horizontal, and iPhone vertical (again android was tricky for this one so it is left out at the moment). I did most of this work in response to our team losing our QA resource as a way to give us a way to give us an automated exploratory testing.
- It is really good for giving you access to numerous OSs and devices for automated and manual tests.
- Automation via mobile device simulators are terribly slow. This causes delays in our pipeline.
- I wish It was cheaper, or had different licensing. I'd like to be able to run even more tests in parallel.
March 08, 2017
Sauce Labs helps to move to CD efficiently
[It's used] mainly for continuous integration and delivery for cross-browser testing by the entire organization. It solves the big problem of maintaining infrastructure in-house.
- Making beta platform and browsers available to be prepared and avoid any browser issues for customer base.
- Mobile testing. Emulators are slow and crash often.
- Possibly some new load testing features.
February 27, 2017
Keep it simple
Sauce Labs is being used as a Platform as a Service(PaaS), which helps the development team immensely while developing new features and QA validation across different browsers/combinations that our software product supports. We also have 2000+ automated regression tests which we run and monitor nightly.
- Sauce Labs does a great job at providing updates and fixing them as quickly as possible (status.saucelabs.com).
- Continuously adding new features to facilitate clients and make life much simpler.
- Support queries getting replied and fixed rapidly.
- I would like to point out Archive tab in particular, We have been running 2000+ tests which does not mean we have 2000 tests they are data provider driven tests with the same job name. The con is finding the particular test which broke based on the console (Jenkins). It's really trivial adding some kind of JQL that finds the tests by its ID.
February 24, 2017
Love the Sauce!
It was recently adopted by the product tech department to be used for multi-browser testing of our newly developed web-based apps. It has not been adopted enterprise-wide. Other departments., specifically QA, are using SkyeTap. It quickly allows us to assess the compatibility of our products across many platform configs without a lot of manual work.
- Within an automation suite, you can quickly set up browser/OS configurations. You can be extremely specific as to browser and OS versions. All it takes is a couple of selections in drop-down menus for manual tests or the addition of a couple lines of code for automated tests.
- Within an automation suite, you can parallelize test execution (run concurrently) up to as many VMs as required (provided you purchase them). This allows the test runs to complete faster. If you are using SL as part of a CD/CI process, that can be very helpful in that code can be merged faster.
- In the Sauce Lab dashboard, the capturing of videos, screenshots, and logs are very helpful for debugging failed tests. The videos and screenshots help when manual verification of a browser is needed for correct UI formatting.
- We are using a Ruby/Cucumber automation framework and we had to split our files into separate scenarios so we could properly report on each scenario. The same thing had to be done when we were running Protractor/Jasmine tests. Maybe they could somehow have reporting at the individual test level instead of file level.
- It seems the Sauce Labs VMs are quite a bit slower than our local VMs even taking into account the tunnel. I understand that parallelization makes up for some of the slowness, but it still causes tests to run slower and more timeouts can occur if you don't adjust wait times when running on Sauce Labs. If you could beef up the VMs a bit more it would make life easier.
- The documentation to get up and running initially is very good on the website. However searching for anything beyond that (problems, error messages, different automation frameworks) can sometimes be hard because of the confusing UI navigation, broken links ect. There is a lot of good info on the support pages but it definitely needs to be revamped to be more accessible.