TrustRadius Insights
Sauce Labs has proved to be a valuable tool for various teams and departments within organizations. Users appreciate the seamless …
Starting at $19 per month
View PricingOverview
What is Sauce Labs?
Sauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple…
Recent Reviews
Awards
Products that are considered exceptional by their customers based on a variety of criteria win TrustRadius awards. Learn more about the types of TrustRadius awards to make the best purchase decision. More about TrustRadius Awards
Reviewer Pros & Cons
Video Reviews
1 video
Sauce Labs Provides Details for Android Developer and Engineer
02:10
Pricing
Live Testing
$19.00
Cloud
per month
Virtual Cloud
$149.00
Cloud
per month
Entry-level set up fee?
- Setup fee optional
For the latest information on pricing, visithttps://saucelabs.com/pricing
Offerings
- Free Trial
- Free/Freemium Version
- Premium Consulting/Integration Services
Product Demos
WebdriverIO + Appium + Sauce Labs = Success? - Live Stream
YouTube
Automated Mobile Testing with Sauce Labs
YouTube
Parallel Testing with Sauce Labs
YouTube
Cross Browser Testing with Selenium, Sauce & Node.js
YouTube
Product Details
- About
- Integrations
- Competitors
- Tech Details
- Downloadables
- FAQs
What is Sauce Labs?
Sauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple virtual machines across many different browser, platform and device combinations, testing time is reduced and developer time is freed up from managing infrastructure.) The Sauce Labs testing cloud is intended to be paired with a CI system. According to the vendor, this combination allows developers to easily test desktop and hybrid, native and mobile web applications early on in their development cycles, continuously and affordably.
Sauce Labs provides enterprise-grade security via Sauce Connect™, its secure tunneling protocol for testing behind a firewall while maintaining control of proxy and access policies. Tests are run in the company’s secure data center and VMs are destroyed (not “wiped”) after each run, ensuring customer data is never exposed to future sessions. After tests are completed the Sauce Labs’ dashboard provides a unique build-oriented report with metadata, access to Selenium logs, screenshots, video recordings, and a complete list of commands and responses. Support for SSO lets customers provision new user accounts on the fly with centralized user account management, access control, and usage reporting.
Sauce Labs Features
- Supported: Automated Cross-Browser Testing
- Supported: Automated Mobile Testing
- Supported: Manual Testing
- Supported: Real device cloud
- Supported: Integrations with all CI servers and JIRA
- Supported: Enterprise Security
- Supported: Proprietary Data Center
- Supported: Support for Selenium, Appium and JUnit Testing
- Supported: Professional Services & Onboarding
- Supported: Instructor-led Selenium and Appium training
Sauce Labs Screenshots
Sauce Labs Integrations
Sauce Labs Competitors
Sauce Labs Technical Details
| Deployment Types | Software as a Service (SaaS), Cloud, or Web-Based |
|---|---|
| Operating Systems | Unspecified |
| Mobile Application | No |
Sauce Labs Downloadables
- Sauce Labs Automated Testing Platform Datasheet
- Sauce Connect - Security in the Sauce Labs Cloud
- Sharecare Scales from Manual to Mobile with Sauce Labs - Case Study
- OKTA Increases Developer Productivity 80% with Sauce Labs - Case Study
- Campus Explorer Reduces Testing Time from 72 Hours to 72 Minutes with Sauce Labs - Case Study
Frequently Asked Questions
Reviewers rate Availability and Product Scalability highest, with a score of 10.
The most common users of Sauce Labs are from Enterprises (1,001+ employees) and the Computer Software industry.
Comparisons
Compare with
Reviews and Ratings
(285)
Community Insights
TrustRadius Insights are summaries of user sentiment data from TrustRadius reviews and, when necessary, 3rd-party data sources. Have feedback on this content? Let us know!
- Business Problems Solved
- Pros
- Cons
- Recommendations
Sauce Labs has proved to be a valuable tool for various teams and departments within organizations. Users appreciate the seamless integration of the platform with Jenkins CI servers, enabling continuous testing of web applications in real browsers and Dockerized environments. The ability to easily configure proxy tunnels and access firewalled environments and desired browsers via the Sauce OnDemand Jenkins plugin has been a major selling point.
One key use case for Sauce Labs is running regression test suites against different OS and browser combinations, which saves time and effort in maintaining test environments. Developer teams utilize Sauce Labs for running end-to-end Selenium tests, while the testing team manages its usage across the organization. Customer Service and Email Marketing teams also benefit from Sauce Labs, using it to identify and address customer issues and bugs before or after deployment. Additionally, the QA team relies on Sauce Labs for executing daily automation test cases on various platforms including mobile and web.
Best solution for deep automated browser testing: Users find Sauce Labs to be the best solution for integrating deep automated browser testing in a CI/CD pipeline, with multiple reviewers stating this as a key advantage of using the platform.
Ability to run test runs faster: Many users appreciate the ability to run test runs faster by using as many VMs as required, which is particularly helpful for CD/CI processes. This feature has been praised by multiple reviewers for its contribution to improving efficiency and reducing execution time.
Sauce Connect Proxy enables testing in firewalled environments: The Sauce Connect Proxy feature is highly valued by users as it allows companies to test in firewalled environments and localhost. Several reviewers have mentioned how this feature enables easy testing of applications behind a firewall, making it a valuable option for conducting tests securely.
Confusing and Difficult User Interface: Users have consistently found the user interface of the tool to be confusing and difficult to navigate, which has made it challenging for them to perform tasks efficiently. Several reviewers have expressed frustration with the complexity of the setup and configuration process, indicating a lack of user-friendliness.
Stability Issues: Some users have experienced stability issues with Sauce Labs, reporting that the tool is not reliable. These instances of instability can negatively impact the testing process for users, causing delays and uncertainties.
Limited Reporting and Customization Options: The lack of comprehensive reporting and customization options for dashboards is a drawback for users who require more detailed analytics and integration with APIs. This limitation has been mentioned by multiple reviewers, highlighting a need for improved functionality in this area.
Based on user reviews, users commonly recommend the following for Sauce Labs:
-
Request a trial and take advantage of fast support. Users highly recommend asking for a trial of Sauce Labs. They praise the company's fast support, which is beneficial in getting started with the tool.
-
Use Sauce Labs for multi-browser and multi-device automation. Sauce Labs is considered the best tool for cloud testing, particularly for testing web applications in different browsers, devices, and operating systems. Users mention its easy adoption and interface as strong points.
-
Consider test architecture and logging for effective automation testing. Users suggest putting at least 2 retries in the test configuration when performing parallel mobile testing with Sauce Labs. They also advise considering test architecture and test logging to enhance the automation testing process.
Overall, users highly recommend Sauce Labs as a top service provider in the market, especially for continuous automated testing and serious mobile or desktop testing. It is praised for its secure nature and integration with real devices on the cloud. However, users also suggest trying other services like BrowserStack for comparison purposes.
Attribute Ratings
Reviews
(76-100 of 159)Companies can't remove reviews or game the system. Here's why
October 10, 2018
Why we chose Saucelabs as our Cross-browser testing platform within our mission critical team.
Score 9 out of 10
Vetted Review
Verified User
Sauce Labs is a relatively new tool in the kit of all audited enterprise tools being used in one of the largest Financial institutions I am part of. It is a highly recommended platform for teams to perform cross-browser testing. After an easy integration process, Sauce Labs allows us to test our projects from iPad screens to Firefox, Chrome and IE running on almost any combination of Operating Systems.
- Multiple browser options to choose from.
- Real devices along with simulators
- Integration with a wide variety of frameworks.
- Use of camera on real mobile devices. Eg: QR Scanning
August 31, 2018
Test in the cloud
Continuous, deep, left-shifted testing executed in a CI/CD pipeline as a quality gate for build promotion into higher environments. Access to browsers, platforms, and devices for manual or automated testing we do not have physical access to. A platform for executing real browser tests that we cannot implement or maintain internally in a cost-effective manner.
- Willow is generally compatible with the latest version of Appium, pretty fast
- We use Sauce Labs to run a test on multiple devices (simulators).
- We use Sauce Labs to execute automation scripts in different browsers in the cloud
- There is not much information on what is causing the issue but it works when I restart it. It would also be nice if the tests are a little faster since the time for the tests to complete is a bit slow
- The main point that I have actually dealt with was the cloud service is a bit sluggish. Often when I run it, it takes a substantially long period of time to finish executions. It is bit sluggish and took at some point to carry out action
August 17, 2018
Review in the cloud
The whole organization does all the necessary tests and faster than many other programs.
- Mobile testing with Appium
- Recording of all test runs
- Adopting new technologies like XCUITest and Espresso allow for the use of industry standard tools in test automation
- Having access to browsers and devices in beta would be ideal
- They have been having increased unexpected downtime lately. This is interruptive at times.
Sauce Labs is used by our QA team during the app development process. We have integrated it with our build pipeline, where it runs our automated regression tests against multiple different browsers in order to make sure our app's core functions work on all platforms. It saves us a ton of time and headache from having to perform the same test multiple times on every browser, and from needing to use our own personal VM's for windows and internet explorer.
- Easy to integrate with other automation processes such as selenium and Jenkins
- Has a large range of platform/browser combinations to chose from, even mobile
- It could be a little faster
August 17, 2018
Pros with some cons, but absolutely mostly pros!
My company has used Sauce to automate the verification of video playback across multiple platforms and environments across desktop to mobile. Right now, it's only used by myself for a subset of teams. Video is a really tough thing to work with as it's very subjective and can be very time consuming to test. Being able to automate at least part of it gives us the ability to spend more time on other tasks.
- Customer communication - My account team and support are always responsive and helpful!
- Staying up to date including day one support for some things.
- Receiving feedback. I've had several meetings with Product to discuss my pain points, future wants, etc.
- Sometimes things can be finicky
- Connection speeds haven't always been great
We use Sauce Labs when we're running our regression test suite against a multitude of OS and browser combinations for our core web product. We are able to easily spin up virtual machines that contain a specific OS along with either the latest, beta or older version of the browsers we support with our app. This saves us a lot of maintenance and support issues with our test environments.
- Greatest strength of Sauce Labs to me is the ease of spinning up a clean virtual machine with the desired OS and browser combination.
- Sauce Labs support has been great! When I've run into issues whether it's from my own code issue or something on their side, they have been very responsive and helpful.
- The ability to scale up or down our needs from Sauce Labs has been great. As we build out more automation, we have a larger need of Sauce Labs services and it's been so simple to do. Need more parallel VMs? No problem. Need more automation time each month? No problem. It's all done almost instantly.
- My main area of concern that could be improved is the cost of the real mobile device farm offered. I have tried it out and it's great! I want to use it for most of my mobile automation, but can't justify the cost.....yet. Once more and more tests are created on my side along with a need to cover more devices then maybe it will work.
- A minor area that could be improved would be the responsiveness of the video stream of active tests. Sometimes I need to refresh the browser to get the video to come on or update.
- Another area of improvement would be the speed that tests can run. This has improved since I first started using Sauce Labs, but don't we all want everything, right now, immediately? I'm asking for the world, but you asked!
July 06, 2018
Effective
I have recommended Sauce to several clients I supported as a consultant of test automation services. It solves the problem of streamlining mobile automation results in a timely fashion. The Sauce Labs platform affords users the ability to execute a variety of test suites on multiple devices, even in parallel. Clients I have talked to want results more quickly during each development sprint.
- Real device cloud is a much needed feature, and Sauce delivers.
- We are in the process of evaluating Sauce Labs for real device testing.
- The biggest strength of Sauce Labs is very easy to configure.
- Many time performance of the execution is really slow, especially when connected with Sauce Connect.
- need to support video playback on
- No real device cloud access for open source projects.
July 06, 2018
Amazing
Sauce Labs has been very [important] to our project. We have used Sauce Labs to run our CI builds for both mobile and desktop web applications, as well as for nightly regression builds. The only reason we have stopped using Sauce Labs is due to project budget and the removal of an automated QA Resource. Still, we have hooked up a pretty spiffy Jenkins, Sauce, and several 3rd party web-metric systems (such as YSlow or Pagespeed) to capture a nightly set of performance data.
- As an advocate for the unit and functional testing, I can safely say that Sauce Labs has been the reason we have been successful in catching several major and minor regression issues before they ever made their way into production.
- There is still some integration to go with Github and several other similar tools.. but Sauce is already appearing to be on that track. With all of the innovations they have made over the past year and a half, I am really looking forward to the changes they have planned for the future.
June 19, 2018
Automate your cross-browser testing with Sauce Labs
Several teams that have a User Interface (UI) are planning to use Sauce Labs to test on different browsers and ensure functionality is working as expected. It helps us do cross-browser testing and mobile testing on both emulators as well as real devices. They have a great collection of real devices and I was able to find the latest Android and iOS devices.
- Many versions (includes older versions) of popular browsers like (IE, Firefox, Chrome, Edge etc.) are available
- Great collection of real mobile devices available for testing
- Works well with CI tools like Jenkins, CircleCI etc.
- Has support for many programming languages like C#, Java, Python, Ruby etc.
- Identifying flakey tests, slow tests can prove to be really useful
- Live testing on VMs is slow i.e. there is a lag for the browser to perform actions after actually performing them
- The metrics provided are very basic. This could be improved
June 13, 2018
This Sauce is good, but needs a little more flavor
Sauce is primarily being used by our Digital team for mobile and browser-based testing. As a financial services firm, we have tight restrictions on what browser/OS combinations that can be installed on in-house machines. Sauce Labs provides us the ability to test on primary browser/OS combinations that our customers use.
- Wide and deep offerings of browser and OS combinations
- Quick support for new releases versions of browsers
- Includes mobile emulators
- Supports both manual and automated testing
- Recent stability issues and outages
- Lack of deep technical support for Windows-based Sauce Connect Tunnels
- The online dashboard provides basic data, but in-depth analysis and drill down is not possible. We run over 10,000 tests a day and can be difficult to find patterns on errors and failed tests
June 13, 2018
Good infrastructure for automated testing
It is used by the whole organization for cross-browser testing and automated web flow. We had lots of UI components which has to be tested across browsers. Also we are using mobile testing for Android and iPhone devices.
- Sauce Labs enables easy debugging by providing video for the test case, Selenium log and step by step command.
- Accessing Sauce Labs is easy, I mean good documentation
- Email notifications when in Sauce Labs have maintenance activity
- Customer support ticket should be responded faster
- Mostly every weekend has maintenance activity, if it is reduced it will be good
June 13, 2018
How you evaluate Sauce Labs
We are using Sauce Labs to execute our automation scripts in parallel, and it's being used by the QA department for the moment. It gave us the flexibility to shorten our automation suites' execution time from 6 hours to 30 minutes. And we do not need to maintain those VM machines we are using, which saves a lot of time/resources as well.
- They recorded the execution videos and you could play back and check the failure in time
- Their help desk and customer support team are very helpful, always ready to answer any questions/issues you have while using their product
- It's very easy to integrate Sauce Labs to almost very CI tools you are using
- If you are using Selenium as the main automation tool in your organization, their VMs might not support the latest Selenium3 code
- It's not that easy for debugging failures on Sauce Labs side, though all the test scripts are passing through our local machine
June 06, 2018
Quick review of Sauce Labs
Our company is using Sauce Labs across our organisation. We have many different product teams that rely on a frontend, which is public facing and has a throughput of millions of customers. It is imperative that we have tests that are reliable and fast to ensure we haven't introduced a regression bug in our development. We have it running in our continuous integration pipelines, which we use on per 'push' of code to our master branch. And I have to say, Sauce Labs delivers. It is fast, reliable and allows me to scale to a different testing browser/device quickly and easily.
- Easy to run a Selenium test on a device. Add 3-4 capabilities, pass it into a driver instance, and boom. You are connected to Sauce Labs.
- Screenshots, videos, network logs, build monitoring, it's got a lot of tools that make it easy to debug a test and figure out what in the AUT is causing test failure.
- Uptime is high, we rarely have problems with their services.
- Mobile and tablet devices use emulators, which are extremely slow. The reason why they are slow is because they boot up a fresh VM on each test run. This adds minutes to a test, even if the test is 10s long. If there was a way whereby we could run a test on VM's which are already booted and ready to go, it will save immense amounts of time.
- Cookie view for a test: we manipulate areas of the cookies at times for debugging. It makes life easier if a snapshot of cookies with their key:values are stored in the Sauce Labs test run dashboard for viewing. This would aid us in saving much time.
- You can have a licence of 50 virtual machines and 5 accounts who share these 50 VMs. However, when you are logged into one of these accounts, and run i.e. 49 tests and then log in to another account, it still shows 50 VM's free when that is not the case. This causes other tests on other accounts to fail, which makes teams lose faith not only in Sauce Labs but in the test frameworks. I wish this area was more visible to all accounts and handled better in the console output.
March 09, 2018
Why sauce was the right solution for us
Score 9 out of 10
Vetted Review
Verified User
I've been using Sauce Labs across multiple platforms for several years. We made the decision as an organization to use Sauce because of the wide variety of browser and device combinations, as well as the ease of use. Integrating Sauce with our CI pipeline allows us to rapidly test a variety of combinations, and return results to developers in minutes. This used to be a wholly manual effort that could take days or weeks depending on the scope of changes. Appium + Sauce Labs have made this much easier.
We occasionally run into the same issues that people will note for this and other solutions. But when faced with challenges the support and feedback is stellar. We're looking forward to doing more testing across devices as we expand our test coverage.
We occasionally run into the same issues that people will note for this and other solutions. But when faced with challenges the support and feedback is stellar. We're looking forward to doing more testing across devices as we expand our test coverage.
- A large variety of browser and device combinations allows for broader test coverage.
- Adopting new technologies like XCUITest and Espresso allow for the use of industry standard tools in test automation
- Massive parallelization helps to reduce test run times.
- SSH tunneling stability can cause test failures
- Having access to browsers and devices in beta would be ideal
- More native testing support would be a big win.
It is used widely across the organization to implement cross-platform testing. It resolves the infrastructure problem of getting new devices or upgrading versions of the operating system or the browser.
- Applications behind a firewall can be easily tested using the sauce tunnel. This helps us not expose our applications to public for testing on a cloud platform
- Platform versions are frequently updated and can be configured easily using desired capabilities.
- Debugging becomes easy as you could watch a replay of the test or debug using command tool or even get the selenium logs.
- Integrate with QASymphony for test management.
- Use extended debugging tool at run time instead of uploading metadata for test run
- Increase test speed by reducing OS startup
February 28, 2018
Sauce Labs is amazing!
Score 10 out of 10
Vetted Review
Verified User
We utilize SauceLabs to test our portfolio of web applications across the various configurations that SauceLabs provides. It allows us to seamlessly spin up these multiple configurations and eliminates the need to maintain virtual boxes or even multiple machines.
- Tunneling ability to internal applications.
- Clean, quick environments to run our automated tests.
- Sauce Labs configs are constantly updated and current.
- Quicker manual testing setup/spinning up sessions.
- iOS platforms
- Customized setup of configurations in Sauce, e.g. email setup (especially mobile) or browser plugins.
As we began architecting a CI/CD pipeline in our SDLC, a need quickly arose for left-shifted, continuous testing of our web applications in real browsers. Specifically, a service that could integrate seamlessly with our Jenkins CI servers and executing tests continuously against our Dockerized applications and firewalled environments. Furthermore, our company does not have the resources to implement and maintain a proprietary Selenium Grid for test distribution. Sauce Labs addresses all of these concerns, and furthermore offers a platform for manually debugging applications in any combination of platforms, browsers, and devices needed, either from an automated test script or from a manual test session. The largest selling point for our needs is its relatively seamless integration with our Jenkins CI servers, including detailed playback and test reports per build job, as well as easy configuration of the proxy tunnel used to access our firewalled environments and desired browsers-under-test, right from the Jenkins UI via their Sauce OnDemand Jenkins plugin.
- Sauce Labs offers the single best solution for integrating deep automated browser testing in a CI/CD pipeline, and integrates best with Jenkins over their competition.
- The Sauce Connect Proxy is a necessary technology for companies who have firewalled testing environments, as well as localhost testing.
- The Jenkins UI plugin offers a way to easily configure browser settings for tests being executed continuously.
- Browser support is quick to be updated as new versions of browsers are released.
- The custom capabilities that can be provided to Sauce Labs VMs during automated testing sessions are a valuable option for experimental or niche testing.
- The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports. Currently, in order to tap into these capabilities, a programatic solution is required from test code, rather than being able to configure them via the Jenkins plugin UI. For example, things like desktop resolution, browser automation binary versions, remote Selenium version, and browser console logs.
- Some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt. Better documentation, logging, and more intuitive configuration around the Sauce Connect Proxy would take what is already an industry leading feature to the next level.
- User account management needs an overhauls, allowing for user groups, rather than just a hierarchy structure.
- Test job queuing is first-come-first-serve, meaning there is no in-built way to queue batches of jobs from, say, different Jenkins servers/accounts.
February 20, 2018
SauceLabs is great to work with!
Score 8 out of 10
Vetted Review
Verified User
We are replacing a competitive product with SauceLabs for all Mobile based automation and are contemplating replacing our Browser testing also with SauceLabs. Other teams here are also contemplating conversion to SauceLabs. SauceLabs provides a very robust Emulator/Simulator/Live mobile device environment that easily uses OpenSource full Appium.
- Great number of Live mobile devices in the Public Cloud. Unlimited number of Emulator/Simulators only limited by the number of concurrent connections in your contract.
- Excellent support of Appium, of course these ARE the folks that wrote and maintain the OpenSource Appium API.
- The goal of SauceLabs is to help your company succeed! Not bleed you dry to get questions answered and assistance.
- Need ability to capture video of Live testing sessions.
- Need better control of other competitors taking their open source code and modifying/selling it claiming compatibility with Appium when it really isn't. This leads to major confusion.
February 19, 2018
Sauce is a great solution to get test automation up and running quickly in your org
Score 9 out of 10
Vetted Review
Verified User
We chose to implement sauce labs initially for one project, as a proof of concept. It's been a great experience, we've had to make our automated tests short to take advantage of the parallel threads. Your suit execution is really only as long as your longest test. It's a great tool, that has saved us a ton of local infrastructure work.
- Remote execution, being triggered by Jenkins is really valuable to our CICD pipeline.
- Reporting is great, and they are continuously adding more to their reporting.
- The UI takes a little getting used to.
February 12, 2018
Cloud solution for cross platform testing
Sauce Labs was used by different teams across our project. Mostly we used it for distributed test automation, however, our business analysts also used this platform to solve their particular tasks.
- Integrated to work with automated tests based on Selenium WebDriver
- Supports a large number of different browsers and operation systems
- Supports different mobile device emulators as well as real devices
- Good API
- Well documented, easy to start
- JIRA integration
- Very rarely the platform becomes unresponsive and tests fail without any significant reason
- Video recordings are sometimes inaccessible
February 05, 2018
Great for seasoned software testers, but may be a bit overwhelming to those newer to running [automated] tests
Within the last 9 months, I used Sauce Labs to test cross-browser capability (similar to what I would do with Browser Stack), as well to do automated Node.js tests with Selenium Web Driver running on Sauce. Given the size of the organization where I work Sauce Labs is obviously used on a departmental case-by-case basis; specifically, some dev teams use it and some do not. Sauce Labs efficiently tests many desktop/mobile/tablet browser-platform combinations - great use case for automation, speeding up delivery times, while improving accuracy.
- The many possible desktop/mobile/tablet browser-platform combos
- More thorough than other competitive solutions as a means of testing cross-browser functionality
- Versatile in that it supports different languages for automated tests, from C#, PHP & Java to even JS (Node.js)
- Has an extensive wiki at https://wiki.saucelabs.com - very helpful!
- Can feel a bit overwhelming when first integrating in a project - that is to say, may seem a bit complex to implement and navigate at first, however, and in fairness, as a front-end software developer and web designer less seasoned than say a veteran software test engineer, a more experienced tester might not share the same experience
- Login credentials have been problematic (could be do to some SSO glitch on my end)
- User interface is somewhere between "good" and "mediocre", relying more on the assumed knowledge of the tester (could be intentional design choice)
January 25, 2018
Sauce labs- cross browser testing champion
We are using saucelabs for all our UI automated tests. It gives us the flexibility to execute the tests on any platform and browser of our choice.
- Facilitate mobile testing on multiple devices
- Eases testing on multiple versions of chrome.
- Simple and easy to set up
- Test execution is slower , can be improved.
- The recorded videos of the test execution are not easy to view. Sometimes they don’t even play.
January 25, 2018
Huge organization review
It is being used by multiple departments. Our organization is very huge. It is very useful for us as we can do development and testing from it. It solves some problems for us to use [across a] combination of unique browsers.
- Proxy settings are utilized [for] our organization - which is the base need for our organization without which the tool would be of no use for us.
- Lots of browser/OS combinations are available.
- Mobile devices are also available for us.
- One issue is - getting started with Sauce Connect. The process is slightly cumbersome. It can be improved.
- Native mobile device support is not proper. so we can't install our mobile apps on any devices there. This is something we could potentially leverage.
- Automation support/coverage is still a bit in the air.
January 22, 2018
Thoughts on using Sauce Labs
Score 7 out of 10
Vetted Review
Verified User
We have used Sauce Labs on our CI server to run our JavaScript unit tests and Selenium functional tests. For unit tests, this ensured that our code will run without issues on any browser, for functional tests we were able to check UI in multiple environments easily including browsers not available on developer machines.
- Can be easily configured to run tests in parallel which makes testing many environments fast.
- Lots of environments available including phones, tablets, different operating systems etc. This help spot environment specific bugs which would be hard to find otherwise.
- Can be easily integrated with most of the major languages/frameworks.
- Running tests on Sauce Labs is not as stable as running them locally. Sometimes tests will fail due to networking issues which then produces false negative results and breaking CI builds.
- Running tests on Sauce Labs seems to be a bit slower than on a local machine. Although it is a bad practice, it is often that teams use arbitrary timeouts in their tests and it is not always trivial to update all tests to follow best standards. That makes tests passing locally and failing on Sauce Labs. Increasing those timeouts help but it slows them down.
- Some of the less known frameworks such as Intern.js might be harder to configure with Sauce Labs as there are fewer docs/examples available for them.
January 17, 2018
A Service worth its sauce!
Score 10 out of 10
Vetted Review
Verified User
As of now, we have a team of testers who thoroughly test our eCommerce website. We use this both to constantly test the site and to test the site before changes are migrated to production.
- Our motto is: catch the error before the customer does. this is what Sauce Labs helps us accomplish.
- The advantage of Sauce Labs is that the VM's are not on our network rather they are off site. this assures us that our testing is valid not only on our grid but also to the outside world
- Saucelabs is reliable and we never have to worry that they don't have enough servers to spin up.
- I would like to see easier integration of mobile tests without having to use real device test which are expensive.
- Also. I would like that the servers should spin up with greater speed
- Sauce Labs dashboard could use some tweaking. better filters. more sorting option. archives section timestamps are off by a few hours!!