Reviews (1-25 of 120)
- It offers a good test suite of mobile devices across platforms and version numbers.
- Ease of uploading new APKs across different users within the business making it easier to test on current versions.
- Provides remote testing opportunities when devices are not available locally.
- Clean user dashboard experience ensuring user-friendly use of the UX.
- Actual app testing made easy as well as web testing.
- Latency between input and action can be improved.
- More devices need to be added more frequently.
- Visual feedback of the test execution is very effective with video and screenshots
- Combinations of browsers and OS is extensive
- The dashboard is easy to use and intuitive
- The speed of the tunnel could be improved
- Shareable test execution video log
- Ability to debug app in the cloud
- Ability to connect local network to the SauceLabs cloud
- Really fast(er) tests on mobile devices in RDC comparing to emulators/simulators
- Slower execution than on real devices
- Sudden connection issues (test aborts itself)
- Complicated work with Sauce Connect (not flexible enough)
- Sometimes really challenging to configure Sauce Connect and Sauce Storage properly
- They have a vast amount of physical devices that run on older OS.
- The ability to integrate with CI/CD platforms
- More accessibility to top tier phones. For instance there are times when a premium phone is being used across all their platforms so during peak hours, there could a time when a phone is in use for 2 hours.
- Quicker start time on mobile emulator load up. If I am sending a test suite to sauce labs, after each test case is complete the emulator stops and then needs to be ramped up again.
- Real vs Virtual Devices
- Tunneled connection for firewalled website
- Well-documented wiki
- Always keep up with new technologies
- The ability to share the account with other colleagues without sharing the actual password
- Should populate the most frequently used devices to the top instead of a static dropdown list
- Always up and running: I'd say 99.9% it's up and running, as I've rarely experienced any down time with their VM farm machines.
- Reliable: we run our automated tests on their VMs at least every hour, around the clock, and their service is very reliable and working properly.
- Community: good online community of other people using Sauce Labs with tips/tricks; often see Sauce Labs at conferences and it's nice to talk with them about what they have planned (new features).
- New features added: dashboard tools with good drill down capabilities, as well as grouping features. This allows us to see what test(s) are constantly failing and what the issue(s) were each time.
- Cost: it's a little bit pricey, but I don't pay the bill so I'm not complaining too much there. Overall, I'd say the price isn't ridiculous but it's not inexpensive.
- Logs: I don't find their logs very useful for front-end web tests, I usually refer to my own logs if I have a bug/issue/error that needs investigation.
- Incredibly cheap.
- The service is outstanding. They provide me with the combinations of browsers/platforms that make it easy for me to do my job.
- Sauce Labs accelerates and optimizes the tests by running them through console logs, metadata, and Selenium with complete lists of compatible commands.
- No integrated CI system
- Sometimes it takes a little longer than a few days to get my support cases to closed
- Customer support tickets should be responded to faster
- SauceConnect is great to allow tunnelling to test systems that are behind a firewall. There are many great features and they are adding more all the time.
- The fact that they maintain all WebDrivers and every version of browsers in invaluable. If we have a need for a specific platform, they have it.
- They have been having increased unexpected downtime lately. This is interruptive at times.
- Multiple browser support
- Very quick and reliable
- Wide range of devices available
- Even though there are lots of devices available, we'll always need more!
- I did notice lag or stuttering at times.
- We always need more documentation or training.
- spin up environments
- Sauce connect! For running on my local machine
- review archives of runs across environments
- concurrent sessions
- logs can be more descriptive
- tests run significantly slower when pointed at SL
If your need is architecting a CI/CD pipeline with left-shifted continuous real browser testing, then there is simply no better service available than Sauce Labs to integrate with this desired model. They are a smaller company than their leading competitor, but they are rapidly innovating in the right direction, and lead the charge in continuous automated testing. Sauce Labs Introduced a Headless feature, which takes Sauce Labs to the very next level.
- We are currently in the process of moving all of our mobile automation from a different vendor to Sauce Labs.
- Sometimes tunneling is so slow and taking a lot of time to start the automation test. It should also support real devices as well, because if pricing is less, then Sauce Labs will be the best tool to use.
- With Sauce Labs, I can run multiple tests with multiple browsers with a different set of simulators and emulators. One good things is it is helpful to test iOS, Android and Web too.
- The most recent Sauce Lab headless feature.
- There are some issues in which the tests stop running and I have to manually restart it. There is not much information on what is causing the issue but it works when I restart it. It would also be nice if the tests were a little faster since the time for the tests to complete is a bit slow. There is a bit of a learning curve on best practices to write your code, so if you tackled this without a plan, you have to go back and rewrite some of your test cases. There's definitely a lot to learn!
- The better documentation for onboarding new users or customers.
The main business problems that it addresses is helping us to understand customers' problems or bugs and make a visual and functionality check before or after a deployment.
- Cross Browsing: It's a large list of OS, Browsers and Versions really updated.
- Really aaS: Sauce is really an as a service product, you just use it when you want with really a few clicks.
- Documentation rocks: They have a large knowledge base documented for all their customers.
- Analytics: The have a nice analytics service to understand you test trends.
- Allow CIs stateless: With Sauce Connect it's possible to get a CI-CD environment really stateless without needing to install and maintain a lot of tools and infrastructure.
- Speed: We've some speed issues with "Live Testing" it's a bit slow and in our agile environment is a little sad.
- Sauce and Testobject: It's wired to use 2 platforms when it's the same company. I wish it was all Saucelabs...It'd be more useful to explain to all the people that it's another service of the same company.
* You need to run your tests in a lot of browsers and versions. It's very useful to be used for cross-browsing and visual pixel perfect tests.
* You need to delegate the maintenance of the selenium infrastructure. It's awesome to forget about browsers or OS releases and all the problems involved with it.
SauceLabs doesn't suit if:
* You need a fast environment to run manual tests.
* You are looking for a fast UI.
- We use Sauce Labs to run automation script on different browsers in the cloud.
- We use Sauce Labs to run a test on multiple devices (simulators).
- It is useful in our manual testing as well.
- We are in the process of evaluating Sauce Labs for real device testing.
- need to improve on network latency issues
- need to support video playback on
- sauce connect looks sometimes flaky
We are using Sauce lab to run our automated tests in different browsers and devices
- Test the same feature in multiple devices and browsers
- Test feature in older versions and even older OS versions are present which make it awesome.
- Save time to upgrade your real device. Emulators in Sauce Labs are readily available
- Test dashboard and capture manual execution video
- Less real time devices
- Some features are better to test in real device
- Easy to integrate as simple as plug and play.
- A wide range of devices and browsers.
- Provides video clips of entire automation.
- Supports live testing on real devices.
- Sometimes, execution is slow, needs improvement.
- Real device testing is available in limited regions.
1. Easy to integrate.
2. A wide range of devices and browsers.
3. Supports live testing on real devices.
4. Easy to maintain.
5. Provides video playback.
6. Pricing is reasonable.
7. Easy to set up a device lab.
1. Execution is slow, needs improvements.
2. Please provide more regions for real device testing.
3. Real devices are slow at times.
- Diversity of test environments
- Ease of looking at the results
- Stellar support team
- Sometimes, the system can be laggy when you examine test results. I have a support case logged about this
- It seems to me that its taking longer for the support team to successfully close my cases
We also are able to quickly verify our mobile apps across a variety of emulators or real devices as we see fit.
And we do not need to have anyone maintain a lab on our own,
- Multi-browser testing scenarios.
- Real mobile device testing
- Enterprise grade tool.
- One thing that Sauce Labs does very well is continuing to provide education for technological products, so that we stay up to speed and are even able to learn new things that we never knew before. I definitely saw myself applying a lot of the new concepts that I learned, such as automated testing.
- I also love the Secret Sauce where we can learn about new product updates for Sauce Labs, as well as learn about upcoming events such as SauceCon. I love being able to stay abreast of a company that I love, as well as be able to learn of more interactive meetings where I can meet tech-minded people, as well as the Sauce company, i.e. Saucecon.
- I really love the customer service. Once in the Forum, I had a question, and Alyssa the VP actually gave me a reply, and was very quick to respond as well as very friendly. I've never had a company where the leadership was so responsive and so eager to dive in with customers on issues and questions that they have. This definitely shows that Sauce isn't just about getting profits, and that they truly deeply care about making the customers happy and successful.
- Lastly, I love how Sauce University has a stash which encourages friendly competition among team members. It shows who has the most points, which encourages us to continue to actively participate in those trainings and challenges and quizzes. This in turn adds an element of fun to our work.
- In Sauce University trainings, it would be nice we could receive more in-depth information, as opposed to a short paragraph of information. As a beginner in the technological field, I would definitely find that helpful. Maybe they could do something where you can create a link to show more details, so that more advanced readers don't have to open it, but beginners can actually open up that link to read more.
- Also, it would be nice if in the trainings you would include the videos as well because a lot of people are visual learners.
- I wish it were easier to search through the Sauce Labs help page. Sometimes it takes quite a few searches to get to the right result. For instance, I'm not sure if I should click on Knowledge Base or Documentation or Support- there's too much to click-through. There should just be a Search All button that would search across the whole Sauce Labs page, so that we can easily find the answer that we need.
- Our team especially loves the challenges, because again that fosters friendly competition and encourages us to continue to learn more about the product and the tech, as well as hone previous skills we've learned through Sauce Labs. We definitely hope that more of those classes come out every week, so we can dive deeper into each concept. I think there should be a feedback page where we can submit ideas for the classes that we would like to see.
It's also well suited for educational purposes, because you get to use Sauce University as well as attend any boot camps to continue to broaden your knowledge and become a stronger technological resource in the company.
- Infrastructure as a service - we do not need to worry about spinning up machines or VMs.
- Scalable based on demands of the company.
- View recordings of the automated tests.
- Live manual test support.
- Mobile device support.
- UI not the most responsive.
- SauceConnect tunnel sometimes fails for no reason.
- Comprehensive platform coverage including all the browsers and operating systems we were looking for. We did not test anything on mobile.
- It saved time on the regression test cycle time and enabled quicker releases to production.
- Video recordings of the test execution were very helpful to triage failures and resolve.
- Cost could be lower - some of the team members felt Sauce Labs was a little expensive but I do not have more details on that.
- The devices are really up to date. For example, the latest iPhone became part of the list almost as soon as it was released.
- Ability to tunnel to a different location so you can run tests on a specific region.
- Customer support is quite responsive.
- Testobject analytics - we've had a hard time ordering tests
- Test start time - sometimes takes a while to upload an app to a device and start test execution
- Price - it's a bit on the expensive side
- Multiple browsers, Multiple OS available for running tests.
- Difficult to maintain these server farm in-house.
- Someone maintains the server farm for us and provides as SaaS offering.
- Tests take longer to run as compared to in-house. This makes overall tests suite completing slow, slowing our deployment time.
Least suited - where your test suite used to run for hours, it will now take days.
Sauce Labs Scorecard Summary
About Sauce Labs
Sauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple virtual machines across many different browser, platform and device combinations, testing time is reduced and developer time is freed up from managing infrastructure.) The Sauce Labs testing cloud is intended to be paired with a CI system. According to the vendor, this combination allows developers to easily test desktop and hybrid, native and mobile web applications early on in their development cycles, continuously and affordably.
Sauce Labs provides enterprise-grade security via Sauce Connect™, its secure tunneling protocol for testing behind a firewall while maintaining control of proxy and access policies. Tests are run in the company’s secure data center and VMs are destroyed (not “wiped”) after each run, ensuring customer data is never exposed to future sessions. After tests are completed the Sauce Labs’ dashboard provides a unique build-oriented report with metadata, access to Selenium logs, screenshots, video recordings, and a complete list of commands and responses. Support for SSO lets customers provision new user accounts on the fly with centralized user account management, access control, and usage reporting.
Sauce Labs Screenshots
Sauce Labs Integrations
Sauce Labs Competitors
- Has featureFree Trial Available?Yes
- Has featureFree or Freemium Version Available?Yes
- Has featurePremium Consulting/Integration Services Available?Yes
- Entry-level set up fee?Optional
Free service available for Open Source projects.
Sauce Labs Support Options
|Free Version||Paid Version|
|Video Tutorials / Webinar|
Sauce Labs Technical Details