Reviews (1-25 of 116)
- Always up and running: I'd say 99.9% it's up and running, as I've rarely experienced any down time with their VM farm machines.
- Reliable: we run our automated tests on their VMs at least every hour, around the clock, and their service is very reliable and working properly.
- Community: good online community of other people using Sauce Labs with tips/tricks; often see Sauce Labs at conferences and it's nice to talk with them about what they have planned (new features).
- New features added: dashboard tools with good drill down capabilities, as well as grouping features. This allows us to see what test(s) are constantly failing and what the issue(s) were each time.
- Cost: it's a little bit pricey, but I don't pay the bill so I'm not complaining too much there. Overall, I'd say the price isn't ridiculous but it's not inexpensive.
- Logs: I don't find their logs very useful for front-end web tests, I usually refer to my own logs if I have a bug/issue/error that needs investigation.
- Incredibly cheap.
- The service is outstanding. They provide me with the combinations of browsers/platforms that make it easy for me to do my job.
- Sauce Labs accelerates and optimizes the tests by running them through console logs, metadata, and Selenium with complete lists of compatible commands.
- No integrated CI system
- Sometimes it takes a little longer than a few days to get my support cases to closed
- Customer support tickets should be responded to faster
- SauceConnect is great to allow tunnelling to test systems that are behind a firewall. There are many great features and they are adding more all the time.
- The fact that they maintain all WebDrivers and every version of browsers in invaluable. If we have a need for a specific platform, they have it.
- They have been having increased unexpected downtime lately. This is interruptive at times.
- Multiple browser support
- Very quick and reliable
- Wide range of devices available
- Even though there are lots of devices available, we'll always need more!
- I did notice lag or stuttering at times.
- We always need more documentation or training.
- spin up environments
- Sauce connect! For running on my local machine
- review archives of runs across environments
- concurrent sessions
- logs can be more descriptive
- tests run significantly slower when pointed at SL
- Shareable test execution video log
- Ability to debug app in the cloud
- Ability to connect local network to the SauceLabs cloud
- Really fast(er) tests on mobile devices in RDC comparing to emulators/simulators
- Slower execution than on real devices
- Sudden connection issues (test aborts itself)
- Complicated work with Sauce Connect (not flexible enough)
- Sometimes really challenging to configure Sauce Connect and Sauce Storage properly
- Visual feedback of the test execution is very effective with video and screenshots
- Combinations of browsers and OS is extensive
- The dashboard is easy to use and intuitive
- The speed of the tunnel could be improved
If your need is architecting a CI/CD pipeline with left-shifted continuous real browser testing, then there is simply no better service available than Sauce Labs to integrate with this desired model. They are a smaller company than their leading competitor, but they are rapidly innovating in the right direction, and lead the charge in continuous automated testing. Sauce Labs Introduced a Headless feature, which takes Sauce Labs to the very next level.
- We are currently in the process of moving all of our mobile automation from a different vendor to Sauce Labs.
- Sometimes tunneling is so slow and taking a lot of time to start the automation test. It should also support real devices as well, because if pricing is less, then Sauce Labs will be the best tool to use.
- With Sauce Labs, I can run multiple tests with multiple browsers with a different set of simulators and emulators. One good things is it is helpful to test iOS, Android and Web too.
- The most recent Sauce Lab headless feature.
- There are some issues in which the tests stop running and I have to manually restart it. There is not much information on what is causing the issue but it works when I restart it. It would also be nice if the tests were a little faster since the time for the tests to complete is a bit slow. There is a bit of a learning curve on best practices to write your code, so if you tackled this without a plan, you have to go back and rewrite some of your test cases. There's definitely a lot to learn!
- The better documentation for onboarding new users or customers.
The main business problems that it addresses is helping us to understand customers' problems or bugs and make a visual and functionality check before or after a deployment.
- Cross Browsing: It's a large list of OS, Browsers and Versions really updated.
- Really aaS: Sauce is really an as a service product, you just use it when you want with really a few clicks.
- Documentation rocks: They have a large knowledge base documented for all their customers.
- Analytics: The have a nice analytics service to understand you test trends.
- Allow CIs stateless: With Sauce Connect it's possible to get a CI-CD environment really stateless without needing to install and maintain a lot of tools and infrastructure.
- Speed: We've some speed issues with "Live Testing" it's a bit slow and in our agile environment is a little sad.
- Sauce and Testobject: It's wired to use 2 platforms when it's the same company. I wish it was all Saucelabs...It'd be more useful to explain to all the people that it's another service of the same company.
* You need to run your tests in a lot of browsers and versions. It's very useful to be used for cross-browsing and visual pixel perfect tests.
* You need to delegate the maintenance of the selenium infrastructure. It's awesome to forget about browsers or OS releases and all the problems involved with it.
SauceLabs doesn't suit if:
* You need a fast environment to run manual tests.
* You are looking for a fast UI.
- We use Sauce Labs to run automation script on different browsers in the cloud.
- We use Sauce Labs to run a test on multiple devices (simulators).
- It is useful in our manual testing as well.
- We are in the process of evaluating Sauce Labs for real device testing.
- need to improve on network latency issues
- need to support video playback on
- sauce connect looks sometimes flaky
We are using Sauce lab to run our automated tests in different browsers and devices
- Test the same feature in multiple devices and browsers
- Test feature in older versions and even older OS versions are present which make it awesome.
- Save time to upgrade your real device. Emulators in Sauce Labs are readily available
- Test dashboard and capture manual execution video
- Less real time devices
- Some features are better to test in real device
- Easy to integrate as simple as plug and play.
- A wide range of devices and browsers.
- Provides video clips of entire automation.
- Supports live testing on real devices.
- Sometimes, execution is slow, needs improvement.
- Real device testing is available in limited regions.
1. Easy to integrate.
2. A wide range of devices and browsers.
3. Supports live testing on real devices.
4. Easy to maintain.
5. Provides video playback.
6. Pricing is reasonable.
7. Easy to set up a device lab.
1. Execution is slow, needs improvements.
2. Please provide more regions for real device testing.
3. Real devices are slow at times.
- Diversity of test environments
- Ease of looking at the results
- Stellar support team
- Sometimes, the system can be laggy when you examine test results. I have a support case logged about this
- It seems to me that its taking longer for the support team to successfully close my cases
We also are able to quickly verify our mobile apps across a variety of emulators or real devices as we see fit.
And we do not need to have anyone maintain a lab on our own,
- One thing that Sauce Labs does very well is continuing to provide education for technological products, so that we stay up to speed and are even able to learn new things that we never knew before. I definitely saw myself applying a lot of the new concepts that I learned, such as automated testing.
- I also love the Secret Sauce where we can learn about new product updates for Sauce Labs, as well as learn about upcoming events such as SauceCon. I love being able to stay abreast of a company that I love, as well as be able to learn of more interactive meetings where I can meet tech-minded people, as well as the Sauce company, i.e. Saucecon.
- I really love the customer service. Once in the Forum, I had a question, and Alyssa the VP actually gave me a reply, and was very quick to respond as well as very friendly. I've never had a company where the leadership was so responsive and so eager to dive in with customers on issues and questions that they have. This definitely shows that Sauce isn't just about getting profits, and that they truly deeply care about making the customers happy and successful.
- Lastly, I love how Sauce University has a stash which encourages friendly competition among team members. It shows who has the most points, which encourages us to continue to actively participate in those trainings and challenges and quizzes. This in turn adds an element of fun to our work.
- In Sauce University trainings, it would be nice we could receive more in-depth information, as opposed to a short paragraph of information. As a beginner in the technological field, I would definitely find that helpful. Maybe they could do something where you can create a link to show more details, so that more advanced readers don't have to open it, but beginners can actually open up that link to read more.
- Also, it would be nice if in the trainings you would include the videos as well because a lot of people are visual learners.
- I wish it were easier to search through the Sauce Labs help page. Sometimes it takes quite a few searches to get to the right result. For instance, I'm not sure if I should click on Knowledge Base or Documentation or Support- there's too much to click-through. There should just be a Search All button that would search across the whole Sauce Labs page, so that we can easily find the answer that we need.
- Our team especially loves the challenges, because again that fosters friendly competition and encourages us to continue to learn more about the product and the tech, as well as hone previous skills we've learned through Sauce Labs. We definitely hope that more of those classes come out every week, so we can dive deeper into each concept. I think there should be a feedback page where we can submit ideas for the classes that we would like to see.
It's also well suited for educational purposes, because you get to use Sauce University as well as attend any boot camps to continue to broaden your knowledge and become a stronger technological resource in the company.
- Infrastructure as a service - we do not need to worry about spinning up machines or VMs.
- Scalable based on demands of the company.
- View recordings of the automated tests.
- Live manual test support.
- Mobile device support.
- UI not the most responsive.
- SauceConnect tunnel sometimes fails for no reason.
- Real vs Virtual Devices
- Tunneled connection for firewalled website
- Well-documented wiki
- Always keep up with new technologies
- The ability to share the account with other colleagues without sharing the actual password
- Should populate the most frequently used devices to the top instead of a static dropdown list
- Comprehensive platform coverage including all the browsers and operating systems we were looking for. We did not test anything on mobile.
- It saved time on the regression test cycle time and enabled quicker releases to production.
- Video recordings of the test execution were very helpful to triage failures and resolve.
- Cost could be lower - some of the team members felt Sauce Labs was a little expensive but I do not have more details on that.
- The devices are really up to date. For example, the latest iPhone became part of the list almost as soon as it was released.
- Ability to tunnel to a different location so you can run tests on a specific region.
- Customer support is quite responsive.
- Testobject analytics - we've had a hard time ordering tests
- Test start time - sometimes takes a while to upload an app to a device and start test execution
- Price - it's a bit on the expensive side
- Multiple browsers, Multiple OS available for running tests.
- Difficult to maintain these server farm in-house.
- Someone maintains the server farm for us and provides as SaaS offering.
- Tests take longer to run as compared to in-house. This makes overall tests suite completing slow, slowing our deployment time.
Least suited - where your test suite used to run for hours, it will now take days.
- Customer communication - My account team and support are always responsive and helpful!
- Staying up to date including day one support for some things.
- Receiving feedback. I've had several meetings with Product to discuss my pain points, future wants, etc.
- Sometimes things can be finicky
- Connection speeds haven't always been great
- Greatest strength of Sauce Labs to me is the ease of spinning up a clean virtual machine with the desired OS and browser combination.
- Sauce Labs support has been great! When I've run into issues whether it's from my own code issue or something on their side, they have been very responsive and helpful.
- The ability to scale up or down our needs from Sauce Labs has been great. As we build out more automation, we have a larger need of Sauce Labs services and it's been so simple to do. Need more parallel VMs? No problem. Need more automation time each month? No problem. It's all done almost instantly.
- My main area of concern that could be improved is the cost of the real mobile device farm offered. I have tried it out and it's great! I want to use it for most of my mobile automation, but can't justify the cost.....yet. Once more and more tests are created on my side along with a need to cover more devices then maybe it will work.
- A minor area that could be improved would be the responsiveness of the video stream of active tests. Sometimes I need to refresh the browser to get the video to come on or update.
- Another area of improvement would be the speed that tests can run. This has improved since I first started using Sauce Labs, but don't we all want everything, right now, immediately? I'm asking for the world, but you asked!
- Real device cloud is a much needed feature, and Sauce delivers.
- We are in the process of evaluating Sauce Labs for real device testing.
- The biggest strength of Sauce Labs is very easy to configure.
- Many time performance of the execution is really slow, especially when connected with Sauce Connect.
- need to support video playback on
- No real device cloud access for open source projects.
- Eliminate testing as a bottleneck
- Improve quality by increasing browser/OS/device coverage
- Move from waterfall to agile methodology
- Many versions (includes older versions) of popular browsers like (IE, Firefox, Chrome, Edge etc.) are available
- Great collection of real mobile devices available for testing
- Works well with CI tools like Jenkins, CircleCI etc.
- Has support for many programming languages like C#, Java, Python, Ruby etc.
- Identifying flakey tests, slow tests can prove to be really useful
- Live testing on VMs is slow i.e. there is a lag for the browser to perform actions after actually performing them
- The metrics provided are very basic. This could be improved
- They recorded the execution videos and you could play back and check the failure in time
- Their help desk and customer support team are very helpful, always ready to answer any questions/issues you have while using their product
- It's very easy to integrate Sauce Labs to almost very CI tools you are using
- If you are using Selenium as the main automation tool in your organization, their VMs might not support the latest Selenium3 code
- It's not that easy for debugging failures on Sauce Labs side, though all the test scripts are passing through our local machine
Sauce Labs Scorecard Summary
About Sauce Labs
Sauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple virtual machines across many different browser, platform and device combinations, testing time is reduced and developer time is freed up from managing infrastructure.) The Sauce Labs testing cloud is intended to be paired with a CI system. According to the vendor, this combination allows developers to easily test desktop and hybrid, native and mobile web applications early on in their development cycles, continuously and affordably.
Sauce Labs provides enterprise-grade security via Sauce Connect™, its secure tunneling protocol for testing behind a firewall while maintaining control of proxy and access policies. Tests are run in the company’s secure data center and VMs are destroyed (not “wiped”) after each run, ensuring customer data is never exposed to future sessions. After tests are completed the Sauce Labs’ dashboard provides a unique build-oriented report with metadata, access to Selenium logs, screenshots, video recordings, and a complete list of commands and responses. Support for SSO lets customers provision new user accounts on the fly with centralized user account management, access control, and usage reporting.
Sauce Labs Screenshots
Sauce Labs Integrations
Sauce Labs Competitors
Free service available for Open Source projects.
Sauce Labs Support Options
|Free Version||Paid Version|
|Video Tutorials / Webinar|
Sauce Labs Technical Details