Scale your tests. Now!
Updated October 11, 2019
Scale your tests. Now!
Score 8 out of 10
Vetted Review
Verified User
Overall Satisfaction with Sauce Labs
We tested both Web and Mobile apps using SauceLabs. We find it especially useful as we need to target tests to multiple platforms. The tool is used by multiple parties: both manual testing and automated testing teams. We also use it to generate test execution reports and share with other parties (e.g. Dev team). That replaces long Steps to Reproduce statements.
- Shareable test execution video log
- Ability to debug app in the cloud
- Ability to connect local network to the SauceLabs cloud
- Really fast(er) tests on mobile devices in RDC comparing to emulators/simulators
- Slower execution than on real devices
- Sudden connection issues (test aborts itself)
- Complicated work with Sauce Connect (not flexible enough)
- Sometimes really challenging to configure Sauce Connect and Sauce Storage properly
Eventually, SauceLabs was cheaper and a bit faster option (at the moment when we made a choice). On the top of that SauceLabs provided us with big enough for consistent evaluation demo period/minutes so we could test it carefully enough before purchasing. We also find no worthier equivalents for Sauce Connect (at the moment of evaluation)
Using Sauce Labs
100 - Main users of SauceLabs services within our organization are: Test Automation Engineers, Functional Testers, UI Designers and sometimes Software Developers. Test Automation people use SauceLabs mostly as a platform for tests scaling for multiple targets and regular executions. Functional Testers use it mostly as a backup when some device or browser is not available locally. Other use case when some steps execution, especially on mobile device, needs to be shared in the real-time or recorded. UI designers and developers use SauceLabs for quick app behavior/rendering validation on different platforms.
2 - Mostly DevOPS guys experienced in both Network Engineering as well as CI pipelines an infrastucture maintenance.
- Regular tests execution on Real Mobile Devices
- Regular tests execution on different browsers
- Sharing a video how the bug is reproduced with stakeholders
- We actually use Mobile RDC in combination with emulators to achieve max tests coverage and faster execution
- We are planning to have more devices in the RDC to achieve even faster tests execution time and scaling to more platforms
Sauce Labs Support
Pros | Cons |
---|---|
Kept well informed Quick Initial Response | Slow Resolution Poor followup Problems left unsolved Escalation required Difficult to get immediate help Need to explain problems multiple times |
Yes - The bug was eventually redirected to the Appium team by SauceLabs support team, that responded in a month that it's not yet fixed.
There was a case when we couldn't should down our SauceConnect tunnels.
SauceLabs representative responded within a few hours and helped to address the issue.
Using Sauce Labs
Pros | Cons |
---|---|
Like to use Easy to use Technical support not required Quick to learn | Feel nervous using |
- Filter test jobs
- Analyze VMs usage
- Record video of tests esxecution
- Filtering executed jobs (not all fields available)
Yes, but I don't use it