Scale your tests. Now!
Updated October 11, 2019

Scale your tests. Now!

Anonymous | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Overall Satisfaction with Sauce Labs

We tested both Web and Mobile apps using SauceLabs. We find it especially useful as we need to target tests to multiple platforms. The tool is used by multiple parties: both manual testing and automated testing teams. We also use it to generate test execution reports and share with other parties (e.g. Dev team). That replaces long Steps to Reproduce statements.
  • Shareable test execution video log
  • Ability to debug app in the cloud
  • Ability to connect local network to the SauceLabs cloud
  • Really fast(er) tests on mobile devices in RDC comparing to emulators/simulators
  • Slower execution than on real devices
  • Sudden connection issues (test aborts itself)
  • Complicated work with Sauce Connect (not flexible enough)
  • Sometimes really challenging to configure Sauce Connect and Sauce Storage properly
Eventually, SauceLabs was cheaper and a bit faster option (at the moment when we made a choice). On the top of that SauceLabs provided us with big enough for consistent evaluation demo period/minutes so we could test it carefully enough before purchasing. We also find no worthier equivalents for Sauce Connect (at the moment of evaluation)
Good to automate tests most of Web and Mobile apps. Complicated to use when custom OS/browser/emulator configuration is required (e.g. cookies disabled or Google Play services installed). Not good for performance testing, custom JavaScript snippets execution results may differ from ones on the real desktop browser. Not recommended to use for http traffic testing (too slow and Sauce Connect may cache traffic unexpectedly).

Using Sauce Labs

100 - Main users of SauceLabs services within our organization are: Test Automation Engineers, Functional Testers, UI Designers and sometimes Software Developers. Test Automation people use SauceLabs mostly as a platform for tests scaling for multiple targets and regular executions. Functional Testers use it mostly as a backup when some device or browser is not available locally. Other use case when some steps execution, especially on mobile device, needs to be shared in the real-time or recorded. UI designers and developers use SauceLabs for quick app behavior/rendering validation on different platforms.
2 - Mostly DevOPS guys experienced in both Network Engineering as well as CI pipelines an infrastucture maintenance.
  • Regular tests execution on Real Mobile Devices
  • Regular tests execution on different browsers
  • Sharing a video how the bug is reproduced with stakeholders
  • We actually use Mobile RDC in combination with emulators to achieve max tests coverage and faster execution
  • We are planning to have more devices in the RDC to achieve even faster tests execution time and scaling to more platforms
I like most of the SauceLabs services, but sometimes they are just tricky to configure (e.g. we are currently struggling with RDC to make it to pickup the latest uploaded artifacts)

Sauce Labs Support

While initial response time is quick, the initial question is the only thing that happens fast.
That's a standard request like adding one more error log or make sure I use the latest version of libs.
All further cmmunication goes really slow.
I am not sure my requests reach proper addresses quick enough.
In 50% of cases I receive a response in a few months (in half of cases stating that the issue can't be addressed).
It's often would be enough just to know if the fix is on the roadmap, but slow responses don't allow any planning.
ProsCons
Kept well informed
Quick Initial Response
Slow Resolution
Poor followup
Problems left unsolved
Escalation required
Difficult to get immediate help
Need to explain problems multiple times
Yes - The bug was eventually redirected to the Appium team by SauceLabs support team, that responded in a month that it's not yet fixed.
There was a case when we couldn't should down our SauceConnect tunnels.
SauceLabs representative responded within a few hours and helped to address the issue.

Using Sauce Labs

I can perform most of operations easily via the UI.
Sometimes I need to spend 15 minutes looking for a feature though.
ProsCons
Like to use
Easy to use
Technical support not required
Quick to learn
Feel nervous using
  • Filter test jobs
  • Analyze VMs usage
  • Record video of tests esxecution
  • Filtering executed jobs (not all fields available)