No more maintenance nightmares!
Updated March 30, 2021

No more maintenance nightmares!

Anonymous | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Overall Satisfaction with Sauce Labs

Sauce labs is currently being used by the automation team for testing the website on different browsers and mobile emulators. It addresses the business problem of having to configure and maintain VMs and a Selenium Grid for emulators/devices or for different browser types. One immediately noticeable benefit is running on a Safari browser, as they have addressed the caching issue by instantiating a fresh browser instance for each scenario. One drawback is the performance and run time of the iPhone Simulators.
  • Jenkins integration: The Sauce OnDemand and SauceConnect tools provide seamless and trivial integration with Jenkins.
  • Documentation: Finding proper desired capabilities for specific browsers/platforms is quick and easy on the site.
  • iPhone Simulator performance: The performance of the iPhone Simulator is dreadful. It was at least three times slower than running on a simulator on my own machine.
  • Monthly cost was a bit higher than expected, which had a slight negative impact
  • Immediate transparency into application performance on various mobile devices was a major positive impact
  • Ability to run tests on various versions as needed was a positive impact
Sauce labs held it's own against Selenium GRID. Maintenance was a key factor, as this is removed from the equation with Sauce Labs. With a GRID, you have to be on the ball with every latest development with Appium, various drivers, etc. Also, the video replay in sauce labs along with the commands and corresponding screens are powerful.
Sauce labs is perfect for a company with the funding that wants a quick solution for cross-browser/device testing without having to set everything up themselves. I believe it is less appropriate for a situation where support of only one or two browsers is required.

Sauce Labs Features & Support

Using Sauce Labs

10 - The primary individuals that use Saucelabs with in my current project are Quality Assurance Automation Engineers. Saucelabs is leveraged within a multi-browser/platform automation effort to cover Android, iPhone, Safari, and IE. Results from test runs are pulled into Jenkins jobs that leverage the Sauce Connect plugin. Integrated Saucelabs video feeds of failed test runs provide full visual feedback on failures within the Jenkins jobs.
2 - There are a few senior Automation Engineers that provide the necessary information required for configuration of Jenkins automated test runs that require Saucelabs. For example, junior engineers may reach out to them for details on what to enter for the Sauce Connect parameters. Support for defects or issues related to Saucelabs itself requires one of these resources to reach out to Saucelabs official support.
  • Multi browser test run support
  • Mobile test run support
  • Video feedback of test failures
  • Configured framework for locally run tests that execute through Saucelabs
  • Configured framework to integrate with Sauce Connect
  • Leveraged Saucelabs for debugging automation code on specific browsers
  • Streamline Saucelabs responsiveness to make it a viable tool for debugging on rare browsers
  • Streamline Saucelabs responsiveness to make it a viable tool for debugging on mobile devices
  • Make running tests on actual mobile devices more affordable
Saucelabs is simply unparalleled for providing multi browser/platform/device test runs easily available. It's seamless integration into CI tools like Jenkins through its Sauce Connect plugin make it an essential tool for teams that do not have the time or money for setting up and maintaining complex test environments. Debugging on specific browsers or platforms is an added bonus for the tool, which can be leveraged for defect validation.