Love the Sauce!
February 24, 2017

Love the Sauce!

Jon Shane | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Overall Satisfaction with Sauce Labs

It was recently adopted by the product tech department to be used for multi-browser testing of our newly developed web-based apps. It has not been adopted enterprise-wide. Other departments., specifically QA, are using SkyeTap. It quickly allows us to assess the compatibility of our products across many platform configs without a lot of manual work.
  • Within an automation suite, you can quickly set up browser/OS configurations. You can be extremely specific as to browser and OS versions. All it takes is a couple of selections in drop-down menus for manual tests or the addition of a couple lines of code for automated tests.
  • Within an automation suite, you can parallelize test execution (run concurrently) up to as many VMs as required (provided you purchase them). This allows the test runs to complete faster. If you are using SL as part of a CD/CI process, that can be very helpful in that code can be merged faster.
  • In the Sauce Lab dashboard, the capturing of videos, screenshots, and logs are very helpful for debugging failed tests. The videos and screenshots help when manual verification of a browser is needed for correct UI formatting.
  • We are using a Ruby/Cucumber automation framework and we had to split our files into separate scenarios so we could properly report on each scenario. The same thing had to be done when we were running Protractor/Jasmine tests. Maybe they could somehow have reporting at the individual test level instead of file level.
  • It seems the Sauce Labs VMs are quite a bit slower than our local VMs even taking into account the tunnel. I understand that parallelization makes up for some of the slowness, but it still causes tests to run slower and more timeouts can occur if you don't adjust wait times when running on Sauce Labs. If you could beef up the VMs a bit more it would make life easier.
  • The documentation to get up and running initially is very good on the website. However searching for anything beyond that (problems, error messages, different automation frameworks) can sometimes be hard because of the confusing UI navigation, broken links ect. There is a lot of good info on the support pages but it definitely needs to be revamped to be more accessible.
Sauce Labs is easier to integrate with an automation suite. I believe that Skytap has fewer choices for browser/OS configs, Safari/MAC as an example.
Sauce Lab is great as part of an automated CI or CD process. The parallelization feature combined with the multitude of browser/OS configurations allows the developer to incorporate cross-browser verification into each build so that it is done upfront as part of the development effort and not pushed back to the tail end of a project or software delivery process.