Sauce Labs from automation point of view
May 15, 2017
Sauce Labs from automation point of view
Score 6 out of 10
Vetted Review
Verified User
Overall Satisfaction with Sauce Labs
Generally Sauce Labs is a good service, but what I found most problematic is the wait time for the emulators to start up. If the test is just a simple check, it was not uncommon that over 70% of the test execution time was spent on waiting for the environment.
Another issue that is problematic in my experience is the tunnel for local work. I personally didn't have much issues with it, but members of my team spent some time debugging why it's not working.
Another issue that is problematic in my experience is the tunnel for local work. I personally didn't have much issues with it, but members of my team spent some time debugging why it's not working.
- Once it's all connected, it's very easy to run the tests on multiple devices.
- The logs/screenshots/screen recordings are very helpful when debugging an issue.
- Depending on the subscription the tests can run parallelly, reducing the run time.
- The failures can be tried manually later, and with the provided screenshot/recordings it's quite easy to reproduce them
- Slowness is the biggest issue I would say. Sometimes a big portion of the test execution time is purely waiting on stuff to start/tear down.
- Restricted number of parallel threads can be a bottle neck if you have a big test suite.
I only used BrowserStack, another service with similar capabilities to Sauce Labs. I found that Sauce Labs for manual testing is much faster. For automation I only used Sauce Labs, I'm not completely satisfied with its speed there, but I cannot compare them on this field. BrowserStack is a good alternative I guess, though I have much more experience with Sauce Labs.