Good if it was a startup - needs to pick up its game
Updated December 01, 2017
Good if it was a startup - needs to pick up its game
Score 6 out of 10
Vetted Review
Verified User
Overall Satisfaction with Sauce Labs
It is currently being used in a limited capacity only for cross browser testing. We have top 5 desktop and top 5 mobile combinations that we review each month and adjust our tests accordingly.
- Capture of log data of all relevant parts such as Selenium, Appium, browser etc. Screenshots and videos are very useful too.
- Good selection of OS/browser combinations and quick adoption of new ones.
- Very easy to integrate with on premise infrastructure.
- Very poor network performance when testing from outside of US, specifically EU, up to 20 times slower.
- Support can be quite slow, had a couple of issues that dragged for months and we as a client had to do a majority of the investigation despite the fact the problem was on Sauce Lab's side.
- Test configuration can be tricky sometimes, the Jenkins plugin does not set correct variables for the test. Ended up specifying parameters by hand.
We are due to run an RFP later on this year
Using Sauce Labs
| Pros | Cons |
|---|---|
Relatively simple Easy to use Well integrated Consistent Convenient Familiar | Requires technical support |
- Initial running of test cases
- Manual execution
- sauce connect
- Sometimes difficult to find right configuration for browser/os
- us only datacenter - performance in europe is unacceptable
- test configuration in CI - there should be libraries available to parse sauce plugin's configuration in CI platform such as Jenkins
- support can be slow when issue is not trivial