Sauce Labs is a great product with a lot of features for debugging
Overall Satisfaction with Sauce Labs
Sauce Labs is used across Yahoo and also in my department (Yahoo Mail). We use Sauce Labs for running UI tests as well as integration tests. It helps us automate the build process by running the tests in a production like environment. There are multiple VMs running the tests in parallel.
Pros
- Supporting different OS and browser combinations
- Adding support for new browsers as they get released
- Detailed analytics view of how the tests are running
Cons
- Sauce Labs could improve on provide test level analytics
- Sauce Labs helps with better reachability when fixing issues, leading to better ROI
- Internal solutions
Sauce Labs, being focused on the idea of running automated tests and providing proper support, takes away the need to maintain the local in-house infrastructure. It provides videos for all the tests and screenshots as needed. There are capabilities to access logs of failed tests. Features like these make it easy for debugging.
Evaluating Sauce Labs and Competitors
Yes - We had our own internal tools for accessing browsers through cloud infrastructure. It was very expensive, in terms of resources, to maintain such an infrastructure and continue to update it with every minor version upgrade of browsers. We wanted to replace them so we could focus on consumer based products rather than the infrastructure itself.
- Price
- Product Features
- Product Usability
- Positive Sales Experience with the Vendor
The biggest factor that influenced our decision making was the list of features offered by the product. Sauce Labs has some amazing set of capabilities that are not matched by other companies in the space. Some of these include screenshot capabilities, video feed, manual testing mode, log analysis, thorough history based on jobs etc.
During our initial analysis of Sauce Labs, we were only focused on their desktop capabilities. We did not care about the mobile infrastructure they had. If we were to do this all over again, we would focus on all aspects of development. Luckily for us, Sauce Labs is equally equipped in its mobile infrastructure.
Using Sauce Labs
Pros | Cons |
---|---|
Like to use Relatively simple Easy to use Well integrated Consistent Quick to learn Convenient Feel confident using Familiar | Requires technical support |
- Automate testing pipelines
- Debug failing tests
- Test different environments
- Tunneling to enterprise network
Yes, but I don't use it
Comments
Please log in to join the conversation