Item: Sauce Labs
Rating: 6
Author: Krzysiek Kwiatosz

Overall Satisfaction with Sauce Labs

Use Cases and Deployment Scope

We use sauce labs in our scrum team to conduct automated UI tests for the main feature flows of our application. We run from 4-5 tests using 3 browser configurations after each commit to development branch.

Pros and Cons

Pros

It's a great tool for getting a quick, on-demand test environment for doing a manual test.
It integrates well with commonly used task runners (MVN, Grunt).
It's easy to write executable tests based on Selenium engine.

Cons

The tests commands are sent by individual HTTP requests - it could be improved by sending more data at once to speed the overall remote test execution.
In our case the tests executed on a Safari browser are unstable. The results are non-deterministic - random fails, random successes.

Other Software Used

CloudFoundry, Bamboo, JIRA Software

Likelihood to Recommend

Sauce Labs is good for testing short scenarios which are essential for your app and which you want to make sure they work fine on most commonly used browsers.

We experience some undeterministic failures of long, complicated scenarios if tested for Safari or IE setup. I would recommend testing long scenarios using only one, solid setup (i.e chrome, Firefox).

Comments

Please log in to join the conversation

Sauce Labs review