Sauce Labs

We were able to achieve increased browser and device coverage. The ability to quickly test our product allowed us to write more tests. Also, with Sauce Labs ability to provide VMs for specific testing, developers are able to test new scenarios in silo leading us to cover more areas of the product, while testing.

Yes we have been able to improve the quality of our product because now we have the ability to reproduce bugs and also test new features on multiple browsers and Mobile devices

The above goals were achieved by my organisation.

Every day new devices are coming on the market. And as a competitive market, we want to test our app on every combination of devices and os. Also, with a fast output of automation results, we can increase the confidence in product release and that is also on time to our customers for their happy experience with the product.

By using Sauce Labs, we are confident that whenever a new device comes to market, we can test it out first before the customer. Even for some out-of-date devices or browsers, Sauce Labs can help as well. With that being said, using Sauce Labs can help improve quality by increasing browser/OS/device coverage.

My organization did achieve the outcome desired of improving quality. It gave transparency into how the product functioned across various configurations, most specifically in the mobile realm. Prior to Sauce Labs test runs, any quality information with respect to mobile was limited to time-consuming, expensive, and somewhat non-replicable one-off manual testing.

We have been able to increase test coverage by running against multi os and browsers. The bottleneck no longer exists.

Yes - for most application we have these included in our pipeline however we are still trying to increase coverage.

We were able to increase OS/browser coverage relatively easy with SauceLabs. However, there was a number of challenges specific per browser that we needed to overcome. E.g. some elements were not clickable on Safari and we needed to use custom JavaScripts to trigger them. At some devices, traffic was not routed properly so we were forced to just exclude these devices from test targets.

So far so good.

We have a pipeline that moves dev code onto testing servers, and automated tests are subsequently auto kicked off and ran against Sauce Labs VM's. We run our pipeline around the clock, every hour, so we need a reliable service like Sauce Labs that is virtually always up and running.

Saucelabs makes it very easy to automate testing on a wide variety of devices, browsers, and operating systems. Always have these on hand and the wealth of tools available decreased a lot of our testing time.

The service is outstanding. They provide me with the combinations of browsers/platforms that make it easy for me to do my job. And I don't have to spend any of my time maintaining a lab! Lab maintenance is where I found I was spending a lot of time in previous jobs.

Confirmed browser specific defects

We have definitely been able to achieve continuous delivery, because we primarily focus on ensuring that customers, AKA our end users, are getting the best experience with the software they use. Of course, with any software you're always going to run into bugs, and so that's where our integration with JIRA comes into play. With this, we've been able to significantly decrease the time it takes to handle customer issues. In the past, it would be super disorganized and we'd have no way of organizing the issues that customers reported to us, nor did we have an efficient way to investigate those issues. Often times it would take up to eight hours to look into what a customer was seeing and test to see how we could fix it. This, in turn, caused a very negative customer service experience and led to a lot of churn. However, with JIRA, we are able to better organize the bug reports that come in, which helps us work more efficiently because we're able to prioritize and figure out which issues are affecting the greatest number of customers, or which issues are very high impact. This helps to decrease wait time for highly important issues, which means that customers are a lot happier, and we've noticed this across the board with our higher customer satisfaction scores. We are also able to test the causes behind each of the customer issues in a faster way, which again gives faster resolution time and a better customer service experience.

It achieved our main outcome to cover coverage. Test with the same set of devices across the world rather than purchasing devices in all offices.

We achieved all of the above, as Sauce Labs provided everything we required to set up the testing lab easily. We could scale up and improve our automation by integrating with Sauce Labs. We could cover cross-platform, different os/devices. Sauce Labs also helped us to eliminate testing bottlenecks by allowing anyone to trigger automation testing, thereby increasing the pace of feature releases.

We're looking to include Sauce Labs as a part of our Continuous Integration and Continuous Delivery Service. We're now focusing on Unit tests, Code Coverage, and Static Analysis but we're thinking about including a new step of e2e testing with selenium and night watches for all the Frontend apps. These tests and all the tests we've run already will run against each pull request or any commit in an open pull request checking the quality of each change.

On the other hand, we're planning to deploy a version of the built app in a test scope server and run e2e regression tests using Sauce Labs to guarantee the correct happy path of each function.