Quick review of Sauce Labs
June 06, 2018
Quick review of Sauce Labs
Score 9 out of 10
Vetted Review
Verified User
Overall Satisfaction with Sauce Labs
Our company is using Sauce Labs across our organisation. We have many different product teams that rely on a frontend, which is public facing and has a throughput of millions of customers. It is imperative that we have tests that are reliable and fast to ensure we haven't introduced a regression bug in our development. We have it running in our continuous integration pipelines, which we use on per 'push' of code to our master branch. And I have to say, Sauce Labs delivers. It is fast, reliable and allows me to scale to a different testing browser/device quickly and easily.
- Easy to run a Selenium test on a device. Add 3-4 capabilities, pass it into a driver instance, and boom. You are connected to Sauce Labs.
- Screenshots, videos, network logs, build monitoring, it's got a lot of tools that make it easy to debug a test and figure out what in the AUT is causing test failure.
- Uptime is high, we rarely have problems with their services.
- Mobile and tablet devices use emulators, which are extremely slow. The reason why they are slow is because they boot up a fresh VM on each test run. This adds minutes to a test, even if the test is 10s long. If there was a way whereby we could run a test on VM's which are already booted and ready to go, it will save immense amounts of time.
- Cookie view for a test: we manipulate areas of the cookies at times for debugging. It makes life easier if a snapshot of cookies with their key:values are stored in the Sauce Labs test run dashboard for viewing. This would aid us in saving much time.
- You can have a licence of 50 virtual machines and 5 accounts who share these 50 VMs. However, when you are logged into one of these accounts, and run i.e. 49 tests and then log in to another account, it still shows 50 VM's free when that is not the case. This causes other tests on other accounts to fail, which makes teams lose faith not only in Sauce Labs but in the test frameworks. I wish this area was more visible to all accounts and handled better in the console output.