Maintenance? What’s that? No such thing with Sauce Labs!
Updated August 03, 2022
Maintenance? What’s that? No such thing with Sauce Labs!
Score 8 out of 10
Vetted Review
Verified User
Modules Used
- Sauce Labs Real Device Cloud
- Sauce Labs Core Platform
Overall Satisfaction with Sauce Labs
Allows testing across all phases of development by all members of a cross functional team. Easy to access and use by all with little knowledge of Sauce Labs via the UI. Solves: Maintenance costs of devices including upgrades, software updates, malfunctions. Device shortage via use of public devices. Device sharing and collaboration. Access to devices during pandemic.
- Range of devices are almost endless.
- Combination of OS, Browser and browser versions are more than satisfactory.
- Logs of every type at your fingertips.
- Updates to the core could be better communicated.
- Documentation can be outdated in certain places. Like broken links or now irrelevant.
- Chat function would be nice as support even if it's a bot.
- Eventually, our actual in-house devices would no longer be needed, where we’ve already stopped purchasing new devices.
- A bit extra investigation needed. Device usage metrics must be gathered both on the Saucelabs side as well as our users so we can get a clear understanding of what devices we need so that each time we refresh our private devices, we get the ones in high demand
Do you think Sauce Labs delivers good value for the price?
Yes
Are you happy with Sauce Labs's feature set?
No
Did Sauce Labs live up to sales and marketing promises?
Yes
Did implementation of Sauce Labs go as expected?
Yes
Would you buy Sauce Labs again?
Yes
Sauce Labs Features & Support
Evaluating Sauce Labs and Competitors
Yes - We had Saucelabs replace TestObject. Simple reason is that Saucelabs acquired them and made them part of the Sauce platform. All the features were migrated onto the Sauce platform (took a while longer than I'd wanted to be honest) with the added ability to access Saucelabs' desktop browsers via their virtual machines. It was a no brainer really as the cost stayed very close to what we had with TestObject originally.
- Price
- Product Features
- Product Usability
- Product Reputation
For us, we came from TestObject, which was acquired by Saucelabs. Pricing staying very close to what we originally paid for TestObject alone, but with the added benefit of desktop browsers.
Saucelabs is very well known in the industry, so with a community backing and great documentation, it was worthwhile making the jump.
As mentioned before in the previous parts, features are constantly being added to Saucelabs and they always have a habit of letting you know when they are available (via their UI), which is great!
Saucelabs is very well known in the industry, so with a community backing and great documentation, it was worthwhile making the jump.
As mentioned before in the previous parts, features are constantly being added to Saucelabs and they always have a habit of letting you know when they are available (via their UI), which is great!
At the time, we tried and tested many of competitors. But given that most of the competitors had less features with a higher cost, it was a no brainer for us to migrate from TestObject to Saucelabs since there was no added learning curve (due to the acquisition) and not much of a change in cost.
Using Sauce Labs
30 - Cross functional development teams which consist of a mixture of QAs, backend developer and frontend developers. As you can imagine, Saucelabs is more utilised by QA, Frontend developers and backend developers, in that order. External of the teams like product owners or directors would make more use of the video features, like for example, sharing a test run which contains gameplay and/or tests running on a browser.
3 - We have a small QA only team which supports with all things QA across the business. This team drives the direction of QA across all departments and provide not only Saucelabs support but support of our in house QA frameworks and technology. Saucelabs is fairly straightfoward to use, especially for manual QAs, so support is usually for automation and/or admin.
- to replace real devices - no maintenance, purchasing, selling required
- the ability to visually show test runs to stakeholders and non technicals
- the ability to easily debug failed test runs
- monitoring systems which spawn up a browser/device to ensure uptime is as expected
- Not known as of yet. More features added in the future by Saucelabs may change this
Sauce Labs Implementation
- Implemented in-house
Change management was minimal
Sauce Labs Support
Pros | Cons |
---|---|
Good followup Knowledgeable team Problems get solved Kept well informed No escalation required Support understands my problem Quick Initial Response | None |
No. Did not need it since we are technical ourselves and are able to debug most of the issues we come across.
Probably a good thing, but haven't needed urgent support.
The times that we did raise a few things, the response time is fairly fast (within 24 hours). But then again, it was never for anything major.
The times that we did raise a few things, the response time is fairly fast (within 24 hours). But then again, it was never for anything major.
Using Sauce Labs
Pros | Cons |
---|---|
Like to use Relatively simple Easy to use Technical support not required Well integrated Quick to learn Convenient Feel confident using | Inconsistent |
- Launching a browser/device manually or through code
- Reviewing test runs through video and Webdriver comms list
- Sharing a session through the UI via a link
- USB remote debugging isn't straightforward
- device usage metrics is non existent or I can't find it
- Individual level usage is fine. But would like to see usage at a team level. i.e. ability to generate a team access key
Yes, but I don't use it
Sauce Labs Reliability
Relationship with Sauce Labs
Since we were the original users of TestObject, of which they acquired, we were able to migrate our devices over from when we had a contract with TestObject as well as gain usage of Saucelabs' VMs for a very little increase in price. Turns out we use VMs more than we thought we would.
Just lay out your requirements as a business. Explain what you'd need devices/VMs for and at what scale and the Saucelabs rep would be able to recommend what's best for your in terms of browser sessions and devices that you'd need.
Upgrading Sauce Labs
- The two VM and real devices side being viewable on one platform (Unified platform)
- Easier navigation and browsing through both real devices and VM browser runs
Yes - Not that it was a different edition, but it was their unified platform that integrated together their own VM browser service with their acquisition of TestObject (real devices). This took a while to fully roll out as we were dependent on certain APIs that were originally only on TestObject, but they eventually got there.