TrustRadius
https://dudodiprj2sv7.cloudfront.net/product-logos/4b/Wm/A1HKR1GD7JMK.PNGSauce LabsPros with some cons, but absolutely mostly pros!2018-08-17T19:16:06.941ZMy company has used Sauce to automate the verification of video playback across multiple platforms and environments across desktop to mobile. Right now, it's only used by myself for a subset of teams. Video is a really tough thing to work with as it's very subjective and can be very time consuming to test. Being able to automate at least part of it gives us the ability to spend more time on other tasks.,Customer communication - My account team and support are always responsive and helpful!
Staying up to date including day one support for some things.
Receiving feedback. I've had several meetings with Product to discuss my pain points, future wants, etc.,Sometimes things can be finicky
Connection speeds haven't always been great,10,Improve quality by increasing browser/OS/device coverage,I don't have any particular insight into this category, so I'm unable to speak to it.,Being able to very quickly access many, many past browser versions and on a handful of different OS's means that we should likely be able to get some sort of parity or something close to whatever customer environment we may need to cover. It frees up our machines from having to be cluttered with all of this which is great, too!,I've touched on some of these points in my other responses, but given the market moves so quickly, trying to constantly buy the newest devices just to have them collect dust doesn't make sense. Instead of my team paying for a device, using it for a little, and then moving on, Sauce can actually be thought of as being environmentally beneficial, too! Allowing multiple companies to utilize the same device makes the justification of that device's resources and materials much more bearable.,I have not used Sauce Labs Proxy.,Xamarin, BrowserStack, AWS Device Farm and Perfecto MobileJayson SmithGet on the Sauce! Sauce Labs will make your automation life A LOT easier!2017-05-17T17:04:34.948ZWe use Sauce Labs when we're running our regression test suite against a multitude of OS and browser combinations for our core web product. We are able to easily spin up virtual machines that contain a specific OS along with either the latest, beta or older version of the browsers we support with our app. This saves us a lot of maintenance and support issues with our test environments.,Greatest strength of Sauce Labs to me is the ease of spinning up a clean virtual machine with the desired OS and browser combination.
Sauce Labs support has been great! When I've run into issues whether it's from my own code issue or something on their side, they have been very responsive and helpful.
The ability to scale up or down our needs from Sauce Labs has been great. As we build out more automation, we have a larger need of Sauce Labs services and it's been so simple to do. Need more parallel VMs? No problem. Need more automation time each month? No problem. It's all done almost instantly.,My main area of concern that could be improved is the cost of the real mobile device farm offered. I have tried it out and it's great! I want to use it for most of my mobile automation, but can't justify the cost.....yet. Once more and more tests are created on my side along with a need to cover more devices then maybe it will work.
A minor area that could be improved would be the responsiveness of the video stream of active tests. Sometimes I need to refresh the browser to get the video to come on or update.
Another area of improvement would be the speed that tests can run. This has improved since I first started using Sauce Labs, but don't we all want everything, right now, immediately? I'm asking for the world, but you asked!,10,Accelerate the pace of new feature releases
Eliminate testing as a bottleneck
Improve quality by increasing browser/OS/device coverage
Achieve continuous delivery,We have been able to test on different OS and browser combinations that we were not able to before. Yes, we could have eventually built virtual machine's with what we needed, but we didn't have the resources in place when we needed it and Sauce Labs gave us a quick way to get this started and still use today. This has given us better quality and definitely made us more efficient which in turn gets us to market quicker. It's a win all around!,A new, clean virtual machine is spun up each time for every test. You cannot access a previously used virtual machine. Any test remnants or access behind our firewall is strictly guarded within each virtual machine and the use of a secured tunnel. When testing mobile apps, the apps are only kept in storage for a minimal amount of time and then deleted. Access is guarded with our Sauce Labs credentials, as well.,Our product is supported on a number of OS and browser combinations and the ability to have clean working test environments is critical to our success. Sauce Labs has given us the ability to spin up a great deal of different combinations and have them ready within seconds. This frees up our time to spend on more useful tasks such as testing.,A company can build out the infrastructure to house a test grid and have it be fairly straightforward. The issue comes in when you need to keep that test grid maintained. When tests are run, they leave behind artifacts from doing installations, downloading files, and other test related stuff. This may cause an issue for future tests if they are not cleaned up properly after each test. Also, there are OS and browser upgrades and patches that need to be installed on a regular basis. Maintaining a sizable test grid is a full time job, so hiring someone to keep the test grid maintained plus any costs of paying for operating systems clearly outweighs the cost of subscribing to a service such as Sauce Labs. Sauce Labs spins up a new virtual machine with the desired browser and browser version (try maintaining different browser versions on your test grid and the number of machines quickly grows) and gives you a clean environment for your testing. Sauce Labs is a bargain when you figure in all the costs of doing it yourself. Why reinvent the wheel?,We use the Sauce Connect secure tunnel to provide access to our test environment behind our firewall to Sauce Labs. This has been critical for us being a security company and maintaining strict access control to our environments. This allows for us to maintain a secure connection and still able to automate tests on Sauce Labs.,,Visual Studio IDE, Selenium,No,Price
Product Features
Product Usability,I don't think I would have changed much of anything. I tried out Sauce Labs and Browser Stack and attempted to do the same type of automation on both. Sauce Labs was clearly easier to use and I believe their price was even better than Browser Stack, so it was a no brainer.,3,3,Number one use case is being able to test on many different OS and browser combinations on a clean machine. Even if you're able to spin up multiple virtual machines with your choice of configuration, it still takes quite a bit of time to create and maintain them.
Automatic reporting of testing. Running automation with Sauce Labs keeps all of your tests in one place with easy filtering to get quick access to test results.
Running on mobile emulators and simulators. You will not always have every device supported to test on, so you will need to rely on emulators and simulators for some of your testing. Like not having to spin up virtual machines for every desktop OS and browser combo, you don't need to create every emulator or simulator either. Run directly on Sauce Labs!,Using Sauce Labs has increased our test coverage which is the biggest win for us. Previously, we were limited by resources to create all the environments, but now we can test across many different types of configurations. This has been a huge boost to our testing!
Running tests in parallel! Before, we mostly ran our tests one by one which took a long time especially as we developed more and more scripts. Being able to seamlessly run many tests in parallel has greatly sped up testing and keeping our coverage at the same time.
The use of mobile emulators and simulators. Before we were limited by what devices we had on hand and only using a browser's emulator for our testing which is very limited and doesn't cover many features of a mobile device. Using Sauce Labs for emulator and simulator testing has helped us with greater coverage than we had before.
Sauce Labs real device farm! I've only test driven their real device farm, but it worked great! I was able to run my automation on native android and ios apps on real devices that we didn't have on hand. How can you beat that?,The plan is to run many tests in parallel, so I'm expecting to need many more virtual machines to run at the same time.
Real device farm: I've tried it out and now I want to use it on a regular basis. As more mobile scripts are developed, there will be a need at some point to move away from managing our own inventory and use Sauce Labs real device farm.,10,Implemented in-house,No,We were lucky. I knew Sauce Labs before starting at a new job that had no automation in place, so I was able to convince management to get Sauce Labs at the very start of building out automation.,10,No,10,Yes,When I was first trying to use Appium for mobile testing, I struggled quite a bit getting it up and running. I was attempting to use Sauce Labs, as well, while trying to get going. I ran into many issues (self made), but many times I didn't know if it was on my side or Sauce Labs, so there were a number of times that I sent them my problem. Not once did they kick it back to me saying it was on my side and not theirs. They always helped and would even escalate to a senior member to offer assistance with Appium to help out. Like I've said before, I can't say enough great things about the support I've received at Sauce Labs. They truly make your success their success.,The ease of spinning up a new virtual machine with your choice of OS and browser
Being able to retrieve and review test results
Adding team members to their own sub account to separate testing,While spinning up a new virtual machine is easy, it can be tricky if you're not familiar with the need of creating a secured tunnel to access a test environment behind a firewall. Easy after you realize it though.
Getting live video to update while a test is running can be cumbersome. I've had to refresh the browser sometimes to get the video to load.
I wish tests would run faster especially with mobile emulators and simulators. I hate to put this down because I know how difficult this must be, but if I could magically make something better it would be the speed of tests.,9Randall KelleySauce Labs is the way to go!2018-07-16T22:53:42.476ZWe use Sauce Labs to run all of our automated tests on the VMs, primarily being used by the QA Engineering team. We have web/front-end tests consuming VMs, as well as mobile tests.,Always up and running: I'd say 99.9% it's up and running, as I've rarely experienced any down time with their VM farm machines.
Reliable: we run our automated tests on their VMs at least every hour, around the clock, and their service is very reliable and working properly.
Community: good online community of other people using Sauce Labs with tips/tricks; often see Sauce Labs at conferences and it's nice to talk with them about what they have planned (new features).,Reporting: overall reporting over a time period used to be an issue, but there new feature to support this is getting there and improving.
Logs: I don't find their logs very useful for front-end web tests, I usually refer to my own logs if I have a bug/issue/error that needs investigation.
Cost: it's a little bit pricey, but I don't pay the bill so I'm not complaining too much there. Overall, I'd say the price isn't ridiculous but it's not inexpensive.,10,Achieve continuous delivery,My company is not in financial services, but we do trust that our data is secure in Sauce Labs. I haven't taken a deep dive into looking at their security measures, so I can't give a great review on this subject matter.,On the web we support Chrome, and that browser is available in Sauce Labs (SL), in many different OS/version combinations. It provides us with what we need for our front end web tests.
On mobile, it provides all the device and platforms we need support for, from iPad to iPhone to Android to tablets.
Overall, SL seems to cover all the bases for web and mobile platforms/devices needed.,In my previous company, I built my own VM farm of machines and managed them for running our automated tests against. By doing this yourself, you learn a lot, but it consumes a lot of your time and becomes a big headache to be honest. Mainly, it is the time consumption of managing/upkeep on the VM's. It almost becomes a FT position job, to manage the VM farm on your own.
Since using Sauce Labs, it now provides a reliable farm of VM's and I can focus on doing what I enjoy (coding) instead of trying to manage/upkeep my own set of VM's.
Without a doubt, Sauce Labs is the way to go. Don't even think about trying to manage your own VM farm.,We currently do not use the Sauce Labs Proxy, so I do not have enough info on this feature in order to provide much feedback.,JIRA SoftwareDeon CravalhoEffective2018-07-06T18:54:40.644ZI have recommended Sauce to several clients I supported as a consultant of test automation services. It solves the problem of streamlining mobile automation results in a timely fashion. The Sauce Labs platform affords users the ability to execute a variety of test suites on multiple devices, even in parallel. Clients I have talked to want results more quickly during each development sprint.,Real device cloud is a much needed feature, and Sauce delivers.
We are in the process of evaluating Sauce Labs for real device testing.
The biggest strength of Sauce Labs is very easy to configure.,Many time performance of the execution is really slow, especially when connected with Sauce Connect.
need to support video playback on
No real device cloud access for open source projects.,10,Eliminate testing as a bottleneck
Improve quality by increasing browser/OS/device coverage,I would be interested in learning more about these implementations. While not in financial services, we do have heavily audited applications that may benefit from any new [security and compliance] features.,Sauce Labs has allowed my team to implement automated testing into our pipeline that would not have been possible without Sauce Labs.,Sauce Labs has allowed my team to implement automated testing into our pipeline that would not have been possible without Sauce Labs.,We extensively use Sauce Connect for all of our automated testing. We have had many struggles with the proxy servers and configuring the PAC files to enable us to access our internal test environments as well as our external facing test environments. It's been a constant struggle for us to maintain this PAC file as new sites come online.,Michael ChangAutomate your cross-browser testing with Sauce Labs2018-06-19T14:08:54.505ZSeveral teams that have a User Interface (UI) are planning to use Sauce Labs to test on different browsers and ensure functionality is working as expected. It helps us do cross-browser testing and mobile testing on both emulators as well as real devices. They have a great collection of real devices and I was able to find the latest Android and iOS devices.,Many versions (includes older versions) of popular browsers like (IE, Firefox, Chrome, Edge etc.) are available
Great collection of real mobile devices available for testing
Works well with CI tools like Jenkins, CircleCI etc.
Has support for many programming languages like C#, Java, Python, Ruby etc.,Identifying flakey tests, slow tests can prove to be really useful
Live testing on VMs is slow i.e. there is a lag for the browser to perform actions after actually performing them
The metrics provided are very basic. This could be improved,9,Improve quality by increasing browser/OS/device coverage
Achieve continuous delivery,We definitely think Sauce Labs would be helpful since they encrypt the data to ensure security and also do not store any data on their servers. We do not use real customer information specifically PII/PIFI during testing and only use test data. Our testing is limited to non-production environments only. Because of these reasons, we are able to use Sauce Labs,By testing our application on different browsers and mobile devices, we are able to catch bugs early and fix them before it gets to the customer. This ensures we provide a good and consistent experience to our clients irrespective of the browser/mobile device they use to access our application.,You could maintain a Selenium Grid for doing cross-browser testing and have a bunch of mobile devices to do mobile testing. This becomes a lot to maintain over a period of time since they need constant maintenance. It is also not possible to provide all the different browser/OS/resolution combinations that Sauce Labs provides.,This is a nice feature if your application is behind a corporate firewall. Sauce Connect allows you to test such applications. It is good that data is encrypted and sent over the tunnel and also the tunnel is only open for the duration of the test run. It is definitely very helpful rather than maintaining your own proxy.,BrowserStack and CrossBrowserTestingVignesh Viswanathan
Unspecified
Sauce Labs
179 Ratings
