TrustRadius
https://media.trustradius.com/product-logos/4b/Wm/A1HKR1GD7JMK.PNGSauce LabsTesting Automation2019-05-21T18:31:13.869ZFrom the past year, Sauce Labs and their tools have been an integral part of my department. But I have mixed feelings about them, because while there are aspects that I truly love them for, but for others I think they are fine. Sauce Labs works daily to run tests and ensure the infrastructural compatibility, functionality, and performance of the applications.,Incredibly cheap.
The service is outstanding. They provide me with the combinations of browsers/platforms that make it easy for me to do my job.
Sauce Labs accelerates and optimizes the tests by running them through console logs, metadata, and Selenium with complete lists of compatible commands.,No integrated CI system
Sometimes it takes a little longer than a few days to get my support cases to closed
Customer support tickets should be responded to faster,9,Achieve continuous delivery,IT offer all the configurations you need and respond to the needs and desires of customers.,It gave us the flexibility to shorten the execution time of our automation suites. Quicker releases because Sauce Labs enables us to run tests concurrently.,We did not have time to build our own solution. Building our own solution would mean there would be ongoing maintenance which we did not want. No need for an engineer to maintain activity.,We are using Sauce Labs proxy to access internal network which is mostly needed by any org.,CrossBrowserTesting, Selenium and BrowserStackDishank VishnoiSauce Labs = Amazing Labs2018-03-02T19:50:46.267ZSauce Labs is used by Developer Teams to run their e2e Selenium tests. Sauce Labs is managed by a cross-department (testing team) but it's used across the whole organization (not only in IT department) It's used also by Customer Service teams or Email Marketing teams.
The main business problems that it addresses is helping us to understand customers' problems or bugs and make a visual and functionality check before or after a deployment.,Cross Browsing: It's a large list of OS, Browsers and Versions really updated.
Really aaS: Sauce is really an as a service product, you just use it when you want with really a few clicks.
Documentation rocks: They have a large knowledge base documented for all their customers.
Analytics: The have a nice analytics service to understand you test trends.
Allow CIs stateless: With Sauce Connect it's possible to get a CI-CD environment really stateless without needing to install and maintain a lot of tools and infrastructure.,Speed: We've some speed issues with "Live Testing" it's a bit slow and in our agile environment is a little sad.
Sauce and Testobject: It's wired to use 2 platforms when it's the same company. I wish it was all Saucelabs...It'd be more useful to explain to all the people that it's another service of the same company.,9,Achieve continuous delivery,We're not a security issue with Sauce Labs. All the things we use are based on the production code...accessed by the production Url and using the Sauce connect tunnel we're sure that it's secure and also we've some infrastructure services inside of our platform to avoid to be a part of security issues.,Sauce Labs is not helping us right now with this topic honestly.,In the past, we have our own platform like sauce labs. But it was to much cost to keep it updated and available to all the developers when they really need to use it. We decided to buy because of it, we do not want to have a maintenance cost of developers, resources, time, etc. We really appreciate Saucelabs because let us free of this problem.,BrowserStack, TestingBot and CrossBrowserTesting,CircleCI, Jenkins, AppiumJavier CardosoSauce Lab Review2018-01-09T16:55:26.456ZSauce Labs is a powerful tool for our organizations in terms of running our automation scripts on multiple browsers/devices on the cloud. It is very easily integrated with our CI tool, it helps us executing our whole test suite as per the schedule mentioned in our CI tool. The results are shown in a user-friendly, easily readable format.,We use Sauce Labs to run automation script on different browsers in the cloud.
We use Sauce Labs to run a test on multiple devices (simulators).
It is useful in our manual testing as well.
We are in the process of evaluating Sauce Labs for real device testing.,need to improve on network latency issues
need to support video playback on
sauce connect looks sometimes flaky,9,Accelerate the pace of new feature releases,Every company has different wants and requires an application that can be personalized for their size, type of workers and customers, and the specific industry they are in. For these reasons, no software can provide perfect features out-of-the-box. When you look for a software app, first be sure what you need it for. Read some Sauce Labs reviews and ask yourself do you desire basic features or do you want advanced functionality? Are there any industry-specific features that you are searching for? Find the answers to these questions to help your search. There are plenty of aspects that you need to mull over and these include your finances, specific business needs, your company size, integration needs etc. Take your time, use a few free trials, and finally select the platform that presents all that you require boosting your company effectiveness and productivity.,The wide scope of open source coding brings freedom and innovation for the design, architecture, and infrastructure of the applications. Through this, the whole community of developers can work with the open coding framework of Selenium.,Sauce Labs offers valuable and powerful cloud-based capabilities for testing mobile and web applications. It’s simple yet advanced based on the agile frameworks combined with open source code methodology. Hence, delivering the right set of tools to developers and testers to run tests across different platforms, browsers, and integrations.,not really,Amazon Cloud Drive,Microsoft Azure, Jenkins, HP Application Lifecycle ManagementManoj T VExtra Saucy!2019-05-28T15:05:47.306ZIt's being used by our QA and developers for automation and device testing. It makes device testing really accessible and near hassle-free, complete with a suite of tools to enhance the experience.,Multiple browser support
Very quick and reliable
Wide range of devices available,Even though there are lots of devices available, we'll always need more!
I did notice lag or stuttering at times.
We always need more documentation or training.,8,Eliminate testing as a bottleneck
Improve quality by increasing browser/OS/device coverage,We do trust it. I'm not specifically sure on the details but it has been reviewed by our security team and was deemed a trustworthy tool.,Having a wide variety of browsers and devices available makes it simple and quick for us to test our UI and user experience across a vast amount of use cases. User interface issues or navigation bugs are quickly picked up by QA or automation.,It takes a lot of time and resources to build a product like this. Rather than rebuild the wheel, we'd instead use a well established and built tool like Sauce Labs with great support to go with it.,I haven't used the proxy.Cohen SinghGet Saucy!2018-03-12T14:39:35.977ZWe are using it across many teams for test automation across multiple browsers. It makes our lives much easier as we do not have to maintain multiple browsers and WebDrivers for testing.,SauceConnect is great to allow tunnelling to test systems that are behind a firewall. There are many great features and they are adding more all the time.
The fact that they maintain all WebDrivers and every version of browsers in invaluable. If we have a need for a specific platform, they have it.,They have been having increased unexpected downtime lately. This is interruptive at times.,10,Increase the number of software release cycles
Eliminate testing as a bottleneck
Achieve continuous delivery,I do trust them. Their tunnels are encrypted and they work to ensure everything in their environments is secure. I've never had a concern that our data was in jeopardy in Sauce's environments and continue to trust their teams.,We've been able to ensure that key user flows have been validated with each release across multiple browsers.,Buy is MUCH cheaper and easier for us than build is. Specifically in my case, where I am a test team of one; I would never have time to maintain browser drivers myself.,I have not used it.,,No,Price
Product Features
Product Usability
Existing Relationship with the Vendor,Evaluate a few more,1,2,cross-browser testing
user flow validations
automating webdriver maintenance,Device emulation,10,Implemented in-house,Yes,Change management was a big part of the implementation and was well-handled,10Chris Hyde, MISIncrease test coverage and improve user experience2018-07-18T22:15:21.106ZIt is being used by the QA department. It saves time to verify and access all devices. One portal for all devices makes it easy for all quality assurance engineers to test and ship fast. It improved our organization by reducing escaped bugs. The best part of Sauce Lab for the whole QA team is that they will test on the same set of devices and test are captured even for manual.
We are using Sauce lab to run our automated tests in different browsers and devices,Different OS
Fast and reliable
Different browsers
Save money on devices,Add more real devices,10,Accelerate the pace of new feature releases
Improve quality by increasing browser/OS/device coverage
Achieve continuous delivery,I don't have much idea about financial services,Test user experience in all devices and browsers is the main usage of Sauce Labs for us. It provided the same support in the last 3 years especially to me.,It took a lot of effort and resources to build such type of platform. Sauce Labs is the best way to deal with this problem. It is already available in the market and then we need to build. We can utilize the same time to build new products and implement new features in products.,Iused Sauce Connect Proxy for manual and automated testing. There is no security concern,,No,Product Features,100,Run Automation test case
Manual testing,Used to run automate test and use sauce lab with allure reporting and jenkins,10Himanshu SingalEasy and Simple2019-03-02T22:52:02.331ZWe are currently using Sauce Labs in the software department.,Easy to integrate as simple as plug and play.
A wide range of devices and browsers.
Provides video clips of entire automation.
Supports live testing on real devices.,Sometimes, execution is slow, needs improvement.
Real device testing is available in limited regions.,10,Accelerate the pace of new feature releases
Eliminate testing as a bottleneck
Improve quality by increasing browser/OS/device coverage
Achieve continuous delivery,Sauce Labs met the security standards with our company.,The building takes up a lot of time and effort. Sauce Labs provided an easy plug and play mechanism with a huge variety of devices and browsers, which helped in scaling up the testing process. Provided real device testing which eliminated us in investing in procuring real devices. Sauce Labs also helped in continuous integration.,AWS Device FarmAshish Miraskar UmakanthaA Sauce Review2018-06-13T18:05:42.904ZHelps us with our user acceptance tests for multiple browser analysis.,spin up environments
Sauce connect! For running on my local machine
review archives of runs across environments,concurrent sessions
logs can be more descriptive
tests run significantly slower when pointed at SL,10,Improve quality by increasing browser/OS/device coverage,I do not believe this is relevant to my use to review.,align code to match small nuances across browsers,out of the box, low learning curve, hit the ground almost running.,no security concerns, Connect works well.,,Not Sure,Product Usability,Perform interviews with other teams about their processes. I would also seek to demo competitive solutions.,10,5,Nightly regression runs.
Validating defects do not return.
Confirming new feature user flows.,to assist with manual testing by spinning up a selected browser and starting point.
Increasing boundary test limits such as capturing 1000 scenarios versus 10.
Finding inconsistencies in JS between browsers.,Video capture to show new hires the overhead view of functionality.
Showing stakeholders the run count for confidence.
Jr engineers can write automation before diving into feature development.,8,Implemented in-house,No,Change management was minimal,Transfer of Knowledge.
Increasing learning curve.
Implementing with CI.,6,5,NA,Integrating with Jenkins
Integrating with Testrail
Running automation.,Adding a new framework.
Sauce Connect
Determining if failures are a system issue or flaky test.,6Joe MassiminoScale your tests. Now!2017-12-18T16:13:15.204ZWe tested both Web and Mobile apps using SauceLabs. We find it especially useful as we need to target tests to multiple platforms. The tool is used by multiple parties: both manual testing and automated testing teams. We also use it to generate test execution reports and share with other parties (e.g. Dev team). That replaces long Steps to Reproduce statements.,Shareable test execution video log
Ability to debug app in the cloud
Ability to connect local network to the SauceLabs cloud,Slower execution than on real devices
Sudden connection issues (test aborts itself)
Complicated work with Sauce Connect (not flexible enough),8,Improve quality by increasing browser/OS/device coverage,We have no complaints regarding the security of SauceLabs services. They follow NDA in the proper way. They suggest Sauce Storage for items used for mobile testing. Data there is uploaded in a secure way and can not be accessed without authentication. Test execution results are not accessible for other parties as well unless they are explicitly shared.,As mentioned earlier, we needed to scale our tests to multiple platforms and browsers to ensure our app works stable in multiple environments. Thanks to SauceLabs we were able to catch a few dozens serious enough environment specific issues so everyone was happy about that. We also found reports useful enough to improve communication between teams.,Eventually, it turned out to be cheaper than maintaining own devices farm. We did not have enough stuff to connect and maintain all kind of devices required for testing. From another side, with SauceLabs we have less control over devices used for testing so when we need some tweaks or bugfixes that takes a really ugly piece of time until they handle it (if they do it ever).,We currently use Sauce Connect and I'd like to admit that it has some issues when passing through streamed data.For the rest of protocols (like ordinary http requests) it works just fine. Regarding security limitations, we needed to make changes on our side to enable SauceLabs proxy. That was challenging to configure required network exceptions.,BrowserStack,Appium, IntelliJ IDEA, Eclipse, Skype for Business (formerly Lync), Slack, CA Flowdock, PostgreSQL,4,Yes,There was a case when we couldn't should down our SauceConnect tunnels.SauceLabs representative responded within a few hours and helped to address the issue.,Filter test jobs
Analyze VMs usage
Record video of tests esxecution,Filtering executed jobs (not all fields available),Yes, but I don't use it,8Verified UserAmazing website2018-11-02T18:29:25.985ZAt this time we are currently using Sauce Labs across the entire organization. Within 1 to 2 months of being hired, we all get an invite to join Sauce Labs from our email and then we're set a couple of reminder emails as well. Our organization is B2B software, and our goal is that no matter what department you're in, you'll be educated on the technology we all ultimately work with. We're all encouraged to take additional training to get ourselves up to speed about different kinds of software and technology, as well as troubleshooting devices and codes. What my team specifically uses is Sauce Labs University, which is where we can build our knowledge of IT and coding that we can apply to our job. The benefit that we get from this is that we can better understand what goes on in the back end, and we can therefore work more efficiently and better address customer-facing questions.,One thing that Sauce Labs does very well is continuing to provide education for technological products, so that we stay up to speed and are even able to learn new things that we never knew before. I definitely saw myself applying a lot of the new concepts that I learned, such as automated testing.
I also love the Secret Sauce where we can learn about new product updates for Sauce Labs, as well as learn about upcoming events such as SauceCon. I love being able to stay abreast of a company that I love, as well as be able to learn of more interactive meetings where I can meet tech-minded people, as well as the Sauce company, i.e. Saucecon.
I really love the customer service. Once in the Forum, I had a question, and Alyssa the VP actually gave me a reply, and was very quick to respond as well as very friendly. I've never had a company where the leadership was so responsive and so eager to dive in with customers on issues and questions that they have. This definitely shows that Sauce isn't just about getting profits, and that they truly deeply care about making the customers happy and successful.
Lastly, I love how Sauce University has a stash which encourages friendly competition among team members. It shows who has the most points, which encourages us to continue to actively participate in those trainings and challenges and quizzes. This in turn adds an element of fun to our work.,In Sauce University trainings, it would be nice we could receive more in-depth information, as opposed to a short paragraph of information. As a beginner in the technological field, I would definitely find that helpful. Maybe they could do something where you can create a link to show more details, so that more advanced readers don't have to open it, but beginners can actually open up that link to read more.
Also, it would be nice if in the trainings you would include the videos as well because a lot of people are visual learners.
I wish it were easier to search through the Sauce Labs help page. Sometimes it takes quite a few searches to get to the right result. For instance, I'm not sure if I should click on Knowledge Base or Documentation or Support- there's too much to click-through. There should just be a Search All button that would search across the whole Sauce Labs page, so that we can easily find the answer that we need.
Our team especially loves the challenges, because again that fosters friendly competition and encourages us to continue to learn more about the product and the tech, as well as hone previous skills we've learned through Sauce Labs. We definitely hope that more of those classes come out every week, so we can dive deeper into each concept. I think there should be a feedback page where we can submit ideas for the classes that we would like to see.,10,Achieve continuous delivery,I'm currently just an end user of Sauce Labs. However I can say that I do trust Sauce. I read that they've had a lot of positive reviews and all my co-workers have positive and great things to say about Sauce. Every interaction that I've had with Sauce customer service has been very efficient and everyone was caring, patient, and helpful with all the questions that I have.,I work alongside our company's customer service departments, so I definitely understand how important great customer service is. Sauce Labs definitely meets my customer service requirements. The support center is very helpful, because it provides comprehensive information. Not only that, but anytime I speak with anyone on the phone, through email, or through the forum, I'm able to get a quick response within 24 hours. Sauce really does go above and beyond in their customer service. Even the leadership team is willing to get their hands dirty. Y'all rock.,The reason we decided to buy Sauce Labs is because we were focused on increasing customer satisfaction. We wanted to find a software that would allow us to streamline our process of dealing with bugs that our thousands of end-users report on a daily basis. Before, we had no way of organizing all those bugs, nor did we have a way of testing and investigating the best solution to resolve those bugs for customers. This meant that we had low customer service scores across the board, as well as a high churn rate of customers that decided to move on to other software. This software has definitely made our bug resolution a lot more efficient. We were able to decrease our service times as well as increase customer satisfaction because we were able to use Sauce software to test and investigate the bugs a lot more quickly and intuitively.,I did not have any concerns. It did help to satisfy security concerns. I have not had any issues of it infiltrating PII.
After all security is top concern with our company, especially being a recruiting firm.,JIRA Software,Not Sure,Product Features
Product Usability
Product Reputation,I would also love to have read testimonials,90,20,Ease of use
Pricing
Security,Security
Sauce Labs Challenges to promote learning,N/A,10,Don't know,Change management was minimal,people had learning curve
some people only wanted to do things the old way,10,Self-taught,Yes. I looked at the webstie and Sauce Labs University. I learned the basics.,10,no,a time saver,10,Yes,
Tristan Lombard was super quick to help with one of my questions. He immediately responded back in the same business day. I did not expect that but I really appreciated how quick he did it. Not only that but he made his response back very personable.,sauce lab challenges
AI,N/a, they provide great training so I didn't find anything difficult,10,10,10,10,none,salesforce,File import/export,10,Just make sure they have that integration and then do it. :) Very user friendly,10,10,not applicable,Just ask as many questions as you need to.They are super patient and friendly,increased efficiency,more trainingsVerified UserSauce Labs - 5 years of use2019-06-11T20:30:52.728ZWe use Sauce Labs for crossbrowser testing both manually and through automation. It removes the need for our teams to maintain VMs with the correct setup (browser.OS/webdrivers etc).,Visual feedback of the test execution is very effective with video and screenshots
Combinations of browsers and OS is extensive
The dashboard is easy to use and intuitive,The speed of the tunnel could be improved,10,Improve quality by increasing browser/OS/device coverage,We have a specific set of browser combinations we need to support for our customers. We can find the issues with the app on the various combos easily through Sauce without having to set the machines and maintain the environments.,To setup and maintain the environments in house would have been a big pain point. We do maintain a small number of VMs for testing and they are a constant headache for the team.,Haven't used yet.,BrowserStackVerified UserGood to use for efficiency | Automated testing Giant2019-04-26T18:36:26.761ZIf your need is architecting a CI/CD pipeline with left-shifted continuous real browser testing, then there is simply no better service available than Sauce Labs to integrate with this desired model. They are a smaller company than their leading competitor, but they are rapidly innovating in the right direction, and lead the charge in continuous automated testing. Sauce Labs Introduced a Headless feature, which takes Sauce Labs to the very next level.,We are currently in the process of moving all of our mobile automation from a different vendor to Sauce Labs.
Sometimes tunneling is so slow and taking a lot of time to start the automation test. It should also support real devices as well, because if pricing is less, then Sauce Labs will be the best tool to use.
With Sauce Labs, I can run multiple tests with multiple browsers with a different set of simulators and emulators. One good things is it is helpful to test iOS, Android and Web too.
The most recent Sauce Lab headless feature.,There are some issues in which the tests stop running and I have to manually restart it. There is not much information on what is causing the issue but it works when I restart it. It would also be nice if the tests were a little faster since the time for the tests to complete is a bit slow. There is a bit of a learning curve on best practices to write your code, so if you tackled this without a plan, you have to go back and rewrite some of your test cases. There's definitely a lot to learn!
The better documentation for onboarding new users or customers.,10,Accelerate the pace of new feature releases,We began to utilize Sauce Labs for manual recognition of mobile friendly websites. We have actually considering the included automatic screening through Selenium and it has actually conserved us time evaluating brand-new and existing applications.,I really recommend Sauce if you have a CI/CD pipeline or if you need to give more tools (live sessions) to your customer experience team. It's very useful to reproduce users bugs to understand whether it's a real bug or it's a user mistake.,While their device list may not be as big as some other vendors I never have to wait for any devices and I'm able to run on all of their devices, whenever I want. On top of that I don't have to pay separately for BOTH access to a device AND concurrency. The (both) type of billing model really doesn't sit well with me nor does having to schedule a device, sit in a queue for one, or flat out not have your test run. In an environment where development teams practice CI, having to wait in line or even worse: schedule doesn't match up.,This has helped greatly as our company switches from a waterfall method to an agile method of software development. This is the biggest benefit it has for my organization as this transition has been wrought with problems, but every piece of good software such as Sauce Labs that we find to smooth the process has been a great asset.,Verified UserThe best in the business2019-01-26T19:58:54.805ZWe currently utilize Sauce Labs as our third-party provider for cross-browser testing. There are a lot of devices and mobiles out there. Even though we can manage to purchase a variety of devices in our lab, we sometimes run into issues when we are not actually having an un-common device/phone to test. That's how Sauce Labs comes into the picture. With a lot of real vs virtual devices, Sauce Labs helps a lot with debugging and testing across multiple devices, which reduces the cost of purchasing new real devices.,Real vs Virtual Devices
Tunneled connection for firewalled website
Well-documented wiki
Always keep up with new technologies,The ability to share the account with other colleagues without sharing the actual password
Should populate the most frequently used devices to the top instead of a static dropdown list,10,Improve quality by increasing browser/OS/device coverage,This is not a problem with Sauce Labs. Sauce Labs provides SauceConnect, which opens up a tunnel between a machine inside the network and the actual Sauce Labs website. With this method, we can easily run our tests before the firewall on Saucelabs, both manually and automatedly. Sauce Labs also provides a well-documented wiki for this setup.,Whenever a new device comes out to the market, Saucelabs makes sure they have it integrated to their list of real or virtual devices. We can easily choose from the list of real or virtual devices that can meet our expectation. Not only that, the virtual devices look really real and have all the required functionalities that we need.,With Sauce Labs, we can run multiple tests at the same time. With that being said, we can integrate Sauce Labs to our current CI CD process and we can run multiple jobs on our Jenkins server without any problem. That helps ensure all the built are being run as soon as the codes are pushed to the repository.,This is the best of what Sauce Labs has offered. With this Sauce Connect, users can easily open up a tunnel between a host machine and Sauce Labs. Some of the staging or testing website environments are sitting behind a corporate firewall, and sauce Connect helps ensure we can run the test on Sauce Labs without any problem.,CrossBrowserTestingVerified UserPros with some cons, but absolutely mostly pros!2018-08-17T19:16:06.941ZMy company has used Sauce to automate the verification of video playback across multiple platforms and environments across desktop to mobile. Right now, it's only used by myself for a subset of teams. Video is a really tough thing to work with as it's very subjective and can be very time consuming to test. Being able to automate at least part of it gives us the ability to spend more time on other tasks.,Customer communication - My account team and support are always responsive and helpful!
Staying up to date including day one support for some things.
Receiving feedback. I've had several meetings with Product to discuss my pain points, future wants, etc.,Sometimes things can be finicky
Connection speeds haven't always been great,10,Improve quality by increasing browser/OS/device coverage,I don't have any particular insight into this category, so I'm unable to speak to it.,Being able to very quickly access many, many past browser versions and on a handful of different OS's means that we should likely be able to get some sort of parity or something close to whatever customer environment we may need to cover. It frees up our machines from having to be cluttered with all of this which is great, too!,I've touched on some of these points in my other responses, but given the market moves so quickly, trying to constantly buy the newest devices just to have them collect dust doesn't make sense. Instead of my team paying for a device, using it for a little, and then moving on, Sauce can actually be thought of as being environmentally beneficial, too! Allowing multiple companies to utilize the same device makes the justification of that device's resources and materials much more bearable.,I have not used Sauce Labs Proxy.,Xamarin, BrowserStack, AWS Device Farm and Perfecto MobileJayson SmithThings that Arkie says2018-11-30T00:20:51.840ZWe use it in the quality department for help with our cross browser testing. We also use it for testing of our mobile apps. It helps us with confidence in our apps in a variety of different contexts, and the fact that we don't have to maintain a lab environment is one of the biggest wins for us.,Diversity of test environments
Ease of looking at the results
Stellar support team,Sometimes, the system can be laggy when you examine test results. I have a support case logged about this
It seems to me that its taking longer for the support team to successfully close my cases,10,Improve quality by increasing browser/OS/device coverage,I think they do. We do ask our vendors to pass a security audit. I was not a part of that review, nor do I know the specifics that were asked in this review process, but Sauce Labs did pass and has been approved by us to be used in our engineering processes.,They helped us achieve this by removing the maintenance burden of having to keep up a bank of machines in a multitude of configurations from our team. I've maintained a local selenium grid for a few weeks before I told my boss of the potential nightmare that would be coming down the pike it we continued down that path.,Time and money is really where it comes down to it. With infinite money, sure, you could maintain the lab yourself, but we don't have infinite money and time. So the cost of Sauce - while not cheap - enables us to focus on the real problems, as opposed to problems that maintaining a test lab would force us to face.,We have not used the Proxy,BrowserStackAlan ArkGet on the Sauce! Sauce Labs will make your automation life A LOT easier!2017-05-17T17:04:34.948ZWe use Sauce Labs when we're running our regression test suite against a multitude of OS and browser combinations for our core web product. We are able to easily spin up virtual machines that contain a specific OS along with either the latest, beta or older version of the browsers we support with our app. This saves us a lot of maintenance and support issues with our test environments.,Greatest strength of Sauce Labs to me is the ease of spinning up a clean virtual machine with the desired OS and browser combination.
Sauce Labs support has been great! When I've run into issues whether it's from my own code issue or something on their side, they have been very responsive and helpful.
The ability to scale up or down our needs from Sauce Labs has been great. As we build out more automation, we have a larger need of Sauce Labs services and it's been so simple to do. Need more parallel VMs? No problem. Need more automation time each month? No problem. It's all done almost instantly.,My main area of concern that could be improved is the cost of the real mobile device farm offered. I have tried it out and it's great! I want to use it for most of my mobile automation, but can't justify the cost.....yet. Once more and more tests are created on my side along with a need to cover more devices then maybe it will work.
A minor area that could be improved would be the responsiveness of the video stream of active tests. Sometimes I need to refresh the browser to get the video to come on or update.
Another area of improvement would be the speed that tests can run. This has improved since I first started using Sauce Labs, but don't we all want everything, right now, immediately? I'm asking for the world, but you asked!,10,Accelerate the pace of new feature releases
Eliminate testing as a bottleneck
Improve quality by increasing browser/OS/device coverage
Achieve continuous delivery,We have been able to test on different OS and browser combinations that we were not able to before. Yes, we could have eventually built virtual machine's with what we needed, but we didn't have the resources in place when we needed it and Sauce Labs gave us a quick way to get this started and still use today. This has given us better quality and definitely made us more efficient which in turn gets us to market quicker. It's a win all around!,A new, clean virtual machine is spun up each time for every test. You cannot access a previously used virtual machine. Any test remnants or access behind our firewall is strictly guarded within each virtual machine and the use of a secured tunnel. When testing mobile apps, the apps are only kept in storage for a minimal amount of time and then deleted. Access is guarded with our Sauce Labs credentials, as well.,Our product is supported on a number of OS and browser combinations and the ability to have clean working test environments is critical to our success. Sauce Labs has given us the ability to spin up a great deal of different combinations and have them ready within seconds. This frees up our time to spend on more useful tasks such as testing.,A company can build out the infrastructure to house a test grid and have it be fairly straightforward. The issue comes in when you need to keep that test grid maintained. When tests are run, they leave behind artifacts from doing installations, downloading files, and other test related stuff. This may cause an issue for future tests if they are not cleaned up properly after each test. Also, there are OS and browser upgrades and patches that need to be installed on a regular basis. Maintaining a sizable test grid is a full time job, so hiring someone to keep the test grid maintained plus any costs of paying for operating systems clearly outweighs the cost of subscribing to a service such as Sauce Labs. Sauce Labs spins up a new virtual machine with the desired browser and browser version (try maintaining different browser versions on your test grid and the number of machines quickly grows) and gives you a clean environment for your testing. Sauce Labs is a bargain when you figure in all the costs of doing it yourself. Why reinvent the wheel?,We use the Sauce Connect secure tunnel to provide access to our test environment behind our firewall to Sauce Labs. This has been critical for us being a security company and maintaining strict access control to our environments. This allows for us to maintain a secure connection and still able to automate tests on Sauce Labs.,,Visual Studio IDE, Selenium,No,Price
Product Features
Product Usability,I don't think I would have changed much of anything. I tried out Sauce Labs and Browser Stack and attempted to do the same type of automation on both. Sauce Labs was clearly easier to use and I believe their price was even better than Browser Stack, so it was a no brainer.,3,3,Number one use case is being able to test on many different OS and browser combinations on a clean machine. Even if you're able to spin up multiple virtual machines with your choice of configuration, it still takes quite a bit of time to create and maintain them.
Automatic reporting of testing. Running automation with Sauce Labs keeps all of your tests in one place with easy filtering to get quick access to test results.
Running on mobile emulators and simulators. You will not always have every device supported to test on, so you will need to rely on emulators and simulators for some of your testing. Like not having to spin up virtual machines for every desktop OS and browser combo, you don't need to create every emulator or simulator either. Run directly on Sauce Labs!,Using Sauce Labs has increased our test coverage which is the biggest win for us. Previously, we were limited by resources to create all the environments, but now we can test across many different types of configurations. This has been a huge boost to our testing!
Running tests in parallel! Before, we mostly ran our tests one by one which took a long time especially as we developed more and more scripts. Being able to seamlessly run many tests in parallel has greatly sped up testing and keeping our coverage at the same time.
The use of mobile emulators and simulators. Before we were limited by what devices we had on hand and only using a browser's emulator for our testing which is very limited and doesn't cover many features of a mobile device. Using Sauce Labs for emulator and simulator testing has helped us with greater coverage than we had before.
Sauce Labs real device farm! I've only test driven their real device farm, but it worked great! I was able to run my automation on native android and ios apps on real devices that we didn't have on hand. How can you beat that?,The plan is to run many tests in parallel, so I'm expecting to need many more virtual machines to run at the same time.
Real device farm: I've tried it out and now I want to use it on a regular basis. As more mobile scripts are developed, there will be a need at some point to move away from managing our own inventory and use Sauce Labs real device farm.,10,Implemented in-house,No,We were lucky. I knew Sauce Labs before starting at a new job that had no automation in place, so I was able to convince management to get Sauce Labs at the very start of building out automation.,10,No,10,Yes,When I was first trying to use Appium for mobile testing, I struggled quite a bit getting it up and running. I was attempting to use Sauce Labs, as well, while trying to get going. I ran into many issues (self made), but many times I didn't know if it was on my side or Sauce Labs, so there were a number of times that I sent them my problem. Not once did they kick it back to me saying it was on my side and not theirs. They always helped and would even escalate to a senior member to offer assistance with Appium to help out. Like I've said before, I can't say enough great things about the support I've received at Sauce Labs. They truly make your success their success.,The ease of spinning up a new virtual machine with your choice of OS and browser
Being able to retrieve and review test results
Adding team members to their own sub account to separate testing,While spinning up a new virtual machine is easy, it can be tricky if you're not familiar with the need of creating a secured tunnel to access a test environment behind a firewall. Easy after you realize it though.
Getting live video to update while a test is running can be cumbersome. I've had to refresh the browser sometimes to get the video to load.
I wish tests would run faster especially with mobile emulators and simulators. I hate to put this down because I know how difficult this must be, but if I could magically make something better it would be the speed of tests.,9Randall KelleyTest in the cloud2018-08-31T21:30:47.293ZContinuous, deep, left-shifted testing executed in a CI/CD pipeline as a quality gate for build promotion into higher environments. Access to browsers, platforms, and devices for manual or automated testing we do not have physical access to. A platform for executing real browser tests that we cannot implement or maintain internally in a cost-effective manner.,Willow is generally compatible with the latest version of Appium, pretty fast
We use Sauce Labs to run a test on multiple devices (simulators).
We use Sauce Labs to execute automation scripts in different browsers in the cloud,There is not much information on what is causing the issue but it works when I restart it. It would also be nice if the tests are a little faster since the time for the tests to complete is a bit slow
The main point that I have actually dealt with was the cloud service is a bit sluggish. Often when I run it, it takes a substantially long period of time to finish executions. It is bit sluggish and took at some point to carry out action,10,Increase the number of software release cycles
Accelerate the pace of new feature releases,We are trying to solve some business issues by integrating this with our pipelines and automate testing when the code is pushed to the repository. The best thing is that all the testing is done in the cloud so we don't have to maintain any of the machines!,Bambu and SeleniumJean Carlos Diaz FreytesSimple way to run tests on multiple platform/browser combinations2018-08-17T21:01:41.219ZSauce Labs is used by our QA team during the app development process. We have integrated it with our build pipeline, where it runs our automated regression tests against multiple different browsers in order to make sure our app's core functions work on all platforms. It saves us a ton of time and headache from having to perform the same test multiple times on every browser, and from needing to use our own personal VM's for windows and internet explorer.,Easy to integrate with other automation processes such as selenium and Jenkins
Has a large range of platform/browser combinations to chose from, even mobile,It could be a little faster,9,Eliminate testing as a bottleneck,I don't know much about this so I won't comment on it, sorry. It works for us.,We have not had to contact customer service yet so I cannot comment on the quality of this either.,Sauce Labs is not yet used as a standard in our company. We are a single team that needed to run some automated test cases across multiple platforms and decided on Sauce labs because of its prominence meant it would be well supported, as well as ready to use immediately.,This is a similar security question as before, I don't know much about security so I will not personally comment, but Sauce Labs has been approved by our IRM department, so I trust it.,Alexander CassarWhy we chose Saucelabs as our Cross-browser testing platform within our mission critical team.2018-10-10T16:34:21.609ZSauce Labs is a relatively new tool in the kit of all audited enterprise tools being used in one of the largest Financial institutions I am part of. It is a highly recommended platform for teams to perform cross-browser testing. After an easy integration process, Sauce Labs allows us to test our projects from iPad screens to Firefox, Chrome and IE running on almost any combination of Operating Systems.,Multiple browser options to choose from.
Real devices along with simulators
Integration with a wide variety of frameworks.,Use of camera on real mobile devices. Eg: QR Scanning,9,Accelerate the pace of new feature releases,Yes.,We have certain services being accessed only on mobile devices while others on desktop browsers. Sauce Labs facilitates testing both scenarios as a single central platform.,Buying a subscription may be expensive at times. But considering the time to develop a similar platform, it could well worth be a good deal.,CrossBrowserTestingVishal MenonReview in the cloud2018-08-17T21:06:36.428ZThe whole organization does all the necessary tests and faster than many other programs.,Mobile testing with Appium
Recording of all test runs
Adopting new technologies like XCUITest and Espresso allow for the use of industry standard tools in test automation,Having access to browsers and devices in beta would be ideal
They have been having increased unexpected downtime lately. This is interruptive at times.,9,Increase the number of software release cycles
Accelerate the pace of new feature releases
Improve quality by increasing browser/OS/device coverage,If you need a farm to test any browser or device, Sauce is your company. They offer all the configurations you need and respond to the needs and desires of customers.,It gave us the flexibility to shorten the execution time of our automation suites from 6 hours to 30 minutes. And we do not need to maintain those VM machines that we are using, which saves a lot of time/resources too.,Internal Selenium will require a lot of effort and time, we also keep this Selenium Grid with different OS/browser that is a painful process for our team. But after buying the services of Sauce Labs, we were able to free those efforts and resources for the development of some internal tools, which gave a great improvement to the team. Currently, we are happy to work with Sauce Labs.,Sauce Connect as a proxy between the Sauce Labs services and our test environment. This proxy tunnel is very stable and secure, and we never encounter security problems when using the services of Sauce Labs.Nelson FreytesTesting Automation at its Finest2018-11-01T19:18:59.457ZSauce Labs is used across the organization on many consumer-facing teams. It is our primary method of regression testing, freeing QA resources up from manual testing. Sauce Labs also takes into account the infrastructure aspect, which is a huge time/cost sink if an organization would have to build that in-house.,Infrastructure as a service - we do not need to worry about spinning up machines or VMs.
Scalable based on demands of the company.
View recordings of the automated tests.
Live manual test support.
Mobile device support.,UI not the most responsive.
SauceConnect tunnel sometimes fails for no reason.,10,Increase the number of software release cycles
Accelerate the pace of new feature releases,We had a security team review the product and found no issues.,The ability to get reports directly from the Jenkins Sauce Labs plugin was very helpful. This allowed us to at a glance look at build issues including screenshots of where tests failed. The ability to view recordings within the web portal also allowed us to see what "the customer" sees when automation is run.,We are happy with our decision to buy. To build requires not only deep knowledge of the tool, but also infrastructure support - both knowledge and personnel. We did try to build and it did not go well both from a cost and ongoing maintenance perspective. Buying frees up our people to focus on actual business problems.,We have used Sauce Connect to connect to our internal sites. The tunneling tool was reviewed by our security team before we implemented. It is an incredibly convenient feature as it allows Sauce Labs to connect to internal sites without having to expose dev/stage/test environments to the Internet. Security has not been a concern since we've implemented it.,Verified UserTesting made easy and quick.2018-11-02T17:57:30.084ZWe used Sauce Labs integrated with our automated testing platform for front-end testing of Salesforce applications. That involved both SFDC B2C and B2B applications.,Comprehensive platform coverage including all the browsers and operating systems we were looking for. We did not test anything on mobile.
It saved time on the regression test cycle time and enabled quicker releases to production.
Video recordings of the test execution were very helpful to triage failures and resolve.,Cost could be lower - some of the team members felt Sauce Labs was a little expensive but I do not have more details on that.,8,Improve quality by increasing browser/OS/device coverage,We did not have any security issues.,Quicker releases because Sauce Labs enables us to run tests concurrently.,We did not have time to build our own solution. Building our own solution would mean there would be ongoing maintenance which we did not want to do but we rely on a service like Sauce Labs.,It was helpful wherever VPNs were involved.,BrowserStackVerified UserA Sauce labs review2018-10-22T17:04:49.027ZAutomated UI tests are all currently running on Sauce Labs and Testobject. It solves the issue of having to maintain a server that runs emulators/simulators.,The devices are really up to date. For example, the latest iPhone became part of the list almost as soon as it was released.
Ability to tunnel to a different location so you can run tests on a specific region.
Customer support is quite responsive.,Testobject analytics - we've had a hard time ordering tests
Test start time - sometimes takes a while to upload an app to a device and start test execution
Price - it's a bit on the expensive side,8,Accelerate the pace of new feature releases
Improve quality by increasing browser/OS/device coverage
Achieve continuous delivery,Sauce Labs is quite reliable. Apps are removed from devices after a run.,As we are able to release faster, the customer gets the latest version of our app faster.,Buy: No maintenance. Only need to worry about actual test implementation.
Build: Have to maintain. Simulator and emulators crash a lot. Wastes a lot time.
As the team is quite small, the decision to buy is definitely a good one.,I am happy with this feature though there were struggles in the beginning in making it work.Verified UserUsing SauceLabs enterprise-wide2018-11-02T14:57:50.700ZRun UI bases tests to mimic actual browser on variety of devices.,Multiple browsers, Multiple OS available for running tests.
Difficult to maintain these server farm in-house.
Someone maintains the server farm for us and provides as SaaS offering.,Tests take longer to run as compared to in-house. This makes overall tests suite completing slow, slowing our deployment time.,7,Accelerate the pace of new feature releases,I believe it is secure. Haven't gone into details.,Helps get the UI tests done.,Double edge sword. We built some part of it in-house, and bought some part of it. We built for faster execution and bought for variety in platform.,I think it did solve some.,Verified UserSauce Labs is the way to go!2018-07-16T22:53:42.476ZWe use Sauce Labs to run all of our automated tests on the VMs, primarily being used by the QA Engineering team. We have web/front-end tests consuming VMs, as well as mobile tests.,Always up and running: I'd say 99.9% it's up and running, as I've rarely experienced any down time with their VM farm machines.
Reliable: we run our automated tests on their VMs at least every hour, around the clock, and their service is very reliable and working properly.
Community: good online community of other people using Sauce Labs with tips/tricks; often see Sauce Labs at conferences and it's nice to talk with them about what they have planned (new features).,Reporting: overall reporting over a time period used to be an issue, but there new feature to support this is getting there and improving.
Logs: I don't find their logs very useful for front-end web tests, I usually refer to my own logs if I have a bug/issue/error that needs investigation.
Cost: it's a little bit pricey, but I don't pay the bill so I'm not complaining too much there. Overall, I'd say the price isn't ridiculous but it's not inexpensive.,10,Achieve continuous delivery,My company is not in financial services, but we do trust that our data is secure in Sauce Labs. I haven't taken a deep dive into looking at their security measures, so I can't give a great review on this subject matter.,On the web we support Chrome, and that browser is available in Sauce Labs (SL), in many different OS/version combinations. It provides us with what we need for our front end web tests.
On mobile, it provides all the device and platforms we need support for, from iPad to iPhone to Android to tablets.
Overall, SL seems to cover all the bases for web and mobile platforms/devices needed.,In my previous company, I built my own VM farm of machines and managed them for running our automated tests against. By doing this yourself, you learn a lot, but it consumes a lot of your time and becomes a big headache to be honest. Mainly, it is the time consumption of managing/upkeep on the VM's. It almost becomes a FT position job, to manage the VM farm on your own.
Since using Sauce Labs, it now provides a reliable farm of VM's and I can focus on doing what I enjoy (coding) instead of trying to manage/upkeep my own set of VM's.
Without a doubt, Sauce Labs is the way to go. Don't even think about trying to manage your own VM farm.,We currently do not use the Sauce Labs Proxy, so I do not have enough info on this feature in order to provide much feedback.,JIRA SoftwareDeon Cravalho
Unspecified
Sauce Labs
206 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow'>trScore algorithm: Learn more.</a>
