Sauce Labs vs. TestMu AI

Access to specific devices is good, as well as access to a specific browser/platform. We are not able to connect our dev environments to Sauce Labs because the devices are put in our VPC. Some versions are not available like iPhone with iOS 12.1. With iOS, there is limited/no support for push notifications without real devices due to Apple's provisioning profiles.

Incentivized

As reactnative devs we develop hybrid apps for both ios and Android and testing on different physical devices is very annoying while as with LambdaTest we can just select the virtual device boot that and start testing on the go. No need to keep devices. Sometimes clients report issues and they provide the device name and if available in LambdaTest we can just test and fix the device specific bugs

• Gets good people to work for it. These guys and gals are freed and just want you to succeed.
• Sauce Labs listens to what the customers want. (Though I could still use an AWS East-1, hint-hint.)
• They come to us when we ask, so that is pretty cool.

Incentivized

• Offers geolocation testing in automation which is amazing!
• You can select browsers, timezone, country and run the capability to start testing instantly.
• We could scale up with parallel testing on local environment without any maintenance cost.
• Integration with project management tools like JIRA, CI/CD tools like Jenkins, Gitlab which makes our test cycle easier

• Cost: it's a little bit pricey, but I don't pay the bill so I'm not complaining too much there. Overall, I'd say the price isn't ridiculous but it's not inexpensive.
• Logs: I don't find their logs very useful for front-end web tests, I usually refer to my own logs if I have a bug/issue/error that needs investigation.

Incentivized

• More real devices should be added like I have Samsung mobile but it was not in the list
• It takes time in checking the link on LambdaTest if we compare with real mobiles
• Sometimes exact results are not matching as from real mobiles

I love how it's super easy to use. Not only that but it ensures security and it always has great updates to ensure that it continues to be awesome. Also, I love how nice the people there are too. Their support tea is amazing. Anytime, I have a question, they are super speedy to answer.

Incentivized

The reason i have given the 10 points becasue the problem LambdaTest solves is providing access to all devices in one place, allowing developers to identify the same errors they would encounter on real devices. This makes life much easier, especially for developers who regularly face cross-device functionality issues. It's a big plus point that positions LambdaTest as an all-in-one solution.

Incentivized

I think Sauce Labs is great and I've been using them since late 2014. With that said, I'm very used to how their interface works and how to get what I need. I think if a brand new user would come in and use it, it would still be easy, but maybe not as easy as it is for me. That's why I rate this area a 9 instead of a 10. Still great though!

Incentivized

Using LambdaTest feels pretty straightforward once you get the hang of it. The platform has a clean interface so jumping between different features isn’t much work. things feel smooth in UI automation. It takes some time to understand the overall once that is done it'll become easier. The detailed test logs and visual regression features especially stand out in helping you identify issues quickly without extra effort.

Incentivized

Yes, Sauce labs is always there, and it is easy to troubleshoot when you are having any connectivity issue, they always keep you informed when they plan to perform any type of maintenance window on their side in advance, so you can plan and will not affect your current work. I do not recall any outage.

Incentivized

yes always available

Incentivized

The time where they acquired TestObject and were trying to integrate their services would probably be the most annoying time. Annoying as features were in two separate places (websites) for example. But since the introduction of their unified platform, we haven't run into any issues as of yet and we've used them for at least 5-6 years now.

Incentivized

haven't found any glitch while using this

Incentivized

The support is good for Sauce Labs. It is hard to get an initial response but the support has cleared our issues with Sauce Labs. Sometimes we have to follow up and it's hard to get a hold of the team initially. Once we get a hold of the team, the issues are always resolved.

The customer support team is very active and cooperative. Once, I contacted them in their off timings because of an issue, I got an instant reply from the executive and he resolved the issue very efficiently. This is why we have been using LambdaTest for more than two years. It is best suited for us.

I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started

Implementation of Lambdatest was very easy for different project requirements.

Incentivized

Firebase is pay per use and so was difficult to work out the true costings, it also felt more developer focussed whereas Sauce Labs had better Appium support for our Automation team. AWS Device Farm appeared to require either Android or iOS and we wanted both, so that wasn't a great fit. It was also not possible to run Cucumber tests on Android in AWS but this may no longer be the case, but it was another unknown for us and not worth the risk. Sauce Labs explicitly mentioned Cucumber support.

Incentivized

While BrowserStack is also a well-established platform, we found LambdaTest to offer similar and even better features at reasonable pricing. LambdaTest is more cost-effective than BrowserStack. LambdaTest provides a free forever plan, while BrowserStack does not. Even manual testing plans are better priced than BrowserStack’s. In terms of UI and onboarding, we found LambdaTest more user-friendly as well.

With private devices, you have full reign over usage of them, so no complaints there. Public devices are available if no one else is using it, which is understandable. Browser VMs are based on number of open sessions and Saucelabs give you a certain number depending on what you need. If you need more, then you pay for more. It is as simple as that. You need more devices, then you can pay for more private ones too. A workaround for public devices is to pick the first available one and not be too picky, that's if you are able to of course.

Incentivized

not all department, but we're using for our clients

Incentivized

• Provided an ability for us to run 55,000+ tests/month across all browsers.
• Gave us an opportunity to showcase the great things we have done in quality using Sauce Labs. This was through a white paper and an opportunity to speak at Sauce Con. People in our company have a far better appreciation for the what we do and how far we have progressed in the quality space.

Incentivized

• Automation testing has a bit of a learning curve
• Lack of real device keep that bug in your head if not on the website.
• Need to wait for a while for a new OS or browser version on the contrary of immediate availability in case of owning a lab