AWS Device Farm is a mobile application performance testing application that provides real-time automated testing and reproduction of issues, simulating and testing issues that may occur on a variety of platforms (e.g. iPhone or Samsung mobile device, or multiple operations systems, etc).
$0.01
per instance minute
BrowserStack
Score 8.5 out of 10
N/A
BrowserStack is a test platform built for developers and QAs to expand test coverage, scale and optimize testing with cross-browser, real device cloud, accessibility, visual testing, test management, and test observability. BrowserStack states it currently powers over a billion tests a year for customers who include Amazon, Paypal, Well Fargo Bank, Nvidia, MongoDB, Pfizer, GE, Discovery, React JS, Apache, JQuery and several others rely on BrowserStack to test their web and mobile apps.
$0
per month Unlimited users and 5000 free screenshots
Pricing
AWS Device Farm
BrowserStack
Editions & Modules
Pay as You Go - Desktop Browsers
$0.005
per instance minute
Pay-As-You-Go
$0.17
per device minute
Private Devices
$200.00
per month
Unlimited Testing
$250.00
per month
Percy - Free
$0
per month Unlimited users and 5000 free screenshots
App Percy - Free
$0
per month 5000 free screenshots and 100 minutes of infrastructure
We use BrowserStack not because we consider it the best but because it's good enough and has other pros. Maybe LambdaTest has one function that we love and we need but BrowserStack is well known and is good enough for our needs. It is easy to use and everyone can make it work, …
We did a benchmark to compare multiple criterias: Security, reliability, Sound, Variety of devices, availability of devices, how long before new released devices are made available, easy to use, extra features, customer support, company reference, integration with our tools. …
AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.
BrowserStack is very useful if you need to troubleshoot a client's reported experience from using an older device or browser version that you do not own and can not personally replicate in-house. For instance, if you are in a Windows environment and your client has a Mac, or if you have iPhones and they have Android. It's also great for ensuring that above-the-fold content is presented effectively across a variety of mobile devices and optimizing visitor experiences. If you are a small business with lower client volumes where these services are needed, then the price point may be high.
Tests Android and iOS on real devices on cloud, without the need to purchase the devices.
Run Maestro tests and other frameworks on real devices, reporting the errors to be fixed to developers or the test workflows that failed to the QA team.
The quality reports at the end of the tests are really good, because they contain videos of the tests being performed on the devices. So, not only text, I can check the behavior of the application exactly how it runs.
The documentation needs to improve for browser edge cases, such as "approving permissions automatically". There are several "solutions" posted, none of which worked. I needed to go to Discord to get the real solution.
Documentation in general seems to provide answers that are unclear or flaky
There needs to be a more reliable way to programmatically choose device, platform, and window size by being able to query a 'plan' endpoint instead of just 'failing the combination.'
It's almost the 3rd year for us and it's renewal time for us. So yes, we are already discussing how many licenses we need to increase as users are increasing internally. So it's 100% sure that we are already planning renewal this year as well BrowserStack with live and app automate.
So many options that it can be a little overwhelming, but the core functions are easy to find and use and it's usually not too hard to figure things out for the more complex tasks. Very easy to boot up a device and a specific browser from the dashboard to begin a manual website test.
I rated BrowserStack's availability a 10 because it is consistently reliable, with minimal to no downtime or unplanned outages. The platform is accessible whenever needed, ensuring uninterrupted testing. Its robust infrastructure and proactive monitoring ensure a seamless experience, allowing us to meet deadlines without delays caused by availability issues and all
The tests are fast considering the fact that they're Appium tests. I've seen tests reliably pass or fail when they're supposed to, with next to zero issues on the BrowserStack side of things. Tests launch only seconds after I kick off them off from my CLI.
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
I've not had much direct interaction with the BrowserStack support team. The help and community are great and we've not run into any issue that has really required us to reach out. I guess having a stable and easy to use system means you may never need to contact support.
Yes, it was online training on meet, and trainer looks like skilled and technical strong, he has covered end to end all the features and he has answers all the queries. because of this trainings we are able to implement it by our own in the organization, thank you for support and training.
It was a quick training from the support of browserstack, it was nice and easy to understand, thanks again for the support given by the team. and regularly I used to receive mails for training from support for any new feature they launch, I was able to spread same training to all my team and dev.
I rated the implementation satisfaction an 8 because while it went smoothly overall, there were some challenges during the initial learning phase and integration with existing tools. Key insights include the importance of providing sufficient training upfront and ensuring seamless integration with other systems to minimize disruptions and improve adoption speed.
We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.
BrowserStack is simpler and more user friendly than Sauce Labs and can be easily learned by any individual who is new to it and does not require much efforts. Also, BrowserStack is more trusted by the clients that we offer services to, and is always considered the best option among others.
I may not be the best person to answer this as I am only using it for 1 department and at 1 site but will still try my best As far as Scalability for Devices for Mobile Automation is concerned, it gets a Solid 10, as the users can run cases on upto 10 device parallel and also have the best choices of devices to choose
Browserstack improved our internal confidence level when it came to signing off on testing
Browserstack improved the confidence level of our clients by decreasing the number of bugs found during PVT and providing an entry level opportunity for our clients to perform UAT using the same tools.
