1. Home
  2. Performance Testing Tools
  3. AWS Device Farm Reviews
  4. User Review of AWS Device Farm
Using real devices to run E2E mobile testing on Android and iOS, integrated with our CI pipeline!
October 28, 2019

Using real devices to run E2E mobile testing on Android and iOS, integrated with our CI pipeline!

Anonymous | TrustRadius Reviewer
Score 10 out of 10
Vetted Review
Verified User

Overall Satisfaction with AWS Device Farm

AWS Device Farm is supporting us by providing virtual mobile devices and a framework to emulate mobile phones in our automated testing platform. We can easily enable any mobile in different OS versions and also integrate our automated test scripts. Having 30+ mobile apps to validate in multiple phones and software versions, AWS Device Farm is a life saver.
  • 100% compatibility with the installed user base. No simulation, but real results.
  • Integration with Jenkins and other CI/CD tools.
  • A considerable amount of device types available. Again, real devices in the cloud!
  • Interface (CLI) not very easy. Competition has better options.
  • Integration with IDE for test case coding.
  • Reporting for the test scripts executed.
  • Reduced the amount we spent on physical devices by > 90%.
  • Enabled real CI integration even when running E2E test scripts using mobile phones.
  • Helped us to improve overall App stability and rating - fewer crashes (80% to 99% of sessions crashless) and 75% rating increases on apps.
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Do you think AWS Device Farm delivers good value for the price?

Yes

Are you happy with AWS Device Farm's feature set?

Yes

Did AWS Device Farm live up to sales and marketing promises?

Yes

Did implementation of AWS Device Farm go as expected?

Yes

Would you buy AWS Device Farm again?

Yes

As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.