AWS Device Farm vs. Perfecto by Perforce

AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.

Incentivized

Same test case scripts can be executed on different mobiles irrespective of operating systems and language it supports. This covers a wide range of devices (Android, iOS, Blackberry etc) on which automated testing can be performed in very less time. The test scripts are written written using keyword-based Script Once Technology. The creation of scripts are easy. It saves time and effort. Repetitive testing on each iteration would be now be less tedious. This would also allow QA to focus on quality. It would expand test case coverage in the application and finally release reliable/robust application. In all, improving the app quality.

Incentivized

• Integration with CI/CD Pipeline
• Diversity in Real Devices over the Cloud
• Pay as you go option
• Reproduce Issues and easily collect all kinds of logs

Incentivized

• Impressive UI
• Strong support system
• Wide variety of devices

Incentivized

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• It has a lot of room for improvements in terms of reporting and integration with other reporting and defect tools.
• It should have the capability of capturing charts data.
• It should be able to do some scenarios that only manual testers can do. Like - use of camera and touch ID features.

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

I got more features and handy within AWS Device farm than AWS Cloud9

Incentivized

Perfecto has a wide array of mobile devices we can chose from. Automation is easier using OCR technology. The test script generated detailed report of the executed test script at the end with vast variety of information such as actual results, screen captures in digital format, continuous video recording of the entire script and graphs showing statistics about the execution

Incentivized

• Quicker testing leads to faster product to market times
• Can deploy updates much more regularly by testing across many devices quickly

Incentivized

• Since the devices are over cloud, it saves a lot of investment on mobile testing.
• Can be used by testers across the globe.

Incentivized