What users are saying about
8 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 10 out of 100
11 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 7.7 out of 100

Likelihood to Recommend

AWS Device Farm

This is the best solution I have found to trail run software before it is deployed across a large number of users and a large variety of device types. We have Windows, Mac OS, Android, and iOS devices. Android alone has a ton of OSs. This helps save time and test functionality across the board.
Anonymous | TrustRadius Reviewer

Perfecto, by Perforce

Same test case scripts can be executed on different mobiles irrespective of operating systems and language it supports. This covers a wide range of devices (Android, iOS, Blackberry etc) on which automated testing can be performed in very less time. The test scripts are written written using keyword-based Script Once Technology. The creation of scripts are easy. It saves time and effort. Repetitive testing on each iteration would be now be less tedious. This would also allow QA to focus on quality. It would expand test case coverage in the application and finally release reliable/robust application. In all, improving the app quality.
Aswath Bava | TrustRadius Reviewer

Pros

AWS Device Farm

  • 100% compatibility with the installed user base. No simulation, but real results.
  • Integration with Jenkins and other CI/CD tools.
  • A considerable amount of device types available. Again, real devices in the cloud!
Anonymous | TrustRadius Reviewer

Perfecto, by Perforce

  • Impressive UI
  • Strong support system
  • Wide variety of devices
Naresh Padmanabhan(Paddy) | TrustRadius Reviewer

Cons

AWS Device Farm

  • Cost and price is always a concern
  • Can be a bit clunky for the staff using the service.
  • Sometimes, misses issues with iOS devices.
Anonymous | TrustRadius Reviewer

Perfecto, by Perforce

  • It has a lot of room for improvements in terms of reporting and integration with other reporting and defect tools.
  • It should have the capability of capturing charts data.
  • It should be able to do some scenarios that only manual testers can do. Like - use of camera and touch ID features.
Anonymous | TrustRadius Reviewer

Usability

AWS Device Farm

AWS Device Farm 10.0
Based on 1 answer
The users have no issue. The IT staff have learned to work with the software with the help of AWS support. I find it very effective. Could it be easier? Of course. That doesn't mean this isn't a great solution. I would recommend it to anyone based on usability. Overall, it is easy enough to use.
Anonymous | TrustRadius Reviewer

Perfecto, by Perforce

No score
No answers yet
No answers on this topic

Support Rating

AWS Device Farm

AWS Device Farm 10.0
Based on 3 answers
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
Anonymous | TrustRadius Reviewer

Perfecto, by Perforce

No score
No answers yet
No answers on this topic

Alternatives Considered

AWS Device Farm

This is the only solution I have used from device farming. From that perspective, I would purchase it again. I think this is a great solution for a large, diverse organization looking to mass deploy and manage software and devices. We selected this software because we have had great luck with other AWS services.
Anonymous | TrustRadius Reviewer

Perfecto, by Perforce

Perfecto has a wide array of mobile devices we can chose from. Automation is easier using OCR technology. The test script generated detailed report of the executed test script at the end with vast variety of information such as actual results, screen captures in digital format, continuous video recording of the entire script and graphs showing statistics about the execution
Aswath Bava | TrustRadius Reviewer

Return on Investment

AWS Device Farm

  • Reduced the amount we spent on physical devices by > 90%.
  • Enabled real CI integration even when running E2E test scripts using mobile phones.
  • Helped us to improve overall App stability and rating - fewer crashes (80% to 99% of sessions crashless) and 75% rating increases on apps.
Anonymous | TrustRadius Reviewer

Perfecto, by Perforce

  • Since the devices are over cloud, it saves a lot of investment on mobile testing.
  • Can be used by testers across the globe.
Naresh Padmanabhan(Paddy) | TrustRadius Reviewer

Pricing Details

AWS Device Farm

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

AWS Device Farm Editions & Modules

Edition
Pay-As-You-Go$0.171
Unlimited Testing$250.002
Private Devices$200.002
Pay as You Go - Desktop Browsers$0.0053
  1. per device minute
  2. per month
  3. per instance minute
Additional Pricing Details

Perfecto, by Perforce

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Perfecto, by Perforce Editions & Modules

Additional Pricing Details

Add comparison