What users are saying about
8 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 10 out of 100
10 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.4 out of 100

Likelihood to Recommend

AWS Device Farm

This is the best solution I have found to trail run software before it is deployed across a large number of users and a large variety of device types. We have Windows, Mac OS, Android, and iOS devices. Android alone has a ton of OSs. This helps save time and test functionality across the board.
Anonymous | TrustRadius Reviewer

SoapUI Open Source

Having [a] simple and user-friendly Graphical User Interface (GUI) and cross platform, it is used by many of our people. Testers can real time applications. It supports all standard protocols and technologies to test different APIs and web services. A little security enhancement and UI should modified. All else is perfect.
Anonymous | TrustRadius Reviewer

Pros

AWS Device Farm

  • 100% compatibility with the installed user base. No simulation, but real results.
  • Integration with Jenkins and other CI/CD tools.
  • A considerable amount of device types available. Again, real devices in the cloud!
Anonymous | TrustRadius Reviewer

SoapUI Open Source

  • API testing
  • Functional testing
  • Open source
Ajay Kumar | TrustRadius Reviewer

Cons

AWS Device Farm

  • Cost and price is always a concern
  • Can be a bit clunky for the staff using the service.
  • Sometimes, misses issues with iOS devices.
Anonymous | TrustRadius Reviewer

SoapUI Open Source

  • It shows an error if the request has special characters.
  • Writing upload test cases is a bit difficult
  • Virtual services are not supported
Pankaj Rawat | TrustRadius Reviewer

Usability

AWS Device Farm

AWS Device Farm 10.0
Based on 1 answer
The users have no issue. The IT staff have learned to work with the software with the help of AWS support. I find it very effective. Could it be easier? Of course. That doesn't mean this isn't a great solution. I would recommend it to anyone based on usability. Overall, it is easy enough to use.
Anonymous | TrustRadius Reviewer

SoapUI Open Source

No score
No answers yet
No answers on this topic

Support Rating

AWS Device Farm

AWS Device Farm 10.0
Based on 3 answers
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
Anonymous | TrustRadius Reviewer

SoapUI Open Source

No score
No answers yet
No answers on this topic

Alternatives Considered

AWS Device Farm

This is the only solution I have used from device farming. From that perspective, I would purchase it again. I think this is a great solution for a large, diverse organization looking to mass deploy and manage software and devices. We selected this software because we have had great luck with other AWS services.
Anonymous | TrustRadius Reviewer

SoapUI Open Source

SoapUI costs less than all other test tools available in the market. It provides a fast and well-organized framework that generates lots of web services tests.
Anonymous | TrustRadius Reviewer

Return on Investment

AWS Device Farm

  • Reduced the amount we spent on physical devices by > 90%.
  • Enabled real CI integration even when running E2E test scripts using mobile phones.
  • Helped us to improve overall App stability and rating - fewer crashes (80% to 99% of sessions crashless) and 75% rating increases on apps.
Anonymous | TrustRadius Reviewer

SoapUI Open Source

  • Testing resolves most of the issues in the development phases.
  • User friendliness of the app makes it good.
  • Overall client happiness depends on the clean project, which is possible by testing.
Ajay Kumar | TrustRadius Reviewer

Pricing Details

AWS Device Farm

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

AWS Device Farm Editions & Modules

Edition
Pay-As-You-Go$0.171
Unlimited Testing$250.002
Private Devices$200.002
Pay as You Go - Desktop Browsers$0.0053
  1. per device minute
  2. per month
  3. per instance minute
Additional Pricing Details

SoapUI Open Source

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

SoapUI Open Source Editions & Modules

Additional Pricing Details

Add comparison