TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    AWS Device Farm

    Score7.3 out of 10
    N/AAWS Device Farm is a mobile application performance testing application that provides real-time automated testing and reproduction of issues, simulating and testing issues that may occur on a variety of platforms (e.g. iPhone or Samsung mobile device, or multiple operations systems, etc).

    $0.01

    per instance minute

    ReadyAPI

    Score6.1 out of 10
    N/AReadyAPI (formerly SoapUI Pro, LoadUI Pro, and ServiceV Pro) is a REST and SOAP API functional testing tool that enables software developers, QA engineers, and manual testers to work together to create, maintain, and execute complex end-to-end API tests in their CI/CD pipelines without needing to code.N/A
    Pricing
    AWS Device FarmReadyAPI
    Editions & Modules
    Pay as You Go - Desktop Browsers
    $0.005
    per instance minute
    Pay-As-You-Go
    $0.17
    per device minute
    Private Devices
    $200.00
    per month
    Unlimited Testing
    $250.00
    per month
    No answers on this topic
    Offerings
    Pricing Offerings
    AWS Device FarmReadyAPI
    Free Trial
    NoYes
    Free/Freemium Version
    NoYes
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    AWS Device FarmReadyAPI
    Considered Both Products
    Amazon AWS
    No answer on this topic
    SmartBear
    No answer on this topic
    Key User Insights
    Would buy again
    No answers on this topic
    93%
    Would buy again
    28 Answers
    Delivers good value for the price
    No answers on this topic
    89%
    Delivers good value for the price
    24 Answers
    Happy with the feature set
    No answers on this topic
    97%
    Happy with the feature set
    29 Answers
    Lived up to sales and marketing promises
    No answers on this topic
    94%
    Lived up to sales and marketing promises
    15 Answers
    Implementation went as expected
    No answers on this topic
    92%
    Implementation went as expected
    22 Answers
    Best Alternatives
    AWS Device FarmReadyAPI
    Small Businesses
    No answers on this topic
    TestComplete
    Score8 out of 10
    Medium-sized Companies
    No answers on this topic
    OpenText UFT One
    Score8 out of 10
    Enterprises
    Tricentis NeoLoad
    Score8.2 out of 10
    SoapUI Open Source
    Score8.3 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    AWS Device FarmReadyAPI
    Likelihood to Recommend
    9.0
    (3 ratings)
    7.0
    (65 ratings)
    Likelihood to Renew
    -
    (0 ratings)
    7.3
    (18 ratings)
    Usability
    -
    (0 ratings)
    9.9
    (3 ratings)
    Availability
    -
    (0 ratings)
    9.0
    (1 ratings)
    Performance
    -
    (0 ratings)
    8.0
    (1 ratings)
    Support Rating
    10.0
    (1 ratings)
    8.0
    (6 ratings)
    Implementation Rating
    -
    (0 ratings)
    7.0
    (1 ratings)
    Product Scalability
    -
    (0 ratings)
    7.0
    (1 ratings)
    User Testimonials
    AWS Device FarmReadyAPI
    Likelihood to Recommend
    Amazon AWS
    AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.
    Incentivized
    Read full review
    SmartBear
    As stated, we do a LOT of API testing, the swaggerhub import makes it easy to add APIs. This is very well-suited, as well as easy management of the steps/cases/suites inside of ReadyAPI. The one thing I do wish ReadyAPI was better suited for is changes to data, we have a lot of test cases in ReadyAPI and if we make a change to how the backend data is structured, one-by-one adjustments need to be made to the steps. Less appropriate, UI testing.
    Incentivized
    Read full review
    Pros
    Amazon AWS
    • 100% compatibility with the installed user base. No simulation, but real results.
    • Integration with Jenkins and other CI/CD tools.
    • A considerable amount of device types available. Again, real devices in the cloud!
    Incentivized
    Read full review
    SmartBear
    • Ease of use (ability to automatically import API definitions, Jenkins integration for running in the pipeline).
    • Detailed test reports (allow to easily identify weak spots during both functional and performance testing).
    • One platform for all tests (allows to closely couple and reuse existent tests).
    Incentivized
    Read full review
    Cons
    Amazon AWS
    • To be Frank, I have not found any room where it needs to improve. As whatever we used, It is useful for us
    Incentivized
    Read full review
    SmartBear
    • Needs good documentation
    • Need to improve the performance of the tool
    • Setup is very complex and for such [a] commercial tool, it should easy and straightforward
    • Tool says it supports security testing but in reality, it is not at an extensive level.
    Incentivized
    Read full review
    Likelihood to Renew
    Amazon AWS
    No answers on this topic
    SmartBear
    The only reason this isn't a '10' is because of the cost. This product is definitely meant for organizations who are serious about making sure they invest in the full ecosystem of API design, development, maintenance. But there is a significant cost associated with this investment. and because of this cost (and the non-tangible output for executives), it is a difficult line-item to justify in this post-pandemic environment.
    Incentivized
    Read full review
    Usability
    Amazon AWS
    No answers on this topic
    SmartBear
    SoapUI allows us to combine multiple tests and adhere
    to the sequence that they need to run in order to complete successfully.
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing
    Read full review
    Reliability and Availability
    Amazon AWS
    No answers on this topic
    SmartBear
    Soap UI has managed to continuously build on it's solid foundation and keep improving by each release. It is by far the most dependable and accurate testing tool out there of its kind. Available via connecting to VM's created as SoapUI test machines give access to it anytime, anywhere practically.
    Read full review
    Performance
    Amazon AWS
    No answers on this topic
    SmartBear
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing.
    Read full review
    Support Rating
    Amazon AWS
    We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
    Incentivized
    Read full review
    SmartBear
    To be honest, we didnt had much issues with the support, as there is already plenty of online communities available for help. But if ever there were some minor issues with the membership or the certificates, the tech support was always quick and efficient enough to resolve the issue ASAP
    Incentivized
    Read full review
    Implementation Rating
    Amazon AWS
    No answers on this topic
    SmartBear
    no very easy but lacks documentation
    Read full review
    Alternatives Considered
    Amazon AWS
    We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.
    Incentivized
    Read full review
    SmartBear
    ReadyAPI provides intuitive GUI capabilities compared to their own open source product. When compared to Postman, ReadyAPI also supports SOAP based services, which is a saver especially when integrating with legacy or other third party systems.
    Incentivized
    Read full review
    Scalability
    Amazon AWS
    No answers on this topic
    SmartBear
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing. However, I have read that added monitoring tools have been added, which if so the 7 could possibly go to a 8 or 9.
    Read full review
    Return on Investment
    Amazon AWS
    • It impact more and more. Not in terms of ROI but in time as well
    Incentivized
    Read full review
    SmartBear
    • Very quick regression testing, hence having the testing results very soon, even the same day of deployment
    • for same above reason, it can save money for corporation (so no tedious, costly and erroneous manual testings)
    • The test reports are compatible with TestNG, so the corporation can integrate the reports in our Autamation frameworks such as Allure or Jira Zephyr
    Incentivized
    Read full review
    ScreenShots