Top Rated
401 Ratings
Top Rated
156 Ratings
Top Rated
401 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.6 out of 100
Top Rated
156 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.6 out of 100

Attribute Ratings

  • Azure DevOps Services is rated higher in 4 areas: Likelihood to Recommend, Likelihood to Renew, Support Rating, Implementation Rating
  • ReadyAPI is rated higher in 1 area: Usability

Likelihood to Recommend

8.8

Azure DevOps Services

88%
56 Ratings
8.5

ReadyAPI

85%
67 Ratings

Likelihood to Renew

10.0

Azure DevOps Services

100%
3 Ratings
7.4

ReadyAPI

74%
18 Ratings

Usability

7.0

Azure DevOps Services

70%
5 Ratings
9.9

ReadyAPI

99%
3 Ratings

Availability

Azure DevOps Services

N/A
0 Ratings
9.0

ReadyAPI

90%
2 Ratings

Performance

Azure DevOps Services

N/A
0 Ratings
8.0

ReadyAPI

80%
2 Ratings

Support Rating

8.2

Azure DevOps Services

82%
20 Ratings
8.0

ReadyAPI

80%
11 Ratings

Implementation Rating

10.0

Azure DevOps Services

100%
2 Ratings
7.0

ReadyAPI

70%
3 Ratings

Product Scalability

Azure DevOps Services

N/A
0 Ratings
7.0

ReadyAPI

70%
1 Rating

Likelihood to Recommend

Microsoft

[Azure DevOps Services (formerly VSTS)] is well suited for agile teams. It is a digital kanban for teams to access anywhere at any time. Especially during covid when most companies are still remote, it allows teams to fully perform and still be functional in operating within an agile methodology. It also gives visibility to teams capacity.
Read full review

SmartBear

As stated, we do a LOT of API testing, the swaggerhub import makes it easy to add APIs. This is very well-suited, as well as easy management of the steps/cases/suites inside of ReadyAPI. The one thing I do wish ReadyAPI was better suited for is changes to data, we have a lot of test cases in ReadyAPI and if we make a change to how the backend data is structured, one-by-one adjustments need to be made to the steps. Less appropriate, UI testing.
Read full review

Pros

Microsoft

  • Flexible Requirements Hierarchy Management: AZDO makes it easy to track items such as features or epics as a flat list, or as a hierarchy in which you can track the parent-child relationship.
  • Fast Data Entry: AZDO was designed to facilitate quick data entry to capture work items quickly, while still enabling detailed capture of acceptance criteria and item properties.
  • Excel Integration: AZDO stands out for its integration with MS Excel, which enables quick updates for bulk items.
Read full review

SmartBear

  • Different Load testing techniques with variable loads and settings allowing to load test your service in different ways.
  • Assertions are much easier to use by inspecting responses, especially xpath assertions.
  • Exporting test scripts and linking them on jenkins.
  • Modern and user friendly GUI compared to free version.
  • Running test scripts in parallel.
Read full review

Cons

Microsoft

  • Column sorting when in filtered states.
  • A way to show cross-team dependencies.
  • A customized "From" field for notifications. Sometimes when a mail comes from Azure DevOps the teams do not realize that I am sending it
  • A way to do online poker that doesn't require a plug-in.
Read full review

SmartBear

  • Sometimes Ready API Test performs poorly or freezes when REST response contains a lot of data
  • Performance Tests documentation could be updated to describe different assertion points with examples of usage.
  • Ability to disable certain test steps only in the Performance Tests section, while leaving them on for Functional Tests could be added.
Read full review

Pricing Details

Azure DevOps Services

Starting Price

$2 per GB (first 2GB free)

Editions & Modules

Azure DevOps Services editions and modules pricing
EditionModules
Basic Plan$61
Basic + Test Plan$522
Azure Artifacts$23
Azure Pipelines - Microsoft Hosted$404
Azure Pipelines - Self-Hosted$155

Footnotes

  1. per user per month (first 5 users free)
  2. per user per month
  3. per GB (first 2GB free)
  4. per parallel job (1,800 minutes free with 1 free parallel job)
  5. per extra parallel job (1 free parallel job with unlimited minutes)

Offerings

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services

Entry-level set up fee?

No setup fee

Additional Details

ReadyAPI

Starting Price

Editions & Modules

ReadyAPI editions and modules pricing
EditionModules

Footnotes

    Offerings

    Free Trial
    Free/Freemium Version
    Premium Consulting/Integration Services

    Entry-level set up fee?

    No setup fee

    Additional Details

    Likelihood to Renew

    Microsoft

    I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
    Read full review

    SmartBear

    The only reason this isn't a '10' is because of the cost. This product is definitely meant for organizations who are serious about making sure they invest in the full ecosystem of API design, development, maintenance. But there is a significant cost associated with this investment. and because of this cost (and the non-tangible output for executives), it is a difficult line-item to justify in this post-pandemic environment.
    Read full review

    Usability

    Microsoft

    Azure DevOps is a powerful, complex cloud application. As such there are a number of things it does great and something where there is room for improvement. One of those areas would be in usability. In my opinion it relies too much on search. There is no easy way to view all projects or to group them in a logical way. You need to search for everything.
    Read full review

    SmartBear

    SoapUI allows us to combine multiple tests and adhere
    to the sequence that they need to run in order to complete successfully.
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing
    Read full review

    Reliability and Availability

    Microsoft

    No answers on this topic

    SmartBear

    Soap UI has managed to continuously build on it's solid foundation and keep improving by each release. It is by far the most dependable and accurate testing tool out there of its kind. Available via connecting to VM's created as SoapUI test machines give access to it anytime, anywhere practically.
    Read full review

    Performance

    Microsoft

    No answers on this topic

    SmartBear

    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing.
    Read full review

    Support Rating

    Microsoft

    When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
    Read full review

    SmartBear

    To be honest, we didnt had much issues with the support, as there is already plenty of online communities available for help. But if ever there were some minor issues with the membership or the certificates, the tech support was always quick and efficient enough to resolve the issue ASAP
    Read full review

    Implementation Rating

    Microsoft

    Was not part of the process.
    Read full review

    SmartBear

    no very easy but lacks documentation
    Read full review

    Alternatives Considered

    Microsoft

    Azure DevOps is much easier to implement and use on a daily basis than VersionOne. This is based on end-user feedback and my personal experience as well. ADO has more features and seems to get updated more frequently than VersionOne as well. VersionOne is less expensive overall than ADO, but our company prefers to use ADO because it has a lot more benefits.
    Read full review

    SmartBear

    ReadyAPI provides intuitive GUI capabilities compared to their own open source product. When compared to Postman, ReadyAPI also supports SOAP based services, which is a saver especially when integrating with legacy or other third party systems.
    Read full review

    Scalability

    Microsoft

    No answers on this topic

    SmartBear

    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing. However, I have read that added monitoring tools have been added, which if so the 7 could possibly go to a 8 or 9.
    Read full review

    Return on Investment

    Microsoft

    • It provides a great IDE to make things easier, clear, and compact. It has always been a positive ROI
    • It's worth the money. I don't think any other software could replace the VS. It has helped us a lot to making things ready on time
    • The only thing I dislike is that it takes a lot of memory space when in an idle state
    Read full review

    SmartBear

    • We were able to achieve our needs in API test automation with the tool
    • In terms ROI, I would say that we have gotten what is basically needed
    • Though the initial setup was tough, after that we were able to continue it with user friendly UI and reporting.
    • Overall, it had [a] neutral impact in terms [of] ROI.
    Read full review

    Add comparison