ReadyAPI vs. Visual Studio Test Professional

As stated, we do a LOT of API testing, the swaggerhub import makes it easy to add APIs. This is very well-suited, as well as easy management of the steps/cases/suites inside of ReadyAPI. The one thing I do wish ReadyAPI was better suited for is changes to data, we have a lot of test cases in ReadyAPI and if we make a change to how the backend data is structured, one-by-one adjustments need to be made to the steps. Less appropriate, UI testing.

Incentivized

Visual Studio Test Professional is best for .NET and C# based development, which is what 90% of our developers and projects do. It is an integral part of the CI/CD pipeline for our custom made Enterprise resource planning tool. It also works very well with Azure providing seamless integration to way more functionality.

Incentivized

• Ease of use (ability to automatically import API definitions, Jenkins integration for running in the pipeline).
• Detailed test reports (allow to easily identify weak spots during both functional and performance testing).
• One platform for all tests (allows to closely couple and reuse existent tests).

Incentivized

• Visual Studio Test Professional when paired with Azure DevOps is the best solution for Test Case Management when compared to other Testing tools we've used in the past.
• Test Results and Artifacts are always available with full traceablility for audits.
• Testing and Release Management are tied together as one continuous pipeline.

Incentivized

• Needs good documentation
• Need to improve the performance of the tool
• Setup is very complex and for such [a] commercial tool, it should easy and straightforward
• Tool says it supports security testing but in reality, it is not at an extensive level.

Incentivized

• The user community of the Visual Studio Test product is weak. For instant problems with this product, it is necessary to quickly reach the source of the error.
• Licence fees need to be more reasonable. License prices need to be reduced so that they can easily compete with free testing tools.

Incentivized

The only reason this isn't a '10' is because of the cost. This product is definitely meant for organizations who are serious about making sure they invest in the full ecosystem of API design, development, maintenance. But there is a significant cost associated with this investment. and because of this cost (and the non-tangible output for executives), it is a difficult line-item to justify in this post-pandemic environment.

Incentivized

SoapUI allows us to combine multiple tests and adhere
to the sequence that they need to run in order to complete successfully.
It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing

Visual Studio Test Professional's overall usability is extremely high quality. It is extremely functional and like all Microsoft products has a user interface that is well designed and is extremely user friendly. Any functionality which I looked for, I was able to either understand immediately or find a user guide online.

Incentivized

Soap UI has managed to continuously build on it's solid foundation and keep improving by each release. It is by far the most dependable and accurate testing tool out there of its kind. Available via connecting to VM's created as SoapUI test machines give access to it anytime, anywhere practically.

It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing.

To be honest, we didnt had much issues with the support, as there is already plenty of online communities available for help. But if ever there were some minor issues with the membership or the certificates, the tech support was always quick and efficient enough to resolve the issue ASAP

Incentivized

My team has always been able to troubleshoot with the help of customer support (and even schedule a virtual meeting!) in a timely manner. The support is provided immediately and with the necessary knowledge to answer/solve any questions/problems I or my team experience.

Incentivized

no very easy but lacks documentation

ReadyAPI provides intuitive GUI capabilities compared to their own open source product. When compared to Postman, ReadyAPI also supports SOAP based services, which is a saver especially when integrating with legacy or other third party systems.

Incentivized

The visual Studio Test tool is faster than other tools. Since the development and testing processes are in one tool, it is more profitable in terms of cost. It is more inconvenient to write a test case in DevOps.

It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing. However, I have read that added monitoring tools have been added, which if so the 7 could possibly go to a 8 or 9.

• Very quick regression testing, hence having the testing results very soon, even the same day of deployment
• for same above reason, it can save money for corporation (so no tedious, costly and erroneous manual testings)
• The test reports are compatible with TestNG, so the corporation can integrate the reports in our Autamation frameworks such as Allure or Jira Zephyr

Incentivized

• One of the positive ROIs of Visual Studios is the fact that it makes producing our work at a quick rate, things like Intellisense make our work get produced at a much higher rate which is good for our return of investment.
• Testing by the developers has increased by 23%, we now take the time to actually test our product before we send it to our QA people.
• I am not aware of any negative ROI aspects to our company that have been found.

Incentivized