QAComplete is a performance testing tool from SmartBear. The vendor says QAComplete was built from the ground-up to be an easy-to-use test case management tool, adapting to the user's existing processes and empowering users to manage all of their manual and automated tests with ease, while reporting on all test results in one central location. The vendor's goal is for QAComplete to allows users to spend less time managing tests and focus on what they do best; making great…
N/A
ReadyAPI
Score 6.2 out of 10
N/A
ReadyAPI (formerly SoapUI Pro, LoadUI Pro, and ServiceV Pro) is a REST and SOAP API functional testing tool that enables software developers, QA engineers, and manual testers to work together to create, maintain, and execute complex end-to-end API tests in their CI/CD pipelines without needing to code.
N/A
Tricentis NeoLoad
Score 7.4 out of 10
N/A
Tricentis NeoLoad is a solution for continuous performance testing software to automate API and application load testing. It was developed by the French company Neotys and acquired by Tricentis, along with the company, in March 2021.
NeoLoad is more SAP-centric and offers use cases a lot closer to what we experiment on a daily basis. The main competition in the space would be loadrunner but it lacks the flexibility of NeoLoad, and also comes at a much higher price in a way that would have hurt our …
I think QAComplete is a great way to organize the literal hundreds of development bugs that are discovered throughout an agile-based project. Teams aren't always able to hotfix items on the fly and this tool provides a great repository and facility for storing and prioritizing those technical debt items that may get overlooked from sprint to sprint. It also let's everyone on the team get a clear understanding for project progress.
As stated, we do a LOT of API testing, the swaggerhub import makes it easy to add APIs. This is very well-suited, as well as easy management of the steps/cases/suites inside of ReadyAPI. The one thing I do wish ReadyAPI was better suited for is changes to data, we have a lot of test cases in ReadyAPI and if we make a change to how the backend data is structured, one-by-one adjustments need to be made to the steps. Less appropriate, UI testing.
While Tricentis NeoLoad supports SAP GUI protocols, recording and maintaining test scripts for complex SAP transactions (like those in the OTC module) can be cumbersome.
For instance, we had challenges recording a VA01 (Sales Order Creation) transaction because of the dynamic nature of SAP screen fields and session handling. NeoLoad sometimes struggles to properly correlate or handle SAP’s SAPGUI Dynpro fields automatically.
With Tricentis NeoLoad, we have control on the test dynamically. One can alter user count/volume even when test is in progress. This makes it a very cool tool as you can avoid running multiple tests eventually saves a lot of time.
Tricentis NeoLoad user paths are very well structured. End points can be identified and tweaked easily especially when a large list of endpoints are part of the neoload project.
Tricentis NeoLoad results comparison is one of the cool options. We can compare previous tests against the current one to see the exact delta between transaction metrics. This helps in gauging the application behaviour with changes deployed
Ease of use: Some users find certain features or aspects of the interface to be confusing or hard to use. Improving the overall usability of the tool could make it more accessible and easier for users to get up and running with it.
Integration with other tools: Tricentis NeoLoad does not have many integrations with other tools. Adding more integrations with popular tools and platforms could make it easier for users to work with Tricentis NeoLoad as part of their overall workflow.
Mobile testing: Some users wish that Tricentis NeoLoad had more robust support for testing the performance of mobile applications. This could include the ability to simulate different mobile devices and networks, as well as the ability to test the performance of native mobile apps.
Cloud support: Tricentis NeoLoad does not have as much support for cloud-based applications and infrastructure. Adding more support for testing the performance of applications hosted in the cloud could be a useful feature for some users.
Advanced scripting capabilities: While Tricentis NeoLoad does offer some scripting capabilities, it would be nice to have more advanced options for customizing and automating load testing scenarios. Adding more advanced scripting capabilities could make it easier for users to create complex load testing scenarios.
The only reason this isn't a '10' is because of the cost. This product is definitely meant for organizations who are serious about making sure they invest in the full ecosystem of API design, development, maintenance. But there is a significant cost associated with this investment. and because of this cost (and the non-tangible output for executives), it is a difficult line-item to justify in this post-pandemic environment.
We find NeoLoad easy to use compared to their competitors. It requires minimal coding knowledge, also it is easy to train newcomers with NeoLoad. It also offers good integration and automation capability where with less code you can automate your testing process
I gave QAComplete this rating because though I do feel that it is a powerful tool, it's definitely not designed for the everyday user. Obviously the target demographic is QA specialists who should be team members that are very technical and methodical in their approaches. However, for the rest of the team, it can often time prove difficult to navigate. Also, the UI is in need of a serious refresh.
SoapUI allows us to combine multiple tests and adhere to the sequence that they need to run in order to complete successfully. It has an excellent GUI design and the reporting mechanism is also very good. It does consume a lot of memory though during concurrent testing
Soap UI has managed to continuously build on it's solid foundation and keep improving by each release. It is by far the most dependable and accurate testing tool out there of its kind. Available via connecting to VM's created as SoapUI test machines give access to it anytime, anywhere practically.
I have not had to work with their customer service directly yet. Our client has been utilizing this tool for years, so I would assume that the support they have received would be good enough to keep them wanting to continue to use the product.
To be honest, we didnt had much issues with the support, as there is already plenty of online communities available for help. But if ever there were some minor issues with the membership or the certificates, the tech support was always quick and efficient enough to resolve the issue ASAP
This is the only area where we strongly feel Tricentis needs to improve. Their support process is inadequate, representatives are not so capable of providing solutions at one shot without consulting their internal engineering teams. Most importantly, the time they take to resolve simple issues is huge and at many times hampered our work.
ReadyAPI provides intuitive GUI capabilities compared to their own open source product. When compared to Postman, ReadyAPI also supports SOAP based services, which is a saver especially when integrating with legacy or other third party systems.
When we used Apache JMeter we faced some problems like less documentation is available for integrating tools, and some integrations have not yet been deployed. Very few plugin updates are made. Since customer support is an open source tool, it is a major problem. While Tricentis Neoload provides better documentations and customer services.
It has an excellent GUI design and the reporting mechanism is also very good. It does consume a lot of memory though during concurrent testing. However, I have read that added monitoring tools have been added, which if so the 7 could possibly go to a 8 or 9.
Performance testing is like an insurance. An online store which is not available causes a loss of sales. Without a performance test you do not know if it might happen. The invest into performance tests reduces the risk of loosing sales. The flexible license model of NeoLoad allows or customers to choose reasonable and suiteable rate.
