Huawei Cloud Cloud Performance Test Service (CPTS) vs. Tricentis NeoLoad

While Tricentis NeoLoad supports SAP GUI protocols, recording and maintaining test scripts for complex SAP transactions (like those in the OTC module) can be cumbersome.


For instance, we had challenges recording a VA01 (Sales Order Creation) transaction because of the dynamic nature of SAP screen fields and session handling. NeoLoad sometimes struggles to properly correlate or handle SAP’s SAPGUI Dynpro fields automatically.

Incentivized

• With Tricentis NeoLoad, we have control on the test dynamically. One can alter user count/volume even when test is in progress. This makes it a very cool tool as you can avoid running multiple tests eventually saves a lot of time.
• Tricentis NeoLoad user paths are very well structured. End points can be identified and tweaked easily especially when a large list of endpoints are part of the neoload project.
• Tricentis NeoLoad results comparison is one of the cool options. We can compare previous tests against the current one to see the exact delta between transaction metrics. This helps in gauging the application behaviour with changes deployed

Incentivized

• Ease of use: Some users find certain features or aspects of the interface to be confusing or hard to use. Improving the overall usability of the tool could make it more accessible and easier for users to get up and running with it.
• Integration with other tools: Tricentis NeoLoad does not have many integrations with other tools. Adding more integrations with popular tools and platforms could make it easier for users to work with Tricentis NeoLoad as part of their overall workflow.
• Mobile testing: Some users wish that Tricentis NeoLoad had more robust support for testing the performance of mobile applications. This could include the ability to simulate different mobile devices and networks, as well as the ability to test the performance of native mobile apps.
• Cloud support: Tricentis NeoLoad does not have as much support for cloud-based applications and infrastructure. Adding more support for testing the performance of applications hosted in the cloud could be a useful feature for some users.
• Advanced scripting capabilities: While Tricentis NeoLoad does offer some scripting capabilities, it would be nice to have more advanced options for customizing and automating load testing scenarios. Adding more advanced scripting capabilities could make it easier for users to create complex load testing scenarios.

Incentivized

We find NeoLoad easy to use compared to their competitors. It requires minimal coding knowledge, also it is easy to train newcomers with NeoLoad. It also offers good integration and automation capability where with less code you can automate your testing process

Incentivized

In being flexible to meet all needs, it is very bare bones by design, but this could be a considered a feature and not a bug.

This is the only area where we strongly feel Tricentis needs to improve. Their support process is inadequate, representatives are not so capable of providing solutions at one shot without consulting their internal engineering teams. Most importantly, the time they take to resolve simple issues is huge and at many times hampered our work.

Incentivized

1. Their documentation is scattered over many places like GitHub read me files, their internal website etc;
2. Support team takes huge time just to acknowledge our ticket
3. No support to automatically migrate scripts from competetor tool into

Incentivized

When we used Apache JMeter we faced some problems like less documentation is available for integrating tools, and some integrations have not yet been deployed. Very few plugin updates are made. Since customer support is an open source tool, it is a major problem. While Tricentis Neoload provides better documentations and customer services.

Incentivized

• Performance testing is like an insurance. An online store which is not available causes a loss of sales. Without a performance test you do not know if it might happen. The invest into performance tests reduces the risk of loosing sales. The flexible license model of NeoLoad allows or customers to choose reasonable and suiteable rate.

Incentivized