Likelihood to Recommend
AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.
Read full review
Here are some specific scenarios where Tricentis NeoLoad might be well-suited:
Performance testing of web applications: Tricentis NeoLoad is well-suited for testing the performance of web applications under heavy loads. It can simulate multiple users accessing the application simultaneously and measure response times, throughput, and error rates to identify bottlenecks and potential failure points. Testing the scalability of APIs: Tricentis NeoLoad is well-suited for testing the scalability of APIs. It can simulate increasing loads on an API and measure the response times and error rates to identify the point at which performance starts to degrade. Identifying performance bottlenecks: Tricentis NeoLoad can be used to identify performance bottlenecks in web applications and APIs by measuring response times, throughput, and error rates at various points in the application. This can help organizations pinpoint the specific parts of their applications that are causing performance issues and take steps to address them.
Here are some scenarios where Tricentis NeoLoad might be less appropriate:
Testing the performance of native mobile applications: Tricentis NeoLoad is primarily focused on testing the performance of web applications and APIs. It does not have as much support for testing the performance of native mobile applications. Testing the performance of applications hosted in the cloud: Tricentis NeoLoad does not have as much support for testing the performance of applications hosted in the cloud. It may be less well-suited for testing the performance of cloud-based applications and infrastructure. Advanced scripting and customization: While Tricentis NeoLoad does offer some scripting and customization capabilities, it is not as well-suited for users who need more advanced options for customizing and automating load testing scenarios. Read full review Pros Integration with CI/CD Pipeline Diversity in Real Devices over the Cloud Pay as you go option Reproduce Issues and easily collect all kinds of logs Read full review NeoLoad supports performance test engineers with a strong feature set to analyse the results. The first metric you have in mind is response time of the application. The metric satisfies the stakeholder if it meets the requirements. Otherwise, the stakeholder wants to know some comments and suggestions for improvement. I rely on the data gathered by monitoring agents when I analyse test results. The monitoring agent is a service which collects different counters from an operating system, databases, web server, etc. The results can be analysed in individual composed graphs. This is a powerful feature to deliver conclusive reports to stakeholders. Even the export of reports in various formats is helpful for communication with different stakeholders. Our customers like the flexible license model of NeoLoad. A usual performance test project starts with the development of tests and configuration of the test environment. Finally, there is a first test execution followed by a couple of additional test executions. Usually, it is hard to say how long it takes to implement the issues based on the test results. So we usually do not know how long is the period between first and last test execution. It does not matter how long the period might be. In most of our projects we prefer daily licenses of NeoLoad. If you buy e.g. a four-day license you can use NeoLoad at four different days. As a performance test engineer, I like the impressive APIs of NeoLoad. NeoLoad is just a performance test tool and the vendor Neotys is focused on this job. Whenever you would like to add something into a test scenario which is not mainly a performance issue you can integrate these parts by APIs which are easy to handle and very powerful. They also support you in case technologies which are not supported yet by NeoLoad. Maybe there is a new device which you want to monitor. Therefore you can report the measurements of the specific counters by the data exchange API during test execution. So you can analyse the data in the usual way. In our company we developed already a couple of features based on the APIs of NeoLoad and we are very happy with this flexibility. Read full review Cons Interface (CLI) not very easy. Competition has better options. Integration with IDE for test case coding. Reporting for the test scripts executed. Read full review Integration with third-party tools. I cannot stream NL test data to a third-party DB and then plot graphs out of it. Keyboard shortcuts. It is tedious to use the mouse to click everywhere. I'd love to have some keyboard shortcuts Reports and Analytics. Lacks intelligence in identifying patterns of problems Read full review Likelihood to Renew
We find NeoLoad easy to use compared to their competitors. It requires minimal coding knowledge, also it is easy to train newcomers with NeoLoad. It also offers good integration and automation capability where with less code you can automate your testing process
Read full review Usability
In being flexible to meet all needs, it is very bare bones by design, but this could be a considered a feature and not a bug.
Read full review Support Rating
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
Read full review
This is the only area where we strongly feel Tricentis needs to improve. Their support process is inadequate, representatives are not so capable of providing solutions at one shot without consulting their internal engineering teams. Most importantly, the time they take to resolve simple issues is huge and at many times hampered our work.
Read full review Implementation Rating Their documentation is scattered over many places like GitHub read me files, their internal website etc; Support team takes huge time just to acknowledge our ticket No support to automatically migrate scripts from competetor tool into Read full review Alternatives Considered
I got more features and handy within AWS Device farm than
AWS Cloud9 Read full review
We used Jenkins for manual performance testing and had big efforts to script and evaluate the test results. Furthermore, the effort of maintaining and editing the scripts was very high. To generate a report, many tables must be analyzed. The efforts of these tasks are minimized since we used the great tool NeoLoad.
Read full review Return on Investment Quicker testing leads to faster product to market times Can deploy updates much more regularly by testing across many devices quickly Read full review Neoload solves a test based web sockets & supporting the desire for later hurdle faced by user. User can prove throughput & find limitations before going into production. Overall; its pleasant to see the outcome provided by Neoload for business development tools in most of all manners. Read full review ScreenShots Tricentis NeoLoad Screenshots