NeoLoad is easy to use without strict limitations in scalabilty or interaction with other tools
May 11, 2017
NeoLoad is easy to use without strict limitations in scalabilty or interaction with other tools
Score 9 out of 10
Vetted Review
Verified User
Overall Satisfaction with NeoLoad
As performance test engineers we support our own software engineering and customers with performance testing.
In both cases, the stakeholders want to make sure that the software has a good performance. The performance is an important argument for customers to like or dislike an application. So more and more requirement engineers define performance requirements in an early stage of the project. Based on those requirements and formerly metrics we can provide reliable and reproducible performance results for the current version in various test environments. These results are used by software engineers and system administrators to optimize software and configuration.
The result of the next test run can demonstrate the effect of changes and this is also an important feedback to the team. So NeoLoad helps to improve the performance of web applications and also web services.
In both cases, the stakeholders want to make sure that the software has a good performance. The performance is an important argument for customers to like or dislike an application. So more and more requirement engineers define performance requirements in an early stage of the project. Based on those requirements and formerly metrics we can provide reliable and reproducible performance results for the current version in various test environments. These results are used by software engineers and system administrators to optimize software and configuration.
The result of the next test run can demonstrate the effect of changes and this is also an important feedback to the team. So NeoLoad helps to improve the performance of web applications and also web services.
- NeoLoad supports performance test engineers with a strong feature set to analyse the results. The first metric you have in mind is response time of the application. The metric satisfies the stakeholder if it meets the requirements. Otherwise, the stakeholder wants to know some comments and suggestions for improvement. I rely on the data gathered by monitoring agents when I analyse test results. The monitoring agent is a service which collects different counters from an operating system, databases, web server, etc. The results can be analysed in individual composed graphs. This is a powerful feature to deliver conclusive reports to stakeholders. Even the export of reports in various formats is helpful for communication with different stakeholders.
- Our customers like the flexible license model of NeoLoad. A usual performance test project starts with the development of tests and configuration of the test environment. Finally, there is a first test execution followed by a couple of additional test executions. Usually, it is hard to say how long it takes to implement the issues based on the test results. So we usually do not know how long is the period between first and last test execution. It does not matter how long the period might be. In most of our projects we prefer daily licenses of NeoLoad. If you buy e.g. a four-day license you can use NeoLoad at four different days.
- As a performance test engineer, I like the impressive APIs of NeoLoad. NeoLoad is just a performance test tool and the vendor Neotys is focused on this job. Whenever you would like to add something into a test scenario which is not mainly a performance issue you can integrate these parts by APIs which are easy to handle and very powerful. They also support you in case technologies which are not supported yet by NeoLoad. Maybe there is a new device which you want to monitor. Therefore you can report the measurements of the specific counters by the data exchange API during test execution. So you can analyse the data in the usual way. In our company we developed already a couple of features based on the APIs of NeoLoad and we are very happy with this flexibility.
- NeoLoad allows the user many switches and options. Sometimes it is hard to understand dependencies. But the documentation and the support helps you.
- In most projects it is necessary to develop small scripts. NeoLoad only supports JavaScript and the editor is weak. There is syntax highlighting but sometimes you can not see where the cursor is located exactly. NeoLoad supports a workaround if you register .js-files in Windows to a different editor.
- Performance testing is like an insurance. An online store which is not available causes a loss of sales. Without a performance test you do not know if it might happen. The invest into performance tests reduces the risk of loosing sales. The flexible license model of NeoLoad allows or customers to choose reasonable and suiteable rate.
- JMeter and Gatling
In small projects open source tools like JMeter are the hardest competitors because money is a reliable metric. But NeoLoad offers a value in case of reporting and scalability. The standard reports are very comprehensive and easy to understand for stakeholders. It takes much more time to gather and present data in other open source tools. So the customer has to choose if he wants to pay a fix license fee or for a consultant generating a report.