What users are saying about
105 Ratings
14 Ratings
105 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.3 out of 101
14 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.4 out of 101

Likelihood to Recommend

JMeter

The key questions I would pose are: how high of a concurrent load do you need to generate against the system? How technically skilled are your personnel that will perform the load testing? How much programmable/scripting/code based control do you desire from the tool? Do you prefer more of a GUI based tool or a programmatic code/scripting based tool? JMeter will be for those that want a GUI, moderate to low scripting/code based control/programmability, moderate to low load generation, and for users experienced in the novice to expert range.
David Luu profile photo

NeoLoad

NeoLoad is a very comprehensive tool if you are looking for a performance test tool for web applications and other applications using protocols like REST, SOAP, etc. The concepts are easy to understand and mostly clear. This enables you to develop very fast tests with a very good flexibility regarding the number of virtual users, the mixture of scripts, locations where load is generated or there is load variation. In consulting projects it is very helpful that project data and reports can be viewed by NeoLoad without the need of a license.
Dirk Schweier profile photo

Feature Rating Comparison

Load Testing

JMeter
7.5
NeoLoad
8.0
End to end performance management
JMeter
7.7
NeoLoad
8.9
Integrated performance data
JMeter
7.3
NeoLoad
8.0
Deployment model flexibility
JMeter
7.2
NeoLoad
8.1
Real time monitoring
JMeter
8.5
NeoLoad
6.2
Automated anomaly detection
JMeter
6.7
NeoLoad
8.9

Pros

JMeter

  • Easy to construct Webservices script - You just need to add a sampler with the endpoint, payload and header information. And boom you can run a load test on the service with varying load and capture the response time and throughput. In a commercial tool like Loadrunner or Silkperformer, this process would take at least couple of hours, while with Jmeter we can do this in 10 minutes or less.
  • Modularizing the scripts - Jmeter has a very good way of organizing the scripts and the reusability of the existing script (transactions) is also as easy as copy pasting the script.
  • Jmeter tests can be run from anywhere, so you can run it from the idle webserver itself if you have some firewall restrictions to test it from your local or other environment.
  • Jmeter distributed tests can be spawn from the AWS and results collated to see the performance from different regions in the world.
No photo available

NeoLoad

  • NeoLoad supports performance test engineers with a strong feature set to analyse the results. The first metric you have in mind is response time of the application. The metric satisfies the stakeholder if it meets the requirements. Otherwise, the stakeholder wants to know some comments and suggestions for improvement. I rely on the data gathered by monitoring agents when I analyse test results. The monitoring agent is a service which collects different counters from an operating system, databases, web server, etc. The results can be analysed in individual composed graphs. This is a powerful feature to deliver conclusive reports to stakeholders. Even the export of reports in various formats is helpful for communication with different stakeholders.
  • Our customers like the flexible license model of NeoLoad. A usual performance test project starts with the development of tests and configuration of the test environment. Finally, there is a first test execution followed by a couple of additional test executions. Usually, it is hard to say how long it takes to implement the issues based on the test results. So we usually do not know how long is the period between first and last test execution. It does not matter how long the period might be. In most of our projects we prefer daily licenses of NeoLoad. If you buy e.g. a four-day license you can use NeoLoad at four different days.
  • As a performance test engineer, I like the impressive APIs of NeoLoad. NeoLoad is just a performance test tool and the vendor Neotys is focused on this job. Whenever you would like to add something into a test scenario which is not mainly a performance issue you can integrate these parts by APIs which are easy to handle and very powerful. They also support you in case technologies which are not supported yet by NeoLoad. Maybe there is a new device which you want to monitor. Therefore you can report the measurements of the specific counters by the data exchange API during test execution. So you can analyse the data in the usual way. In our company we developed already a couple of features based on the APIs of NeoLoad and we are very happy with this flexibility.
Dirk Schweier profile photo

Cons

JMeter

  • To get a summarized HTML report, the user needs to configure a lot of things. It should be done with a single click like other paid tools in the market.
  • Support to measure desktop based application performance.
Binoy Shah profile photo

NeoLoad

  • NeoLoad allows the user many switches and options. Sometimes it is hard to understand dependencies. But the documentation and the support helps you.
  • In most projects it is necessary to develop small scripts. NeoLoad only supports JavaScript and the editor is weak. There is syntax highlighting but sometimes you can not see where the cursor is located exactly. NeoLoad supports a workaround if you register .js-files in Windows to a different editor.
Dirk Schweier profile photo

Likelihood to Renew

JMeter

JMeter 8.6
Based on 12 answers
Price, Wiki and user sharing. Having access to the information provided by the developers and other open source providers is key for me. The ability to share information and get answers directly is very important to success in software testing. And the price of this product currently is amazing. Too many companies charge way too much money for products that are far behind in their value and pertinence
Charlie Harris profile photo

NeoLoad

No score
No answers yet
No answers on this topic

Usability

JMeter

JMeter 9.0
Based on 1 answer
I can jump right into a new test plan and start building from scratch. The natural progression from test plan to thread group and then designing the basic format of the process is very streamlined and smooth. With only slight modifications I can build out a very complex model from a very basic beginning.
Charlie Harris profile photo

NeoLoad

NeoLoad 10.0
Based on 1 answer
Arpita Choudhury profile photo

Support

JMeter

No score
No answers yet
No answers on this topic

NeoLoad

NeoLoad 9.0
Based on 1 answer
Immediate response and help.
Arpita Choudhury profile photo

Alternatives Considered

JMeter

The main and best thing is that it's an open source tool with the biggest community worldwide.
Binoy Shah profile photo

NeoLoad

NeolLoad is a less expensive alternative to HP LoadRunner that is also easier to learn and use. NeoLoad supports the same web-based protocols as HP LoadRunner, and, in addition, provides better support for testing mobile applications. In my organization, NeoLoad's main deficiency is lack of support for mainframe terminal protocols. Although NeoLoad does not include support for "deep-dive" diagnostics as is available for HP LoadRunner, it does provide interfaces for two leading diagnostic products, AppDynamics and DynaTrace. Neotys, the company that produces NeoLoad, also has an additional product, NeoSense, that executes NeoLoad scripts as an Application Performance Management (APM) tool. This product is a separate purchase, and I have not used it.
Michael Esposito profile photo

Return on Investment

JMeter

  • Troubleshooting data easier
  • Interface is technical and not always intuitive
  • Clearer direction before making decisions on projects
No photo available

NeoLoad

  • Reduced risk of performance issues in production.
  • Increased employee efficiency.
  • Increased customer satisfaction with online transactions.
Michael Esposito profile photo

Pricing Details

JMeter

General

Free Trial
Free/Freemium Version
Yes
Premium Consulting/Integration Services
Entry-level set up fee?
No

NeoLoad

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Add comparison