TrustRadius Insights for Apache JMeter are summaries of user sentiment data from TrustRadius reviews and, when necessary, third party data sources.
Pros
User-Friendly Interface: Many users have praised JMeter for its user-friendly interface, stating that it makes load testing and stress testing efficient and easy. They appreciate the clear documentation provided by JMeter, which helps them test their applications' performance and resolve any issues before going into production. The friendly and easy-to-use UI of JMeter contributes to its popularity among testers.
Powerful Load Testing Functionality: Users consider JMeter a powerful tool for analyzing product performance through load testing. They find it very useful for performing performance tests in a detailed manner and consider it more complete than other tools like NeoLoad and LoadRunner. The ability to automate JMeter tests and integrate them with Jenkins is seen as a major advantage by users. The availability of various testing features, including functional and automation testing, is also appreciated.
Flexibility and Customization: Users highlight the flexibility of JMeter, allowing for customization according to their specific needs. They value the ability to replicate real-time scenarios, efficiently manage cookies, and utilize thread groups. Additionally, they highly appreciate the abundance of information available on the web about building custom flows with JMeter. The flexibility of JMeter along with the availability of numerous plugins are highlighted as valuable features by users.
Apache Jmeter is used for Azure Load Testing, we have created the scenarios using the JMeter and then we will run those through the Azure Load Engine. We are focusing on building the scalable cloud application so the Azure Load Testing using JMeter is important for us to understand the load of the server. We run the load testing with every release.
Pros
The integration with CI-CD has worked well
The possibility of running scenarios with different data
Dynamic data can be handled with external files like JSON, excel
Works well with the Azure Load Engines
The simulation of the concurrent users works nicely.
Cons
The user interface can be improved a lot. When making changes, we need to do multiple clicks and for non technical person, it is difficult to understand the flow so easily.
The modularity of the scenarios cannot be easily handled.
The inbuilt reporting is not a great one, though there is a possibility to integrate with external tools.
Does not support all the API's. We have grpc api and we need to workaround to work in the Jmeter.
Likelihood to Recommend
Apache JMeter is still one of the powerful performance and load testing tool in the market. We have been using this solution to do load testing against our server hosted in the Azure Cloud. We have tried with different concurrent users and Jmeter has served our purpose. It also has very well integrated with our CI-CD systems. The big challenge is the UI and modularity in the JMeter.
VU
Verified User
Project Manager in Quality Assurance (501-1000 employees)
JMeter is used predominantly for performance and load testing purposes. As our application stack is majorly microservice-based, thousands of APIs are developed, enhanced, and maintained to enable a satisfied customer experience. To achieve this, the APIs should meet the expected performance metrics, and JMeter helps in validating them through our SDLC release cycles.
Pros
All kinds of response formats are supported.
JMS or message based systems can also be tested seamlessly.
Pluggable samplers, visualization tools are helpful.
Open source and free.
Cons
JMeter's UI or frontend can be improved to be more lightweight.
Not ideal for user based performance testing, since no support for final rendering.
System resource-intensive.
Likelihood to Recommend
It's best suited for API testing and load testing of endpoints. Team members can be onboarded easily. Test plans and scripts can be maintained in version control systems like Git. Not good for end-user testing or final user POV performance testing. Scalability of test execution is not simple or supported OOTB.
VU
Verified User
Engineer in Information Technology (10,001+ employees)
Apache JMeter helps ensure our performance targets are met for release, and quantifies changes we make in the name of performance. Without it, we end up with custom code written by system testers or QA that don't always fully understand how code evolves, and then inevitably we have to throw it away in a year. Apache JMeter allows developers to run standardized performance tests ahead of QA.
Pros
Easy to get started with
Good, straightforward UI
Deep options for fine tweaking under uncommon scenarios
Cons
Some options are arcane and misleading
Results are too easily skewed by poor methodology
Likelihood to Recommend
For local, simple systems (think, "it has a main and it goes from there") it will do 10/10. Even for common frameworks, it can instrument/monitor/measure very accurately out of the box; we have even had some attempts at hitting it against a user interface, although then the developer must know more about some internals to understand what is being measured. Strong recommend for data processing code - that is, code that is repeatedly invoked.
Apache JMeter helps our team in areas like load testing and performance benchmarking of APIs across products and services. Every new feature that gets released is the first load tested using Apahe JMeter, by passing appropriate parameters to check if it can handle the list and stress easily. This helps to assert that the service can easily serve 'x' users in 'y' conditions. With teams focusing more on microservices and agile development, non-functional testing plays a vital role. Apache JMeter is an open-source tool written in pure Java, making it the most preferable option for us to test our services, both API and UI through its user interface as well as Non-GUI mode. This makes the SDET team perform testing and feature releases more confidently with optimum quality.
Pros
Report generation.
Multithreading
Log debugging and sampling.
Cons
Optimize CPU and Memory utilization.
Reporting visuals and metrics.
Likelihood to Recommend
Best suited: Any new service i.e. monolith or microservice must be load tested to check how it can scale at extreme load, this helps to be prepared early and stay ahead of the competition too. Not suited: Limited CPU and Memory resources are available.
VU
Verified User
Manager in Information Technology (5001-10,000 employees)
Jmeter is used for the load or performance testing of an application. It is used to identify the bottleneck in the performance and improve the user experience. We have used for newly created authenticated API, Identify management system, and database to store PII. It is worth the tool to create your project and scripts to benchmark the performance numbers for future releases and improvements. We have found many bottlenecks in the application which required to re-design the data flow with the help of Jmeter.
Pros
Performance Testing.
Load Testing.
Penetration Testing.
Scale the test and rerun existing scripts.
Cons
Project Creation.
Variable declaration.
Global Design UI.
End User scenario to execute like live users performing the action on the application.
Likelihood to Recommend
Performance testing of API, UI, Back-end, Middle layer of an application which transforms the data and consumer application uses it to Scale your tests to any size. Run Your Existing JMeter Tests At Any Limit From Any Location. Continuous Load Testing. Services: Scale your load testing. For any new API, it is better to benchmark the performance numbers for future improvements.
VU
Verified User
Team Lead in Information Technology (10,001+ employees)
JMeter is used by both software developers and testers to check that the application functions correctly. It's used in 2 ways: check that the new version of the application functions as expected and also for load testing the application. After the tests are written once by a software developer they can be automated or easily run manually by a non-technical person.
Pros
Load testing. Easy to specify how heavy test is wanted & reports are simple to read.
Doesn't require lots of resources. Tests can be run with normal PC.
Can generate different kind of reports easily.
Cons
Test writing process requires a technical person and needs some learning.
UI elements are rather dated.
Tests recorded with recorder functionality need lots of manual editing to work reliably.
Likelihood to Recommend
JMeter is designed to perform load tests against web applications and suits this purpose well. It is a completely free application and runs on multiple platforms without any hassle. It can also be used to check that the new version of the application functions correctly (regression testing), however, JMeter doesn't actually run the application in the browser but only checks for server responses. The benefit of this is that it requires a lot fewer resources & setup, the drawback is that more complex tests that require lots of UI interaction may not be possible.
VU
Verified User
Employee in Information Technology (1001-5000 employees)
We used JMeter for performance and load testing of our cloud service to verify that it worked well with many users before launch and also to be able to calculate costs when scaling up the service for more users.
Pros
Easy load testing to verify system with load from many users
Very customizable through your own Java code
Possible to run from a console without any user interface
Cons
Make it easier to record traffic and use that as input during testing
Likelihood to Recommend
It’s great for load testing when you want to apply a load but wants to be sure it’s not restricted by the client machine you run JMeter on. It can be a bit hard to use for people without Java skills.
VU
Verified User
Technician in Research & Development (1-10 employees)
Apache Jmeter scripts are great for load testing. I like the parameterization strategy offered by JMeter because I can better reproduce real-life scenarios by introducing variables and randomizing my tests. Also, JMeter extensions are accessible in the open-source sector to extend current JMeter capabilities. I love this to do my performance testing.
Pros
User interface is not complex. Easy to understand and work flow is very simple.
It comes with many useful testing features.
Cons
It's very difficult to find any cons about this powerful tool. Actually it works perfectly for me.
While installation is very simple, some problems may occur if it is not installed by someone with experience.
Likelihood to Recommend
Apache Jmeter is very useful for parameterizing tests and loading info, which means it has a great performance testing. JMeter will allow you to evaluate if you need to extend outside the existing hardware infrastructure. It can maximize the access to the CSV data by reading it correctly, as the I/O efficiency is overhead. It also offers a very simple user experience, many plug-in modules and a range of graphical maps and descriptive notes to the audience. You could even use the chrome BlazeMeter add-on to capture, retrieve, and create JMSX files in HTML Cookie Manager for an app-based check.
Most of our developers use JMeter for performance testing. It's a great tool where you can do all kinds of performance testing tests like Baseline test, smoke test, load test, and stress test. It is useful for test performance and scalability of REST APIs. It is used as an automation tool for API testing.
Pros
Automation tool which is best suited to do performance testing
Easy to use and setup. The software has community and documentation to solve questions.
Great tool for testing REST APIs
Cons
It should support more test cases running at the same time
Should be able to support multiple threads for different testing scenarios
The newer version doesn't have a start time and end time for the test
Likelihood to Recommend
It is a very great tool for running load tests to check the performance and scalability of REST APIs. Its free for commercial use and well supported by the community. It needs to have a very good system that supports a high heap size. It has a lot of plugins and extensions which can improve performance testing.
VU
Verified User
Engineer in Information Technology (5001-10,000 employees)
JMeter is being used by our QA teams mainly for performance testing. We are into banking and finance domain. Hence, the performance of the bank transactions should be very rich. JMeter helps us to find bottlenecks around performance issues within our web apps and web services. JMeter also helps us to simulate different user loads in order to test web application under various load patterns.
Pros
Jmeter is an open source and highly customized tool for your needs. There are open source JMeter plugins also available in the market to extend JMeter existing functionality.
JMeter provides a very easy user interface and pluggable components, and different visual charts and summary report listeners. Also nowadays JMeter supports quite rich HTML reporting.
JMeter can be used for volume testing, load testing, availability testing. Also, it allows the master and slave concept. Hence you can create multiple load generators and controllers, and JMeter will give you combined execution status.
JMeter provides great documentation.
Cons
To get a summarized HTML report, the user needs to configure a lot of things. It should be done with a single click like other paid tools in the market.
Support to measure desktop based application performance.
Likelihood to Recommend
It is well suited for the organization who is looking for an open source solution for their performance testing needs. JMeter is the best tool for performance testing, I don't see any limitations here, and hence it's never less appropriate for any organization.