Overall Satisfaction with JMeter
Our organization utilizes the JMeter product across many areas of the IT footprint. Our application development teams will use it for unit testing and our quality assurance team uses it for functional, performance, load and stress testing. We have identified many memory leak, database connection and virtual server issues with the versatility provided by the JMeter product. Our company is expanding their horizons with SOA and other web service upgrades that were until recently an unknown environment for our testing teams. I have spent countless hours in test case and use case review with our QA teams and having Jmeter as a viable testing option has been crucial in our performance and load testing endeavors. We have identified shortcomings in our initial virtual server setup and web service breakdown through comprehensive testing and use case review.
- JMeter has the best range of 'config element' options available to the user. Versatility is the key for me when building a solid base of data options that will be available for all facets of the desired test case selection.
- JMeter provides the user with a variety of reports, results and graphs that can provide the customer with a solid picture of the overall success of the test plan and how to build out the future scenarios. The key is having all levels of output options (executive to technical) and the ability to have comprehensive reviews for all IT teams.
- JMeter has a very robust multithreading framework that allows my team to emulate dozens of user options and threads from within the same test sampling. Building a broad-based test sample is crucial to the success of our testing efforts as we step towards the SOA environment and away from the archaic way of thinking about QA testing. Too many other load testing tools are limited in their scenario building options and ability to simulate so many different types of users.
- I would like to see the WebService (SOAP) functionality returned to JMeter. I don't mind the HTTP option update for this, but I still use previous versions with this option available.
- I would like to see someone build a better, well-rounded documentation effort. I understand this is open source, but there are millions of users out there and at least one of them has some Technical Writing background.
- JMeter has brought a very positive influence in the way that we test web services. This allows us to find more issues sooner and identify server, network and database shortcomings during unit and performance testing.
- HP LoadRunner,SoapUI
JMeter gives us a much more versatile option for driving our performance testing options. Having so many data configurations, timers and listeners to choose from is very important to our QA teams. We also save so much time in using this product because of the speed at which we can build solid test cases and scenarios. JMeter gives such great flexibility in the test plan build. The ability to mix and match test types and functions is crucial to our success.
Price, Wiki and user sharing. Having access to the information provided by the developers and other open source providers is key for me. The ability to share information and get answers directly is very important to success in software testing. And the price of this product currently is amazing. Too many companies charge way too much money for products that are far behind in their value and pertinence.
I would like to know what are the overall goals of the projects under review and the opportunity to emulate various user types and scenarios. A simple load test is extremely easy to build with this product and then can be adapted to any test case options needed as the project moves forward in the software development lifecycle.
I can jump right into a new test plan and start building from scratch. The natural progression from test plan to thread group and then designing the basic format of the process is very streamlined and smooth. With only slight modifications I can build out a very complex model from a very basic beginning.
Like to use
Easy to use
Technical support not required
Feel confident using
Slow to learn
- Configuration Elements are the backbone of the JMeter product. They are used to setup the parameters or variables that will be referenced throughout the testing process.
- Listeners are crucial in their broad range of roles. They can be used to view, save and compile for result data from the end of the testing efforts.
- Samplers are the workhorse of the JMeter product. They provide the test team with a great amount of flexibility when designing test cases and scenarios.
- Reports are more suited for the engineering department. If the test team wants to review results with the customer or development team they need to install third party products to make the results more user-friendly.