Overall Satisfaction with JMeter
We used JMeter to execute performance tests on our web services. The main business purpose was to assure that changes did not affect web service performance.
- JMeter allows direct interaction with services bypassing the UI which is a main pain point when testing backend systems.
- JMeter has an easy to follow record/enhance/replay mechanism that help create powerful tests in very little time.
- I like the parameterization approach in JMeter as I can better replicate real world scenarios by introducing parameters and randomisation into my tests
- I would like to see a real executable of JMeter instead of using a JAR file. Some companies I worked for had very strict security policies that made it difficult to run JMeter remotely.
- Being a free tool JMeter provided only positive outcomes once we decided to use it. We were able to discontinue our LoadRunner license which was costing us thousands a year and achieve the same level or test coverage in very short period of time.
LoadRunner and Silk Test were the tools I used in the past to compare with JMeter. I thought LoadRunner had a more commercial appearance and it comes with HP support from your service provider. It also comes at a steep price. JMeter and LoadRunner have a similar learning curve for someone new to performance testing but once you familiarize with the basics it is no less convenient as any other commercial tool. It is faster to operate and doesn't require lengthy build process unlike other tools. At first I found that using C language provides more flexibility but with time found that I can achieve the same level with JMeter. In fact I think that the way parameterization was implemented in JMeter is the best so far out of all the tools I used. Overall JMeter is a great tool that challenges the competition on all usability levels and definitely beats paid tools in price.
It is free and easy to use. It is very well suited for both functional and performance testing of web services. Very powerful test suites can be generated in little time and executions are easy to set up. Direct integration with Blazemeter is very helpful when you are ready to scale testing. Execution reports are also very informative and easy to process. JMeter is not the a good tool for testing that involves UI interactions.