Apache JMeter vs. Polarion ALM

JMeter is well suited for Java applications where the user can script the scenario once and make changes to accommodate for as many numbers of users for load test execution. The image and selection of any files or exporting files scenario is handled well.

It is less appropriate to test Ajax applications where it is required to script click per use.

Incentivized

The question is actually not trivial to answer in 200 words. To summarize, I can say that we have had consistently positive experiences with all customers where we have used Polarion ALM. The sector in which the customer operates only played a subordinate role. We use Polarion ALM in almost all sectors: Medical technology, pharmaceuticals, aerospace, agriculture, automotive and many others. It is also interesting to note that in the beginning we were mostly active in the development of products, systems or software. Over time, this has changed more and more for some customers and risk management or projects for lessons learned have taken up more space. This enabled us to banish a seemingly endless number of Excel lists. Who doesn't know this problem: at first there is only one Excel list on the drive. Day by day there are more. Some with a date in the file name. Others with an employee abbreviation. In the end, nobody can tell which is the current and complete list. The really good thing about Polarion ALM is that it is extremely flexible to use and the configuration determines what the project is used for in Polarion ALM. It is customizable to my situation and not rigid.

• Easy of use - in generate load like HTTP requests, and processing/analyzing the responses. No coding is necessary at the basic level, just need to understand load testing and the infrastructure being tested.
• Automatic management of things like cookies to help with session state support - so you don't specifically have to worry about it or handle it
• Lots of testing/configuration options to suit your needs in making the right load generation (sampling requests), and analyzing the results, including any pre and post processing of the results first. Things like the Beanshell/BSF pre/post processors, response assertion, regular expression extractor, XPath extractor, CSV data set config
• There is a JMeter cloud service called BlazeMeter that I think would be useful for those that need to scale up high load without provisioning their own systems. I've not personally tried it though, but I recently attended a meetup presentation that highlighted nice useful features that BlazeMeter provides. One should evaluate the service if they are considering JMeter and need to expand beyond existing hardware resources.

• Requirements Management:
• Polarion ALM provides a centralized repository for capturing and managing requirements. Teams can define, organize, and link requirements to other artifacts like test cases and development tasks.
• Test Management:
• Polarion ALM facilitates end-to-end test management. Teams can create detailed test cases, manage test execution, and track test results.
• Traceability and Impact Analysis:
• Polarion ALM ensures traceability across all phases of the development lifecycle. Users can establish links between requirements, test cases, development tasks, and other artifacts. This traceability helps in impact analysis, allowing teams to understand how changes in one area may affect other parts of the project.
• Customization and Adaptability:
• Polarion ALM is highly customizable to fit the unique needs of different organizations and industries. Users can create custom workflows, define custom fields, and adapt the tool to their specific development processes.

• Jmeter requires many tweaks with respect to its configuration file and thread properties. users need to edit theses files themselves. There could be some interface where we can edit this fields.
• Jmeter cannot handle more threads and hangs up when we increase the number of threads. This causes lot of inconvenience. In these situations, user can be notified that such change would be lead to slow performance so that user can do as required. The same appears when we try to view huge files on graph listener.
• Jmeter should optimize the read and write access to output csv since it acts as overhead to the I/O performance. This affects our test results for the application which we are testing.

• More robust engine as far as the actual took is concerned. There are navigation components in trace to reporting which we feel can be improved especially when dealing with cross global accessing of the tool. It slows us down a bit so it's backend driven optimization as well as some front end "clunkiness" that can be improved.
• Improve some filtering capabilities especially in creating custom reports and generally all around the ALM components of the tool.
• As of the version we have, the ability to enhance replationship types in traceability is limited.

Incentivized

Price, Wiki and user sharing. Having access to the information provided by the developers and other open source providers is key for me. The ability to share information and get answers directly is very important to success in software testing. And the price of this product currently is amazing. Too many companies charge way too much money for products that are far behind in their value and pertinence

There is too much at stake to go into a new system. But with everything else being promised as far as newer more innovative products, the justification to not renew is a huge risk so that is not a concern

Incentivized

I can jump right into a new test plan and start building from scratch. The natural progression from test plan to thread group and then designing the basic format of the process is very streamlined and smooth. With only slight modifications I can build out a very complex model from a very basic beginning.

Polarion ALM can be used individually and what I do with Polarion ALM is decided by my configuration. Lesson-learned, operational risk management, product, system or software development or customer management .... doesn't matter at all. I decide with my configuration what I will do with Polarion ALM. Of course, you can also use Polarion ALM out-of-the-box for your development because it comes with a large set of project templates.For this reason, I would also recommend not to just get started. A suitable consultant will show you the right templates and customize them according to your needs. Having Polarion ALM is like having a car. You know exactly how to operate the car. You've done it a thousand times before. The details are in the configuration: did I have a navigation system installed or not? Do I have a lane departure warning system or not? Do I have cruise control or not? Unlike when buying a vehicle, almost all functions are already available and can be used, usually at no extra cost. However, if something is missing, it can be obtained via the manufacturer's extension portal. Individual extensions are subject to a charge. Polarion ALM - easy to deploy and easy to use.

update, reindex takes to long

Incentivized

I have been using JMeter for the last year. By using this tool, you can make sure the system will work under varied loads. It helps us to simulate real time scenarios by creating required virtual users and make sure the application will work under load. Perform load, stress, and stability testing using JMeter.

Incentivized

Support for customers using the full range of Polarion could be better.

Incentivized

competent trainer, good training project

Incentivized

easy to follow, efficent

Incentivized

Automated install and backup procedure ist missing

Incentivized

I have used LoadRunner and Silkperformer, and so far Jmeter turns out be the easiest to use of all these. While each of them have their own ROI, Jmeter can be picked by anyone in hours and start testing within a day. While with other tools, we need to get license, install them (takes a while) and setup tests and firewalls, etc.

Polarion ALM has the best usability, extensibility and reactiv product management. The support is also very good compared to other companies. Or in other words it is closer to the customer. Codebeamer is for sure also a good ALM tool with a great feature set, but existing customers are often neglected. We will see, what PTC as the new owner of codebeamer will change at this point.

should be more flexible

Incentivized

• Good ROI on improving the performance of the application.
• Finding issues in the performance.
• Benchmark the performance results.
• CON: Need skillset to create and maintain the scripts in Java.
• Scripts are reusable and it is executed by any user.
• Need Client and Server setup to execute the scripts.

Incentivized

• Many of our customers have achieved things that they could not have done without Polarion
• Possibility to make engineering enjoyable and not so documentation oriented (especially in regulated industries)
• Automatic and all the time up-to-date reporting gives savings in time
• Information reuse is typically giving benefits in resource use and time-to-market. Up to 40% reduction in time-to-market seen.
• 10-20% reduction in R&D cost is typically achievable

Incentivized