What users are saying about
113 Ratings
124 Ratings
113 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.5 out of 100
124 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.6 out of 100

Likelihood to Recommend

JMeter

JMeter is well suited for Java applications where the user can script the scenario once and make changes to accommodate for as many numbers of users for load test execution. The image and selection of any files or exporting files scenario is handled well.
It is less appropriate to test Ajax applications where it is required to script click per use.
Anonymous | TrustRadius Reviewer

SoapUI Pro

SopaUI is the best choice when it comes to testing complicated combination of web services such as RESTful, SOAP, JSON and AMF. Although It can also cover simple HTML GUI test cases by calling web page elements as a recorded order, but it is not a good choice for testing user interfaces or as a replacement to Selenium.
Payam Pirooznia | TrustRadius Reviewer

Feature Rating Comparison

Load Testing

JMeter
8.3
SoapUI Pro
End to end performance management
JMeter
8.8
SoapUI Pro
Integrated performance data
JMeter
8.8
SoapUI Pro
Deployment model flexibility
JMeter
8.7
SoapUI Pro
Real time monitoring
JMeter
8.3
SoapUI Pro
Automated anomaly detection
JMeter
7.0
SoapUI Pro

Pros

JMeter

  • Easy of use - in generate load like HTTP requests, and processing/analyzing the responses. No coding is necessary at the basic level, just need to understand load testing and the infrastructure being tested.
  • Automatic management of things like cookies to help with session state support - so you don't specifically have to worry about it or handle it
  • Lots of testing/configuration options to suit your needs in making the right load generation (sampling requests), and analyzing the results, including any pre and post processing of the results first. Things like the Beanshell/BSF pre/post processors, response assertion, regular expression extractor, XPath extractor, CSV data set config
  • There is a JMeter cloud service called BlazeMeter that I think would be useful for those that need to scale up high load without provisioning their own systems. I've not personally tried it though, but I recently attended a meetup presentation that highlighted nice useful features that BlazeMeter provides. One should evaluate the service if they are considering JMeter and need to expand beyond existing hardware resources.
David Luu | TrustRadius Reviewer

SoapUI Pro

  • Ease of use and setup, particularly with SOAP services where you have the WSDL. Import and go. If your WSDL changes you can update the definition or refactor it, which is a life saver.
  • Decent GUI - I feel the GUI is well thought out in most areas.
  • Scripting and Plugins - Allows setting of a script repository (Pro). In general, you can script in Groovy or JavaScript throughout a project. We use Groovy and haven't run into anything we haven't been able to find a solution to through scripting. For plugins, we've written some custom ones in Java to add menu items. To use them you just have to drop the jar file in a specific directory.
  • Community - The community via blogs and forums is great. If you run into issues you can normally find someone else who had a similar problem. The response on the forums from SmartBear is also good. They also recently added an 'API Dojo' which is very informational.
Natalie Colyer | TrustRadius Reviewer

Cons

JMeter

  • Jmeter requires many tweaks with respect to its configuration file and thread properties. users need to edit theses files themselves. There could be some interface where we can edit this fields.
  • Jmeter cannot handle more threads and hangs up when we increase the number of threads. This causes lot of inconvenience. In these situations, user can be notified that such change would be lead to slow performance so that user can do as required. The same appears when we try to view huge files on graph listener.
  • Jmeter should optimize the read and write access to output csv since it acts as overhead to the I/O performance. This affects our test results for the application which we are testing.
Ameeta Muralidharan | TrustRadius Reviewer

SoapUI Pro

  • Recently the tool has become heavy since it has integrated virtualization features. Unless provided enough heap space, the tool sometimes can crash during the execution.
  • History of test execution is forgotten as new payload is executed in the same step. Will be useful to keep the history for reuse purposes.
Sachin Gulmadagkar | TrustRadius Reviewer

Likelihood to Renew

JMeter

JMeter 8.6
Based on 12 answers
Price, Wiki and user sharing. Having access to the information provided by the developers and other open source providers is key for me. The ability to share information and get answers directly is very important to success in software testing. And the price of this product currently is amazing. Too many companies charge way too much money for products that are far behind in their value and pertinence
Charlie Harris | TrustRadius Reviewer

SoapUI Pro

SoapUI Pro 9.2
Based on 16 answers
Invested in 1000 of hours reusable test script and modules, and it still seems to be growing. Not to mention that even without that consideration, it would still be the choice for the type of testing SoapUI provides. It is in investment that was wisely made, and requires us to stay the course.
Christopher Saleh | TrustRadius Reviewer

Usability

JMeter

JMeter 9.0
Based on 1 answer
I can jump right into a new test plan and start building from scratch. The natural progression from test plan to thread group and then designing the basic format of the process is very streamlined and smooth. With only slight modifications I can build out a very complex model from a very basic beginning.
Charlie Harris | TrustRadius Reviewer

SoapUI Pro

SoapUI Pro 9.9
Based on 3 answers
SoapUI allows us to combine multiple tests and adhere
to the sequence that they need to run in order to complete successfully.
It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing
Christopher Saleh | TrustRadius Reviewer

Reliability and Availability

JMeter

JMeter 1.0
Based on 1 answer
No answer on this topic is available.

SoapUI Pro

SoapUI Pro 9.0
Based on 1 answer
Soap UI has managed to continuously build on it's solid foundation and keep improving by each release. It is by far the most dependable and accurate testing tool out there of its kind. Available via connecting to VM's created as SoapUI test machines give access to it anytime, anywhere practically.
Christopher Saleh | TrustRadius Reviewer

Performance

JMeter

JMeter 8.0
Based on 1 answer
No answer on this topic is available.

SoapUI Pro

SoapUI Pro 8.0
Based on 1 answer
It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing.
Christopher Saleh | TrustRadius Reviewer

Support Rating

JMeter

JMeter 9.5
Based on 2 answers
I have been using JMeter for the last year. By using this tool, you can make sure the system will work under varied loads. It helps us to simulate real time scenarios by creating required virtual users and make sure the application will work under load. Perform load, stress, and stability testing using JMeter.
Anonymous | TrustRadius Reviewer

SoapUI Pro

SoapUI Pro 7.4
Based on 14 answers
For my purposes, the provided help features have been sufficient. I am sure I would be better off if I were to spend more time studying the app. For now, I load a project, connect, and execute. It just works.
Anonymous | TrustRadius Reviewer

Implementation Rating

JMeter

No score
No answers yet
No answers on this topic

SoapUI Pro

SoapUI Pro 7.0
Based on 2 answers
no very easy but lacks documentation
Anonymous | TrustRadius Reviewer

Alternatives Considered

JMeter

I have used LoadRunner and Silkperformer, and so far Jmeter turns out be the easiest to use of all these. While each of them have their own ROI, Jmeter can be picked by anyone in hours and start testing within a day. While with other tools, we need to get license, install them (takes a while) and setup tests and firewalls, etc.
Anonymous | TrustRadius Reviewer

SoapUI Pro

Our team did an extensive analysis of the products that were available to carry out API Testing. There were 3 products that were finalized, SoapUI Pro, Postman, and Katalon Studio, out of these 3 SoapUI was the clear winner. I can't stress enough about the SoapUI's UI interface, very clean. SoapUI Pro enabled us to reuse our test scripts over multiple environments. Enabled us with data-driven testing.
Anonymous | TrustRadius Reviewer

Scalability

JMeter

No score
No answers yet
No answers on this topic

SoapUI Pro

SoapUI Pro 7.0
Based on 1 answer
It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing. However, I have read that added monitoring tools have been added, which if so the 7 could possibly go to a 8 or 9.
Christopher Saleh | TrustRadius Reviewer

Return on Investment

JMeter

  • Gives liberty to developers and testers to perform testing. Easy to set up and run load tests, stress tests has improved testing.
  • Enhances the performance testing which ensures the delivery of well-suited applications.
  • The Enterprise messaging system, it's a great tool which helps in testing JMS based messages.
Anonymous | TrustRadius Reviewer

SoapUI Pro

  • Positive impact: It has made our webservice automation faster and more reliable than manual webservice testing. ROI has definitely increased in recent months.
  • Negative Impact: You need trained resources in order to implement the complete solution. Sometimes it's difficult to find trained sources.
Binoy Shah | TrustRadius Reviewer

Pricing Details

JMeter

General

Free Trial
Free/Freemium Version
Yes
Premium Consulting/Integration Services
Entry-level set up fee?
No

SoapUI Pro

General

Free Trial
Yes
Free/Freemium Version
Yes
Premium Consulting/Integration Services
Entry-level set up fee?
No

Rating Summary

Likelihood to Recommend

JMeter
9.1
SoapUI Pro
8.5

Likelihood to Renew

JMeter
8.6
SoapUI Pro
9.2

Usability

JMeter
9.0
SoapUI Pro
9.9

Reliability and Availability

JMeter
1.0
SoapUI Pro
9.0

Performance

JMeter
8.0
SoapUI Pro
8.0

Support Rating

JMeter
9.5
SoapUI Pro
7.4

Online Training

JMeter
1.0
SoapUI Pro

Implementation Rating

JMeter
SoapUI Pro
7.0

Scalability

JMeter
SoapUI Pro
7.0

Add comparison