What users are saying about
105 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.3 out of 101
22 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 7.2 out of 101

Likelihood to Recommend

JMeter

The key questions I would pose are: how high of a concurrent load do you need to generate against the system? How technically skilled are your personnel that will perform the load testing? How much programmable/scripting/code based control do you desire from the tool? Do you prefer more of a GUI based tool or a programmatic code/scripting based tool? JMeter will be for those that want a GUI, moderate to low scripting/code based control/programmability, moderate to low load generation, and for users experienced in the novice to expert range.
David Luu profile photo

Visual Studio Test Professional

Test Professional will work better if the software has been tested on a Windows desktop or Internet Explorer. If you have Microsoft TFS, the reasons to use Test Professional are to record test sessions, automate tests and reduce the cost of QA team Visual Studio licenses.
No photo available

Feature Rating Comparison

Load Testing

JMeter
7.5
Visual Studio Test Professional
End to end performance management
JMeter
7.7
Visual Studio Test Professional
Integrated performance data
JMeter
7.3
Visual Studio Test Professional
Deployment model flexibility
JMeter
7.2
Visual Studio Test Professional
Real time monitoring
JMeter
8.5
Visual Studio Test Professional
Automated anomaly detection
JMeter
6.7
Visual Studio Test Professional

Pros

JMeter

  • Jmeter scripts are good to be used for load and soak tests. This helps in analysing response times and throughput. For example for a particular application it would give response time for each transaction you perform like login, submitting information etc.
  • Jmeter has elements like listeners which helps us visualize results and helps us compare them. This helps in analyzing the results faster. For example to compare response times of different transactions
  • Jmeter is flexible and can be used to test any applications apart from Java. For example I tried to prepare scripts for SOAP and web service.
Ameeta Muralidharan profile photo

Visual Studio Test Professional

  • Creation and handling of test plans and test cases.
  • Full integration with Microsoft Team Foundation Server, including Agile or Scrum templates.
  • Recording and automation of tests in Internet Explorer or Windows desktop environments.
No photo available

Cons

JMeter

  • Jmeter requires many tweaks with respect to its configuration file and thread properties. users need to edit theses files themselves. There could be some interface where we can edit this fields.
  • Jmeter cannot handle more threads and hangs up when we increase the number of threads. This causes lot of inconvenience. In these situations, user can be notified that such change would be lead to slow performance so that user can do as required. The same appears when we try to view huge files on graph listener.
  • Jmeter should optimize the read and write access to output csv since it acts as overhead to the I/O performance. This affects our test results for the application which we are testing.
Ameeta Muralidharan profile photo

Visual Studio Test Professional

  • Test Manager became outdated and can be fully substituted by Microsoft TFS features most of the time.
No photo available

Likelihood to Renew

JMeter

JMeter 8.6
Based on 12 answers
Price, Wiki and user sharing. Having access to the information provided by the developers and other open source providers is key for me. The ability to share information and get answers directly is very important to success in software testing. And the price of this product currently is amazing. Too many companies charge way too much money for products that are far behind in their value and pertinence
Charlie Harris profile photo

Visual Studio Test Professional

No score
No answers yet
No answers on this topic

Usability

JMeter

JMeter 9.0
Based on 1 answer
I can jump right into a new test plan and start building from scratch. The natural progression from test plan to thread group and then designing the basic format of the process is very streamlined and smooth. With only slight modifications I can build out a very complex model from a very basic beginning.
Charlie Harris profile photo

Visual Studio Test Professional

No score
No answers yet
No answers on this topic

Alternatives Considered

JMeter

Jmeter is better for projecting a path to look into. Crystal only allows you to pull the specific data and display a set of data that you request. Jmeter allows you to feel out the direction the data is going as you go. Crystal also can have issues with graphing data correctly
No photo available

Visual Studio Test Professional

Visual Studio IDE has a lot of test functions to developers. The Enterprise Version allows installation of full test manager features. It is best if you have a Microsoft Enterprise Agreement. Visual Studio Team System or Microsoft TFS incorporate a lot of test management features in the web solution. Then the only reason to use Test Professional is if you need to record and automate tests.
No photo available

Return on Investment

JMeter

  • It being an open source solution for performance testing, the ROI is very good. You can build your tests very fast and start seeing the benefits very early.
No photo available

Visual Studio Test Professional

  • It contributes to budget reduction due to the use of less expensive licenses for QA team.
  • Using automation it contributes to reducing the time to market and the quality of the outcomes through regression tests.
No photo available

Pricing Details

JMeter

General

Free Trial
Free/Freemium Version
Yes
Premium Consulting/Integration Services
Entry-level set up fee?
No

Visual Studio Test Professional

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Add comparison