TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    JMeter

    Score8.3 out of 10
    N/AJMeter, from Apache, is a load and performance testing tool.

    $0

    blackfire.io

    Score9 out of 10
    N/ABlackfire.io is designed to empower PHP developers to continuously verify and improve their app’s performance in development, testing, staging and production. It makes it possible to drill down to function/method call level to understand and fix performance bottlenecks. The vendor says its wide variety of automation options makes it a breeze to add it to a development and testing workflow. The Blackfire Player, an Open Source Web Crawling, Web Tester, and Web…N/A
    Pricing
    JMeterblackfire.io
    Editions & Modules
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    JMeterblackfire.io
    Free Trial
    NoYes
    Free/Freemium Version
    YesYes
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeOptional
    Additional Details——
    More Pricing Information
    Community Pulse
    JMeterblackfire.io
    Considered Both Products
    Apache
    No answer on this topic
    Blackfire
    No answer on this topic
    Key User Insights
    Would buy again
    100%
    Would buy again
    8 Answers
    No answers on this topic
    Delivers good value for the price
    100%
    Delivers good value for the price
    8 Answers
    No answers on this topic
    Happy with the feature set
    100%
    Happy with the feature set
    8 Answers
    No answers on this topic
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    7 Answers
    No answers on this topic
    Implementation went as expected
    100%
    Implementation went as expected
    8 Answers
    No answers on this topic
    Features
    JMeterblackfire.io
    Load Testing
    Comparison of Load Testing features of Apache JMeter and blackfire.io
    Feature
    Apache JMeter
    7.2
    24 Ratings
    17% below category average
    blackfire.io
    -
    Ratings
    End to end performance management9.021 Ratings00 Ratings
    Integrated performance data8.522 Ratings00 Ratings
    Deployment model flexibility7.521 Ratings00 Ratings
    Real time monitoring6.521 Ratings00 Ratings
    Automated anomaly detection4.417 Ratings00 Ratings
    Best Alternatives
    JMeterblackfire.io
    Small Businesses
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    No answers on this topic
    No answers on this topic
    Enterprises
    LoadRunner Professional
    Score8.5 out of 10
    Tricentis NeoLoad
    Score8.2 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    JMeterblackfire.io
    Likelihood to Recommend
    8.5
    (39 ratings)
    9.0
    (2 ratings)
    Likelihood to Renew
    8.6
    (12 ratings)
    -
    (0 ratings)
    Usability
    6.5
    (3 ratings)
    -
    (0 ratings)
    Availability
    1.0
    (1 ratings)
    -
    (0 ratings)
    Performance
    8.0
    (1 ratings)
    -
    (0 ratings)
    Support Rating
    10.0
    (1 ratings)
    -
    (0 ratings)
    Online Training
    1.0
    (1 ratings)
    -
    (0 ratings)
    User Testimonials
    JMeterblackfire.io
    Likelihood to Recommend
    Apache
    JMeter is well suited for Java applications where the user can script the scenario once and make changes to accommodate for as many numbers of users for load test execution. The image and selection of any files or exporting files scenario is handled well.
    It is less appropriate to test Ajax applications where it is required to script click per use.
    Incentivized
    Read full review
    Blackfire
    Blackfire.io is super helpful in allowing proactive testing of applications before releasing on the production environment. Blackfire.io provides actionable insights to improve code proactively by integration with the development software. Also tracks the live production environment and is able to highlight any loading issues or unusual bounce rates. Blackfire.io also monitors HTTP requests and SQL queries which again help improve efficiency for developers and reduce development time.
    Incentivized
    Read full review
    Pros
    Apache
    • Easy of use - in generate load like HTTP requests, and processing/analyzing the responses. No coding is necessary at the basic level, just need to understand load testing and the infrastructure being tested.
    • Automatic management of things like cookies to help with session state support - so you don't specifically have to worry about it or handle it
    • Lots of testing/configuration options to suit your needs in making the right load generation (sampling requests), and analyzing the results, including any pre and post processing of the results first. Things like the Beanshell/BSF pre/post processors, response assertion, regular expression extractor, XPath extractor, CSV data set config
    • There is a JMeter cloud service called BlazeMeter that I think would be useful for those that need to scale up high load without provisioning their own systems. I've not personally tried it though, but I recently attended a meetup presentation that highlighted nice useful features that BlazeMeter provides. One should evaluate the service if they are considering JMeter and need to expand beyond existing hardware resources.
    Read full review
    Blackfire
    • Provide details on processes eating up valuable server resources
    • Alert against bottlenecks and find bottlenecks
    • Performs load tests in code before moving to production environments
    Incentivized
    Read full review
    Cons
    Apache
    • Jmeter requires many tweaks with respect to its configuration file and thread properties. users need to edit theses files themselves. There could be some interface where we can edit this fields.
    • Jmeter cannot handle more threads and hangs up when we increase the number of threads. This causes lot of inconvenience. In these situations, user can be notified that such change would be lead to slow performance so that user can do as required. The same appears when we try to view huge files on graph listener.
    • Jmeter should optimize the read and write access to output csv since it acts as overhead to the I/O performance. This affects our test results for the application which we are testing.
    Read full review
    Blackfire
    • They count same API endpoint AND same method (e.g. POST, OPTIONS, GET etc) as different profiles
    • Customer service needs a lot of improvement
    • The documentation can be a bit more detailed to remove any scope of doubts
    Incentivized
    Read full review
    Likelihood to Renew
    Apache
    Price, Wiki and user sharing. Having access to the information provided by the developers and other open source providers is key for me. The ability to share information and get answers directly is very important to success in software testing. And the price of this product currently is amazing. Too many companies charge way too much money for products that are far behind in their value and pertinence
    Read full review
    Blackfire
    No answers on this topic
    Usability
    Apache
    The purpose related to performance and load testing through Apache JMeter works fine but the usability of the tool should be improved quite a lot. If someone starts with the Jmeter fresh without prior experience, they need to put more efforts in understanding the tool. The UI is not that great which is the main reason not to give high rating on usability.
    Incentivized
    Read full review
    Blackfire
    No answers on this topic
    Support Rating
    Apache
    I have been using JMeter for the last year. By using this tool, you can make sure the system will work under varied loads. It helps us to simulate real time scenarios by creating required virtual users and make sure the application will work under load. Perform load, stress, and stability testing using JMeter.
    Incentivized
    Read full review
    Blackfire
    No answers on this topic
    Alternatives Considered
    Apache
    I have used LoadRunner and Silkperformer, and so far Jmeter turns out be the easiest to use of all these. While each of them have their own ROI, Jmeter can be picked by anyone in hours and start testing within a day. While with other tools, we need to get license, install them (takes a while) and setup tests and firewalls, etc.
    Read full review
    Blackfire
    blackfire.io definitely provides an edge over competing products such as Datadog due to the level of monitoring and analysis it provides. Datadog is a great tool however when evaluating and catching inefficiencies in lower non production environments, blackfire.io provides a level of reporting that were did not find any competing products.
    Incentivized
    Read full review
    Return on Investment
    Apache
    • Good ROI on improving the performance of the application.
    • Finding issues in the performance.
    • Benchmark the performance results.
    • CON: Need skillset to create and maintain the scripts in Java.
    • Scripts are reusable and it is executed by any user.
    • Need Client and Server setup to execute the scripts.
    Incentivized
    Read full review
    Blackfire
    • Reduce in bugs by 50%, more happy customers
    • 2x decrease in load time for the website
    • 100% performance validation before production release
    Incentivized
    Read full review
    ScreenShots