TrustRadius: an HG Insights company

blackfire.io vs. BlazeMeter vs. IBM Engineering Lifecycle Management

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    blackfire.io

    Score9 out of 10
    N/ABlackfire.io is designed to empower PHP developers to continuously verify and improve their app’s performance in development, testing, staging and production. It makes it possible to drill down to function/method call level to understand and fix performance bottlenecks. The vendor says its wide variety of automation options makes it a breeze to add it to a development and testing workflow. The Blackfire Player, an Open Source Web Crawling, Web Tester, and Web…N/A

    BlazeMeter

    Score8 out of 10
    N/AThe BlazeMeter Continuous Testing Platform is a unified, end-to-end, next-generation software test automation platform built for both Agile and COE teams, from Perforce. BlazeMeter includes complete continuous testing capabilities deeply integrated into a single, intuitive workflow.

    $199

    per month

    IBM Engineering Lifecycle Management

    Score5 out of 10
    N/AIBM Engineering Lifecycle Management (ELM) is an integrated suite for managing requirements, engineering work, system and software models, and verification activities across complex product-development programs. It is used by systems engineers, software teams, test organizations, project managers, and compliance teams in industries such as automotive, aerospace and defense, medical devices, and public infrastructure.N/A
    Pricing
    blackfire.ioBlazeMeterIBM Engineering Lifecycle Management
    Editions & Modules
    No answers on this topic
    Basic
    $149.00
    per month
    Pro
    $649.00
    per month
    No answers on this topic
    Offerings
    Pricing Offerings
    blackfire.ioBlazeMeterIBM Engineering Lifecycle Management
    Free Trial
    YesNoNo
    Free/Freemium Version
    YesYesNo
    Premium Consulting/Integration Services
    NoNoNo
    Entry-level Setup FeeOptionalNo setup feeNo setup fee
    Additional Details———
    More Pricing Information
    Community Pulse
    blackfire.ioBlazeMeterIBM Engineering Lifecycle Management
    Considered Multiple Products
    Blackfire
    No answer on this topic
    Perforce Software
    No answer on this topic
    IBM
    No answer on this topic
    Key User Insights
    Would buy again
    No answers on this topic
    No answers on this topic
    78%
    Would buy again
    7 Answers
    Delivers good value for the price
    No answers on this topic
    No answers on this topic
    88%
    Delivers good value for the price
    7 Answers
    Happy with the feature set
    No answers on this topic
    No answers on this topic
    89%
    Happy with the feature set
    8 Answers
    Lived up to sales and marketing promises
    No answers on this topic
    No answers on this topic
    100%
    Lived up to sales and marketing promises
    5 Answers
    Implementation went as expected
    No answers on this topic
    No answers on this topic
    86%
    Implementation went as expected
    6 Answers
    Features
    blackfire.ioBlazeMeterIBM Engineering Lifecycle Management
    Automation Testing
    Comparison of Automation Testing features of blackfire.io and BlazeMeter and IBM Engineering Lifecycle Management
    Feature
    blackfire.io
    -
    Ratings
    BlazeMeter
    9.0
    1 Ratings
    6% above category average
    IBM Engineering Lifecycle Management
    -
    Ratings
    CI/CD Tool Integration00 Ratings9.01 Ratings00 Ratings
    Integrated Version Control00 Ratings9.01 Ratings00 Ratings
    Data-Driven Testing00 Ratings9.01 Ratings00 Ratings
    Testing Collaboration00 Ratings9.01 Ratings00 Ratings
    Testing Reports & Analytics00 Ratings9.01 Ratings00 Ratings
    Best Alternatives
    blackfire.ioBlazeMeterIBM Engineering Lifecycle Management
    Small Businesses
    No answers on this topic
    BrowserStack
    Score8.5 out of 10
    Polarion ALM
    Score10 out of 10
    Medium-sized Companies
    No answers on this topic
    BrowserStack
    Score8.5 out of 10
    PTC Windchill RV&S
    Score2 out of 10
    Enterprises
    Tricentis NeoLoad
    Score8.2 out of 10
    Tricentis Tosca
    Score8.8 out of 10
    Polarion ALM
    Score10 out of 10
    All AlternativesView all alternativesView all alternativesView all alternatives
    User Ratings
    blackfire.ioBlazeMeterIBM Engineering Lifecycle Management
    Likelihood to Recommend
    9.0
    (2 ratings)
    9.0
    (5 ratings)
    3.0
    (22 ratings)
    Likelihood to Renew
    -
    (0 ratings)
    -
    (0 ratings)
    8.0
    (6 ratings)
    Usability
    -
    (0 ratings)
    -
    (0 ratings)
    4.0
    (5 ratings)
    Support Rating
    -
    (0 ratings)
    -
    (0 ratings)
    5.0
    (3 ratings)
    Implementation Rating
    -
    (0 ratings)
    -
    (0 ratings)
    10.0
    (1 ratings)
    User Testimonials
    blackfire.ioBlazeMeterIBM Engineering Lifecycle Management
    Likelihood to Recommend
    Blackfire
    Blackfire.io is super helpful in allowing proactive testing of applications before releasing on the production environment. Blackfire.io provides actionable insights to improve code proactively by integration with the development software. Also tracks the live production environment and is able to highlight any loading issues or unusual bounce rates. Blackfire.io also monitors HTTP requests and SQL queries which again help improve efficiency for developers and reduce development time.
    Incentivized
    Read full review
    Perforce Software
    It is well suited for applications that are mission-critical or applications that can receive high traffic/transactions at unscheduled time periods. Using the load testing feature of BlazeMeter, we can test and ascertain the capacity of the application without the drawbacks of the usual Apache JMeter load testing which depends heavily on the host system from where the load testing is performed.
    Incentivized
    Read full review
    IBM
    The software is robust enough to handle highly complex software development or other product development and can be used well beyond the range to do what a client needs. However, because of the inability to hold its users to proper best practices, things can get wildly out of hand and cascade over the years, creating unnecessary technical debt. The system has a lot of usable features, but they don't funnel users toward the correct processes and practices.
    Incentivized
    Read full review
    Pros
    Blackfire
    • Provide details on processes eating up valuable server resources
    • Alert against bottlenecks and find bottlenecks
    • Performs load tests in code before moving to production environments
    Incentivized
    Read full review
    Perforce Software
    • BlazeMeter takes the .jmx script that teams had written for JMeter. The transition from JMeter to BlazeMeter was seamless.
    • BlazeMeter offers its own cloud and hence we did not have to set it up on-premise.
    • BlazeMeter hits our application from various geographic locations that simulates real life users.
    Incentivized
    Read full review
    IBM
    • Open Services supporting Lifecycle Collaboration (OSLC).
    • Required definition management and managed capabilities enabling.
    • Rational DOORS Web Access for local on the test field presence.
    • On-sites established reporting system.
    • Approved linking requirements to test plans
    • Engineering Requirements Management DOORS traces requirements thereby eliminates manually processes and spreadsheets, for improved productivity.
    • Returns the investment efficiently.
    Incentivized
    Read full review
    Cons
    Blackfire
    • They count same API endpoint AND same method (e.g. POST, OPTIONS, GET etc) as different profiles
    • Customer service needs a lot of improvement
    • The documentation can be a bit more detailed to remove any scope of doubts
    Incentivized
    Read full review
    Perforce Software
    • Blazemeter reporting is very basic and shallow. There is no way to drill down or correlate. I can get better reports by using JMeter for free.
    • Blazemeter is very costly. Testing with volumes of more than 1K cu is expensive, and can be done for much cheaper if a company/team is willing to invest a bit of time to figure out how to use cloud instances and jmeter slaves, and to write a basic script to collect resulting xml output.
    Incentivized
    Read full review
    IBM
    • I feel like it is too heavy sometimes and updating is not very straight forward. For example, if I want to change an incident ticket (IN) to a service request (SR) and add some comment for the change, I have to first change the IN to SR, then click refresh which takes a few seconds, then add a comment. If I forget the refresh step, my comment will be discarded without warning like my ticket is not in the latest status. This also happens when somebody else changes the ticket during my edit as I can not lock the ticket exclusively.
    Incentivized
    Read full review
    Likelihood to Renew
    Blackfire
    No answers on this topic
    Perforce Software
    No answers on this topic
    IBM
    At the moment we are required by contract to continue to use the IBM DOORS software for our current client. Given that it can be expensive, if we were to use it after our current client's needs were met, we would have to secure other projects in order to justify the continued use of the software.
    Incentivized
    Read full review
    Usability
    Blackfire
    No answers on this topic
    Perforce Software
    Easy to setup to do API Performance Testing. Dashboard to showcase results Capability to showcase runtime results
    Incentivized
    Read full review
    IBM
    The UI is terrible and not intuitive. Users need training in order to complete tasks. Much like SAP, it's not the clearest tool. The tracing feature is especially complicated because you must write the scripts yourself. There is a learning curve. Also, even the setup, installation, and logging in each time takes a considerable amount of time.
    Incentivized
    Read full review
    Support Rating
    Blackfire
    No answers on this topic
    Perforce Software
    No answers on this topic
    IBM
    It does a basic job and has the potential to complete some robust reporting tasks, however, it really is a clunky piece of software with a terrible user interface that makes using it routinely quite unpleasant. Many of our legacy and maintenance projects still use DOORS but our department and company use many alternatives and are looking for better tools.
    Incentivized
    Read full review
    Implementation Rating
    Blackfire
    No answers on this topic
    Perforce Software
    No answers on this topic
    IBM
    No problems
    Incentivized
    Read full review
    Alternatives Considered
    Blackfire
    blackfire.io definitely provides an edge over competing products such as Datadog due to the level of monitoring and analysis it provides. Datadog is a great tool however when evaluating and catching inefficiencies in lower non production environments, blackfire.io provides a level of reporting that were did not find any competing products.
    Incentivized
    Read full review
    Perforce Software
    In comparison with Blazemeter the closes competitor is JMeter but it has disadvantages like it is not a tool that can be use as a collaborative tool and works locally in a computer, Blazemeter is in the web so different people can access and run tests or collaborate do add, edit or delete the existent scripts.
    Incentivized
    Read full review
    IBM
    It was easier to do all the change management-related activities, even configurations were handled very effectively. New process definitions and initiatives made it easier for better project deliverables. Effective resource allocations and better reporting and defect management. The overall cost of the tool is great too and well within budget.
    Incentivized
    Read full review
    Return on Investment
    Blackfire
    • Reduce in bugs by 50%, more happy customers
    • 2x decrease in load time for the website
    • 100% performance validation before production release
    Incentivized
    Read full review
    Perforce Software
    • It helped positively by helping to identify the maximum capacity needed for high traffic periods
    • Saved revenue by eliminating unwanted duplication of systems
    Incentivized
    Read full review
    IBM
    • It's part of CLM suite so it can be used to manage the whole lifecycle with tight integration with development module (Rational Team Concert) and quality module (Rational Quality Manager).
    • Comprehensive reports and dashboards provide better visibility.
    • License cost is on higher side.
    Incentivized
    Read full review
    ScreenShots