TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    BlazeMeter

    Score8 out of 10
    N/AThe BlazeMeter Continuous Testing Platform is a unified, end-to-end, next-generation software test automation platform built for both Agile and COE teams, from Perforce. BlazeMeter includes complete continuous testing capabilities deeply integrated into a single, intuitive workflow.

    $199

    per month

    SpecFlow

    Score10 out of 10
    N/ASpecFlow is an open source BDD for .NET. that aims to bridge the communication gap between domain experts and developers by binding readable behavior specifications to the underlying implementation.N/A
    Pricing
    BlazeMeterSpecFlow
    Editions & Modules
    Basic
    $149.00
    per month
    Pro
    $649.00
    per month
    No answers on this topic
    Offerings
    Pricing Offerings
    BlazeMeterSpecFlow
    Free Trial
    NoNo
    Free/Freemium Version
    YesNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Features
    BlazeMeterSpecFlow
    Automation Testing
    Comparison of Automation Testing features of BlazeMeter and SpecFlow
    Feature
    BlazeMeter
    9.0
    1 Ratings
    6% above category average
    SpecFlow
    -
    Ratings
    CI/CD Tool Integration9.01 Ratings00 Ratings
    Integrated Version Control9.01 Ratings00 Ratings
    Data-Driven Testing9.01 Ratings00 Ratings
    Testing Collaboration9.01 Ratings00 Ratings
    Testing Reports & Analytics9.01 Ratings00 Ratings
    Best Alternatives
    BlazeMeterSpecFlow
    Small Businesses
    BrowserStack
    Score8.5 out of 10
    BrowserStack
    Score8.5 out of 10
    Medium-sized Companies
    BrowserStack
    Score8.5 out of 10
    BlazeMeter
    Score8 out of 10
    Enterprises
    Tricentis Tosca
    Score8.8 out of 10
    Tricentis Tosca
    Score8.8 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    BlazeMeterSpecFlow
    Likelihood to Recommend
    9.0
    (5 ratings)
    9.0
    (1 ratings)
    User Testimonials
    BlazeMeterSpecFlow
    Likelihood to Recommend
    Perforce Software
    It is well suited for applications that are mission-critical or applications that can receive high traffic/transactions at unscheduled time periods. Using the load testing feature of BlazeMeter, we can test and ascertain the capacity of the application without the drawbacks of the usual Apache JMeter load testing which depends heavily on the host system from where the load testing is performed.
    Incentivized
    Read full review
    Open Source
    It is best suited for implementing the automated test cases in a human readable form so it's easy for non-technical members of the team and stakeholders to understand the test cases, features and the functionalities of the application. Automation of Integration tests and End to End tests are good use case. It is less appropriate or situations where the focus is only on the writing and maintenance of unit tests.
    Incentivized
    Read full review
    Pros
    Perforce Software
    • BlazeMeter takes the .jmx script that teams had written for JMeter. The transition from JMeter to BlazeMeter was seamless.
    • BlazeMeter offers its own cloud and hence we did not have to set it up on-premise.
    • BlazeMeter hits our application from various geographic locations that simulates real life users.
    Incentivized
    Read full review
    Open Source
    • Versatility to be used in combination with different kinds of automated testing like automated performance testing, API testing, UI testing etc. I use JavaScript, Selenium, C#, email testing libraries, database testing libraries in combination with BDD with SpecFlow. I am able to use all these with SpecFlow to make my automation framework to be able to automate any kind of automated testing.
    • It provides different widely used runner options like NUnit, XUnit etc. Before I started to work on establishing proper test automation in my workplace, the previous automation framework (non-BDD based) as well as unit tests used NUnit runner. The transition to using BDD was smooth because we could use the same runner and there were no compatibility issues.
    • The auto-complete feature is good. I use it with Visual Studio as well as Rider and I don't have to recall the entire Gherkin statements. I just type a few words and the entire Gherkin statement implemented in framework is auto-suggested by SpecFlow. It saves time and context switching.
    Incentivized
    Read full review
    Cons
    Perforce Software
    • Blazemeter reporting is very basic and shallow. There is no way to drill down or correlate. I can get better reports by using JMeter for free.
    • Blazemeter is very costly. Testing with volumes of more than 1K cu is expensive, and can be done for much cheaper if a company/team is willing to invest a bit of time to figure out how to use cloud instances and jmeter slaves, and to write a basic script to collect resulting xml output.
    Incentivized
    Read full review
    Open Source
    • SpecFlow does not accepts optional input variables in the methods defined during Gherkin statement implementation. Cucumber supports optional input variables in the methods defined during Gherkin statement implementation.
    • The tests identified while using SpecFlow with NUnit removes all white spaces in the scenario names. It makes the tests less readable. If the white spaces are not auto-removed, it would be much better for readability as well as their actual identification in the repository.
    Incentivized
    Read full review
    Usability
    Perforce Software
    Easy to setup to do API Performance Testing. Dashboard to showcase results Capability to showcase runtime results
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Alternatives Considered
    Perforce Software
    In comparison with Blazemeter the closes competitor is JMeter but it has disadvantages like it is not a tool that can be use as a collaborative tool and works locally in a computer, Blazemeter is in the web so different people can access and run tests or collaborate do add, edit or delete the existent scripts.
    Incentivized
    Read full review
    Open Source
    SpecFlow is .Net based which supports C#. Behave is Python based. Cucumber is Java based. Ghost Inspector is no-code based but provides very limited testing features. We wanted to implement BDD so we rued out using Ghost Inspector. Most of the developers in my team are C# experts so it was decided for everyone's comfort to go for SpecFlow rather than Behave or Cucumber. It's import to have technical experts in the language of the automation framework because there are many situations where the solutions to the test automation needs are not straightforward and implementing those requires expertise in the related programming language.
    Incentivized
    Read full review
    Return on Investment
    Perforce Software
    • It helped positively by helping to identify the maximum capacity needed for high traffic periods
    • Saved revenue by eliminating unwanted duplication of systems
    Incentivized
    Read full review
    Open Source
    • Everyone stays on the same page regarding the behavior of existing functionalities whether it be technical or non-technical individuals. So there is less need for multiple people to get involved which saves time and thus money.
    • Reusing the same code through the implemented Gherkin statement saves test automation time and thus reduces cost.
    • We combine SpecFlow with other opensource testing technologies to make our automation framework more versatile which further saves costs for us.
    Incentivized
    Read full review
    ScreenShots