TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    ReadyAPI

    Score6.1 out of 10
    N/AReadyAPI (formerly SoapUI Pro, LoadUI Pro, and ServiceV Pro) is a REST and SOAP API functional testing tool that enables software developers, QA engineers, and manual testers to work together to create, maintain, and execute complex end-to-end API tests in their CI/CD pipelines without needing to code.N/A

    SpecFlow

    Score10 out of 10
    N/ASpecFlow is an open source BDD for .NET. that aims to bridge the communication gap between domain experts and developers by binding readable behavior specifications to the underlying implementation.N/A
    Pricing
    ReadyAPISpecFlow
    Editions & Modules
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    ReadyAPISpecFlow
    Free Trial
    YesNo
    Free/Freemium Version
    YesNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    ReadyAPISpecFlow
    Considered Both Products
    SmartBear
    No answer on this topic
    Open Source
    No answer on this topic
    Key User Insights
    Would buy again
    93%
    Would buy again
    28 Answers
    No answers on this topic
    Delivers good value for the price
    89%
    Delivers good value for the price
    24 Answers
    No answers on this topic
    Happy with the feature set
    97%
    Happy with the feature set
    29 Answers
    No answers on this topic
    Lived up to sales and marketing promises
    94%
    Lived up to sales and marketing promises
    15 Answers
    No answers on this topic
    Implementation went as expected
    92%
    Implementation went as expected
    22 Answers
    No answers on this topic
    Best Alternatives
    ReadyAPISpecFlow
    Small Businesses
    TestComplete
    Score8 out of 10
    BrowserStack
    Score8.5 out of 10
    Medium-sized Companies
    OpenText UFT One
    Score8 out of 10
    BlazeMeter
    Score8 out of 10
    Enterprises
    SoapUI Open Source
    Score8.2 out of 10
    Tricentis Tosca
    Score8.8 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    ReadyAPISpecFlow
    Likelihood to Recommend
    7.0
    (65 ratings)
    9.0
    (1 ratings)
    Likelihood to Renew
    7.3
    (18 ratings)
    -
    (0 ratings)
    Usability
    9.9
    (3 ratings)
    -
    (0 ratings)
    Availability
    9.0
    (1 ratings)
    -
    (0 ratings)
    Performance
    8.0
    (1 ratings)
    -
    (0 ratings)
    Support Rating
    8.0
    (6 ratings)
    -
    (0 ratings)
    Implementation Rating
    7.0
    (1 ratings)
    -
    (0 ratings)
    Product Scalability
    7.0
    (1 ratings)
    -
    (0 ratings)
    User Testimonials
    ReadyAPISpecFlow
    Likelihood to Recommend
    SmartBear
    As stated, we do a LOT of API testing, the swaggerhub import makes it easy to add APIs. This is very well-suited, as well as easy management of the steps/cases/suites inside of ReadyAPI. The one thing I do wish ReadyAPI was better suited for is changes to data, we have a lot of test cases in ReadyAPI and if we make a change to how the backend data is structured, one-by-one adjustments need to be made to the steps. Less appropriate, UI testing.
    Incentivized
    Read full review
    Open Source
    It is best suited for implementing the automated test cases in a human readable form so it's easy for non-technical members of the team and stakeholders to understand the test cases, features and the functionalities of the application. Automation of Integration tests and End to End tests are good use case. It is less appropriate or situations where the focus is only on the writing and maintenance of unit tests.
    Incentivized
    Read full review
    Pros
    SmartBear
    • Ease of use (ability to automatically import API definitions, Jenkins integration for running in the pipeline).
    • Detailed test reports (allow to easily identify weak spots during both functional and performance testing).
    • One platform for all tests (allows to closely couple and reuse existent tests).
    Incentivized
    Read full review
    Open Source
    • Versatility to be used in combination with different kinds of automated testing like automated performance testing, API testing, UI testing etc. I use JavaScript, Selenium, C#, email testing libraries, database testing libraries in combination with BDD with SpecFlow. I am able to use all these with SpecFlow to make my automation framework to be able to automate any kind of automated testing.
    • It provides different widely used runner options like NUnit, XUnit etc. Before I started to work on establishing proper test automation in my workplace, the previous automation framework (non-BDD based) as well as unit tests used NUnit runner. The transition to using BDD was smooth because we could use the same runner and there were no compatibility issues.
    • The auto-complete feature is good. I use it with Visual Studio as well as Rider and I don't have to recall the entire Gherkin statements. I just type a few words and the entire Gherkin statement implemented in framework is auto-suggested by SpecFlow. It saves time and context switching.
    Incentivized
    Read full review
    Cons
    SmartBear
    • Needs good documentation
    • Need to improve the performance of the tool
    • Setup is very complex and for such [a] commercial tool, it should easy and straightforward
    • Tool says it supports security testing but in reality, it is not at an extensive level.
    Incentivized
    Read full review
    Open Source
    • SpecFlow does not accepts optional input variables in the methods defined during Gherkin statement implementation. Cucumber supports optional input variables in the methods defined during Gherkin statement implementation.
    • The tests identified while using SpecFlow with NUnit removes all white spaces in the scenario names. It makes the tests less readable. If the white spaces are not auto-removed, it would be much better for readability as well as their actual identification in the repository.
    Incentivized
    Read full review
    Likelihood to Renew
    SmartBear
    The only reason this isn't a '10' is because of the cost. This product is definitely meant for organizations who are serious about making sure they invest in the full ecosystem of API design, development, maintenance. But there is a significant cost associated with this investment. and because of this cost (and the non-tangible output for executives), it is a difficult line-item to justify in this post-pandemic environment.
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Usability
    SmartBear
    SoapUI allows us to combine multiple tests and adhere
    to the sequence that they need to run in order to complete successfully.
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing
    Read full review
    Open Source
    No answers on this topic
    Reliability and Availability
    SmartBear
    Soap UI has managed to continuously build on it's solid foundation and keep improving by each release. It is by far the most dependable and accurate testing tool out there of its kind. Available via connecting to VM's created as SoapUI test machines give access to it anytime, anywhere practically.
    Read full review
    Open Source
    No answers on this topic
    Performance
    SmartBear
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing.
    Read full review
    Open Source
    No answers on this topic
    Support Rating
    SmartBear
    To be honest, we didnt had much issues with the support, as there is already plenty of online communities available for help. But if ever there were some minor issues with the membership or the certificates, the tech support was always quick and efficient enough to resolve the issue ASAP
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Implementation Rating
    SmartBear
    no very easy but lacks documentation
    Read full review
    Open Source
    No answers on this topic
    Alternatives Considered
    SmartBear
    ReadyAPI provides intuitive GUI capabilities compared to their own open source product. When compared to Postman, ReadyAPI also supports SOAP based services, which is a saver especially when integrating with legacy or other third party systems.
    Incentivized
    Read full review
    Open Source
    SpecFlow is .Net based which supports C#. Behave is Python based. Cucumber is Java based. Ghost Inspector is no-code based but provides very limited testing features. We wanted to implement BDD so we rued out using Ghost Inspector. Most of the developers in my team are C# experts so it was decided for everyone's comfort to go for SpecFlow rather than Behave or Cucumber. It's import to have technical experts in the language of the automation framework because there are many situations where the solutions to the test automation needs are not straightforward and implementing those requires expertise in the related programming language.
    Incentivized
    Read full review
    Scalability
    SmartBear
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing. However, I have read that added monitoring tools have been added, which if so the 7 could possibly go to a 8 or 9.
    Read full review
    Open Source
    No answers on this topic
    Return on Investment
    SmartBear
    • Very quick regression testing, hence having the testing results very soon, even the same day of deployment
    • for same above reason, it can save money for corporation (so no tedious, costly and erroneous manual testings)
    • The test reports are compatible with TestNG, so the corporation can integrate the reports in our Autamation frameworks such as Allure or Jira Zephyr
    Incentivized
    Read full review
    Open Source
    • Everyone stays on the same page regarding the behavior of existing functionalities whether it be technical or non-technical individuals. So there is less need for multiple people to get involved which saves time and thus money.
    • Reusing the same code through the implemented Gherkin statement saves test automation time and thus reduces cost.
    • We combine SpecFlow with other opensource testing technologies to make our automation framework more versatile which further saves costs for us.
    Incentivized
    Read full review
    ScreenShots