TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Katalon

    Score7.5 out of 10
    N/AKatalon Studio is provided by the vendor as a free and robust automation solution for API, Web and Mobile testing. It is designed to eliminate the complexities of building an automation framework by integrating all necessary test components with built-in keywords and project templates. Katalon Studio includes a full feature set for a complete test automation process covering multiple platforms and testing types. New users can get started with test automation using its easy-to-use…

    $69

    per month

    SpecFlow

    Score10 out of 10
    N/ASpecFlow is an open source BDD for .NET. that aims to bridge the communication gap between domain experts and developers by binding readable behavior specifications to the underlying implementation.N/A
    Pricing
    KatalonSpecFlow
    Editions & Modules
    Node Locked License
    $69.00
    per month
    Floating License
    $1,529.00
    per year
    No answers on this topic
    Offerings
    Pricing Offerings
    KatalonSpecFlow
    Free Trial
    YesNo
    Free/Freemium Version
    YesNo
    Premium Consulting/Integration Services
    YesNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional DetailsKatalon Studio was originated from KMS Technology R&D. It has been a successful solution for numerous automation projects ranging from small team to enterprise client. Katalon Studio is free for use, product development is funded by the testing services provided by KMS Technology. To support future releases, please consider subscribing to our business support services.—
    More Pricing Information
    Community Pulse
    KatalonSpecFlow
    Considered Both Products
    Katalon Inc
    No answer on this topic
    Open Source
    No answer on this topic
    Key User Insights
    Would buy again
    88%
    Would buy again
    7 Answers
    No answers on this topic
    Delivers good value for the price
    88%
    Delivers good value for the price
    7 Answers
    No answers on this topic
    Happy with the feature set
    88%
    Happy with the feature set
    7 Answers
    No answers on this topic
    Lived up to sales and marketing promises
    No answers on this topic
    No answers on this topic
    Implementation went as expected
    100%
    Implementation went as expected
    6 Answers
    No answers on this topic
    Best Alternatives
    KatalonSpecFlow
    Small Businesses
    BrowserStack
    Score8.5 out of 10
    BrowserStack
    Score8.5 out of 10
    Medium-sized Companies
    BlazeMeter
    Score8 out of 10
    BlazeMeter
    Score8 out of 10
    Enterprises
    Tricentis Tosca
    Score8.8 out of 10
    Tricentis Tosca
    Score8.8 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    KatalonSpecFlow
    Likelihood to Recommend
    8.1
    (11 ratings)
    9.0
    (1 ratings)
    Usability
    9.0
    (1 ratings)
    -
    (0 ratings)
    Support Rating
    9.9
    (2 ratings)
    -
    (0 ratings)
    User Testimonials
    KatalonSpecFlow
    Likelihood to Recommend
    Katalon Inc
    Katalon TestOps is well suited for an oraganization who want to organize their automation collections and have everything in one place. It provides good insight on test runs, failures and also helps in defect tracking. It is extremely easy to schedule and run test suites automatically. With the help of test history, it becomes easier to triage the report and identify if it is a product issue or a test flakiness. Also with the automation run scheduling features with custom options, user do not have to manually trigger the runs and just run the scheduler to do the job.
    Incentivized
    Read full review
    Open Source
    It is best suited for implementing the automated test cases in a human readable form so it's easy for non-technical members of the team and stakeholders to understand the test cases, features and the functionalities of the application. Automation of Integration tests and End to End tests are good use case. It is less appropriate or situations where the focus is only on the writing and maintenance of unit tests.
    Incentivized
    Read full review
    Pros
    Katalon Inc
    • Easy to setup and quick to get started: As Katalon comes with built-in features a new automation tester can automate easily. Script creation time is quick.
    • Test Analytics: Katalon also provides analytics which tells you the pattern of your automated tests at a different instance of time.
    • Third Party Integration: Katalon provides amazing integration with 3rd party tools like JIRA, ALM, GIT, JENKINS, etc.
    • Image-based testing: Katalon also provides inbuilt image based test automation.
    Incentivized
    Read full review
    Open Source
    • Versatility to be used in combination with different kinds of automated testing like automated performance testing, API testing, UI testing etc. I use JavaScript, Selenium, C#, email testing libraries, database testing libraries in combination with BDD with SpecFlow. I am able to use all these with SpecFlow to make my automation framework to be able to automate any kind of automated testing.
    • It provides different widely used runner options like NUnit, XUnit etc. Before I started to work on establishing proper test automation in my workplace, the previous automation framework (non-BDD based) as well as unit tests used NUnit runner. The transition to using BDD was smooth because we could use the same runner and there were no compatibility issues.
    • The auto-complete feature is good. I use it with Visual Studio as well as Rider and I don't have to recall the entire Gherkin statements. I just type a few words and the entire Gherkin statement implemented in framework is auto-suggested by SpecFlow. It saves time and context switching.
    Incentivized
    Read full review
    Cons
    Katalon Inc
    • Integration with Azure is painstakingly slow as it takes too much time to upload reports to Azure. When raised with the support team i was advised to contact Microsoft who promptly and correctly replied that its an issue with the katalon plugin.
    • Non Responsive Customer Support. Several mails were replied late.
    • The Desktop app uses too much memory when booting up and running tests even on a 16gb RAM.
    Read full review
    Open Source
    • SpecFlow does not accepts optional input variables in the methods defined during Gherkin statement implementation. Cucumber supports optional input variables in the methods defined during Gherkin statement implementation.
    • The tests identified while using SpecFlow with NUnit removes all white spaces in the scenario names. It makes the tests less readable. If the white spaces are not auto-removed, it would be much better for readability as well as their actual identification in the repository.
    Incentivized
    Read full review
    Usability
    Katalon Inc
    Due to the slowness, there is an intermediate timeout. There is no other problem.
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Support Rating
    Katalon Inc
    I love the support. They have provided answers and solutions for most of our questions or doubts that could come up. They also have provided basic tutorials on how to get familiarized with the program.
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Alternatives Considered
    Katalon Inc
    Katalon Studio is above both the tools is due to its codeless test automation feature and having API, desktop, web, and mobile automation in one place but obviously there is room for improvement when desktop automation is of primary importance in the automation.
    Incentivized
    Read full review
    Open Source
    SpecFlow is .Net based which supports C#. Behave is Python based. Cucumber is Java based. Ghost Inspector is no-code based but provides very limited testing features. We wanted to implement BDD so we rued out using Ghost Inspector. Most of the developers in my team are C# experts so it was decided for everyone's comfort to go for SpecFlow rather than Behave or Cucumber. It's import to have technical experts in the language of the automation framework because there are many situations where the solutions to the test automation needs are not straightforward and implementing those requires expertise in the related programming language.
    Incentivized
    Read full review
    Return on Investment
    Katalon Inc
    • Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
    • Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
    • Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.
    Incentivized
    Read full review
    Open Source
    • Everyone stays on the same page regarding the behavior of existing functionalities whether it be technical or non-technical individuals. So there is less need for multiple people to get involved which saves time and thus money.
    • Reusing the same code through the implemented Gherkin statement saves test automation time and thus reduces cost.
    • We combine SpecFlow with other opensource testing technologies to make our automation framework more versatile which further saves costs for us.
    Incentivized
    Read full review
    ScreenShots

    Katalon Screenshots

    Screenshot of Project setup - fast start with pre-built templates and scriptsScreenshot of Run Single Tests or Suites on multiple configurations and data sets
Multiple Platform Support so you can run your automation tests on Windows, OSX, Android, and iOSScreenshot of Maintain TestsScreenshot of View Reports