Katalon TestOps vs. Kualitee

Katalon TestOps is well suited for an oraganization who want to organize their automation collections and have everything in one place. It provides good insight on test runs, failures and also helps in defect tracking. It is extremely easy to schedule and run test suites automatically. With the help of test history, it becomes easier to triage the report and identify if it is a product issue or a test flakiness. Also with the automation run scheduling features with custom options, user do not have to manually trigger the runs and just run the scheduler to do the job.

Incentivized

From a business standpoint, features such as test scenarios, test cases, bug logging, and then graphical representations of every minute detail related to task and projects are very satisfying and productive. We can keep track of literally everything with Kualitee, and our quality is improving. One downside is that we cannot change the visualisations of some graphs. I believe that by giving the user more customisation options, such as filtering out on the basis of days and months, the experience could be greatly improved.

Incentivized

• One place for all report history
• Get count of tests automated each release
• Easy way to schedule and run test suites automatically
• Track test flakiness easily

Incentivized

• Import and Export
• Integration with other tools
• Regression and Blackbox testing

Incentivized

• Very small community
• Requires learning curve
• Sometimes application crashes

Incentivized

• Support response time
• Should have dark mode
• Response time for API call

Incentivized

Initially, our oragnization had to integrate Katalon tests with the Jenkins to schedule the test runs. The reports were stored in company local database. To identify test flakiness or product issue one had to dig deep into the reports. This issue was all solved by Katalon TestOps. Katalon TestOps provides report history in one place and also helps in easy triage of the report by pointing out script flakiness

Incentivized

TestRail is very costly and complex compared to Kualitee

Incentivized

• Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
• Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
• Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.

Incentivized

• If the terminology ( Test Scenarios, modules, components ) is not used in your workflow, it may take some time to set up properly because you must figure out how these are defined by your own terminology to get the hierarchy correct

Incentivized