Good tool for Automation TestOps
May 19, 2022

Good tool for Automation TestOps

Anonymous | TrustRadius Reviewer
Score 8 out of 10
Vetted Review
Verified User

Overall Satisfaction with Katalon TestOps

There was no proper insight to test reports and reports were not organized well. It was difficult to get information on test flakiness or test case failure history. Our organization had already been using Katalon automation tool for writing test cases and with the Katalon testOps, everything is in one place.
  • One place for all report history
  • Get count of tests automated each release
  • Easy way to schedule and run test suites automatically
  • Track test flakiness easily
  • Very small community
  • Requires learning curve
  • Sometimes application crashes
  • Single place to analyze test reports
  • Provides number of tests automated for each release
  • Helps with defect tracking
  • Report history for easy triages
  • Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
  • Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
  • Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.
Initially, our oragnization had to integrate Katalon tests with the Jenkins to schedule the test runs. The reports were stored in company local database. To identify test flakiness or product issue one had to dig deep into the reports. This issue was all solved by Katalon TestOps. Katalon TestOps provides report history in one place and also helps in easy triage of the report by pointing out script flakiness.

Do you think Katalon TestOps delivers good value for the price?

Yes

Are you happy with Katalon TestOps's feature set?

Yes

Did Katalon TestOps live up to sales and marketing promises?

I wasn't involved with the selection/purchase process

Did implementation of Katalon TestOps go as expected?

Yes

Would you buy Katalon TestOps again?

Yes

Katalon TestOps is well suited for an oraganization who want to organize their automation collections and have everything in one place. It provides good insight on test runs, failures and also helps in defect tracking. It is extremely easy to schedule and run test suites automatically. With the help of test history, it becomes easier to triage the report and identify if it is a product issue or a test flakiness. Also with the automation run scheduling features with custom options, user do not have to manually trigger the runs and just run the scheduler to do the job.