Katalon vs. Parasoft SOAtest

Katalon TestOps is well suited for an oraganization who want to organize their automation collections and have everything in one place. It provides good insight on test runs, failures and also helps in defect tracking. It is extremely easy to schedule and run test suites automatically. With the help of test history, it becomes easier to triage the report and identify if it is a product issue or a test flakiness. Also with the automation run scheduling features with custom options, user do not have to manually trigger the runs and just run the scheduler to do the job.

Incentivized

This is the go to tool for all the web service testing needs. You can do functional testing, regression testing, automate the testing and drive the data from external sources like a Excel spread sheet or an xml document and finally performance testing. It can get better in scenarios where the response is to be compared with UI, with more automation. The license cost needs to be considered when there are many open source tools out there in the market.

Incentivized

• Easy to setup and quick to get started: As Katalon comes with built-in features a new automation tester can automate easily. Script creation time is quick.
• Test Analytics: Katalon also provides analytics which tells you the pattern of your automated tests at a different instance of time.
• Third Party Integration: Katalon provides amazing integration with 3rd party tools like JIRA, ALM, GIT, JENKINS, etc.
• Image-based testing: Katalon also provides inbuilt image based test automation.

Incentivized

• Organized test suites.
• Fast and efficient execution of automated testing.
• Built in Javascript that can be used to run test cases with a repository tool such as HP Quality Center. This will show the test results and allow the QA engineer to pass, fail, or set a test case to N/A.

Incentivized

• Integration with Azure is painstakingly slow as it takes too much time to upload reports to Azure. When raised with the support team i was advised to contact Microsoft who promptly and correctly replied that its an issue with the katalon plugin.
• Non Responsive Customer Support. Several mails were replied late.
• The Desktop app uses too much memory when booting up and running tests even on a 16gb RAM.

• As always, this is not a free tool and you have to pay for license. There are many open source tools which can perform similar job with no cost albeit with less functionality and more head work.
• There is still some more room for improving the automation which can include more UI level components to make life lot easier when comparing the response vs UI.

Incentivized

I have used the tool at a previous company and I love it.

Incentivized

Due to the slowness, there is an intermediate timeout. There is no other problem.

Incentivized

never had any issues

Incentivized

I love the support. They have provided answers and solutions for most of our questions or doubts that could come up. They also have provided basic tutorials on how to get familiarized with the program.

Incentivized

anytime I had a question, I received feedback the same day from a representative at Parasoft SOAtest.

Incentivized

Yes, I would like to know if there is any action to have Parasoft SOAtest integrated with Microsoft TFS

Incentivized

Katalon Studio is above both the tools is due to its codeless test automation feature and having API, desktop, web, and mobile automation in one place but obviously there is room for improvement when desktop automation is of primary importance in the automation.

Incentivized

Parasoft SOAtest stands out among all the other tools.

Incentivized

• Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
• Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
• Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.

Incentivized

• It has been of tremendous help as the ONE STOP TOOL to test the APIs end to end. Ease of use is great and their support staff is excellent. They always conduct brown bag sessions for us to learn about new features. Overall it has given us a great ROI considering how fast we can test and deliver to market.

Incentivized