Katalon vs. OpenText UFT Digital Lab

Katalon TestOps is well suited for an oraganization who want to organize their automation collections and have everything in one place. It provides good insight on test runs, failures and also helps in defect tracking. It is extremely easy to schedule and run test suites automatically. With the help of test history, it becomes easier to triage the report and identify if it is a product issue or a test flakiness. Also with the automation run scheduling features with custom options, user do not have to manually trigger the runs and just run the scheduler to do the job.

Incentivized

UFT mobile works really well if/when you need physical devices under your management. Managing physical devices in any setup is an interesting undertaking due to the various considerations per device. There are really nice best practices, for example using managed USB switches like the one from Cambrionix, that can help make for a really good experience. For us, we only have 1 application at this time that has frequent updates/releases. We are able to test out these with confidence using our suite of real/on-campus devices managed and made available by the UFT Mobile product.

Incentivized

• Easy to setup and quick to get started: As Katalon comes with built-in features a new automation tester can automate easily. Script creation time is quick.
• Test Analytics: Katalon also provides analytics which tells you the pattern of your automated tests at a different instance of time.
• Third Party Integration: Katalon provides amazing integration with 3rd party tools like JIRA, ALM, GIT, JENKINS, etc.
• Image-based testing: Katalon also provides inbuilt image based test automation.

Incentivized

• Remote access to real devices within your organization network as compared to public devices library offering, where their is a risk of exposing pre-production builds outside the organization.
• "Factory built like" integration with HP ALM, HP Sprinter, HP UFT and HP Network Virtualization.
• Ability to mimic real world conditions in a controlled environment in the devices of your choice.
• Removed the guess work out of using emulators
• Able to extend automation to mobile testing using HP UFT.

Incentivized

• Integration with Azure is painstakingly slow as it takes too much time to upload reports to Azure. When raised with the support team i was advised to contact Microsoft who promptly and correctly replied that its an issue with the katalon plugin.
• Non Responsive Customer Support. Several mails were replied late.
• The Desktop app uses too much memory when booting up and running tests even on a 16gb RAM.

• Most of our problems are with the lengthy onboarding process with iOS devices.
• Occasionally Android devices will disconnect themselves.

Incentivized

The tool continues to meet our expectations and has shown that they are continually evolving the product with new features that benefit us. The most recent new feature was the auto-signing/packaging of iOS apps from the server to allow native interaction of features like biometrics. Prior this was a lengthy exercise.

Incentivized

Due to the slowness, there is an intermediate timeout. There is no other problem.

Incentivized

I love the support. They have provided answers and solutions for most of our questions or doubts that could come up. They also have provided basic tutorials on how to get familiarized with the program.

Incentivized

Katalon Studio is above both the tools is due to its codeless test automation feature and having API, desktop, web, and mobile automation in one place but obviously there is room for improvement when desktop automation is of primary importance in the automation.

Incentivized

HP Mobile Center stacks well against solutions like Mobile Labs Device Connect, Perfecto Mobile and Device Anywhere. Its native integration with HP ALM and HP UFT makes it a clear choice for team already using those solutions. HP Mobile Center also provides extension to Amazon Device Library.

Incentivized

• Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
• Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
• Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.

Incentivized

• Efficient use of the devices. Reduced the idle time.
• Better control over access and user management. Testing within our controlled environments.
• Better control of device matrix.
• Faster testing cycles. Early design bugs to development teams. Real devices means, less guess work.

Incentivized