AWS Device Farm vs. Katalon Studio

AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.

Incentivized

Free trial version is fine but you don't get the adequate support and VFM for the licensed version. Customer service needs to be improved a lot and any QA's with less technical background or less time to troubleshoot issues in the software on their own would find it difficult to use.

• Integration with CI/CD Pipeline
• Diversity in Real Devices over the Cloud
• Pay as you go option
• Reproduce Issues and easily collect all kinds of logs

Incentivized

• Codeless test automation
• Integration with Web, Mobile, API and Desktop automation
• Possibility of end to end test automation using CI tools
• Assistance provided during the coding

Incentivized

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• Katalon Studio supports only grovvy language for now. It will be nice to see support for other scripting languages.
• Performance issues; sudden crash of the tool.
• Debug button is provided only to licensed owner since Katalon 7+ version.
• New tool, few resources available to learn. So there is a mild learning curve here.

Incentivized

Due to the slowness, there is an intermediate timeout. There is no other problem.

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

I love the support. They have provided answers and solutions for most of our questions or doubts that could come up. They also have provided basic tutorials on how to get familiarized with the program.

Incentivized

I got more features and handy within AWS Device farm than AWS Cloud9

Incentivized

Katalon Studio License cost is reasonable and it suits the budget where as other tools are expensive and its difficult to get right ROI. Capabilities are user friendly while using the Katalon Studio for api, mobile , web and desktop application automation where as expensive fails to provide certain basic user friendly factors

Incentivized

• Quicker testing leads to faster product to market times
• Can deploy updates much more regularly by testing across many devices quickly

Incentivized

• No License fee: it saves a license fee which has paid for other tools.
• Able to create a Jenkins pipeline for DevOps saving sufficient time by running nightly.
• The manual tester can also automate making testing becomes faster.

Incentivized