AWS Device Farm vs. QAComplete

AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.

Incentivized

I think QAComplete is a great way to organize the literal hundreds of development bugs that are discovered throughout an agile-based project. Teams aren't always able to hotfix items on the fly and this tool provides a great repository and facility for storing and prioritizing those technical debt items that may get overlooked from sprint to sprint. It also let's everyone on the team get a clear understanding for project progress.

Incentivized

• Integration with CI/CD Pipeline
• Diversity in Real Devices over the Cloud
• Pay as you go option
• Reproduce Issues and easily collect all kinds of logs

Incentivized

• Allows us to create individual tests then group them into comprehensive test plans.
• Allows me to specify custom fields that match our product features to categorize both tests and defects.
• Allows me to create a series of requirements then match tests against them for validation.

Incentivized

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• The user interface can be somewhat perplexing and difficult to navigate at times.
• Naming conventions aren't always succinct and additional training is needed by those who have more experience using the program.
• A modern refresh of the UI would help keep the product from looking dated.

Incentivized

I gave QAComplete this rating because though I do feel that it is a powerful tool, it's definitely not designed for the everyday user. Obviously the target demographic is QA specialists who should be team members that are very technical and methodical in their approaches. However, for the rest of the team, it can often time prove difficult to navigate. Also, the UI is in need of a serious refresh.

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

I have not had to work with their customer service directly yet. Our client has been utilizing this tool for years, so I would assume that the support they have received would be good enough to keep them wanting to continue to use the product.

Incentivized

I got more features and handy within AWS Device farm than AWS Cloud9

Incentivized

A comprehensive solution

Incentivized

• Quicker testing leads to faster product to market times
• Can deploy updates much more regularly by testing across many devices quickly

Incentivized

• Helped us in increase the quality of our firmware releases.
• Helps us continuously improve our testing

Incentivized