AWS Device Farm vs. OpenText UFT Digital Lab

AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.

Incentivized

UFT mobile works really well if/when you need physical devices under your management. Managing physical devices in any setup is an interesting undertaking due to the various considerations per device. There are really nice best practices, for example using managed USB switches like the one from Cambrionix, that can help make for a really good experience. For us, we only have 1 application at this time that has frequent updates/releases. We are able to test out these with confidence using our suite of real/on-campus devices managed and made available by the UFT Mobile product.

Incentivized

• Integration with CI/CD Pipeline
• Diversity in Real Devices over the Cloud
• Pay as you go option
• Reproduce Issues and easily collect all kinds of logs

Incentivized

• Remote access to real devices within your organization network as compared to public devices library offering, where their is a risk of exposing pre-production builds outside the organization.
• "Factory built like" integration with HP ALM, HP Sprinter, HP UFT and HP Network Virtualization.
• Ability to mimic real world conditions in a controlled environment in the devices of your choice.
• Removed the guess work out of using emulators
• Able to extend automation to mobile testing using HP UFT.

Incentivized

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• Most of our problems are with the lengthy onboarding process with iOS devices.
• Occasionally Android devices will disconnect themselves.

Incentivized

The tool continues to meet our expectations and has shown that they are continually evolving the product with new features that benefit us. The most recent new feature was the auto-signing/packaging of iOS apps from the server to allow native interaction of features like biometrics. Prior this was a lengthy exercise.

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

I got more features and handy within AWS Device farm than AWS Cloud9

Incentivized

HP Mobile Center stacks well against solutions like Mobile Labs Device Connect, Perfecto Mobile and Device Anywhere. Its native integration with HP ALM and HP UFT makes it a clear choice for team already using those solutions. HP Mobile Center also provides extension to Amazon Device Library.

Incentivized

• Quicker testing leads to faster product to market times
• Can deploy updates much more regularly by testing across many devices quickly

Incentivized

• Efficient use of the devices. Reduced the idle time.
• Better control over access and user management. Testing within our controlled environments.
• Better control of device matrix.
• Faster testing cycles. Early design bugs to development teams. Real devices means, less guess work.

Incentivized