AWS Device Farm vs. HeadSpin

AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.

Incentivized

We have been using HeadSpin for our web and mobile application testing. It is an easy-to-use solution that provides detailed and in-depth analytics from the testing results. We also get a wide range of live networks and devices to perform the testing from HeadSpin. It has an inbuilt artificial intelligence engine that helps us to get real-time scenarios simulated, which is very helpful for finding performance issues and improving the overall quality of the applications.

• Integration with CI/CD Pipeline
• Diversity in Real Devices over the Cloud
• Pay as you go option
• Reproduce Issues and easily collect all kinds of logs

Incentivized

• Keep track of each browser we have tested and when we lastly updated them.
• Remove any deprecated code or plugins that may cause issues with other browsers.
• Add browser information to our site’s meta tags so that the site displays correctly in different browsers.
• Test our website on all browsers to ensure compatibility.

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• UI needs to be improved
• Graphs on the dashboard are a bit laggy and need detailing for a better understanding of the user

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

I got more features and handy within AWS Device farm than AWS Cloud9

Incentivized

Though LambdaTest was cheaper, it did not offer the deal devices and we wanted to be 100% sure that our app offers a perfect experience to all users. Simulators and emulators are not the technology we wanted to rely on.

• Quicker testing leads to faster product to market times
• Can deploy updates much more regularly by testing across many devices quickly

Incentivized

• Simplified the approach to test the mobile application on multiple devices from different vendors. This helped us to ensure the stability of the application in different environments.
• In-depth analysis to understand the loopholes in the application design function. This helped us to improve the application design and overall user experience.

Incentivized