AWS Device Farm vs. HeadSpin

As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.

Incentivized

We have been using HeadSpin for our web and mobile application testing. It is an easy-to-use solution that provides detailed and in-depth analytics from the testing results. We also get a wide range of live networks and devices to perform the testing from HeadSpin. It has an inbuilt artificial intelligence engine that helps us to get real-time scenarios simulated, which is very helpful for finding performance issues and improving the overall quality of the applications.

• Easy testing on many different devices
• Great integration with development workflow
• Customizable selection of testing framework

Incentivized

• We have hundreds of networking devices and headspin makes monitoring all the easier
• it has a great alert system and gives insights into what particularly might have gone wrong
• we use jenkins workflow and headspin works quite well with the pipeline

Incentivized

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• UI is very slow and sometimes it is stuck and becomes very difficult to operate and work on
• Functionality to upload build does not function as intended to and lags

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.

Incentivized

Headspin lets you test your code for performance, security, usability, and reliability. It also has some fantastic features that make it easy for developers to understand what's going on in their code. Headspin is a great tool to use when compared to LambdaTest. Headspin supports Appium, Appium Inspector, and Selenium, making it easier than ever before to develop such capabilities. However, LambdaTest offers only Appium and Selenium.

• It impact more and more. Not in terms of ROI but in time as well

Incentivized

• Simplified the approach to test the mobile application on multiple devices from different vendors. This helped us to ensure the stability of the application in different environments.
• In-depth analysis to understand the loopholes in the application design function. This helped us to improve the application design and overall user experience.

Incentivized