Overview
ProductRatingMost Used ByProduct SummaryStarting Price
AWS Device Farm
Score 6.0 out of 10
N/A
AWS Device Farm is a mobile application performance testing application that provides real-time automated testing and reproduction of issues, simulating and testing issues that may occur on a variety of platforms (e.g. iPhone or Samsung mobile device, or multiple operations systems, etc).
$0.01
per instance minute
HeadSpin
Score 6.0 out of 10
N/A
HeadSpin is a Digital Experience AI Platform that combines a global device infrastructure, test automation, and ML-driven performance and quality of experience analytics. HeadSpin is designed to empower engineering, QA, operations, and product teams to assure optimal digital experiences across all delivery channels throughout the development lifecycle.N/A
QAComplete
Score 8.9 out of 10
N/A
QAComplete is a performance testing tool from SmartBear. The vendor says QAComplete was built from the ground-up to be an easy-to-use test case management tool, adapting to the user's existing processes and empowering users to manage all of their manual and automated tests with ease, while reporting on all test results in one central location. The vendor's goal is for QAComplete to allows users to spend less time managing tests and focus on what they do best; making great…N/A
Pricing
AWS Device FarmHeadSpinQAComplete
Editions & Modules
Pay as You Go - Desktop Browsers
$0.005
per instance minute
Pay-As-You-Go
$0.17
per device minute
Private Devices
$200.00
per month
Unlimited Testing
$250.00
per month
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
AWS Device FarmHeadSpinQAComplete
Free Trial
NoNoNo
Free/Freemium Version
NoNoNo
Premium Consulting/Integration Services
NoNoNo
Entry-level Setup FeeNo setup feeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
AWS Device FarmHeadSpinQAComplete
Best Alternatives
AWS Device FarmHeadSpinQAComplete
Small Businesses
GitLab
GitLab
Score 8.7 out of 10
Sentry
Sentry
Score 8.7 out of 10
GitLab
GitLab
Score 8.7 out of 10
Medium-sized Companies
GitLab
GitLab
Score 8.7 out of 10
Sentry
Sentry
Score 8.7 out of 10
GitLab
GitLab
Score 8.7 out of 10
Enterprises
GitLab
GitLab
Score 8.7 out of 10
Dynatrace
Dynatrace
Score 8.4 out of 10
GitLab
GitLab
Score 8.7 out of 10
All AlternativesView all alternativesView all alternativesView all alternatives
User Ratings
AWS Device FarmHeadSpinQAComplete
Likelihood to Recommend
9.0
(3 ratings)
9.8
(17 ratings)
7.0
(2 ratings)
Usability
-
(0 ratings)
-
(0 ratings)
7.0
(1 ratings)
Support Rating
10.0
(1 ratings)
-
(0 ratings)
8.0
(1 ratings)
User Testimonials
AWS Device FarmHeadSpinQAComplete
Likelihood to Recommend
Amazon AWS
AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.
Read full review
HeadSpin
We have been using HeadSpin for our web and mobile application testing. It is an easy-to-use solution that provides detailed and in-depth analytics from the testing results. We also get a wide range of live networks and devices to perform the testing from HeadSpin. It has an inbuilt artificial intelligence engine that helps us to get real-time scenarios simulated, which is very helpful for finding performance issues and improving the overall quality of the applications.
Read full review
SmartBear
I think QAComplete is a great way to organize the literal hundreds of development bugs that are discovered throughout an agile-based project. Teams aren't always able to hotfix items on the fly and this tool provides a great repository and facility for storing and prioritizing those technical debt items that may get overlooked from sprint to sprint. It also let's everyone on the team get a clear understanding for project progress.
Read full review
Pros
Amazon AWS
  • 100% compatibility with the installed user base. No simulation, but real results.
  • Integration with Jenkins and other CI/CD tools.
  • A considerable amount of device types available. Again, real devices in the cloud!
Read full review
HeadSpin
  • Keep track of each browser we have tested and when we lastly updated them.
  • Remove any deprecated code or plugins that may cause issues with other browsers.
  • Add browser information to our site’s meta tags so that the site displays correctly in different browsers.
  • Test our website on all browsers to ensure compatibility.
Read full review
SmartBear
  • Allows us to create individual tests then group them into comprehensive test plans.
  • Allows me to specify custom fields that match our product features to categorize both tests and defects.
  • Allows me to create a series of requirements then match tests against them for validation.
Read full review
Cons
Amazon AWS
  • To be Frank, I have not found any room where it needs to improve. As whatever we used, It is useful for us
Read full review
HeadSpin
  • UI needs to be improved
  • Graphs on the dashboard are a bit laggy and need detailing for a better understanding of the user
Read full review
SmartBear
  • The user interface can be somewhat perplexing and difficult to navigate at times.
  • Naming conventions aren't always succinct and additional training is needed by those who have more experience using the program.
  • A modern refresh of the UI would help keep the product from looking dated.
Read full review
Usability
Amazon AWS
No answers on this topic
HeadSpin
No answers on this topic
SmartBear
I gave QAComplete this rating because though I do feel that it is a powerful tool, it's definitely not designed for the everyday user. Obviously the target demographic is QA specialists who should be team members that are very technical and methodical in their approaches. However, for the rest of the team, it can often time prove difficult to navigate. Also, the UI is in need of a serious refresh.
Read full review
Support Rating
Amazon AWS
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
Read full review
HeadSpin
No answers on this topic
SmartBear
I have not had to work with their customer service directly yet. Our client has been utilizing this tool for years, so I would assume that the support they have received would be good enough to keep them wanting to continue to use the product.
Read full review
Alternatives Considered
Amazon AWS
We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.
Read full review
HeadSpin
Though LambdaTest was cheaper, it did not offer the deal devices and we wanted to be 100% sure that our app offers a perfect experience to all users. Simulators and emulators are not the technology we wanted to rely on.
Read full review
SmartBear
A comprehensive solution
Read full review
Return on Investment
Amazon AWS
  • It impact more and more. Not in terms of ROI but in time as well
Read full review
HeadSpin
  • Simplified the approach to test the mobile application on multiple devices from different vendors. This helped us to ensure the stability of the application in different environments.
  • In-depth analysis to understand the loopholes in the application design function. This helped us to improve the application design and overall user experience.
Read full review
SmartBear
  • Helped us in increase the quality of our firmware releases.
  • Helps us continuously improve our testing
Read full review
ScreenShots