What users are saying about
11 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>Score 9 out of 100
Based on 11 reviews and ratings
Top Rated
368 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>Score 8.7 out of 100
Based on 368 reviews and ratings
Attribute Ratings
- AWS Device Farm is rated higher in 2 areas: Likelihood to Recommend, Support Rating
Likelihood to Recommend
9.3
AWS Device Farm
93%
4 Ratings
8.8
Azure DevOps Services
88%
56 Ratings
Likelihood to Renew
AWS Device Farm
N/A
0 Ratings
10.0
Azure DevOps Services
100%
3 Ratings
Usability
AWS Device Farm
N/A
0 Ratings
7.1
Azure DevOps Services
71%
5 Ratings
Support Rating
10.0
AWS Device Farm
100%
2 Ratings
8.4
Azure DevOps Services
84%
20 Ratings
Implementation Rating
AWS Device Farm
N/A
0 Ratings
10.0
Azure DevOps Services
100%
2 Ratings
Likelihood to Recommend
AWS Device Farm
AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.

Verified User
Executive in Engineering
Medical Device Company, 1-10 employeesAzure DevOps Services
[Azure DevOps Services (formerly VSTS)] is well suited for agile teams. It is a digital kanban for teams to access anywhere at any time. Especially during covid when most companies are still remote, it allows teams to fully perform and still be functional in operating within an agile methodology. It also gives visibility to teams capacity.

Verified User
Analyst in Information Technology
Consumer Goods Company, 1001-5000 employeesPros
AWS Device Farm
- Integration with CI/CD Pipeline
- Diversity in Real Devices over the Cloud
- Pay as you go option
- Reproduce Issues and easily collect all kinds of logs
Lead Quality Engineer
SumergeComputer Software, 51-200 employees
Azure DevOps Services
- Flexible Requirements Hierarchy Management: AZDO makes it easy to track items such as features or epics as a flat list, or as a hierarchy in which you can track the parent-child relationship.
- Fast Data Entry: AZDO was designed to facilitate quick data entry to capture work items quickly, while still enabling detailed capture of acceptance criteria and item properties.
- Excel Integration: AZDO stands out for its integration with MS Excel, which enables quick updates for bulk items.

Verified User
Manager in Marketing
Electrical/Electronic Manufacturing Company, 5001-10,000 employeesCons
AWS Device Farm
- Interface (CLI) not very easy. Competition has better options.
- Integration with IDE for test case coding.
- Reporting for the test scripts executed.

Verified User
Executive in Information Technology
Consumer Goods Company, 10,001+ employeesAzure DevOps Services
- Column sorting when in filtered states.
- A way to show cross-team dependencies.
- A customized "From" field for notifications. Sometimes when a mail comes from Azure DevOps the teams do not realize that I am sending it
- A way to do online poker that doesn't require a plug-in.
Product Owner
Development Dimensions InternationalHuman Resources, 1001-5000 employees
Pricing Details
AWS Device Farm
General
Free Trial
—Free/Freemium Version
—Premium Consulting/Integration Services
—Entry-level set up fee?
No
Starting Price
$0.005 per instance minute
AWS Device Farm Editions & Modules
Edition
Pay-As-You-Go | $0.171 |
---|---|
Unlimited Testing | $250.002 |
Private Devices | $200.002 |
Pay as You Go - Desktop Browsers | $0.0053 |
- per device minute
- per month
- per instance minute
Additional Pricing Details
—Azure DevOps Services
General
Free Trial
—Free/Freemium Version
—Premium Consulting/Integration Services
—Entry-level set up fee?
No
Starting Price
$2 per GB (first 2GB free)
Azure DevOps Services Editions & Modules
Edition
Basic Plan | $61 |
---|---|
Basic + Test Plan | $522 |
Azure Artifacts | $23 |
Azure Pipelines - Microsoft Hosted | $404 |
Azure Pipelines - Self-Hosted | $155 |
- per user per month (first 5 users free)
- per user per month
- per GB (first 2GB free)
- per parallel job (1,800 minutes free with 1 free parallel job)
- per extra parallel job (1 free parallel job with unlimited minutes)
Additional Pricing Details
—Likelihood to Renew
AWS Device Farm
No score
No answers yet
No answers on this topic
Azure DevOps Services
Azure DevOps Services 10.0
Based on 3 answers
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
Business Analyst
InnovaSystems International, LLCComputer Software, 201-500 employees
Usability
AWS Device Farm
No score
No answers yet
No answers on this topic
Azure DevOps Services
Azure DevOps Services 7.1
Based on 5 answers
Azure DevOps is a powerful, complex cloud application. As such there are a number of things it does great and something where there is room for improvement. One of those areas would be in usability. In my opinion it relies too much on search. There is no easy way to view all projects or to group them in a logical way. You need to search for everything.
Technical Lead
Newell RubbermaidConsumer Goods, 10,001+ employees
Support Rating
AWS Device Farm
AWS Device Farm 10.0
Based on 2 answers
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Verified User
Executive in Information Technology
Consumer Goods Company, 10,001+ employeesAzure DevOps Services
Azure DevOps Services 8.4
Based on 20 answers
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.

Verified User
Professional in Information Technology
Architecture & Planning Company, 1001-5000 employeesImplementation Rating
AWS Device Farm
No score
No answers yet
No answers on this topic
Azure DevOps Services
Azure DevOps Services 10.0
Based on 2 answers
Was not part of the process.

Verified User
Analyst in Research & Development
Hospital & Health Care Company, 10,001+ employeesAlternatives Considered
AWS Device Farm
I got more features and handy within AWS Device farm than AWS Cloud9
Founder & Technical Director
Essence SolusoftComputer Software, 11-50 employees
Azure DevOps Services
Azure DevOps is much easier to implement and use on a daily basis than VersionOne. This is based on end-user feedback and my personal experience as well. ADO has more features and seems to get updated more frequently than VersionOne as well. VersionOne is less expensive overall than ADO, but our company prefers to use ADO because it has a lot more benefits.
Senior Network Administrator
University HealthSystem ConsortiumHospital & Health Care, 1001-5000 employees
Return on Investment
AWS Device Farm
- Quicker testing leads to faster product to market times
- Can deploy updates much more regularly by testing across many devices quickly

Verified User
Executive in Engineering
Medical Device Company, 1-10 employeesAzure DevOps Services
- It provides a great IDE to make things easier, clear, and compact. It has always been a positive ROI
- It's worth the money. I don't think any other software could replace the VS. It has helped us a lot to making things ready on time
- The only thing I dislike is that it takes a lot of memory space when in an idle state
VLSI TEST ENGINEER
Tessolve Services Pvt. Ltd.Semiconductors, 1001-5000 employees