AWS Device Farm vs Azure DevOps Services | TrustRadius

What users are saying about

Score 10 out of 10

Based on 8 reviews and ratings

Score 8.8 out of 10

Based on 306 reviews and ratings

Pros

100% compatibility with the installed user base. No simulation, but real results.
Integration with Jenkins and other CI/CD tools.
A considerable amount of device types available. Again, real devices in the cloud!

Read full review

Verified User

Executive in Information Technology

Consumer Goods Company, 10,001+ employees

View all 2 answers on this topic

Flexible Requirements Hierarchy Management: AZDO makes it easy to track items such as features or epics as a flat list, or as a hierarchy in which you can track the parent-child relationship.
Fast Data Entry: AZDO was designed to facilitate quick data entry to capture work items quickly, while still enabling detailed capture of acceptance criteria and item properties.
Excel Integration: AZDO stands out for its integration with MS Excel, which enables quick updates for bulk items.

Read full review

Verified User

Manager in Marketing

Electrical/Electronic Manufacturing Company, 5001-10,000 employees

View all 48 answers on this topic

Cons

Cost and price is always a concern
Can be a bit clunky for the staff using the service.
Sometimes, misses issues with iOS devices.

Read full review

Verified User

Analyst in Other

Government Administration Company, 201-500 employees

View all 2 answers on this topic

Column sorting when in filtered states.
A way to show cross-team dependencies.
A customized "From" field for notifications. Sometimes when a mail comes from Azure DevOps the teams do not realize that I am sending it
A way to do online poker that doesn't require a plug-in.

Read full review

Product Owner

Development Dimensions InternationalHuman Resources, 1001-5000 employees

View all 48 answers on this topic

Likelihood to Renew

No score

No answers yet

No answers on this topic

Azure DevOps Services 10.0

Based on 3 answers

I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.

Read full review

Raylene Wall, PMP

Business Analyst

InnovaSystems International, LLCComputer Software, 201-500 employees

View all 3 answers on this topic

Usability

AWS Device Farm 10.0

Based on 1 answer

The users have no issue. The IT staff have learned to work with the software with the help of AWS support. I find it very effective. Could it be easier? Of course. That doesn't mean this isn't a great solution. I would recommend it to anyone based on usability. Overall, it is easy enough to use.

Read full review

Verified User

Analyst in Other

Government Administration Company, 201-500 employees

View all 1 answers on this topic

Azure DevOps Services 7.5

Based on 5 answers

Azure DevOps is a powerful, complex cloud application. As such there are a number of things it does great and something where there is room for improvement. One of those areas would be in usability. In my opinion it relies too much on search. There is no easy way to view all projects or to group them in a logical way. You need to search for everything.

Read full review

Technical Lead

Newell RubbermaidConsumer Goods, 10,001+ employees

View all 5 answers on this topic

Support Rating

AWS Device Farm 10.0

Based on 3 answers

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Read full review

Verified User

Executive in Information Technology

Consumer Goods Company, 10,001+ employees

View all 3 answers on this topic

Azure DevOps Services 8.7

Based on 19 answers

When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.

Read full review

Verified User

Professional in Information Technology

Architecture & Planning Company, 1001-5000 employees

View all 19 answers on this topic

Implementation Rating

No score

No answers yet

No answers on this topic

Azure DevOps Services 10.0

Based on 2 answers

Was not part of the process.

Read full review

Verified User

Analyst in Research & Development

Hospital & Health Care Company, 10,001+ employees

View all 2 answers on this topic

Alternatives Considered

This is the only solution I have used from device farming. From that perspective, I would purchase it again. I think this is a great solution for a large, diverse organization looking to mass deploy and manage software and devices. We selected this software because we have had great luck with other AWS services.

Read full review

Verified User

Analyst in Other

Government Administration Company, 201-500 employees

View all 2 answers on this topic

Azure DevOps is much easier to implement and use on a daily basis than VersionOne. This is based on end-user feedback and my personal experience as well. ADO has more features and seems to get updated more frequently than VersionOne as well. VersionOne is less expensive overall than ADO, but our company prefers to use ADO because it has a lot more benefits.

Read full review

Senior Network Administrator

University HealthSystem ConsortiumHospital & Health Care, 1001-5000 employees

View all 48 answers on this topic

Return on Investment

Reduced the amount we spent on physical devices by > 90%.
Enabled real CI integration even when running E2E test scripts using mobile phones.
Helped us to improve overall App stability and rating - fewer crashes (80% to 99% of sessions crashless) and 75% rating increases on apps.

Read full review

Verified User

Executive in Information Technology

Consumer Goods Company, 10,001+ employees

View all 2 answers on this topic

It provides a great IDE to make things easier, clear, and compact. It has always been a positive ROI
It's worth the money. I don't think any other software could replace the VS. It has helped us a lot to making things ready on time
The only thing I dislike is that it takes a lot of memory space when in an idle state

Read full review

AMANDEEP KUNDRAO

VLSI TEST ENGINEER

Tessolve Services Pvt. Ltd.Semiconductors, 1001-5000 employees

View all 48 answers on this topic

Pricing Details

General

Free Trial

—

Free/Freemium Version

—

Premium Consulting/Integration Services

—

Entry-level set up fee?

No

AWS Device Farm Editions & Modules

Edition

Pay-As-You-Go	$0.17¹
Unlimited Testing	$250.00²
Private Devices	$200.00²
Pay as You Go - Desktop Browsers	$0.005³

per device minute
per month
per instance minute

Additional Pricing Details

—

General

Free Trial

—

Free/Freemium Version

—

Premium Consulting/Integration Services

—

Entry-level set up fee?

No

Azure DevOps Services Editions & Modules

Edition

Basic Plan	$6¹
Basic + Test Plan	$52²
Azure Artifacts	$2³
Azure Pipelines - Microsoft Hosted	$40⁴
Azure Pipelines - Self-Hosted	$15⁵

per user per month (first 5 users free)
per user per month
per GB (first 2GB free)
per parallel job (1,800 minutes free with 1 free parallel job)
per extra parallel job (1 free parallel job with unlimited minutes)

Additional Pricing Details

—

Add comparison