11 Ratings
Top Rated
368 Ratings
11 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 9 out of 100
Top Rated
368 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.7 out of 100

Attribute Ratings

  • AWS Device Farm is rated higher in 2 areas: Likelihood to Recommend, Support Rating

Likelihood to Recommend

9.3

AWS Device Farm

93%
4 Ratings
8.8

Azure DevOps Services

88%
56 Ratings

Likelihood to Renew

AWS Device Farm

N/A
0 Ratings
10.0

Azure DevOps Services

100%
3 Ratings

Usability

AWS Device Farm

N/A
0 Ratings
7.1

Azure DevOps Services

71%
5 Ratings

Support Rating

10.0

AWS Device Farm

100%
2 Ratings
8.4

Azure DevOps Services

84%
20 Ratings

Implementation Rating

AWS Device Farm

N/A
0 Ratings
10.0

Azure DevOps Services

100%
2 Ratings

Likelihood to Recommend

AWS Device Farm

AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.
Anonymous | TrustRadius Reviewer

Azure DevOps Services

[Azure DevOps Services (formerly VSTS)] is well suited for agile teams. It is a digital kanban for teams to access anywhere at any time. Especially during covid when most companies are still remote, it allows teams to fully perform and still be functional in operating within an agile methodology. It also gives visibility to teams capacity.
Anonymous | TrustRadius Reviewer

Pros

AWS Device Farm

  • Integration with CI/CD Pipeline
  • Diversity in Real Devices over the Cloud
  • Pay as you go option
  • Reproduce Issues and easily collect all kinds of logs
Amr Saad | TrustRadius Reviewer

Azure DevOps Services

  • Flexible Requirements Hierarchy Management: AZDO makes it easy to track items such as features or epics as a flat list, or as a hierarchy in which you can track the parent-child relationship.
  • Fast Data Entry: AZDO was designed to facilitate quick data entry to capture work items quickly, while still enabling detailed capture of acceptance criteria and item properties.
  • Excel Integration: AZDO stands out for its integration with MS Excel, which enables quick updates for bulk items.
Anonymous | TrustRadius Reviewer

Cons

AWS Device Farm

  • Interface (CLI) not very easy. Competition has better options.
  • Integration with IDE for test case coding.
  • Reporting for the test scripts executed.
Anonymous | TrustRadius Reviewer

Azure DevOps Services

  • Column sorting when in filtered states.
  • A way to show cross-team dependencies.
  • A customized "From" field for notifications. Sometimes when a mail comes from Azure DevOps the teams do not realize that I am sending it
  • A way to do online poker that doesn't require a plug-in.
Amy Liston | TrustRadius Reviewer

Pricing Details

AWS Device Farm

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Starting Price

$0.005 per instance minute

AWS Device Farm Editions & Modules

Edition
Pay-As-You-Go$0.171
Unlimited Testing$250.002
Private Devices$200.002
Pay as You Go - Desktop Browsers$0.0053
  1. per device minute
  2. per month
  3. per instance minute
Additional Pricing Details

Azure DevOps Services

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Starting Price

$2 per GB (first 2GB free)

Azure DevOps Services Editions & Modules

Edition
Basic Plan$61
Basic + Test Plan$522
Azure Artifacts$23
Azure Pipelines - Microsoft Hosted$404
Azure Pipelines - Self-Hosted$155
  1. per user per month (first 5 users free)
  2. per user per month
  3. per GB (first 2GB free)
  4. per parallel job (1,800 minutes free with 1 free parallel job)
  5. per extra parallel job (1 free parallel job with unlimited minutes)
Additional Pricing Details

Likelihood to Renew

AWS Device Farm

No score
No answers yet
No answers on this topic

Azure DevOps Services

Azure DevOps Services 10.0
Based on 3 answers
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
Raylene Wall, PMP | TrustRadius Reviewer

Usability

AWS Device Farm

No score
No answers yet
No answers on this topic

Azure DevOps Services

Azure DevOps Services 7.1
Based on 5 answers
Azure DevOps is a powerful, complex cloud application. As such there are a number of things it does great and something where there is room for improvement. One of those areas would be in usability. In my opinion it relies too much on search. There is no easy way to view all projects or to group them in a logical way. You need to search for everything.
Kyle Kochtan | TrustRadius Reviewer

Support Rating

AWS Device Farm

AWS Device Farm 10.0
Based on 2 answers
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
Anonymous | TrustRadius Reviewer

Azure DevOps Services

Azure DevOps Services 8.4
Based on 20 answers
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
Anonymous | TrustRadius Reviewer

Implementation Rating

AWS Device Farm

No score
No answers yet
No answers on this topic

Azure DevOps Services

Azure DevOps Services 10.0
Based on 2 answers
Was not part of the process.
Anonymous | TrustRadius Reviewer

Alternatives Considered

AWS Device Farm

I got more features and handy within AWS Device farm than AWS Cloud9
Sachin Gevariya | TrustRadius Reviewer

Azure DevOps Services

Azure DevOps is much easier to implement and use on a daily basis than VersionOne. This is based on end-user feedback and my personal experience as well. ADO has more features and seems to get updated more frequently than VersionOne as well. VersionOne is less expensive overall than ADO, but our company prefers to use ADO because it has a lot more benefits.
Mark McCully | TrustRadius Reviewer

Return on Investment

AWS Device Farm

  • Quicker testing leads to faster product to market times
  • Can deploy updates much more regularly by testing across many devices quickly
Anonymous | TrustRadius Reviewer

Azure DevOps Services

  • It provides a great IDE to make things easier, clear, and compact. It has always been a positive ROI
  • It's worth the money. I don't think any other software could replace the VS. It has helped us a lot to making things ready on time
  • The only thing I dislike is that it takes a lot of memory space when in an idle state
AMANDEEP KUNDRAO | TrustRadius Reviewer

Add comparison