TrustRadius: an HG Insights company

Amazon Web Services vs. Azure DevOps vs. Azure DevOps Server

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Amazon Web Services

    Score8.7 out of 10
    N/AAmazon Web Services (AWS) is a subsidiary of Amazon that provides on-demand cloud computing services. With over 165 services offered, AWS services can provide users with a comprehensive suite of infrastructure and computing building blocks and tools.

    $100

    per month

    Azure DevOps

    Score8.1 out of 10
    N/AAzure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.

    $2

    per GB (first 2GB free)

    Azure DevOps Server

    Score8.5 out of 10
    N/AAzure DevOps Server (formerly Team Foundation Server, or TFS) is the on-premise version of Azure DevOps. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.N/A
    Pricing
    Amazon Web ServicesAzure DevOpsAzure DevOps Server
    Editions & Modules
    Free Tier
    $0
    per month
    Basic Environment
    $100 - $200
    per month
    Intermediate Environment
    $250 - $600
    per month
    Advanced Environment
    $600-$2500
    per month
    Azure Artifacts
    $2
    per GB (first 2GB free)
    Basic Plan
    $6
    per user per month (first 5 users free)
    Azure Pipelines - Self-Hosted
    $15
    per extra parallel job (1 free parallel job with unlimited minutes)
    Azure Pipelines - Microsoft Hosted
    $40
    per parallel job (1,800 minutes free with 1 free parallel job)
    Basic + Test Plan
    $52
    per user per month
    No answers on this topic
    Offerings
    Pricing Offerings
    Amazon Web ServicesAzure DevOpsAzure DevOps Server
    Free Trial
    YesNoNo
    Free/Freemium Version
    YesNoYes
    Premium Consulting/Integration Services
    NoNoNo
    Entry-level Setup FeeNo setup feeNo setup feeNo setup fee
    Additional DetailsAWS allows a “save when you commit” option that offers lower prices when you sign up for a 1- or 3- year term that includes an AWS service or category of services.——
    More Pricing Information
    Community Pulse
    Amazon Web ServicesAzure DevOpsAzure DevOps Server
    Considered Multiple Products
    Amazon AWS
    Chose Amazon Web Services
    I selected AWS for my development environment and disaster recovery, due to the simplicity compared to other vendors.
    Incentivized
    Chose Amazon Web Services
    AWS has more APIs to use on the cloud. Microsoft has an API mainly for the Microsoft platform. And Google has different big data analytics than other competitors [do].
    Incentivized
    Microsoft
    Chose Azure DevOps
    Beside all cloud benefits, the main advantage Azure DevOps Services compared to Azure DevOps Server is the easier remote access for third party team members, and always up to date software.
    On the other hand, on prem deployment (Azure DevOps Server) makes complex access or …
    Incentivized
    Chose Azure DevOps
    Compared to other tools we have used, Microsoft STS has been a much more complete tool. Communication, collaboration, tracking, management, automation, testing, speed to production—all these areas have been improved since we started using Microsoft STS. We have been looking for …
    Incentivized
    Chose Azure DevOps
    Easier to use than GitHub, but it comes at a cost. Although you can script VSTS, the online version could use a more substantial editor. Those who remember project Monaco and its current implementation in Azure, App Service Editor, will be disappointed if looking for more of …
    Incentivized
    Chose Azure DevOps
    Excellent tool when used in Microsoft technology environment.
    Incentivized
    Chose Azure DevOps
    Our TFS was dated and in some ways was quite crude. VSTS is thoroughly modern and I don't have to worry about updating it since MS is always updating VSTS. Also, VSTS has better integration with other products such as JIRA than our older TFS would. I am sure you could integrate …
    Incentivized
    Chose Azure DevOps
    Being its predecessor, VSS has a very limited team-sharing view, providing little to no multiple-user, multiple-project support. Considering the fact that Microsoft has purged its support in favor of TFS and VSTS, it's only reasonable to believe they have something extra. Git …
    Incentivized
    Chose Azure DevOps
    Very simple to setup, easy connection to Visual Studio, nice web UI.
    Incentivized
    Chose Azure DevOps
    Haven't used a lot of similar products that have the full feature set as Visual Studio. It's highly effective development platform especially when used with SVN and TFS makes large Agile project easy to manage and collaborate.
    Incentivized
    Chose Azure DevOps
    I haven't used any other products, so I can't say how VSTS/TFS would stack against any competitors, but I know that for an SDLC management tool, VSTS/TFS has everything you need to help an organization meet the requirements needed to adhere to the specific/general practices …
    Incentivized
    Microsoft
    Chose Azure DevOps Server
    My organization already has an established Microsoft relationship which allowed us to move faster in procuring the product. The alternative would require my large organization to move at a snail's pace at procurement. This is not necessarily a hindrance for most other …
    Incentivized
    Chose Azure DevOps Server
    Azure DevOps server has quite an upper hand while we compare it with other tools in the market. Its not just a tool in fact its been a complete suit. If we look out at other products available as alternative options to Azure DevOps Server, they are meant for a specific purpose …
    Incentivized
    Key User Insights
    Would buy again
    92%
    Would buy again
    48 Answers
    97%
    Would buy again
    38 Answers
    91%
    Would buy again
    21 Answers
    Delivers good value for the price
    92%
    Delivers good value for the price
    45 Answers
    100%
    Delivers good value for the price
    37 Answers
    100%
    Delivers good value for the price
    18 Answers
    Happy with the feature set
    96%
    Happy with the feature set
    50 Answers
    100%
    Happy with the feature set
    39 Answers
    91%
    Happy with the feature set
    21 Answers
    Lived up to sales and marketing promises
    90%
    Lived up to sales and marketing promises
    38 Answers
    96%
    Lived up to sales and marketing promises
    23 Answers
    100%
    Lived up to sales and marketing promises
    13 Answers
    Implementation went as expected
    91%
    Implementation went as expected
    40 Answers
    100%
    Implementation went as expected
    32 Answers
    100%
    Implementation went as expected
    15 Answers
    Features
    Amazon Web ServicesAzure DevOpsAzure DevOps Server
    Infrastructure-as-a-Service (IaaS)
    Comparison of Infrastructure-as-a-Service (IaaS) features of Amazon Web Services and Azure DevOps and Azure DevOps Server
    Feature
    Amazon Web Services
    8.6
    79 Ratings
    4% above category average
    Azure DevOps
    -
    Ratings
    Azure DevOps Server
    -
    Ratings
    Service-level Agreement (SLA) uptime9.273 Ratings00 Ratings00 Ratings
    Dynamic scaling8.974 Ratings00 Ratings00 Ratings
    Elastic load balancing9.470 Ratings00 Ratings00 Ratings
    Pre-configured templates7.567 Ratings00 Ratings00 Ratings
    Monitoring tools8.774 Ratings00 Ratings00 Ratings
    Pre-defined machine images8.367 Ratings00 Ratings00 Ratings
    Operating system support8.273 Ratings00 Ratings00 Ratings
    Security controls8.875 Ratings00 Ratings00 Ratings
    Automation8.126 Ratings00 Ratings00 Ratings
    Best Alternatives
    Amazon Web ServicesAzure DevOpsAzure DevOps Server
    Small Businesses
    IBM Cloud Object Storage
    Score9 out of 10
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    IBM Cloud Bare Metal Servers
    Score8.7 out of 10
    Azure DevOps Server
    Score8.5 out of 10
    Azure DevOps
    Score8.1 out of 10
    Enterprises
    SAP on IBM Cloud
    Score9 out of 10
    Azure DevOps Server
    Score8.5 out of 10
    Azure DevOps
    Score8.1 out of 10
    All AlternativesView all alternativesView all alternativesView all alternatives
    User Ratings
    Amazon Web ServicesAzure DevOpsAzure DevOps Server
    Likelihood to Recommend
    8.0
    (91 ratings)
    8.9
    (74 ratings)
    9.0
    (48 ratings)
    Likelihood to Renew
    9.4
    (10 ratings)
    10.0
    (3 ratings)
    10.0
    (1 ratings)
    Usability
    7.8
    (22 ratings)
    8.4
    (13 ratings)
    6.0
    (4 ratings)
    Availability
    9.0
    (1 ratings)
    -
    (0 ratings)
    -
    (0 ratings)
    Support Rating
    7.2
    (24 ratings)
    8.1
    (11 ratings)
    8.4
    (10 ratings)
    Online Training
    7.0
    (1 ratings)
    -
    (0 ratings)
    -
    (0 ratings)
    Implementation Rating
    10.0
    (3 ratings)
    10.0
    (1 ratings)
    8.0
    (1 ratings)
    Ease of integration
    -
    (0 ratings)
    -
    (0 ratings)
    9.0
    (2 ratings)
    User Testimonials
    Amazon Web ServicesAzure DevOpsAzure DevOps Server
    Likelihood to Recommend
    Amazon AWS
    This is something that is actually common across most cloud providers. A comprehensive understanding of one's use cases, constraints and future directions is key to determining if you even need a cloud solution. If you are a 2-person startup developing something with a best-scenario audience of 1k DAU in a year, you would very likely best served by a dirt-cheap dedicated Linux server somewhere (and your options to graduate to a cloud solution will still be open). If, however, you are a bigger fish, and/or you are actively considering build-vs-buy decisions for complicated, highly-loaded, six-figure requests per minute systems, global loadbalancing, extreme growth projections - then MAYBE you solve all or part of it with a cloud provider. And depending on your taste for risk, reliability, flexibility, track record - it might be AWS.
    Incentivized
    Read full review
    Microsoft
    Azure DevOps works well when you’ve got larger delivery efforts with multiple teams and a lot of moving parts, and you need one place to plan work, track it properly, and see how everything links together. It’s especially useful when delivery and development are closely tied and you want backlog items, code and releases connected rather than spread across tools. Where it’s less of a fit is for small teams or simple pieces of work, as it can feel like more setup and process than you really need, and non-technical users often struggle with the interface. It also isn’t great if you want instant, easy programme-level views or a very visual planning experience without putting time into configuration.
    Incentivized
    Read full review
    Microsoft
    Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
    Incentivized
    Read full review
    Pros
    Amazon AWS
    • During the month-end, we experience high resource utilization; however, with AWS's scalability, we can effectively tackle the peak load.
    • With AWS IAM, we don't need to set up complete infrastructure for identity and access management, as AWS provides end-to-end IAM services.
    • With AWS, development has become very easy as it's very quick to spin up and destroy the environment, which saves costs.
    Incentivized
    Read full review
    Microsoft
    • Utilize Git as a repository to share work between multiple users
    • Ability to configure Pipelines to build containers to run virtual deployments and testing scripts.
    • Split individual tasks and relate to master documents for quick navigation and ability to see overall picture of project.
    • Track status of each task
    • Integrate with Git to utilize branches, merging, approvals, history, etc.
    Incentivized
    Read full review
    Microsoft
    • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
    • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
    • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
    Incentivized
    Read full review
    Cons
    Amazon AWS
    • When there is any misconfiguration of EC2 related to SSM Connect. It doesn't clearly states that what particular configuration is missing.
    • Debugging networking related issues could be improved.
    • From the security group page, it's difficult to determine which resource a security group is associated with.
    Incentivized
    Read full review
    Microsoft
    • I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
    • The wiki is not the prettiest thing to look at, so it could have refinements there.
    • It could improve the search slightly better.
    Read full review
    Microsoft
    • Can add more build templates for specific technology requirements
    • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
    • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
    Incentivized
    Read full review
    Likelihood to Renew
    Amazon AWS
    We are almost entirely satisfied with the service. In order to move off it, we'd have to build for ourselves many of the services that AWS provides and the cost would be prohibitive. Although there are cost savings and security benefits to returning to the colo facility, we could never afford to do it, and we'd hate to give up the innovation and constant cycle of new features that AWS gives us.
    Read full review
    Microsoft
    I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
    Incentivized
    Read full review
    Microsoft
    Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
    Incentivized
    Read full review
    Usability
    Amazon AWS
    AWS offers a wide range of powerful services that cater to various business needs which is significant strength. The ability to scale resources on-demand is a major advantage making it suitable for businesses of all sizes. The sheer volume of options and configurations can be overwhelming for new users leading to a steep learning curve. While functional the AWS management console can feel cluttered and less intuitive compared to some competitors which can hinder navigation. Although some documentation lacks clarity and practical examples which can frustrate users trying to implement specific solutions.
    Incentivized
    Read full review
    Microsoft
    It's a great help to get more information about new feature release and stay updated on what the dev team is working on. I like how easy it is to just login and read through the work items. Each work item has basic details: Title, Description, Assigned to, State, Area (what it belongs to), and iteration (when it’s worked on). See image above.They move through different states (New → Discovery → Ready for Prod → etc.).
    Incentivized
    Read full review
    Microsoft
    For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.
    Incentivized
    Read full review
    Reliability and Availability
    Amazon AWS
    Availability is very good, with the exception of occasional spectacular outages.
    Read full review
    Microsoft
    No answers on this topic
    Microsoft
    No answers on this topic
    Performance
    Amazon AWS
    AWS does not provide the raw performance that you can get by building your own custom infrastructure. However, it is often the case that the benefits of specialized, high-performance hardware do not necessarily outweigh the significant extra cost and risk. Performance as perceived by the user is very different from raw throughput.
    Read full review
    Microsoft
    No answers on this topic
    Microsoft
    No answers on this topic
    Support Rating
    Amazon AWS
    The customer support of Amazon Web Services are quick in their responses. I appreciate its entire team, which works amazingly, and provides professional support. AWS is a great tool, indeed, to provide customers a suitable way to
    immediately search for their compatible software's and also to guide them in a
    good direction. Moreover, this product is a good suggestion for every type of
    company because of its affordability and ease of use.
    Incentivized
    Read full review
    Microsoft
    When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
    Incentivized
    Read full review
    Microsoft
    I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
    Incentivized
    Read full review
    Implementation Rating
    Amazon AWS
    The API's were very well documented and was Janova's main point of entry into the services.
    Read full review
    Microsoft
    Was not part of the process.
    Incentivized
    Read full review
    Microsoft
    Do research beforehand and, if possible, do a trial run before implementing into production environment.
    Incentivized
    Read full review
    Alternatives Considered
    Amazon AWS
    Amazon Web Services fits best for all levels of organisations like startup, mid level or enterprise. The services are easy to use and doesn't require a high level of understanding as you can learn via blogs or youtube videos. AWS is Reasonable in cost as the plan is pay as you use.
    Incentivized
    Read full review
    Microsoft
    Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
    Incentivized
    Read full review
    Microsoft
    In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
    Incentivized
    Read full review
    Return on Investment
    Amazon AWS
    • Using Amazon Web Services has allowed us to develop and deploy new SAAS solutions quicker than we did when we used traditional web hosting. This has allowed us to grow our service offerings to clients and also add more value to our existing services.
    • Having AWS deployed has also allowed our development team to focus on delivering high-quality software without worrying about whether our servers will be able to handle the demand. Since AWS allows you to adjust your server needs based on demand, we can easily assign a faster server instance to ease and improve service without the client even knowing what we did.
    Incentivized
    Read full review
    Microsoft
    • We have saved a ton of time not calculating metrics by hand.
    • We no longer spend time writing out cards during planning, it goes straight to the board.
    • We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.
    Incentivized
    Read full review
    Microsoft
    • It has streamlined the pipeline and project management for our agile effort.
    • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
    • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
    Incentivized
    Read full review
    ScreenShots