AWS CodePipeline vs. Azure DevOps

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
AWS CodePipeline
Score 7.1 out of 10
N/A
AWS CodePipeline is a fully managed continuous delivery service that helps users automate release pipelines. CodePipeline automates the build, test, and deploy phases of the release process every time there is a code change, based on the release model a user defines.
$1
per active pipeline/per month
Azure DevOps
Score 8.2 out of 10
N/A
Azure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.
$2
per GB (first 2GB free)
Pricing
AWS CodePipelineAzure DevOps
Editions & Modules
AWS CodePipeline
$1
per active pipeline/per month
Free Tier
Free
Azure Artifacts
$2
per GB (first 2GB free)
Basic Plan
$6
per user per month (first 5 users free)
Azure Pipelines - Self-Hosted
$15
per extra parallel job (1 free parallel job with unlimited minutes)
Azure Pipelines - Microsoft Hosted
$40
per parallel job (1,800 minutes free with 1 free parallel job)
Basic + Test Plan
$52
per user per month
Offerings
Pricing Offerings
AWS CodePipelineAzure DevOps
Free Trial
NoNo
Free/Freemium Version
YesNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
AWS CodePipelineAzure DevOps
Considered Both Products
AWS CodePipeline

No answer on this topic

Azure DevOps
Chose Azure DevOps
Azure DevOps required the least amount of up front knowledge to get a pipeline up and running. Because of the built in activities, when I initially started working with this tool I didn't have to know anything other than where my code was stored. The rest was easy enough to …
Best Alternatives
AWS CodePipelineAzure DevOps
Small Businesses
GitLab
GitLab
Score 8.7 out of 10
GitHub
GitHub
Score 9.1 out of 10
Medium-sized Companies
GitLab
GitLab
Score 8.7 out of 10
GitHub
GitHub
Score 9.1 out of 10
Enterprises
GitLab
GitLab
Score 8.7 out of 10
Perforce P4
Perforce P4
Score 7.0 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
AWS CodePipelineAzure DevOps
Likelihood to Recommend
9.0
(8 ratings)
8.4
(69 ratings)
Likelihood to Renew
-
(0 ratings)
10.0
(3 ratings)
Usability
9.0
(1 ratings)
7.7
(9 ratings)
Performance
6.8
(2 ratings)
-
(0 ratings)
Support Rating
9.1
(2 ratings)
8.1
(11 ratings)
Implementation Rating
-
(0 ratings)
10.0
(1 ratings)
Ease of integration
7.4
(2 ratings)
-
(0 ratings)
User Testimonials
AWS CodePipelineAzure DevOps
Likelihood to Recommend
Amazon AWS
I think AWS CodePipeline is a great tool for anyone wanted automated deployments in a multi-server/container AWS environment. AWS also offers services like Elastic Beanstalk that provide a more managed hosting & deployment experience. CodePipeline is a good middle ground with solid, built-in automation with enough customizability to not lock people into one deployment or architecture philosophy.
Read full review
Microsoft
Azure DevOps works well when you’ve got larger delivery efforts with multiple teams and a lot of moving parts, and you need one place to plan work, track it properly, and see how everything links together. It’s especially useful when delivery and development are closely tied and you want backlog items, code and releases connected rather than spread across tools. Where it’s less of a fit is for small teams or simple pieces of work, as it can feel like more setup and process than you really need, and non-technical users often struggle with the interface. It also isn’t great if you want instant, easy programme-level views or a very visual planning experience without putting time into configuration.
Read full review
Pros
Amazon AWS
  • It is reliable and works without errors
  • It integrates well with our repository and all other AWS functions as well as our end database
Read full review
Microsoft
  • Utilize Git as a repository to share work between multiple users
  • Ability to configure Pipelines to build containers to run virtual deployments and testing scripts.
  • Split individual tasks and relate to master documents for quick navigation and ability to see overall picture of project.
  • Track status of each task
  • Integrate with Git to utilize branches, merging, approvals, history, etc.
Read full review
Cons
Amazon AWS
  • Ease of use - things like CircleCI or other tools are a bit easier to learn.
  • Ability to build from more sources.
Read full review
Microsoft
  • I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
  • The wiki is not the prettiest thing to look at, so it could have refinements there.
  • It could improve the search slightly better.
Read full review
Likelihood to Renew
Amazon AWS
No answers on this topic
Microsoft
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
Read full review
Usability
Amazon AWS
Overall, I give AWS Codepipeline a 9 because it gets the job done and I can't complain much about the web interface as much of the action is taking place behind the scenes on the terminal locally or via Amazon's infrastructure anyway. It would be nicer to have a better flowing and visualizable web interface, however.
Read full review
Microsoft
It's a great help to get more information about new feature release and stay updated on what the dev team is working on. I like how easy it is to just login and read through the work items. Each work item has basic details: Title, Description, Assigned to, State, Area (what it belongs to), and iteration (when it’s worked on). See image above.They move through different states (New → Discovery → Ready for Prod → etc.).
Read full review
Performance
Amazon AWS
Our pipeline takes about 30 minutes to run through. Although this time depends on the applications you are using on either end, I feel that it is a reasonable time to make upgrades and updates to our system as it is not an every day push.
Read full review
Microsoft
No answers on this topic
Support Rating
Amazon AWS
We didn't need a lot of support with AWS CodePipeline as it was pretty straightforward to configure and use, but where we ran into problems, the AWS community was able to help. AWS support agents were also helpful in resolving some of the minor issues we encountered, which we could not find a solution elsewhere.
Read full review
Microsoft
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
Read full review
Implementation Rating
Amazon AWS
No answers on this topic
Microsoft
Was not part of the process.
Read full review
Alternatives Considered
Amazon AWS
CodeCommit and CodeDeploy can be used with CodePipeline so it’s not really fair to stack them against each other as they can be quite the compliment. The same goes for Beanstalk, which is often used as a deployment target in relation to CodePipeline.

CodePipeline fulfills the CI/CD duty, where the other services do not focus on that specific function. They are supplements, not replacements. CodePipeline will detect the updated code and handle deploying it to the actual instance via Beanstalk.

Jenkins is open source and not a native AWS service, that is its primary differentiator. Jenkins can also be used as a supplement to CodePipeline.
Read full review
Microsoft
Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
Read full review
Return on Investment
Amazon AWS
  • CodePipeline has reduced ongoing devops costs for my clients, especially around deployment & testing.
  • CodePipeline has sped up development workflow by making the deployment process automated off git pushes. Deployment takes very little coordination as the system will just trigger based on what is the latest commit in a branch.
  • CodePipeline offered a lot of out-of-the-box functionality that was much simpler to setup than a dedicated CI server. It allowed the deployment process to built and put into production with much less and effort and cost compared to rolling the functionality manually.
Read full review
Microsoft
  • We have saved a ton of time not calculating metrics by hand.
  • We no longer spend time writing out cards during planning, it goes straight to the board.
  • We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.
Read full review
ScreenShots