TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Azure DevOps

    Score8.1 out of 10
    N/AAzure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.

    $2

    per GB (first 2GB free)

    Jenkins

    Score8.2 out of 10
    N/AJenkins is an open source automation server. Jenkins provides hundreds of plugins to support building, deploying and automating any project. As an extensible automation server, Jenkins can be used as a simple CI server or turned into a continuous delivery hub for any project.N/A
    Pricing
    Azure DevOpsJenkins
    Editions & Modules
    Azure Artifacts
    $2
    per GB (first 2GB free)
    Basic Plan
    $6
    per user per month (first 5 users free)
    Azure Pipelines - Self-Hosted
    $15
    per extra parallel job (1 free parallel job with unlimited minutes)
    Azure Pipelines - Microsoft Hosted
    $40
    per parallel job (1,800 minutes free with 1 free parallel job)
    Basic + Test Plan
    $52
    per user per month
    No answers on this topic
    Offerings
    Pricing Offerings
    Azure DevOpsJenkins
    Free Trial
    NoNo
    Free/Freemium Version
    NoYes
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    Azure DevOpsJenkins
    Considered Both Products
    Microsoft
    Chose Azure DevOps
    If you are currently using Jenkins or Bitbucket as an ALM tool, then I would highly recommend taking a look at Azure DevOps as the integration to the Microsoft stack is extremely easy and versatile. Microsoft has invested heavily in getting this tool best in class with the …
    Incentivized
    Chose Azure DevOps
    VSTS is great if you final source system is Microsoft based. Everything work well together and once you learned how use VSTS it isn't difficult to build more build systems. If your staff are used to the methods Microsoft uses, their time learning VSTS won't be as difficult as …
    Incentivized
    Chose Azure DevOps
    As a cloud services user of Azure, using Azure DevOps made sense because it has the most support tailored for Azure ecosystem.
    Incentivized
    Chose Azure DevOps
    Azure DevOps is a completed product and ecosystem. It offers a robust ecosystem that does everything that is needed. The above products do lack features like pipelines tasks, third-party integrations. Besides all cloud benefits, the main advantage of Azure DevOps Services …
    Incentivized
    Chose Azure DevOps
    The greatest strength of Azure DevOps Services (formerly VSTS) is that it's a one-stop solution for all agile project management instead of setting up bits of different software put together for each and every need. Azure DevOps Services (formerly VSTS) has a great ecosystem …
    Incentivized
    Chose Azure DevOps
    I prefer Azure Devops over all other code repository / ci/cd systems that I've used in the past. All features are integrated into a single service (back log, repo mgmt, deployment pipelines, artifacts, etc.). The tools are easy to use and super powerful.
    Incentivized
    Chose Azure DevOps
    Our company is already using a lot of Azure services and it makes more sense to start using Azure DevOps Services (formerly VSTS) when we needed a CI/CD tool. We tested different features of Azure DevOps Services (formerly VSTS) and found out that the build and release …
    Incentivized
    Chose Azure DevOps
    One of the foremost reasons that acted in favor of Azure DevOps was its all-in-one packed web portal which enabled easy access to all the CI/CD tools and kits. Customizable screens, notifications via Teams/mails, project views, etc. Most other tools/products offer only part of …
    Incentivized
    Chose Azure DevOps
    Azure DevOps required the least amount of up front knowledge to get a pipeline up and running. Because of the built in activities, when I initially started working with this tool I didn't have to know anything other than where my code was stored. The rest was easy enough to …
    Incentivized
    Chose Azure DevOps
    Excellent tool when used in Microsoft technology environment.
    Incentivized
    Chose Azure DevOps
    With more functionality added, JIRA has become slow, whereas VSTS is a pleasure to use. Trac and JIRA do not show the entire health status of the pipeline like VSTS. Hygieia is open source and trying to achieve what VSTS does but it is not as mature yet.
    Incentivized
    Chose Azure DevOps
    VSTS is the best integrated tracking and deployment software for a pure Microsoft shop. It has some weaknesses, the builds aren't as easy to configure as TeamCity and the security setup is needlessly convoluted, but it is a solid offering.
    Incentivized
    Chose Azure DevOps
    There is little sensible competition for Visual Studio Team System as it offers a unique solution for Microsoft development. It is possible to build a similar solution using various open source technologies, but the will never compete in terms of unified solution.
    Incentivized
    Open Source
    Chose Jenkins
    Team services, while very similar, did not really have that much more added features for the much higher price tag. The team has moved over to the subscription-based Visual Studio so we may be reevaluating this solution as now it is part of our subscription and no longer an …
    Incentivized
    Key User Insights
    Would buy again
    97%
    Would buy again
    38 Answers
    87%
    Would buy again
    26 Answers
    Delivers good value for the price
    100%
    Delivers good value for the price
    37 Answers
    100%
    Delivers good value for the price
    27 Answers
    Happy with the feature set
    100%
    Happy with the feature set
    39 Answers
    87%
    Happy with the feature set
    26 Answers
    Lived up to sales and marketing promises
    96%
    Lived up to sales and marketing promises
    23 Answers
    93%
    Lived up to sales and marketing promises
    13 Answers
    Implementation went as expected
    100%
    Implementation went as expected
    32 Answers
    96%
    Implementation went as expected
    22 Answers
    Best Alternatives
    Azure DevOpsJenkins
    Small Businesses
    No answers on this topic
    Apache Maven
    Score9 out of 10
    Medium-sized Companies
    Azure DevOps Server
    Score8.5 out of 10
    Apache Maven
    Score9 out of 10
    Enterprises
    Azure DevOps Server
    Score8.5 out of 10
    Gradle Build Tool (Open Source)
    Score9 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    Azure DevOpsJenkins
    Likelihood to Recommend
    8.9
    (74 ratings)
    6.7
    (74 ratings)
    Likelihood to Renew
    10.0
    (3 ratings)
    -
    (0 ratings)
    Usability
    8.4
    (13 ratings)
    6.4
    (8 ratings)
    Performance
    -
    (0 ratings)
    8.9
    (6 ratings)
    Support Rating
    8.1
    (11 ratings)
    6.6
    (6 ratings)
    Implementation Rating
    10.0
    (1 ratings)
    6.0
    (1 ratings)
    User Testimonials
    Azure DevOpsJenkins
    Likelihood to Recommend
    Microsoft
    Azure DevOps works well when you’ve got larger delivery efforts with multiple teams and a lot of moving parts, and you need one place to plan work, track it properly, and see how everything links together. It’s especially useful when delivery and development are closely tied and you want backlog items, code and releases connected rather than spread across tools. Where it’s less of a fit is for small teams or simple pieces of work, as it can feel like more setup and process than you really need, and non-technical users often struggle with the interface. It also isn’t great if you want instant, easy programme-level views or a very visual planning experience without putting time into configuration.
    Incentivized
    Read full review
    Open Source
    Jenkins is a highly customizable CI/CD tool with excellent community support. One can use Jenkins to build and deploy monolith services to microservices with ease. It can handle multiple "builds" per agent simultaneously, but the process can be resource hungry, and you need some impressive specs server for that. With Jenkins, you can automate almost any task. Also, as it is an open source, we can save a load of money by not spending on enterprise CI/CD tools.
    Incentivized
    Read full review
    Pros
    Microsoft
    • Utilize Git as a repository to share work between multiple users
    • Ability to configure Pipelines to build containers to run virtual deployments and testing scripts.
    • Split individual tasks and relate to master documents for quick navigation and ability to see overall picture of project.
    • Track status of each task
    • Integrate with Git to utilize branches, merging, approvals, history, etc.
    Incentivized
    Read full review
    Open Source
    • Automated Builds: Jenkins is configured to monitor the version control system for new pull requests. Once a pull request is created, Jenkins automatically triggers a build process. It checks out the code, compiles it, and performs any necessary build steps specified in the configuration.
    • Unit Testing: Jenkins runs the suite of unit tests defined for the project. These tests verify the functionality of individual components and catch any regressions or errors. If any unit tests fail, Jenkins marks the build as unsuccessful, and the developer is notified to fix the issues.
    • Code Analysis: Jenkins integrates with code analysis tools like SonarQube or Checkstyle. It analyzes the code for quality, adherence to coding standards, and potential bugs or vulnerabilities. The results are reported back to the developer and the product review team for further inspection.
    Incentivized
    Read full review
    Cons
    Microsoft
    • I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
    • The wiki is not the prettiest thing to look at, so it could have refinements there.
    • It could improve the search slightly better.
    Read full review
    Open Source
    • The UI could be slightly better, it feels kind of like the 90s, but it works well.
    • An easier way to filter jobs other than views on the dashboard.
    • An easier way to read the console logs when tests do fail.
    Incentivized
    Read full review
    Likelihood to Renew
    Microsoft
    I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
    Incentivized
    Read full review
    Open Source
    We have a certain buy-in as we have made a lot of integrations and useful tools around jenkins, so it would cost us quite some time to change to another tool. Besides that, it is very versatile, and once you have things set up, it feels unnecessary to change tool. It is also a plus that it is open source.
    Incentivized
    Read full review
    Usability
    Microsoft
    It's a great help to get more information about new feature release and stay updated on what the dev team is working on. I like how easy it is to just login and read through the work items. Each work item has basic details: Title, Description, Assigned to, State, Area (what it belongs to), and iteration (when it’s worked on). See image above.They move through different states (New → Discovery → Ready for Prod → etc.).
    Incentivized
    Read full review
    Open Source
    Jenkins streamlines development and provides end to end automated integration and deployment. It even supports Docker and Kubernetes using which container instances can be managed effectively. It is easy to add documentation and apply role based access to files and services using Jenkins giving full control to the users. Any deviation can be easily tracked using the audit logs.
    Incentivized
    Read full review
    Performance
    Microsoft
    No answers on this topic
    Open Source
    No, when we integrated this with GitHub, it becomes more easy and smart to manage and control our workforce. Our distributed workforce is now streamlined to a single bucket. All of our codes and production outputs are now automatically synced with all the workers. There are many cases when our in-house team makes changes in the release, our remote workers make another release with other environment variables. So it is better to get all of the work in control.
    Incentivized
    Read full review
    Support Rating
    Microsoft
    When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
    Incentivized
    Read full review
    Open Source
    As with all open source solutions, the support can be minimal and the information that you can find online can at times be misleading. Support may be one of the only real downsides to the overall software package. The user community can be helpful and is needed as the product is not the most user-friendly thing we have used.
    Incentivized
    Read full review
    Implementation Rating
    Microsoft
    Was not part of the process.
    Incentivized
    Read full review
    Open Source
    It is worth well the time to setup Jenkins in a docker container. It is also well worth to take the time to move any "Jenkins configuration" into Jenkinsfiles and not take shortcuts.
    Incentivized
    Read full review
    Alternatives Considered
    Microsoft
    Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
    Incentivized
    Read full review
    Open Source
    Overall, Jenkins is the easiest platform for someone who has no experience to come in and use effectively. We can get a junior engineer into Jenkins, give them access, and point them in the right direction with minimal hand-holding. The competing products I have used (TravisCI/GitLab/Azure) provide other options but can obfuscate the process due to the lack of straightforward simplicity. In other areas (capability, power, customization), Jenkins keeps up with the competition and, in some areas, like customization, exceeds others.
    Incentivized
    Read full review
    Return on Investment
    Microsoft
    • We have saved a ton of time not calculating metrics by hand.
    • We no longer spend time writing out cards during planning, it goes straight to the board.
    • We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.
    Incentivized
    Read full review
    Open Source
    • Faster Time-to-Market: Jenkins automate the build, testing, and deployment process, enabling faster feedback and continuous improvement.
    • Improved Quality: Jenkins automatically run unit tests and integration tests, ensuring that code changes meet the necessary quality standards.
    • Cost Savings: Jenkins is an open-source tool that is free to use
    Incentivized
    Read full review
    ScreenShots