Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure DevOps Server
Score 8.4 out of 10
N/A
Azure DevOps Server (formerly Team Foundation Server, or TFS) is the on-premise version of Azure DevOps. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.N/A
CloudBees Continuous Integration
Score 7.8 out of 10
N/A
CloudBees Continuous Integration (formerly the CloudBees Jenkins Platform) is a continuous integration (CI) and continuous delivery (CD) solution that extends Jenkins. Developed for on-premise installations, CloudBees CI offers stable releases with monthly updates, as well as additional proprietary tools and enterprise features to enhance the manageability and security of Jenkins. CloudBees CI helps administrators manage growing installations due to ever-increasing teams, projects and jobs…N/A
Jenkins
Score 8.4 out of 10
N/A
Jenkins is an open source automation server. Jenkins provides hundreds of plugins to support building, deploying and automating any project. As an extensible automation server, Jenkins can be used as a simple CI server or turned into a continuous delivery hub for any project.N/A
Pricing
Azure DevOps ServerCloudBees Continuous IntegrationJenkins
Editions & Modules
No answers on this topic
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
Azure DevOps ServerCloudBees Continuous IntegrationJenkins
Free Trial
NoNoNo
Free/Freemium Version
YesNoYes
Premium Consulting/Integration Services
NoNoNo
Entry-level Setup FeeNo setup feeOptionalNo setup fee
Additional Details
More Pricing Information
Community Pulse
Azure DevOps ServerCloudBees Continuous IntegrationJenkins
Considered Multiple Products
Azure DevOps Server
Chose Azure DevOps Server
Because of the microsoft ecosystem and the product is also build on ms services cloud which uses azure internal services so it is easy to integrate.
more reliant support available for the microsoft services because of the well established user community of the product and …
Chose Azure DevOps Server
Microsoft Azure DevOps is the one that integrates everything you can possibly use and provides a solution that eases your developing process. It has a strong support community and well-written documentation. No matter what you do, you will always find the right pipeline. It is …
Chose Azure DevOps Server
I was not involved in selecting the tool.
Chose Azure DevOps Server
Azure DevOps server has quite an upper hand while we compare it with other tools in the market. Its not just a tool in fact its been a complete suit. If we look out at other products available as alternative options to Azure DevOps Server, they are meant for a specific purpose …
CloudBees Continuous Integration
Chose CloudBees Continuous Integration
CloudBees Jenkins Support is on par with the other enterprise tools we're currently using. It has performed well enough that we've adopted the product and placed it in the critical path of our software delivery pipelines.
Jenkins
Chose Jenkins
Overall, Jenkins is the easiest platform for someone who has no experience to come in and use effectively. We can get a junior engineer into Jenkins, give them access, and point them in the right direction with minimal hand-holding. The competing products I have used (TravisCI/G…
Chose Jenkins
Jenkins supports multi-platforms quite well and that is the main reason why it was initially chosen.
Best Alternatives
Azure DevOps ServerCloudBees Continuous IntegrationJenkins
Small Businesses
GitHub
GitHub
Score 9.1 out of 10
GitLab
GitLab
Score 8.8 out of 10
GitLab
GitLab
Score 8.8 out of 10
Medium-sized Companies
GitHub
GitHub
Score 9.1 out of 10
GitLab
GitLab
Score 8.8 out of 10
GitLab
GitLab
Score 8.8 out of 10
Enterprises
Perforce P4
Perforce P4
Score 7.2 out of 10
GitLab
GitLab
Score 8.8 out of 10
GitLab
GitLab
Score 8.8 out of 10
All AlternativesView all alternativesView all alternativesView all alternatives
User Ratings
Azure DevOps ServerCloudBees Continuous IntegrationJenkins
Likelihood to Recommend
9.0
(48 ratings)
9.0
(2 ratings)
7.0
(74 ratings)
Likelihood to Renew
10.0
(1 ratings)
-
(0 ratings)
-
(0 ratings)
Usability
6.0
(4 ratings)
-
(0 ratings)
6.7
(8 ratings)
Performance
-
(0 ratings)
-
(0 ratings)
8.9
(6 ratings)
Support Rating
8.4
(10 ratings)
5.0
(1 ratings)
6.6
(6 ratings)
Implementation Rating
8.0
(1 ratings)
-
(0 ratings)
6.0
(1 ratings)
Ease of integration
9.0
(2 ratings)
-
(0 ratings)
-
(0 ratings)
User Testimonials
Azure DevOps ServerCloudBees Continuous IntegrationJenkins
Likelihood to Recommend
Microsoft
Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
Read full review
CloudBees
For all continuous integration features like multi branch pipeline, continuous build, and deployment execution, highly customizable groovy scripting, well integration with most of repositories like SVN, GIT, etc. are some of the exceptional features which helps devOps related tasks a treat to work everyday. With some minor changes in agent configuration and handling of their configuration on master instances would reduce a lot of issues. Also, cache of maven handling on agents needs to be improved (though not related to tool but the CI pipelines). But, since this is a very mature and performant tool, we expect some out of the box functionalities to handle all such scenarios. Overall, the tool works wonders because of its highly customizable features.
Read full review
Open Source
Jenkins is a highly customizable CI/CD tool with excellent community support. One can use Jenkins to build and deploy monolith services to microservices with ease. It can handle multiple "builds" per agent simultaneously, but the process can be resource hungry, and you need some impressive specs server for that. With Jenkins, you can automate almost any task. Also, as it is an open source, we can save a load of money by not spending on enterprise CI/CD tools.
Read full review
Pros
Microsoft
  • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
  • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
  • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
Read full review
CloudBees
  • Customer Support
  • Solutions engineering
Read full review
Open Source
  • Automated Builds: Jenkins is configured to monitor the version control system for new pull requests. Once a pull request is created, Jenkins automatically triggers a build process. It checks out the code, compiles it, and performs any necessary build steps specified in the configuration.
  • Unit Testing: Jenkins runs the suite of unit tests defined for the project. These tests verify the functionality of individual components and catch any regressions or errors. If any unit tests fail, Jenkins marks the build as unsuccessful, and the developer is notified to fix the issues.
  • Code Analysis: Jenkins integrates with code analysis tools like SonarQube or Checkstyle. It analyzes the code for quality, adherence to coding standards, and potential bugs or vulnerabilities. The results are reported back to the developer and the product review team for further inspection.
Read full review
Cons
Microsoft
  • Can add more build templates for specific technology requirements
  • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
  • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
Read full review
CloudBees
  • File or Workspace Management
  • Agent configurations at master level
  • Better Support for issues in product
Read full review
Open Source
  • The UI could be slightly better, it feels kind of like the 90s, but it works well.
  • An easier way to filter jobs other than views on the dashboard.
  • An easier way to read the console logs when tests do fail.
Read full review
Likelihood to Renew
Microsoft
Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Read full review
CloudBees
No answers on this topic
Open Source
We have a certain buy-in as we have made a lot of integrations and useful tools around jenkins, so it would cost us quite some time to change to another tool. Besides that, it is very versatile, and once you have things set up, it feels unnecessary to change tool. It is also a plus that it is open source.
Read full review
Usability
Microsoft
For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.
Read full review
CloudBees
No answers on this topic
Open Source
Jenkins streamlines development and provides end to end automated integration and deployment. It even supports Docker and Kubernetes using which container instances can be managed effectively. It is easy to add documentation and apply role based access to files and services using Jenkins giving full control to the users. Any deviation can be easily tracked using the audit logs.
Read full review
Performance
Microsoft
No answers on this topic
CloudBees
No answers on this topic
Open Source
No, when we integrated this with GitHub, it becomes more easy and smart to manage and control our workforce. Our distributed workforce is now streamlined to a single bucket. All of our codes and production outputs are now automatically synced with all the workers. There are many cases when our in-house team makes changes in the release, our remote workers make another release with other environment variables. So it is better to get all of the work in control.
Read full review
Support Rating
Microsoft
I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Read full review
CloudBees
Support seems very unreachable from my experience. They handle cases if developers are facing issues, support seems to be very limited. It's not like other tools in a market where every mail is being taken priority and responses are sent. We see a lack in this particular aspect when it comes to CloudBees Jenkins Platform.
Read full review
Open Source
As with all open source solutions, the support can be minimal and the information that you can find online can at times be misleading. Support may be one of the only real downsides to the overall software package. The user community can be helpful and is needed as the product is not the most user-friendly thing we have used.
Read full review
Implementation Rating
Microsoft
Do research beforehand and, if possible, do a trial run before implementing into production environment.
Read full review
CloudBees
No answers on this topic
Open Source
It is worth well the time to setup Jenkins in a docker container. It is also well worth to take the time to move any "Jenkins configuration" into Jenkinsfiles and not take shortcuts.
Read full review
Alternatives Considered
Microsoft
In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
Read full review
CloudBees
CloudBees Jenkins Support is on par with the other enterprise tools we're currently using. It has performed well enough that we've adopted the product and placed it in the critical path of our software delivery pipelines.
Read full review
Open Source
Overall, Jenkins is the easiest platform for someone who has no experience to come in and use effectively. We can get a junior engineer into Jenkins, give them access, and point them in the right direction with minimal hand-holding. The competing products I have used (TravisCI/GitLab/Azure) provide other options but can obfuscate the process due to the lack of straightforward simplicity. In other areas (capability, power, customization), Jenkins keeps up with the competition and, in some areas, like customization, exceeds others.
Read full review
Return on Investment
Microsoft
  • It has streamlined the pipeline and project management for our agile effort.
  • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
  • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
Read full review
CloudBees
  • Positive - Handles number of requests
  • Positive - Customizations of pipelines helps integrate many type of frameworks
  • Negative - Cache management on agents for dependencies downloaded
  • Positive - credential management helps reduce configurations to be done for each project job at manual level
Read full review
Open Source
  • Faster Time-to-Market: Jenkins automate the build, testing, and deployment process, enabling faster feedback and continuous improvement.
  • Improved Quality: Jenkins automatically run unit tests and integration tests, ensuring that code changes meet the necessary quality standards.
  • Cost Savings: Jenkins is an open-source tool that is free to use
Read full review
ScreenShots