Jenkins vs. Upsource

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Jenkins
Score 8.4 out of 10
N/A
Jenkins is an open source automation server. Jenkins provides hundreds of plugins to support building, deploying and automating any project. As an extensible automation server, Jenkins can be used as a simple CI server or turned into a continuous delivery hub for any project.N/A
Upsource
Score 8.0 out of 10
N/A
N/AN/A
Pricing
JenkinsUpsource
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
JenkinsUpsource
Free Trial
NoNo
Free/Freemium Version
YesNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
JenkinsUpsource
Best Alternatives
JenkinsUpsource
Small Businesses
GitLab
GitLab
Score 8.7 out of 10
GitHub
GitHub
Score 9.1 out of 10
Medium-sized Companies
GitLab
GitLab
Score 8.7 out of 10
Veracode
Veracode
Score 9.1 out of 10
Enterprises
GitLab
GitLab
Score 8.7 out of 10
Perforce P4
Perforce P4
Score 7.0 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
JenkinsUpsource
Likelihood to Recommend
7.0
(74 ratings)
8.0
(1 ratings)
Usability
6.7
(8 ratings)
-
(0 ratings)
Performance
8.9
(6 ratings)
-
(0 ratings)
Support Rating
6.6
(6 ratings)
-
(0 ratings)
Implementation Rating
6.0
(1 ratings)
-
(0 ratings)
User Testimonials
JenkinsUpsource
Likelihood to Recommend
Open Source
Jenkins is a highly customizable CI/CD tool with excellent community support. One can use Jenkins to build and deploy monolith services to microservices with ease. It can handle multiple "builds" per agent simultaneously, but the process can be resource hungry, and you need some impressive specs server for that. With Jenkins, you can automate almost any task. Also, as it is an open source, we can save a load of money by not spending on enterprise CI/CD tools.
Read full review
JetBrains
Upsource is the best review tool we've found but it still has some flaws. Notably, it makes reviewing small and quick changes less convenient than they need to be, and diff viewing (especially collaboratively) can be tedious.
It does handle larger, iterative reviews well. Especially when using a feature branch, Upsource will track that branch and automatically add all commits to the review. You can then review the branch as a whole, or look at a subset of diffs.
Read full review
Pros
Open Source
  • Automated Builds: Jenkins is configured to monitor the version control system for new pull requests. Once a pull request is created, Jenkins automatically triggers a build process. It checks out the code, compiles it, and performs any necessary build steps specified in the configuration.
  • Unit Testing: Jenkins runs the suite of unit tests defined for the project. These tests verify the functionality of individual components and catch any regressions or errors. If any unit tests fail, Jenkins marks the build as unsuccessful, and the developer is notified to fix the issues.
  • Code Analysis: Jenkins integrates with code analysis tools like SonarQube or Checkstyle. It analyzes the code for quality, adherence to coding standards, and potential bugs or vulnerabilities. The results are reported back to the developer and the product review team for further inspection.
Read full review
JetBrains
  • Automatically watch git repositories
  • Track all commits in a branch in a single commit
  • Integrates with build server to report build status of specific commits when looking at reviews/commits
  • Integrates with JetBrains IDEs
  • Ability for reviewers to add comments inline and require comments to be resolved before approval
  • Built in diff viewer, both stacked and side-by-side
Read full review
Cons
Open Source
  • The UI could be slightly better, it feels kind of like the 90s, but it works well.
  • An easier way to filter jobs other than views on the dashboard.
  • An easier way to read the console logs when tests do fail.
Read full review
JetBrains
  • Creating and closing reviews isn't as quick as it could be. You must create a review, assign reviewers, approve and close. I wish there would be a quick review-approve-close for a commit where the change is simple and doesn't require multiple review iterations.
  • Web based interface can be clunky, especially when looking at big diffs side-by-side
  • JetBrains IDE integration is somehow less convenient than going using it in browser.
Read full review
Likelihood to Renew
Open Source
We have a certain buy-in as we have made a lot of integrations and useful tools around jenkins, so it would cost us quite some time to change to another tool. Besides that, it is very versatile, and once you have things set up, it feels unnecessary to change tool. It is also a plus that it is open source.
Read full review
JetBrains
No answers on this topic
Usability
Open Source
Jenkins streamlines development and provides end to end automated integration and deployment. It even supports Docker and Kubernetes using which container instances can be managed effectively. It is easy to add documentation and apply role based access to files and services using Jenkins giving full control to the users. Any deviation can be easily tracked using the audit logs.
Read full review
JetBrains
No answers on this topic
Performance
Open Source
No, when we integrated this with GitHub, it becomes more easy and smart to manage and control our workforce. Our distributed workforce is now streamlined to a single bucket. All of our codes and production outputs are now automatically synced with all the workers. There are many cases when our in-house team makes changes in the release, our remote workers make another release with other environment variables. So it is better to get all of the work in control.
Read full review
JetBrains
No answers on this topic
Support Rating
Open Source
As with all open source solutions, the support can be minimal and the information that you can find online can at times be misleading. Support may be one of the only real downsides to the overall software package. The user community can be helpful and is needed as the product is not the most user-friendly thing we have used.
Read full review
JetBrains
No answers on this topic
Implementation Rating
Open Source
It is worth well the time to setup Jenkins in a docker container. It is also well worth to take the time to move any "Jenkins configuration" into Jenkinsfiles and not take shortcuts.
Read full review
JetBrains
No answers on this topic
Alternatives Considered
Open Source
Overall, Jenkins is the easiest platform for someone who has no experience to come in and use effectively. We can get a junior engineer into Jenkins, give them access, and point them in the right direction with minimal hand-holding. The competing products I have used (TravisCI/GitLab/Azure) provide other options but can obfuscate the process due to the lack of straightforward simplicity. In other areas (capability, power, customization), Jenkins keeps up with the competition and, in some areas, like customization, exceeds others.
Read full review
JetBrains
Compared to the other tools we evaluated, Upsource was the only tool that allowed distinct reviews without needing explicit pull requests while still being able to go in-depth when required. The diff viewer is serviceable and better than the alternatives, as well, especially the side-by-side viewer.
Read full review
Return on Investment
Open Source
  • Faster Time-to-Market: Jenkins automate the build, testing, and deployment process, enabling faster feedback and continuous improvement.
  • Improved Quality: Jenkins automatically run unit tests and integration tests, ensuring that code changes meet the necessary quality standards.
  • Cost Savings: Jenkins is an open-source tool that is free to use
Read full review
JetBrains
  • Increased our code base quality
  • Reduced the number of bugs found after deployment (bugs are found in review and fixed before deploy)
  • Improved knowledge sharing
Read full review
ScreenShots