Digital.ai Release vs. Jenkins vs. Octopus Deploy

Mainly used in release management where all deployments are well managed and processed further based on the approval system. Complete enterprise-level solution with minor difficulties which need to be added to product improvement features. Integration with other CI-CD tools makes it easier to perform tasks in terms of release and deployments.

Incentivized

Jenkins is a highly customizable CI/CD tool with excellent community support. One can use Jenkins to build and deploy monolith services to microservices with ease. It can handle multiple "builds" per agent simultaneously, but the process can be resource hungry, and you need some impressive specs server for that. With Jenkins, you can automate almost any task. Also, as it is an open source, we can save a load of money by not spending on enterprise CI/CD tools.

Incentivized

Octopus Deploy is well suited for our requirements of deploying across multiple environments with one consistent release. We are saving a lot of time by not having to package and move release files around. Our release process is more efficient and consistent with automation. There are some parts that we could probably perform with existing tools such as DevOps and there are one or two features we have to workaround to fit for our setup such as the step templates to install websites. These are minor in our opinion.

Incentivized

• Cross-team release workflow control using email, texts, scripts allow our release management to be truly a 360 process.
• XL Release allowing our Jenkins toolchain to control the beginning of release trains which is very powerful.
• XL release allows us to expose the business process flow for anyone to read direct at the source which runs the process instead of a separate vision.

Incentivized

• Automated Builds: Jenkins is configured to monitor the version control system for new pull requests. Once a pull request is created, Jenkins automatically triggers a build process. It checks out the code, compiles it, and performs any necessary build steps specified in the configuration.
• Unit Testing: Jenkins runs the suite of unit tests defined for the project. These tests verify the functionality of individual components and catch any regressions or errors. If any unit tests fail, Jenkins marks the build as unsuccessful, and the developer is notified to fix the issues.
• Code Analysis: Jenkins integrates with code analysis tools like SonarQube or Checkstyle. It analyzes the code for quality, adherence to coding standards, and potential bugs or vulnerabilities. The results are reported back to the developer and the product review team for further inspection.

Incentivized

• Octopus integrates nicely with TeamCity, our build server.
• Octopus uses the same deployment packages across environments and makes it easy to track their progress across those environments.
• Octopus makes it easy to handle configuration across environments which is usually a particularly difficult task.

Incentivized

• Pagination of data - across tool.
• User Roles Management API can be improved.
• Case insensitive ID's are treated differently making user face login and access issues.
• Dependency on Universal template/custom plugins creation should be reduced.
• Code versioning of templates is very difficult.
• Better error handling.
• Futures Timeout Issues.

Incentivized

• The UI could be slightly better, it feels kind of like the 90s, but it works well.
• An easier way to filter jobs other than views on the dashboard.
• An easier way to read the console logs when tests do fail.

Incentivized

• In the past has been somewhat .net focused but that has been changing in recent times
• Would be great if community licenses for NFP organizations were perpetual - but in saying that I appreciate that Octopus does provide my organization with a community [license]. Not all organisations do
• I can’t think of any other

Incentivized

We have a certain buy-in as we have made a lot of integrations and useful tools around jenkins, so it would cost us quite some time to change to another tool. Besides that, it is very versatile, and once you have things set up, it feels unnecessary to change tool. It is also a plus that it is open source.

Incentivized

Would be a 10 except for the retirement of the free Community Edition.

Incentivized

The tool is easy to use, easy to navigate and learn. Manages releases with proper approvals in a systematic manner. Though it needs minor improvements in terms of pagination (data loading), access management, but, overall the tool helps in increasing productivity and less time for production deployments.

Incentivized

Jenkins streamlines development and provides end to end automated integration and deployment. It even supports Docker and Kubernetes using which container instances can be managed effectively. It is easy to add documentation and apply role based access to files and services using Jenkins giving full control to the users. Any deviation can be easily tracked using the audit logs.

Incentivized

Octopus Deploy has greatly helped us to improve our reliability and frequency of our deployments and given us the confidence to deploy much more often, with a direct benefit to customers. Cross-platform support and release to Cloud require more focus on the product side.

Incentivized

No, when we integrated this with GitHub, it becomes more easy and smart to manage and control our workforce. Our distributed workforce is now streamlined to a single bucket. All of our codes and production outputs are now automatically synced with all the workers. There are many cases when our in-house team makes changes in the release, our remote workers make another release with other environment variables. So it is better to get all of the work in control.

Incentivized

Octopus Deploy is a software that runs very effectively, is easy to use, does not require such a high learning curve, provides the necessary tools to carry out the functions it offers, making it a very flexible software, it also allows that can be configured according to the needs of the user and provides integrations with other very advantageous tools since they are carried out in a very favorable way.

Incentivized

Support is not good at all. To this day, I have to mail my queries and their support site does not log in for me (me alone). But, upon contacting many times, no one helps with a proper response. Though good thing is, I get a proper response over mail too. But, being informative about the tool and not on the issues faced by users outside of the process to get support should also be addressed equally. Which is currently missing in support.

Incentivized

As with all open source solutions, the support can be minimal and the information that you can find online can at times be misleading. Support may be one of the only real downsides to the overall software package. The user community can be helpful and is needed as the product is not the most user-friendly thing we have used.

Incentivized

Octopus Deploy support has always been there for us, even when using the free tier, we get responsive hands-on help. We haven't needed to use that level of support since the documentation is clearly written, and help is readily available within the interface itself. Using Octopus Deploy is a truly joyful experience.

Incentivized

It is worth well the time to setup Jenkins in a docker container. It is also well worth to take the time to move any "Jenkins configuration" into Jenkinsfiles and not take shortcuts.

Incentivized

XL release is simpler to configure and deploy to the organization than other change management platforms I have used. That simplicity has minor drawbacks requiring you to fit into a limited set of control methods but that exercise helped us simplify a needlessly onerous process.

Incentivized

Overall, Jenkins is the easiest platform for someone who has no experience to come in and use effectively. We can get a junior engineer into Jenkins, give them access, and point them in the right direction with minimal hand-holding. The competing products I have used (TravisCI/GitLab/Azure) provide other options but can obfuscate the process due to the lack of straightforward simplicity. In other areas (capability, power, customization), Jenkins keeps up with the competition and, in some areas, like customization, exceeds others.

Incentivized

There aren't really any competitors in the land of ASP.NET. Deployment is too ad-hoc. Other tools exist that have massive downsides, like Web Deploy. Most aren't even supported anymore. You could argue that containers (Docker) are a competitor, but containers cannot be used for everything and solve a somewhat different problem. Octopus Deploy is even able to help with containers. To us, Octopus Deploy was really the only really polished solution.

Incentivized

Great support from professional services.

Incentivized

• XL release has improved our consistency of release process, removing multiple days worth of manual status checking and coordination.
• XL release has allowed us to increase the number of beta releases we can support due to simplifying our release actions.

Incentivized

• Faster Time-to-Market: Jenkins automate the build, testing, and deployment process, enabling faster feedback and continuous improvement.
• Improved Quality: Jenkins automatically run unit tests and integration tests, ensuring that code changes meet the necessary quality standards.
• Cost Savings: Jenkins is an open-source tool that is free to use

Incentivized

• Allows us to deploy to our fleet quickly and without interruption to service
• Can roll back to previous releases quickly, allowing us to back out of breaking changes in the worst-case scenarios.
• Integration with several targets has allowed us to explore new platforms for our products, such as Docker in AWS ECS.

Incentivized