Azure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.
$2
per GB (first 2GB free)
Azure DevOps Server
Score 8.4 out of 10
N/A
Azure DevOps Server (formerly Team Foundation Server, or TFS) is the on-premise version of Azure DevOps. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.
N/A
Digital.ai Agility
Score 7.4 out of 10
N/A
Digital.ai Agility (formerly VersionOne) helps organizations harness the power of their people’s knowledge, processes, and technology to build agile practices that scale across the enterprise. Its capabilities enable organizations to align products and investments with strategic business goals by coordinating planning, tracking, and reporting work across large distributed companies. Digital.ai Agility connects business strategy with team execution, providing a unified view at all levels,…
N/A
Pricing
Azure DevOps
Azure DevOps Server
Digital.ai Agility
Editions & Modules
Azure Artifacts
$2
per GB (first 2GB free)
Basic Plan
$6
per user per month (first 5 users free)
Azure Pipelines - Self-Hosted
$15
per extra parallel job (1 free parallel job with unlimited minutes)
Azure Pipelines - Microsoft Hosted
$40
per parallel job (1,800 minutes free with 1 free parallel job)
Basic + Test Plan
$52
per user per month
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
Azure DevOps
Azure DevOps Server
Digital.ai Agility
Free Trial
No
No
No
Free/Freemium Version
No
Yes
No
Premium Consulting/Integration Services
No
No
No
Entry-level Setup Fee
No setup fee
No setup fee
No setup fee
Additional Details
—
—
—
More Pricing Information
Community Pulse
Azure DevOps
Azure DevOps Server
Digital.ai Agility
Considered Multiple Products
Azure DevOps
Verified User
Manager
Chose Azure DevOps
Beside all cloud benefits, the main advantage Azure DevOps Services compared to Azure DevOps Server is the easier remote access for third party team members, and always up to date software. On the other hand, on prem deployment (Azure DevOps Server) makes complex access or …
Compared to other tools we have used, Microsoft STS has been a much more complete tool. Communication, collaboration, tracking, management, automation, testing, speed to production—all these areas have been improved since we started using Microsoft STS. We have been looking for …
Our TFS was dated and in some ways was quite crude. VSTS is thoroughly modern and I don't have to worry about updating it since MS is always updating VSTS. Also, VSTS has better integration with other products such as JIRA than our older TFS would. I am sure you could integrate …
Being its predecessor, VSS has a very limited team-sharing view, providing little to no multiple-user, multiple-project support. Considering the fact that Microsoft has purged its support in favor of TFS and VSTS, it's only reasonable to believe they have something extra. Git …
Haven't used a lot of similar products that have the full feature set as Visual Studio. It's highly effective development platform especially when used with SVN and TFS makes large Agile project easy to manage and collaborate.
I haven't used any other products, so I can't say how VSTS/TFS would stack against any competitors, but I know that for an SDLC management tool, VSTS/TFS has everything you need to help an organization meet the requirements needed to adhere to the specific/general practices …
Digital.ai Agility provided a better user experience with more functionality geared towards the type of processes our team was following. Trello was too basic and did not have nearly the functionality we needed. Azure DevOps had many of the same features as Digital.ai …
Azure DevOps works well when you’ve got larger delivery efforts with multiple teams and a lot of moving parts, and you need one place to plan work, track it properly, and see how everything links together. It’s especially useful when delivery and development are closely tied and you want backlog items, code and releases connected rather than spread across tools. Where it’s less of a fit is for small teams or simple pieces of work, as it can feel like more setup and process than you really need, and non-technical users often struggle with the interface. It also isn’t great if you want instant, easy programme-level views or a very visual planning experience without putting time into configuration.
Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
Digital.ai (formerly XebiaLabs, CollabNet VersionOne, and Arxan)
Scenarios where it works well: 1) Retros can be very well facilitated & notes/action items can be captured against the sprint. 2) Product Owner can effectively track the story progress with all the test-cases, design etc. 3) Being good scaling support, it provides good visibility across multiple teams, programs and agile portfolios, providing a centralized environment where all our stakeholders can easily work together regardless of location. 4) It provides easy tracking all of your epics, stories, themes, defects, tasks, tests and issues 5) I like its intuitive UI as for moving stories around, burning hours. 6) It allows top leadership to visualize and report their strategic plans, giving all stakeholders the relevant data that they need to stay dedicated to the project priorities. 7) It can be easily integrated with slack so for few teams we used slack for collaboration Scenarios where it did not work well: 1) Test Management need improvement in terms of tracking tests, team had hard time tracking regression test cases. 2) Version one comes with lot of features like Rally but here we don’t get customizations which is there in Jira where from workflow to issue everything can be customized based on your team/program/portfolio requirements. 3) Lot of navigation to access basic stuff. Example I want to go to bug attachment , there are lt of clicks & navigation need to do which should be pretty straightforward I feel.
I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
The wiki is not the prettiest thing to look at, so it could have refinements there.
Digital.ai (formerly XebiaLabs, CollabNet VersionOne, and Arxan)
Although Digital.ai Agility supports customizations, they can be somewhat cumbersome to set up and maintain
The Analytics engine's user experience for digging into the data does not have the same feel as the rest of the system and, as a result, can be hard to work with
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Digital.ai (formerly XebiaLabs, CollabNet VersionOne, and Arxan)
No answers on this topic
Usability
Microsoft
It's a great help to get more information about new feature release and stay updated on what the dev team is working on. I like how easy it is to just login and read through the work items. Each work item has basic details: Title, Description, Assigned to, State, Area (what it belongs to), and iteration (when it’s worked on). See image above.They move through different states (New → Discovery → Ready for Prod → etc.).
For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.
Digital.ai (formerly XebiaLabs, CollabNet VersionOne, and Arxan)
No answers on this topic
Support Rating
Microsoft
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Digital.ai (formerly XebiaLabs, CollabNet VersionOne, and Arxan)
VersionOne provides outstanding training. They have Product Owner training that I recommend every Product Owner attend. They have scrum master training and other agile training that was well worth the money paid because it made the teams more productive. And the support for the tool is incredible. These people live and breathe Agile and are evangelists and enthusiasts.
Digital.ai (formerly XebiaLabs, CollabNet VersionOne, and Arxan)
No answers on this topic
Alternatives Considered
Microsoft
Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
Digital.ai (formerly XebiaLabs, CollabNet VersionOne, and Arxan)
JIRA appears to be more extensible with the ability for Scrum, Kanban, bug/incident tracking, and the ability to customize dashboards. However, VersionOne's performance over the same teams is extremely fast in comparison and therefore allows users to be more productive over the same amount of time.
We have saved a ton of time not calculating metrics by hand.
We no longer spend time writing out cards during planning, it goes straight to the board.
We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.
It has streamlined the pipeline and project management for our agile effort.
It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.