What users are saying about
2 Ratings
Top Rated
157 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 8.5 out of 100
2 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener noreferrer'>trScore algorithm: Learn more.</a>
Score 1.3 out of 100

Likelihood to Recommend

Azure DevOps Server (formerly TMS)

Azure DevOps is well suited if you have a big team that is collaborating their codes and need to have devops pipeline for all build and release work. Also since this tool provides bug management facility, you don't need to purchase any other tool for that purpose. Moreover if you have your infrastructure built over Azure cloud then this is a best match for your requirements as it integrates well with it.
Anonymous | TrustRadius Reviewer

Caliber

I personally would prefer other products on the market right now such as Microsoft Team Foundation Server and Test Manager. I think having a product like Caliber that can only do requirements without integrating with a another system makes things a little more time consuming.
Tiffany Seeman | TrustRadius Reviewer

Pros

Azure DevOps Server (formerly TMS)

  • The consolidation of issues is extremely useful for us. Having one place where all bugs are entered has helped our business process immensely.
  • Being able to query data regarding user stories, bugs and code is extremely helpful. As well, using the visual tools built into the system can help with messaging regarding the status of a project.
  • Being able to monitor code deployments is extremely helpful. Since we are managing multiple environments, this tool makes it easy to see what is happening where.
Michael Martinez | TrustRadius Reviewer

Caliber

  • Borland Caliber tracks functional and non-functional requirements pretty easily. You can easily add a requirement and attach a spreadsheet or a picture if needed.
  • Moving the hierarchy of requirements is fairly easy by just dragging and dropping.
  • Assigning users to approve requirements is simple by the fields included when adding a requirement and then submitting for review.
Tiffany Seeman | TrustRadius Reviewer

Cons

Azure DevOps Server (formerly TMS)

  • The older versions of TFS are more lacking in the web version-- if you aren't updated to 2015 or above I believe, a lot of the web features are not available (like bulk update). You really have to keep up to date with TFS for the best features, and it's no simple task to migrate your entire instance of TFS from an older version to a newer version.
  • VSTS is supposed to be a virtual version of TFS that we've been looking into, but it severely limits customization options for ticket templates and workflows. It would be nice for VSTS to eventually carry that customization over so we could feel more comfortable switching to "the cloud" so to speak.
  • Queries are a very powerful tool, but normal business users struggle to understand how they can best utilize this tool to analyze tickets. Because of the permissions structure in all companies I have been a part of, I've never been able to save my custom queries to a public folder in TFS for business/project users. Instead, I have to take time to train these users and give them guidance on how to best create queries for their needs. This is admittedly a business process issue, but it could potentially also be resolved with some good training/guidance around queries provided by TFS themselves.
Erin Hinnen | TrustRadius Reviewer

Caliber

  • I think Borland Caliber visually needs to be updated. It looks very out of date compared to other products on the market. The text box has a notepad feel to it and it's hard to make it visually catching.
  • Borland Caliber needs to be easier to integrate with other testing and development products on the market.
  • Having fields more related to URS and FRS would be helpful to auto-link to a document. So enter in a URS or FRS document ID at the beginning of a project in Caliber and then auto-assigning requirement IDs to link to pieces of code or test cases and having the user be able to decide a naming convention.
  • Borland Caliber needs a specific table for linking to a document ID and then each requirement could auto-generate a sub ID for each requirement to make the process of filling in User Requirements and Functional Requirements more efficient. Then the user should be able to modify the sub ID if the naming convention needed to be different.
Tiffany Seeman | TrustRadius Reviewer

Likelihood to Renew

Azure DevOps Server (formerly TMS)

Azure DevOps Server (formerly TMS) 10.0
Based on 1 answer
Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Bill Starling | TrustRadius Reviewer

Caliber

No score
No answers yet
No answers on this topic

Usability

Azure DevOps Server (formerly TMS)

Azure DevOps Server (formerly TMS) 8.6
Based on 3 answers
Azure DevOps Server or TFS is a complete suite in itself. From Developer's machine where the code is developed to the production environment where the code is meant to run it take care of complete flow within itself. It acts as a code repository you can check-in check-out codes using GIT interface. It also acts as a Build and Automation Test tool which can help you to judge sanctity of your code. It further acts as a release manager to deploy your application to the production environment. And all these steps can also be performed without any manual intervention with the option to have approval processes. Hence its a perfect blend of all set of tools and capabilities required to bring code to production.
Anonymous | TrustRadius Reviewer

Caliber

No score
No answers yet
No answers on this topic

Support Rating

Azure DevOps Server (formerly TMS)

Azure DevOps Server (formerly TMS) 8.6
Based on 22 answers
I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Kellie Crawford | TrustRadius Reviewer

Caliber

No score
No answers yet
No answers on this topic

Implementation Rating

Azure DevOps Server (formerly TMS)

Azure DevOps Server (formerly TMS) 8.0
Based on 2 answers
Do research beforehand and, if possible, do a trial run before implementing into production environment.
Bill Starling | TrustRadius Reviewer

Caliber

No score
No answers yet
No answers on this topic

Alternatives Considered

Azure DevOps Server (formerly TMS)

No tool was all encompassing - always one tool for code management and a separate tool for Requirements and test cases. Testing tools such as HP did not have a code module so code and defects were in two separate tools. Code repositories such as source save do not have a defect module so code cannot be directly linked.
Roxanna Aramjoo | TrustRadius Reviewer

Caliber

I think Borland Caliber is better than Atlassian Confluence and has way more options for ease of use and reporting. Team Foundation Server is my personal choice as it comes as a package for developers to link to requirements easily and link to test cases. Borland Caliber is visually the least attractive of the three systems I have used. If you need just a requirement manager for tracking and reporting then Borland Caliber is a great choice.
Tiffany Seeman | TrustRadius Reviewer

Return on Investment

Azure DevOps Server (formerly TMS)

  • Time to completion for projects has significantly gone down by 15% and that number changes as more people are trained and are comfortable with TFS.
  • Change Management and Approvals are easier to access.
  • More projects are implementing SCRUM methodologies for applications
Tiffany Seeman | TrustRadius Reviewer

Caliber

  • Having Borland Caliber would be nice if you only need to track requirements and your company does not do any developing or testing.
  • It does link very well with HP Quality Center for requirement and test asset tracking and ease of use.
  • Borland Caliber is cheaper than a lot of other products on the market that have the same features.
Tiffany Seeman | TrustRadius Reviewer

Pricing Details

Azure DevOps Server (formerly TMS)

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Caliber

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Add comparison