Azure DevOps Server vs. IBM Engineering Lifecycle Management vs. QMetry

Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.

Incentivized

The software is robust enough to handle highly complex software development or other product development and can be used well beyond the range to do what a client needs. However, because of the inability to hold its users to proper best practices, things can get wildly out of hand and cascade over the years, creating unnecessary technical debt. The system has a lot of usable features, but they don't funnel users toward the correct processes and practices.

Incentivized

QMetry, like any new-gen test management tool, works well with any type of development methodologies, be it agile, waterfall or hybrid. It is positioned to be a tool for enterprises of any size. QMetry also provides easy migration of existing test artifacts from a legacy test management tool to QMetry without loss of any information. The one thing that I see as an opportunity for improvement is trying to provide out-of-box integration with all major test automation tools. Another area could be to expand the offering to include it as a product suite with accessibility testing, security testing, performance testing, and test automation which is what the trend is.

Incentivized

• Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
• Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
• Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.

Incentivized

• Open Services supporting Lifecycle Collaboration (OSLC).
• Required definition management and managed capabilities enabling.
• Rational DOORS Web Access for local on the test field presence.
• On-sites established reporting system.
• Approved linking requirements to test plans
• Engineering Requirements Management DOORS traces requirements thereby eliminates manually processes and spreadsheets, for improved productivity.
• Returns the investment efficiently.

Incentivized

• Works well with all dev methodologies.
• Real-time integration with Jira.
• Out of box reports.
• Integration with test automation tools.

Incentivized

• Can add more build templates for specific technology requirements
• Can have more features in dashboards which can help dev teams stream line their tasks and priorities
• Can have raise alarm feature in case of any sort of failure in devops pipeline execution

Incentivized

• I feel like it is too heavy sometimes and updating is not very straight forward. For example, if I want to change an incident ticket (IN) to a service request (SR) and add some comment for the change, I have to first change the IN to SR, then click refresh which takes a few seconds, then add a comment. If I forget the refresh step, my comment will be discarded without warning like my ticket is not in the latest status. This also happens when somebody else changes the ticket during my edit as I can not lock the ticket exclusively.

Incentivized

• Provision to report on custom fields.
• Integration with other agile management tools.
• API limit consumption.

Incentivized

Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.

Incentivized

At the moment we are required by contract to continue to use the IBM DOORS software for our current client. Given that it can be expensive, if we were to use it after our current client's needs were met, we would have to secure other projects in order to justify the continued use of the software.

Incentivized

For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.

Incentivized

The UI is terrible and not intuitive. Users need training in order to complete tasks. Much like SAP, it's not the clearest tool. The tracing feature is especially complicated because you must write the scripts yourself. There is a learning curve. Also, even the setup, installation, and logging in each time takes a considerable amount of time.

Incentivized

I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus

Incentivized

It does a basic job and has the potential to complete some robust reporting tasks, however, it really is a clunky piece of software with a terrible user interface that makes using it routinely quite unpleasant. Many of our legacy and maintenance projects still use DOORS but our department and company use many alternatives and are looking for better tools.

Incentivized

Do research beforehand and, if possible, do a trial run before implementing into production environment.

Incentivized

No problems

Incentivized

In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!

Incentivized

It was easier to do all the change management-related activities, even configurations were handled very effectively. New process definitions and initiatives made it easier for better project deliverables. Effective resource allocations and better reporting and defect management. The overall cost of the tool is great too and well within budget.

Incentivized

QMetry provides an easy path for migration from the legacy test management tool. The migration utility is free compared to other vendors. We have received great customer support from day one of the engagement starting with POC, implementation, and ongoing support. Overall, pricing and licensing model are affordable and attractive.

Incentivized

• It has streamlined the pipeline and project management for our agile effort.
• It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
• The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.

Incentivized

• It's part of CLM suite so it can be used to manage the whole lifecycle with tight integration with development module (Rational Team Concert) and quality module (Rational Quality Manager).
• Comprehensive reports and dashboards provide better visibility.
• License cost is on higher side.

Incentivized

• Helped with overall adoption to the new dev model.
• Fits well with Devops framework.
• Overall licensing model is affordable and accommodates many users.

Incentivized