Likelihood to Recommend Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
Read full review The qTest is well-suited for organizations transitioning to Agile or DevOps frameworks. It Streamlines test management with real-time collaboration and integrates with popular CI/CD tools. It excels in complex, large-scale projects needing centralized test cases management, traceability, and detailed reporting. However, organizations on a tight budget might find it cost prohibitive compared to simpler, low-cost alternatives.
Read full review Pros Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project. Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts. Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing. Read full review Highly customizable: we were able to organize our test cases in unique ways that made our work easier. Connectivity with Jira: being able to pull requirements information in from Jira was a big point for us. Standalone tool: Being a standalone tool on a dedicated server, we were able to have access to our tests regardless of whether our Jira server was down. Read full review Cons Can add more build templates for specific technology requirements Can have more features in dashboards which can help dev teams stream line their tasks and priorities Can have raise alarm feature in case of any sort of failure in devops pipeline execution Read full review In requirements , we can't add multiple test cases at once, or search multiple cases at once, need to do one by one. Here actually qtest needs to improve. Linking cloud hosted qtest and on-premise TOSCA is very difficult especially when you are working with client system with security wall. It requires tunnelling software which is not recommended. Read full review Likelihood to Renew Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Read full review This has been a core QA management tool for our organization and integrates well with our other SDLC platforms (Azure DevOps/Jira/Katalon).
Read full review Usability Azure DevOps Server or TFS is a complete suite in itself. From Developer's machine where the code is developed to the production environment where the code is meant to run it take care of complete flow within itself. It acts as a code repository you can check-in check-out codes using GIT interface. It also acts as a Build and Automation Test tool which can help you to judge sanctity of your code. It further acts as a release manager to deploy your application to the production environment. And all these steps can also be performed without any manual intervention with the option to have approval processes. Hence its a perfect blend of all set of tools and capabilities required to bring code to production.
Read full review qTest is actually intuitive and user-friendly, despite my other scathing review aspects
Nick Larsen Quality Assurance Manager - Application Development & Support
Read full review Support Rating I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Read full review The actual answer is 0. I have never experienced worse support, whether personal or professional
Nick Larsen Quality Assurance Manager - Application Development & Support
Read full review Implementation Rating Do research beforehand and, if possible, do a trial run before implementing into production environment.
Read full review Again, supporting documentation could have been a lot better
Nick Larsen Quality Assurance Manager - Application Development & Support
Read full review Alternatives Considered In my opinion, DevOps covers the development process end to end way better than
Jira or
GitHub . Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
Read full review Extensive integration options with various third-party tools, enabling seamless integration into existing workflows. Allows for flexibility and customization of workflows, fields, and permissions to adapt to unique testing requirements. Supports robust requirements traceability, ensuring comprehensive test coverage. Lastly management decisions too
Read full review Return on Investment It has streamlined the pipeline and project management for our agile effort. It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise. The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization. Read full review Better organization and centralization of test cases has led to more cohesive team collaboration Speed to delivery, deployments to production, are mostly maintained Performance issues have led to testing delays requiring the team to switch to other methods which contributed to QA bottleneck issues and sometimes even missed sprint commitments Read full review ScreenShots Tricentis qTest Screenshots