Azure DevOps Server vs. TestRail

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure DevOps Server
Score 8.3 out of 10
N/A
AzureDevOps Server (formerly Team Foundation Server, or TFS) is a test management and application lifecycle management tool, from Microsoft's Visual Studio offerings. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.N/A
TestRail
Score 6.4 out of 10
N/A
TestRail by Gurock, an IDERA company, is presented as a complete web-based test case management solution to manage, track, and organize your software testing efforts.N/A
Pricing
Azure DevOps ServerTestRail
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
Azure DevOps ServerTestRail
Free Trial
NoNo
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
Azure DevOps ServerTestRail
Top Pros
Top Cons
Features
Azure DevOps ServerTestRail
Test Management
Comparison of Test Management features of Product A and Product B
Azure DevOps Server
-
Ratings
TestRail
6.8
2 Ratings
17% below category average
Centralized test management00 Ratings6.02 Ratings
Manage test hosts and schedules00 Ratings6.01 Ratings
Map tests to user stories00 Ratings6.02 Ratings
Test execution reporting00 Ratings9.02 Ratings
Defect management00 Ratings7.01 Ratings
Best Alternatives
Azure DevOps ServerTestRail
Small Businesses
GitHub
GitHub
Score 9.0 out of 10
BrowserStack
BrowserStack
Score 8.3 out of 10
Medium-sized Companies
AWS CodePipeline
AWS CodePipeline
Score 9.2 out of 10
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 7.5 out of 10
Enterprises
AWS CodePipeline
AWS CodePipeline
Score 9.2 out of 10
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 7.5 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Azure DevOps ServerTestRail
Likelihood to Recommend
8.3
(47 ratings)
5.0
(2 ratings)
Likelihood to Renew
10.0
(1 ratings)
-
(0 ratings)
Usability
8.7
(3 ratings)
-
(0 ratings)
Support Rating
8.4
(10 ratings)
-
(0 ratings)
Implementation Rating
8.0
(1 ratings)
-
(0 ratings)
Ease of integration
9.0
(2 ratings)
-
(0 ratings)
User Testimonials
Azure DevOps ServerTestRail
Likelihood to Recommend
Microsoft
Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
Read full review
IDERA (an Idera, Inc. company)
The integration with other tools, and their user friendly layout and design. It's very comfortable to use and is way better than other tools with the Automation Testing tools, thanks to the great API that is included. Sometimes the integration with Jira is a little faulty, but the links to that tool usually work well. It could be cool if it had a better following for the bug items that were registered on other tools.
Read full review
Pros
Microsoft
  • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
  • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
  • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
Read full review
IDERA (an Idera, Inc. company)
  • Manual Test Cases
  • Organization
  • Easy Reporting
Read full review
Cons
Microsoft
  • Can add more build templates for specific technology requirements
  • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
  • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
Read full review
IDERA (an Idera, Inc. company)
  • Integration with Jira seems [a] little faulty.
  • Increase the API call limit for different editions.
  • Better way to trigger automation suites from TestRail.
Read full review
Likelihood to Renew
Microsoft
Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Read full review
IDERA (an Idera, Inc. company)
No answers on this topic
Usability
Microsoft
Azure DevOps Server or TFS is a complete suite in itself. From Developer's machine where the code is developed to the production environment where the code is meant to run it take care of complete flow within itself. It acts as a code repository you can check-in check-out codes using GIT interface. It also acts as a Build and Automation Test tool which can help you to judge sanctity of your code. It further acts as a release manager to deploy your application to the production environment. And all these steps can also be performed without any manual intervention with the option to have approval processes. Hence its a perfect blend of all set of tools and capabilities required to bring code to production.
Read full review
IDERA (an Idera, Inc. company)
No answers on this topic
Support Rating
Microsoft
I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Read full review
IDERA (an Idera, Inc. company)
No answers on this topic
Implementation Rating
Microsoft
Do research beforehand and, if possible, do a trial run before implementing into production environment.
Read full review
IDERA (an Idera, Inc. company)
No answers on this topic
Alternatives Considered
Microsoft
In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
Read full review
IDERA (an Idera, Inc. company)
TestRail definitely saves times. I work in a company that consists of several development teams, all of which have different processes. Some of the teams leverage test cases, some do not. I've noticed that the turn around time it takes for me to pick up a ticket, QA it, and then pass/fail/send feedback is much faster when there is a test case created as I'm not reading through ticket description/comments to figure out what needs to be QA'd.
Read full review
Return on Investment
Microsoft
  • It has streamlined the pipeline and project management for our agile effort.
  • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
  • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
Read full review
IDERA (an Idera, Inc. company)
  • We are able to easily pull reports any time management would like to see them
  • Jira integration makes it easy to attach to stories/defects and save time
  • A quick overview at the system's health as a whole is easy to see from TestRail
Read full review
ScreenShots