Azure Test Plans vs. TestRail

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure Test Plans
Score 9.1 out of 10
N/A
Azure Test Plans is an exploratory test toolkit available from Microsoft's Azure suite of services. It enables manual testing for users, so that they can plan, execute, and track scripted tests with actionable defects and end-to-end traceability. Assess quality throughout the development lifecycle by testing your desktop or web applications. It is available with Azure DevOps Services.N/A
TestRail
Score 6.7 out of 10
N/A
TestRail by Gurock, an IDERA company, is presented as a complete web-based test case management solution to manage, track, and organize your software testing efforts.N/A
Pricing
Azure Test PlansTestRail
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
Azure Test PlansTestRail
Free Trial
NoNo
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details——
More Pricing Information
Community Pulse
Azure Test PlansTestRail
Top Pros

No answers on this topic

Top Cons

No answers on this topic

Features
Azure Test PlansTestRail
Test Management
Comparison of Test Management features of Product A and Product B
Azure Test Plans
8.4
6 Ratings
4% above category average
TestRail
7.0
1 Ratings
14% below category average
Centralized test management8.86 Ratings7.01 Ratings
Manage test hosts and schedules8.26 Ratings6.01 Ratings
Map tests to user stories8.56 Ratings6.01 Ratings
Test execution reporting9.36 Ratings9.01 Ratings
Defect management7.36 Ratings7.01 Ratings
Best Alternatives
Azure Test PlansTestRail
Small Businesses
BrowserStack
BrowserStack
Score 8.3 out of 10
BrowserStack
BrowserStack
Score 8.3 out of 10
Medium-sized Companies
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 7.7 out of 10
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 7.7 out of 10
Enterprises
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 7.7 out of 10
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 7.7 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Azure Test PlansTestRail
Likelihood to Recommend
9.0
(6 ratings)
7.0
(1 ratings)
User Testimonials
Azure Test PlansTestRail
Likelihood to Recommend
Microsoft
It works well for express test case implementation with a short duration. You can define the tests for two weeks and run the activities documenting the software errors and fixes to control the effectiveness of DevOps. The graphic reports give the idea of the backlog phases advances and errors detected. It needs improvement if you have a large test project and need to design financial budgets and control over costs of the test plan.
Read full review
IDERA (an Idera, Inc. company)
The integration with other tools, and their user friendly layout and design. It's very comfortable to use and is way better than other tools with the Automation Testing tools, thanks to the great API that is included. Sometimes the integration with Jira is a little faulty, but the links to that tool usually work well. It could be cool if it had a better following for the bug items that were registered on other tools.
Read full review
Pros
Microsoft
  • Multi test plan access
  • Well structured and easy to use
  • Integrates with other azure features to work seamlessly ,connecting the data flow
Read full review
IDERA (an Idera, Inc. company)
  • Beautiful and productive UI.
  • Nice filtering system allowing me to find what I need quickly.
Read full review
Cons
Microsoft
  • Graphic definition of the the Work Break Down Structure
  • Gantt Chart to check the activity dependance and flow of the process
  • Basic cost module to design test budgets.
Read full review
IDERA (an Idera, Inc. company)
  • Integration with Jira seems [a] little faulty.
  • Increase the API call limit for different editions.
  • Better way to trigger automation suites from TestRail.
Read full review
Alternatives Considered
Microsoft
We're doing a full continuous integration (CI), continuous delivery (CD), continuous testing (CT), security, delivery, and monitoring. They have been lately adding features to the services on a regular basis. Every two weeks, they add functionality to Azure DevOps Services to match it with what Azure DevOps Server or on-prem would offer. So, we continue to get more robust functionality. My favorite right now is that they are starting to open up the API availability within Azure DevOps Services.
Read full review
IDERA (an Idera, Inc. company)
TestRail definitely saves times. I work in a company that consists of several development teams, all of which have different processes. Some of the teams leverage test cases, some do not. I've noticed that the turn around time it takes for me to pick up a ticket, QA it, and then pass/fail/send feedback is much faster when there is a test case created as I'm not reading through ticket description/comments to figure out what needs to be QA'd.
Read full review
Return on Investment
Microsoft
  • Pros: One stop solution for end to end traceability
  • Pros: Exploratory testing used
  • Pros: maximum coverage on multiple browsers, operating system combinations
  • Cons: Integration with Non-Microsoft tools can be improved
Read full review
IDERA (an Idera, Inc. company)
  • Improved test management process and collaboration inside team.
  • Increased transparency of QA work.
  • Team became more satisfied.
Read full review
ScreenShots