<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener'>Customer Verified: Read more.</a>
253 Ratings
14 Ratings

Azure DevOps Server (formerly TMS)

<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener'>Customer Verified: Read more.</a>
253 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.3 out of 100
14 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 7.5 out of 100

Feature Set Ratings

    Test Management

    Azure DevOps Server (formerly TMS)

    Feature Set Not Supported
    N/A
    7.0

    TestRail

    70%
    TestRail ranks higher in 5/5 features

    Centralized test management

    N/A
    0 Ratings
    7.0
    70%
    1 Rating

    Manage test hosts and schedules

    N/A
    0 Ratings
    6.0
    60%
    1 Rating

    Map tests to user stories

    N/A
    0 Ratings
    6.0
    60%
    1 Rating

    Test execution reporting

    N/A
    0 Ratings
    9.0
    90%
    1 Rating

    Defect management

    N/A
    0 Ratings
    7.0
    70%
    1 Rating

    Attribute Ratings

    • Azure DevOps Server is rated higher in 1 area: Likelihood to Recommend

    Likelihood to Recommend

    8.6

    Azure DevOps Server (formerly TMS)

    86%
    48 Ratings
    7.0

    TestRail

    70%
    1 Rating

    Likelihood to Renew

    10.0

    Azure DevOps Server (formerly TMS)

    100%
    1 Rating

    TestRail

    N/A
    0 Ratings

    Usability

    8.7

    Azure DevOps Server (formerly TMS)

    87%
    3 Ratings

    TestRail

    N/A
    0 Ratings

    Support Rating

    8.5

    Azure DevOps Server (formerly TMS)

    85%
    22 Ratings

    TestRail

    N/A
    0 Ratings

    Implementation Rating

    8.0

    Azure DevOps Server (formerly TMS)

    80%
    2 Ratings

    TestRail

    N/A
    0 Ratings

    Ease of integration

    9.0

    Azure DevOps Server (formerly TMS)

    90%
    2 Ratings

    TestRail

    N/A
    0 Ratings

    Likelihood to Recommend

    Microsoft

    Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
    Read full review

    IDERA (an Idera, Inc. company)

    The integration with other tools, and their user friendly layout and design. It's very comfortable to use and is way better than other tools with the Automation Testing tools, thanks to the great API that is included. Sometimes the integration with Jira is a little faulty, but the links to that tool usually work well. It could be cool if it had a better following for the bug items that were registered on other tools.
    Read full review

    Pros

    Microsoft

    • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
    • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
    • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
    Read full review

    IDERA (an Idera, Inc. company)

    • Beautiful and productive UI.
    • Nice filtering system allowing me to find what I need quickly.
    Read full review

    Cons

    Microsoft

    • Can add more build templates for specific technology requirements
    • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
    • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
    Read full review

    IDERA (an Idera, Inc. company)

    • Integration with Jira seems [a] little faulty.
    • Increase the API call limit for different editions.
    • Better way to trigger automation suites from TestRail.
    Read full review

    Pricing Details

    Azure DevOps Server (formerly TMS)

    Starting Price

    Editions & Modules

    Azure DevOps Server (formerly TMS) editions and modules pricing
    EditionModules

    Footnotes

      Offerings

      Free Trial
      Free/Freemium Version
      Premium Consulting/Integration Services

      Entry-level set up fee?

      No setup fee

      Additional Details

      TestRail

      Starting Price

      Editions & Modules

      TestRail editions and modules pricing
      EditionModules

      Footnotes

        Offerings

        Free Trial
        Free/Freemium Version
        Premium Consulting/Integration Services

        Entry-level set up fee?

        No setup fee

        Additional Details

        Likelihood to Renew

        Microsoft

        Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
        Read full review

        IDERA (an Idera, Inc. company)

        No answers on this topic

        Usability

        Microsoft

        Azure DevOps Server or TFS is a complete suite in itself. From Developer's machine where the code is developed to the production environment where the code is meant to run it take care of complete flow within itself. It acts as a code repository you can check-in check-out codes using GIT interface. It also acts as a Build and Automation Test tool which can help you to judge sanctity of your code. It further acts as a release manager to deploy your application to the production environment. And all these steps can also be performed without any manual intervention with the option to have approval processes. Hence its a perfect blend of all set of tools and capabilities required to bring code to production.
        Read full review

        IDERA (an Idera, Inc. company)

        No answers on this topic

        Support Rating

        Microsoft

        I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
        Read full review

        IDERA (an Idera, Inc. company)

        No answers on this topic

        Implementation Rating

        Microsoft

        Do research beforehand and, if possible, do a trial run before implementing into production environment.
        Read full review

        IDERA (an Idera, Inc. company)

        No answers on this topic

        Alternatives Considered

        Microsoft

        In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
        Read full review

        IDERA (an Idera, Inc. company)

        TestRail definitely saves times. I work in a company that consists of several development teams, all of which have different processes. Some of the teams leverage test cases, some do not. I've noticed that the turn around time it takes for me to pick up a ticket, QA it, and then pass/fail/send feedback is much faster when there is a test case created as I'm not reading through ticket description/comments to figure out what needs to be QA'd.
        Read full review

        Return on Investment

        Microsoft

        • It has streamlined the pipeline and project management for our agile effort.
        • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
        • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
        Read full review

        IDERA (an Idera, Inc. company)

        • Improved test management process and collaboration inside team.
        • Increased transparency of QA work.
        • Team became more satisfied.
        Read full review

        Add comparison