<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener'>Customer Verified: Read more.</a>
253 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener'>Customer Verified: Read more.</a>
22 Ratings

Azure DevOps Server (formerly TMS)

<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener'>Customer Verified: Read more.</a>
253 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.3 out of 100

Tricentis qTest

<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener'>Customer Verified: Read more.</a>
22 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 5.2 out of 100

Feature Set Ratings

    Test Management

    Azure DevOps Server (formerly TMS)

    Feature Set Not Supported
    N/A
    6.7

    Tricentis qTest

    67%
    Tricentis qTest ranks higher in 5/5 features

    Centralized test management

    N/A
    0 Ratings
    8.2
    82%
    10 Ratings

    Manage test hosts and schedules

    N/A
    0 Ratings
    5.3
    53%
    6 Ratings

    Map tests to user stories

    N/A
    0 Ratings
    7.0
    70%
    7 Ratings

    Test execution reporting

    N/A
    0 Ratings
    6.3
    63%
    9 Ratings

    Defect management

    N/A
    0 Ratings
    6.6
    66%
    5 Ratings

    Attribute Ratings

    • Azure DevOps Server is rated higher in 5 areas: Likelihood to Recommend, Likelihood to Renew, Usability, Support Rating, Implementation Rating

    Likelihood to Recommend

    8.6

    Azure DevOps Server (formerly TMS)

    86%
    48 Ratings
    3.5

    Tricentis qTest

    35%
    12 Ratings

    Likelihood to Renew

    10.0

    Azure DevOps Server (formerly TMS)

    100%
    1 Rating
    4.0

    Tricentis qTest

    40%
    2 Ratings

    Usability

    8.7

    Azure DevOps Server (formerly TMS)

    87%
    3 Ratings
    8.0

    Tricentis qTest

    80%
    1 Rating

    Support Rating

    8.5

    Azure DevOps Server (formerly TMS)

    85%
    22 Ratings
    1.0

    Tricentis qTest

    10%
    1 Rating

    Implementation Rating

    8.0

    Azure DevOps Server (formerly TMS)

    80%
    2 Ratings
    5.0

    Tricentis qTest

    50%
    1 Rating

    Ease of integration

    9.0

    Azure DevOps Server (formerly TMS)

    90%
    2 Ratings

    Tricentis qTest

    N/A
    0 Ratings

    Likelihood to Recommend

    Microsoft

    Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
    Read full review

    Tricentis

    I've only used the Tricentis qTest Explorer portion of Tricentis qTest (I recall some of the test management stuff being too clunky and prescribed to fit our workflow, so we chose a different tool). It's well suited for automatically capturing screenshots of browser-based or Windows-based applications during test sessions. However, we've had difficulty getting it to work well in other contexts, such as inside a Virtual Machine or on Linux.
    Read full review

    Pros

    Microsoft

    • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
    • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
    • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
    Read full review

    Tricentis

    • Highly customizable: we were able to organize our test cases in unique ways that made our work easier.
    • Connectivity with Jira: being able to pull requirements information in from Jira was a big point for us.
    • Standalone tool: Being a standalone tool on a dedicated server, we were able to have access to our tests regardless of whether our Jira server was down.
    Read full review

    Cons

    Microsoft

    • Can add more build templates for specific technology requirements
    • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
    • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
    Read full review

    Tricentis

    • Data query is slow for large projects (64109 test cases). It's not usable because the screen won't even load.
    • It would be nice to be able to add user to groups directly within the individual user Action menu. Instead of having to create user, assign projects, then go to Groups to add the user.
    • Some simple filtering with the search function or make it context based. So that if I am in Test Design tab, and I run a search, provide results for TC's only. Right now it returns everything from Requirements and Test Runs, etc.
    Read full review

    Pricing Details

    Azure DevOps Server (formerly TMS)

    Starting Price

    Editions & Modules

    Azure DevOps Server (formerly TMS) editions and modules pricing
    EditionModules

    Footnotes

      Offerings

      Free Trial
      Free/Freemium Version
      Premium Consulting/Integration Services

      Entry-level set up fee?

      No setup fee

      Additional Details

      Tricentis qTest

      Starting Price

      $1,000 per year per user

      Editions & Modules

      Tricentis qTest editions and modules pricing
      EditionModules

      Footnotes

        Offerings

        Free Trial
        Free/Freemium Version
        Premium Consulting/Integration Services

        Entry-level set up fee?

        Optional

        Additional Details

        Request Pricing

        Likelihood to Renew

        Microsoft

        Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
        Read full review

        Tricentis

        This has been a core QA management tool for our organization and integrates well with our other SDLC platforms (Azure DevOps/Jira/Katalon).
        Read full review

        Usability

        Microsoft

        Azure DevOps Server or TFS is a complete suite in itself. From Developer's machine where the code is developed to the production environment where the code is meant to run it take care of complete flow within itself. It acts as a code repository you can check-in check-out codes using GIT interface. It also acts as a Build and Automation Test tool which can help you to judge sanctity of your code. It further acts as a release manager to deploy your application to the production environment. And all these steps can also be performed without any manual intervention with the option to have approval processes. Hence its a perfect blend of all set of tools and capabilities required to bring code to production.
        Read full review

        Tricentis

        qTest is actually intuitive and user-friendly, despite my other scathing review aspects
        Read full review

        Support Rating

        Microsoft

        I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
        Read full review

        Tricentis

        The actual answer is 0. I have never experienced worse support, whether personal or professional
        Read full review

        Implementation Rating

        Microsoft

        Do research beforehand and, if possible, do a trial run before implementing into production environment.
        Read full review

        Tricentis

        Again, supporting documentation could have been a lot better
        Read full review

        Alternatives Considered

        Microsoft

        In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
        Read full review

        Tricentis

        We felt like for the feature set and due to the fact it was mid-range on the cost, it was a good choice. It also has some other plugins which we plan to utilize at some point like Tosca.
        Read full review

        Return on Investment

        Microsoft

        • It has streamlined the pipeline and project management for our agile effort.
        • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
        • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
        Read full review

        Tricentis

        • Better organization and centralization of test cases has led to more cohesive team collaboration
        • Speed to delivery, deployments to production, are mostly maintained
        • Performance issues have led to testing delays requiring the team to switch to other methods which contributed to QA bottleneck issues and sometimes even missed sprint commitments
        Read full review

        Screenshots

        Add comparison