Azure DevOps vs. Azure DevOps Server vs. Tricentis Tosca

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure DevOps
Score 8.1 out of 10
N/A
Azure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.
$2
per GB (first 2GB free)
Azure DevOps Server
Score 8.4 out of 10
N/A
Azure DevOps Server (formerly Team Foundation Server, or TFS) is the on-premise version of Azure DevOps. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.N/A
Tricentis Tosca
Score 8.9 out of 10
N/A
Tricentis Tosca provides an approach to test automation that is AI-powered, codeless, and end-to-end so it can test everything in a complex IT landscape, to ensure business processes work flawlessly no matter where changes occurs. Its 160+ technology support helps users test everything at the UI, API and data layer, including virtually any enterprise, custom, homegrown and mobile application. With its model-based approach, Tosca enables business, QA and IT teams to…N/A
Pricing
Azure DevOpsAzure DevOps ServerTricentis Tosca
Editions & Modules
Azure Artifacts
$2
per GB (first 2GB free)
Basic Plan
$6
per user per month (first 5 users free)
Azure Pipelines - Self-Hosted
$15
per extra parallel job (1 free parallel job with unlimited minutes)
Azure Pipelines - Microsoft Hosted
$40
per parallel job (1,800 minutes free with 1 free parallel job)
Basic + Test Plan
$52
per user per month
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
Azure DevOpsAzure DevOps ServerTricentis Tosca
Free Trial
NoNoNo
Free/Freemium Version
NoYesNo
Premium Consulting/Integration Services
NoNoNo
Entry-level Setup FeeNo setup feeNo setup feeOptional
Additional Details
More Pricing Information
Community Pulse
Azure DevOpsAzure DevOps ServerTricentis Tosca
Considered Multiple Products
Azure DevOps
Chose Azure DevOps
Beside all cloud benefits, the main advantage Azure DevOps Services compared to Azure DevOps Server is the easier remote access for third party team members, and always up to date software.
On the other hand, on prem deployment (Azure DevOps Server) makes complex access or …
Chose Azure DevOps
Compared to other tools we have used, Microsoft STS has been a much more complete tool. Communication, collaboration, tracking, management, automation, testing, speed to production—all these areas have been improved since we started using Microsoft STS. We have been looking for …
Chose Azure DevOps
Excellent tool when used in Microsoft technology environment.
Chose Azure DevOps
Our TFS was dated and in some ways was quite crude. VSTS is thoroughly modern and I don't have to worry about updating it since MS is always updating VSTS. Also, VSTS has better integration with other products such as JIRA than our older TFS would. I am sure you could integrate …
Chose Azure DevOps
Being its predecessor, VSS has a very limited team-sharing view, providing little to no multiple-user, multiple-project support. Considering the fact that Microsoft has purged its support in favor of TFS and VSTS, it's only reasonable to believe they have something extra. Git
Chose Azure DevOps
Very simple to setup, easy connection to Visual Studio, nice web UI.
Chose Azure DevOps
Haven't used a lot of similar products that have the full feature set as Visual Studio. It's highly effective development platform especially when used with SVN and TFS makes large Agile project easy to manage and collaborate.
Chose Azure DevOps
I haven't used any other products, so I can't say how VSTS/TFS would stack against any competitors, but I know that for an SDLC management tool, VSTS/TFS has everything you need to help an organization meet the requirements needed to adhere to the specific/general practices …
Azure DevOps Server

No answer on this topic

Tricentis Tosca
Chose Tricentis Tosca
Tricentis Tosca is better as the first testing tool to introduce in a news organization. I believe it's the testing tool that is the easiest to introduce and adopt. It is oriented toward manual testers that would like to start automation but it is less oriented toward …
Features
Azure DevOpsAzure DevOps ServerTricentis Tosca
Automation Testing
Comparison of Automation Testing features of Product A and Product B
Azure DevOps
-
Ratings
Azure DevOps Server
-
Ratings
Tricentis Tosca
7.3
23 Ratings
14% below category average
Record and Automate00 Ratings00 Ratings7.421 Ratings
Multi-Browser Testing00 Ratings00 Ratings8.423 Ratings
Mobile Testing00 Ratings00 Ratings7.219 Ratings
Test Scheduling00 Ratings00 Ratings7.623 Ratings
Test Management00 Ratings00 Ratings8.120 Ratings
CI/CD Tool Integration00 Ratings00 Ratings8.120 Ratings
Integrated Version Control00 Ratings00 Ratings1.01 Ratings
Parallel Testing00 Ratings00 Ratings8.121 Ratings
Object Recognition00 Ratings00 Ratings7.822 Ratings
Data-Driven Testing00 Ratings00 Ratings7.922 Ratings
Real Device Testing00 Ratings00 Ratings7.914 Ratings
Testing Reports & Analytics00 Ratings00 Ratings7.922 Ratings
Best Alternatives
Azure DevOpsAzure DevOps ServerTricentis Tosca
Small Businesses
GitHub
GitHub
Score 9.1 out of 10
GitHub
GitHub
Score 9.1 out of 10
BrowserStack
BrowserStack
Score 8.5 out of 10
Medium-sized Companies
GitHub
GitHub
Score 9.1 out of 10
GitHub
GitHub
Score 9.1 out of 10
ReadyAPI
ReadyAPI
Score 6.2 out of 10
Enterprises
Perforce P4
Perforce P4
Score 7.2 out of 10
Perforce P4
Perforce P4
Score 7.2 out of 10
ignio AIOps
ignio AIOps
Score 8.1 out of 10
All AlternativesView all alternativesView all alternativesView all alternatives
User Ratings
Azure DevOpsAzure DevOps ServerTricentis Tosca
Likelihood to Recommend
8.4
(69 ratings)
9.0
(48 ratings)
8.1
(31 ratings)
Likelihood to Renew
10.0
(3 ratings)
10.0
(1 ratings)
10.0
(3 ratings)
Usability
7.8
(9 ratings)
6.0
(4 ratings)
6.2
(25 ratings)
Availability
-
(0 ratings)
-
(0 ratings)
10.0
(1 ratings)
Performance
-
(0 ratings)
-
(0 ratings)
10.0
(1 ratings)
Support Rating
8.1
(11 ratings)
8.4
(10 ratings)
10.0
(2 ratings)
In-Person Training
-
(0 ratings)
-
(0 ratings)
8.0
(1 ratings)
Implementation Rating
10.0
(1 ratings)
8.0
(1 ratings)
10.0
(1 ratings)
Configurability
-
(0 ratings)
-
(0 ratings)
10.0
(1 ratings)
Contract Terms and Pricing Model
-
(0 ratings)
-
(0 ratings)
10.0
(1 ratings)
Ease of integration
-
(0 ratings)
9.0
(2 ratings)
10.0
(1 ratings)
Product Scalability
-
(0 ratings)
-
(0 ratings)
10.0
(1 ratings)
Professional Services
-
(0 ratings)
-
(0 ratings)
10.0
(1 ratings)
Vendor post-sale
-
(0 ratings)
-
(0 ratings)
10.0
(1 ratings)
Vendor pre-sale
-
(0 ratings)
-
(0 ratings)
10.0
(1 ratings)
User Testimonials
Azure DevOpsAzure DevOps ServerTricentis Tosca
Likelihood to Recommend
Microsoft
Azure DevOps works well when you’ve got larger delivery efforts with multiple teams and a lot of moving parts, and you need one place to plan work, track it properly, and see how everything links together. It’s especially useful when delivery and development are closely tied and you want backlog items, code and releases connected rather than spread across tools. Where it’s less of a fit is for small teams or simple pieces of work, as it can feel like more setup and process than you really need, and non-technical users often struggle with the interface. It also isn’t great if you want instant, easy programme-level views or a very visual planning experience without putting time into configuration.
Read full review
Microsoft
Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
Read full review
Tricentis
I still love to test some desktop applications as well as API's with Tosca. For web applications Tosca is OK but there are better alternatives. As a user, Tosca is really great to work with as you can set up a clean project quite fast. It is also quite easy to make a mess as a non-experienced user, using configurations (but in the wrong way), using TCD (but in the wrong way). It would help if there was more focus on generic test automation fundamentals, many more clear examples and instead of just mentioning the best practices, make users really understand the best practices so they know how and when to (not) apply them.
Read full review
Pros
Microsoft
  • Utilize Git as a repository to share work between multiple users
  • Ability to configure Pipelines to build containers to run virtual deployments and testing scripts.
  • Split individual tasks and relate to master documents for quick navigation and ability to see overall picture of project.
  • Track status of each task
  • Integrate with Git to utilize branches, merging, approvals, history, etc.
Read full review
Microsoft
  • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
  • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
  • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
Read full review
Tricentis
  • Ease of maintenance with the help of Reusable TestStep Blocks (Libraries)
  • Flexible and scalable execution infrastructure to support organizations to ramp up or ramp down the resources based on the requirement.
  • Various certification courses available on Tricentis Academy to enable users to learn all the available products based on the role desired by the user.
  • Creation of Execution packs based on the type of testing cycle
Read full review
Cons
Microsoft
  • I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
  • The wiki is not the prettiest thing to look at, so it could have refinements there.
  • It could improve the search slightly better.
Read full review
Microsoft
  • Can add more build templates for specific technology requirements
  • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
  • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
Read full review
Tricentis
  • Documentation - struggled multiple times with features not explained very well, or not explained at all
  • The only support is on Tricentis Forums, where, sometimes, based on 'luck' - you will open a support case, and wait few days until you get the chance to speak with someone from Tricentis and show case your issue
Read full review
Likelihood to Renew
Microsoft
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
Read full review
Microsoft
Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Read full review
Tricentis
Tricentis Tosca has consistently delivered value through its model‑based, low‑code automation, strong SAP ECC/S/4HANA and Fiori support, and the ability to reuse test assets across regression, upgrades, and transformation projects. Its coverage across SAP, Web, APIs, and desktop within a single platform reduces tool sprawl and maintenance effort, while features like risk‑based testing, CI/CD integration, and business‑readable tests align well with our quality and release goals
Read full review
Usability
Microsoft
It's a great help to get more information about new feature release and stay updated on what the dev team is working on. I like how easy it is to just login and read through the work items. Each work item has basic details: Title, Description, Assigned to, State, Area (what it belongs to), and iteration (when it’s worked on). See image above.They move through different states (New → Discovery → Ready for Prod → etc.).
Read full review
Microsoft
For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.
Read full review
Tricentis
Tricentis Tosca supports a large number of technologies and applications. it is easier to start and progress on test automation using Tosca. It is a codeless tool which makes it easier to learn for even a entry level engineer.The modular approach makes it easier to create test cases and maintain them for future enhancements.
Read full review
Support Rating
Microsoft
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
Read full review
Microsoft
I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Read full review
Tricentis
Tricentis team was very supportive. Support is expensive but they helped us at many level. Setting up timeline, implementation, precise questions on automation challenges. We had an account manager and technical people we could as to talk to. Support was generally timely and helping. They often proposed to come on site to help us which would cost more but could be helpful
Read full review
In-Person Training
Microsoft
No answers on this topic
Microsoft
No answers on this topic
Tricentis
It would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is betterif the support is betterIt would be better if the support is betterIt would be better if the support is better
Read full review
Online Training
Microsoft
No answers on this topic
Microsoft
No answers on this topic
Tricentis
okIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is betterIt would be better if the support is better
Read full review
Implementation Rating
Microsoft
Was not part of the process.
Read full review
Microsoft
Do research beforehand and, if possible, do a trial run before implementing into production environment.
Read full review
Tricentis
No answers on this topic
Alternatives Considered
Microsoft
Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
Read full review
Microsoft
In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
Read full review
Tricentis
Tricentis Tosca is codeless and therefore easier to use. It's a great tool for people that would start doing automation and have no coding background. It seems like it has the same capabilities as other test automation suites but I felt it lacked a bit of capabilities on the test management suite such as defects test suites organizations etc
Read full review
Return on Investment
Microsoft
  • We have saved a ton of time not calculating metrics by hand.
  • We no longer spend time writing out cards during planning, it goes straight to the board.
  • We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.
Read full review
Microsoft
  • It has streamlined the pipeline and project management for our agile effort.
  • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
  • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
Read full review
Tricentis
  • It really had a very good impact on our ROI. We were able to automate most of the apps and layers with in it and get a very short execution time which led to increased releases with in short span of time.
  • Time to market really improved and efficiency of developing scripts was not too bad.
  • With built in test dashboards, it was easy to pull metrics and share the insights with management.
Read full review
ScreenShots

Tricentis Tosca Screenshots

Screenshot of where no-code, model-based test automation separates the technical information of an application into reusable, no-code modules that can be updated as applications change, which auto-updates test cases.Screenshot of a test case design for risk optimization - this displays a flexible testing model that enables fast, easy test case creation and maintenance and reduces risk in app releases.Screenshot of requirements coverage for risk optimization - this enables users to prioritize requirements by business risk/ impact, understand what is needed to test, and gain business insight on defects to ensure smarter and faster release decisions.Screenshot of Vision AI - AI powered test automation using patented neural network technology to deliver resilient UI automation. Includes self-healing AI capabilities.Screenshot of service virtualization, which enables users to build realistic, simulated services in minutes to remove bottlenecks and run end-to-end tests faster in the software development lifecycle.Screenshot of test data management. This offers test data when it is needed and helps keep track of the data as it gets consumed across end-to-end business processes.