Azure DevOps Services vs. Tricentis NeoLoad

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure DevOps Services
Score 8.6 out of 10
N/A
Azure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.
$2
per GB (first 2GB free)
Tricentis NeoLoad
Score 8.5 out of 10
N/A
Tricentis NeoLoad is a solution for continuous performance testing software to automate API and application load testing. It was developed by the French company Neotys and acquired by Tricentis, along with the company, in March 2021.
$20,000
per year with 300 virtual users
Pricing
Azure DevOps ServicesTricentis NeoLoad
Editions & Modules
Azure Artifacts
$2
per GB (first 2GB free)
Basic Plan
$6
per user per month (first 5 users free)
Azure Pipelines - Self-Hosted
$15
per extra parallel job (1 free parallel job with unlimited minutes)
Azure Pipelines - Microsoft Hosted
$40
per parallel job (1,800 minutes free with 1 free parallel job)
Basic + Test Plan
$52
per user per month
No answers on this topic
Offerings
Pricing Offerings
Azure DevOps ServicesTricentis NeoLoad
Free Trial
NoYes
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeOptional
Additional Details
More Pricing Information
Community Pulse
Azure DevOps ServicesTricentis NeoLoad
Top Pros
Top Cons
Best Alternatives
Azure DevOps ServicesTricentis NeoLoad
Small Businesses
Docker
Docker
Score 9.2 out of 10
GitLab
GitLab
Score 8.9 out of 10
Medium-sized Companies
Docker
Docker
Score 9.2 out of 10
GitLab
GitLab
Score 8.9 out of 10
Enterprises
Docker
Docker
Score 9.2 out of 10
GitLab
GitLab
Score 8.9 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Azure DevOps ServicesTricentis NeoLoad
Likelihood to Recommend
8.8
(66 ratings)
8.6
(22 ratings)
Likelihood to Renew
10.0
(3 ratings)
7.3
(1 ratings)
Usability
7.0
(5 ratings)
7.3
(3 ratings)
Support Rating
8.1
(11 ratings)
3.6
(3 ratings)
Implementation Rating
10.0
(1 ratings)
6.4
(1 ratings)
User Testimonials
Azure DevOps ServicesTricentis NeoLoad
Likelihood to Recommend
Microsoft
ADO is well suited for the visibility of day-to-day tasks and responsibilities as well as things such as Features, user stories, etc. Off the top of my head, I can't think of any scenario where it might not be well suited, as you can customize ADO to your liking to a degree.
Read full review
Tricentis
Our testing environment has found NeoLoad to be an invaluable tool. It was mostly utilized for web load testing. Its upkeep and the way various features were implemented were excellent. Because of the test results and actions in various items, the majority of institutions use this program. Additionally, by investigating various load types, it enables developers to test heavy load applications and assist in analyzing the strength and performance of such apps.
Read full review
Pros
Microsoft
  • Flexible Requirements Hierarchy Management: AZDO makes it easy to track items such as features or epics as a flat list, or as a hierarchy in which you can track the parent-child relationship.
  • Fast Data Entry: AZDO was designed to facilitate quick data entry to capture work items quickly, while still enabling detailed capture of acceptance criteria and item properties.
  • Excel Integration: AZDO stands out for its integration with MS Excel, which enables quick updates for bulk items.
Read full review
Tricentis
  • Simulating realistic user behavior: Tricentis NeoLoad allows users to define the actions that simulated users will take when accessing a website or application. This can include clicking links, filling out forms, and accessing specific pages or resources. This allows organizations to test the performance of their applications under realistic conditions.
  • Testing the performance of APIs: Tricentis NeoLoad can be used to test the performance of APIs by simulating multiple requests and measuring the response times and error rates. This can help organizations ensure that their APIs can handle the expected traffic and usage patterns.
  • Identifying performance bottlenecks: Tricentis NeoLoad can identify performance bottlenecks by measuring response times, throughput, and error rates at various points in the application. This can help organizations pinpoint the specific parts of their applications that are causing performance issues and take steps to address them.
  • Testing the scalability of applications: Tricentis NeoLoad can simulate increasing loads on an application to test its scalability and identify the point at which it starts to degrade in performance. This can help organizations ensure that their applications can handle expected traffic growth and unexpected spikes in usage.
  • Generating detailed reports: Tricentis NeoLoad generates detailed reports that provide insights into the performance of an application, including response times, throughput, error rates, and other key metrics. These reports can be used to identify performance issues and track progress over time.
Read full review
Cons
Microsoft
  • Column sorting when in filtered states.
  • A way to show cross-team dependencies.
  • A customized "From" field for notifications. Sometimes when a mail comes from Azure DevOps the teams do not realize that I am sending it
  • A way to do online poker that doesn't require a plug-in.
Read full review
Tricentis
  • Integration with third-party tools. I cannot stream NL test data to a third-party DB and then plot graphs out of it.
  • Keyboard shortcuts. It is tedious to use the mouse to click everywhere. I'd love to have some keyboard shortcuts
  • Reports and Analytics. Lacks intelligence in identifying patterns of problems
Read full review
Likelihood to Renew
Microsoft
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
Read full review
Tricentis
We find NeoLoad easy to use compared to their competitors. It requires minimal coding knowledge, also it is easy to train newcomers with NeoLoad. It also offers good integration and automation capability where with less code you can automate your testing process
Read full review
Usability
Microsoft
Azure DevOps is a powerful, complex cloud application. As such there are a number of things it does great and something where there is room for improvement. One of those areas would be in usability. In my opinion it relies too much on search. There is no easy way to view all projects or to group them in a logical way. You need to search for everything.
Read full review
Tricentis
In being flexible to meet all needs, it is very bare bones by design, but this could be a considered a feature and not a bug.
Read full review
Support Rating
Microsoft
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
Read full review
Tricentis
This is the only area where we strongly feel Tricentis needs to improve. Their support process is inadequate, representatives are not so capable of providing solutions at one shot without consulting their internal engineering teams. Most importantly, the time they take to resolve simple issues is huge and at many times hampered our work.
Read full review
Implementation Rating
Microsoft
Was not part of the process.
Read full review
Tricentis
  1. Their documentation is scattered over many places like GitHub read me files, their internal website etc;
  2. Support team takes huge time just to acknowledge our ticket
  3. No support to automatically migrate scripts from competetor tool into
Read full review
Alternatives Considered
Microsoft
Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
Read full review
Tricentis
There is a learning curve for those who are new to cross-browser testing or the Lambda Test platform to comprehend the features, capabilities, and how to put up tests successfully. There can be resource restrictions, such how many parallel tests you can perform at once, depending on your subscription plan. This may reduce the effectiveness of testing for complicated projects. Neoload on the other side is easy to use and restriction free tool.
Read full review
Return on Investment
Microsoft
  • It provides a great IDE to make things easier, clear, and compact. It has always been a positive ROI
  • It's worth the money. I don't think any other software could replace the VS. It has helped us a lot to making things ready on time
  • The only thing I dislike is that it takes a lot of memory space when in an idle state
Read full review
Tricentis
  • Performance testing is like an insurance. An online store which is not available causes a loss of sales. Without a performance test you do not know if it might happen. The invest into performance tests reduces the risk of loosing sales. The flexible license model of NeoLoad allows or customers to choose reasonable and suiteable rate.
Read full review
ScreenShots

Tricentis NeoLoad Screenshots

Screenshot of Code-less design — loops, conditions, and other drag and drop controls simplify test design creation, and JavaScript can still be used for extremely advanced cases.Screenshot of CI/CD integrations — collaborate across dev, QA, operations, and business teams to create a standardized performance testing approach throughout the enterprise.Screenshot of Real-time test results — analyze test results live to react to an anomaly before the test is over. And leverage in-depth test reporting when the test is completed.Screenshot of Collaborate on test result as the test is runningScreenshot of Configure SaaS-based performance testScreenshot of Dashboard for team analysis