Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure DevOps Server
Score 8.4 out of 10
N/A
Azure DevOps Server (formerly Team Foundation Server, or TFS) is the on-premise version of Azure DevOps. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.N/A
BMC AMI DevX
Score 9.3 out of 10
N/A
BMC AMI DevX is an integrated software platform that provides mainframe development teams with modern Application Development and DevOps capabilities. The solution connects traditional mainframe environments with contemporary development practices through components for source code management, testing, debugging, and analytics.N/A
mabl
Score 8.0 out of 10
N/A
mabl is a regression test automation tool with test output visualization and performance regression for tracking the perceived speed of web apps and sites, from the company of the same name in Boston.N/A
Pricing
Azure DevOps ServerBMC AMI DevXmabl
Editions & Modules
No answers on this topic
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
Azure DevOps ServerBMC AMI DevXmabl
Free Trial
NoNoYes
Free/Freemium Version
YesNoNo
Premium Consulting/Integration Services
NoYesNo
Entry-level Setup FeeNo setup feeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
Azure DevOps ServerBMC AMI DevXmabl
Features
Azure DevOps ServerBMC AMI DevXmabl
Automation Testing
Comparison of Automation Testing features of Product A and Product B
Azure DevOps Server
-
Ratings
BMC AMI DevX
-
Ratings
mabl
10.0
1 Ratings
18% above category average
Record and Automate00 Ratings00 Ratings10.01 Ratings
Multi-Browser Testing00 Ratings00 Ratings10.01 Ratings
Test Scheduling00 Ratings00 Ratings10.01 Ratings
Test Management00 Ratings00 Ratings10.01 Ratings
CI/CD Tool Integration00 Ratings00 Ratings10.01 Ratings
Object Recognition00 Ratings00 Ratings10.01 Ratings
Testing Reports & Analytics00 Ratings00 Ratings10.01 Ratings
Best Alternatives
Azure DevOps ServerBMC AMI DevXmabl
Small Businesses
GitHub
GitHub
Score 9.1 out of 10
GitHub
GitHub
Score 9.1 out of 10
BrowserStack
BrowserStack
Score 8.5 out of 10
Medium-sized Companies
GitHub
GitHub
Score 9.1 out of 10
GitHub
GitHub
Score 9.1 out of 10
ReadyAPI
ReadyAPI
Score 6.3 out of 10
Enterprises
Perforce P4
Perforce P4
Score 7.2 out of 10
Perforce P4
Perforce P4
Score 7.2 out of 10
ignio AIOps
ignio AIOps
Score 8.1 out of 10
All AlternativesView all alternativesView all alternativesView all alternatives
User Ratings
Azure DevOps ServerBMC AMI DevXmabl
Likelihood to Recommend
9.0
(48 ratings)
9.1
(17 ratings)
8.0
(1 ratings)
Likelihood to Renew
10.0
(1 ratings)
-
(0 ratings)
-
(0 ratings)
Usability
6.0
(4 ratings)
-
(0 ratings)
-
(0 ratings)
Support Rating
8.4
(10 ratings)
10.0
(1 ratings)
-
(0 ratings)
Implementation Rating
8.0
(1 ratings)
-
(0 ratings)
-
(0 ratings)
Ease of integration
9.0
(2 ratings)
7.4
(9 ratings)
-
(0 ratings)
User Testimonials
Azure DevOps ServerBMC AMI DevXmabl
Likelihood to Recommend
Microsoft
Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
Read full review
BMC Software Inc.
I love these tools! However, my company has not yet transitioned from SCLM to a modern repository, and this is causing most of our developers to remain within TSO for all their development. It's been a slow adoption up to this point, but we are moving toward more modernization this year and next, so with any luck, we'll see usage pick up. Success depends on the speed at which your management is willing to move.
Read full review
mabl
We haven't found a scenario yet where it hasn't been appropriate. We did have one function on our application that mabl couldn't do, but they solved it and got back to us very quickly. Our application is web-based and mabl is able to handle this very easily. We use the command line runner a lot. Being able to easily and quickly change from a cloud based run to a local run has been fantastic. Setting up flows and environments is a wonderful feature
Read full review
Pros
Microsoft
  • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
  • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
  • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
Read full review
BMC Software Inc.
  • The tool I use is fairly intuitive. It doesn't take long to be using it full time.
  • Changing the layout/view is fairly easy. This allows it to fit individual preferences.
  • It is helpful to be able to view specific windows in full screen. Usually, I have it set up to view multiple windows, but sometimes, I just want to view one window in full-screen mode.
Read full review
mabl
  • mabl trainer - record and play back test cases
  • Organization - labels and flows make this easy
  • Customer support!
Read full review
Cons
Microsoft
  • Can add more build templates for specific technology requirements
  • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
  • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
Read full review
BMC Software Inc.
  • Download source code plug-in on Azure DevOps to allow downloading prod version even if it's not in the assignment.
  • Publishing Test Results on Azure DevOps from Total Test plugin
  • Integration with DevEnterprise in Workbench and GenAI capabilities for enhance code analysis (Accross multiple programs/applications)
Read full review
mabl
  • Asserts could be easier to add, but they aren't terribly hard
Read full review
Likelihood to Renew
Microsoft
Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Read full review
BMC Software Inc.
This is a very good range of tools that we use daily to maintain our programs
Read full review
mabl
No answers on this topic
Usability
Microsoft
For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.
Read full review
BMC Software Inc.
9 as it gives good smooth experience for all development tasks. Can be improved a little.
Read full review
mabl
No answers on this topic
Reliability and Availability
Microsoft
No answers on this topic
BMC Software Inc.
The tool is very reliable and we have had very few cases where we have had to contact support.
Read full review
mabl
No answers on this topic
Performance
Microsoft
No answers on this topic
BMC Software Inc.
With one exception, we did not observe any slowdown in development activity when using the AMI DEVX Code DEBug tool.
Read full review
mabl
No answers on this topic
Support Rating
Microsoft
I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Read full review
BMC Software Inc.
Support has been amazing compared to Optim. Further, new features are very regular with File-AID - I can't remember the last time Optim had a significant update. File-AID support is very receptive to feature requests and reported bugs, including sending out hotfixes quickly.
Read full review
mabl
No answers on this topic
Online Training
Microsoft
No answers on this topic
BMC Software Inc.
The learning phase is relatively easy to implement.
Read full review
mabl
No answers on this topic
Implementation Rating
Microsoft
Do research beforehand and, if possible, do a trial run before implementing into production environment.
Read full review
BMC Software Inc.
The installation teams for these products have never complained about any difficulties during the integration of this range of tools into our IT system.
Read full review
mabl
No answers on this topic
Alternatives Considered
Microsoft
In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
Read full review
BMC Software Inc.
The names may have changed over the years, but anyone who has been around for a while will recognize them. For Software Configuration Management, I have used TSO/ISPF/SCLM, Panvalet, ChangeMan, Librarian, Endevor, and now Code Pipeline. All of them met the basic requirements. All of them had their advantages and disadvantages. Code Pipeline, however, stands head and shoulders above the rest in simplicity, completeness, effectiveness, efficiency, and elegance.
Read full review
mabl
We ultimately selected mabl cause it most met our needs and our budget. We needed a low code UI automation test tool. We also have a suite of existing testing tools and other tools that it needed to be able to integrate with. Price was the only thing that ruled out some of the above tools, we are a small start up, and don't have a huge budget. Some tools listed didn't have the same functionality or ease of use with the record and playback. mabl works on our machines and integrates with our existing tools
Read full review
Return on Investment
Microsoft
  • It has streamlined the pipeline and project management for our agile effort.
  • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
  • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
Read full review
BMC Software Inc.
  • Possitive impact. It is main product suite to enable devops in the mainframe applications team. All developers use these on day-to-day work.
  • Negative impact: Recent usability issues caused disappointment in the application teams. It became hard motivate the development community to increase usage.
Read full review
mabl
  • We are able to more quickly automate UI tests
Read full review
ScreenShots

BMC AMI DevX Screenshots

Screenshot of BMC AMI DevX Workbench for VS CodeScreenshot of BMC AMI DevX Code Insights ft BMC AMI Assistant in Visual StudioScreenshot of BMC AMI DevX Code Insights ft Runtime VisualizerScreenshot of BMC AMI DevX Code PipelineScreenshot of BMC AMI zAdviser Enterprise

mabl Screenshots

Screenshot of Testing the login flow of the Freshbooks web application. Each test step is created by interacting with your application and is recorded in the mabl Trainer.Screenshot of Parameterized JavaScript enables everyone to contribute to building automated tests.Screenshot of View of mabl's insights and reporting. In this view, we're looking at mabl's release coverage dashboard, which includes passing rate, quality metrics, and more.Screenshot of Quickly create Jira tickets directly from test failures. All of the test execution data will be automatically pulled into the issue in Jira.Screenshot of Setting up a test as a part of your workflow in GitHub Actions.