Azure DevOps Services vs. TestComplete

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure DevOps Services
Score 8.6 out of 10
N/A
Azure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.
$2
per GB (first 2GB free)
TestComplete
Score 7.0 out of 10
N/A
TestComplete is a GUI test automation tool that enables users of all skill levels to test the UI of every desktop, web, and mobile application. TestComplete is best suited for testers, automation engineers, and QA teams in any industry.
$2,256
per license
Pricing
Azure DevOps ServicesTestComplete
Editions & Modules
Azure Artifacts
$2
per GB (first 2GB free)
Basic Plan
$6
per user per month (first 5 users free)
Azure Pipelines - Self-Hosted
$15
per extra parallel job (1 free parallel job with unlimited minutes)
Azure Pipelines - Microsoft Hosted
$40
per parallel job (1,800 minutes free with 1 free parallel job)
Basic + Test Plan
$52
per user per month
Node-Locked Base
2,256
per license
Node-Locked Pro
3,950
per license
Float - Base
5,077
per license
Float - Pro
7,901
per license
Offerings
Pricing Offerings
Azure DevOps ServicesTestComplete
Free Trial
NoYes
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional DetailsPay for only the modules needed. TestComplete Pro includes all three modules: desktop, web, and mobile, at a bundled price point, as well as access to the parallel testing engine, TestExecute. TestComplete has additional add-ons, including TestExecute and the Intelligent Quality Add-On.
More Pricing Information
Community Pulse
Azure DevOps ServicesTestComplete
Considered Both Products
Azure DevOps Services

No answer on this topic

TestComplete
Chose TestComplete
»In order to select the best tool to be used at Inspire Innovations, we have defined our selection criteria based on price, functionalities, ease of use and
Top Pros
Top Cons
Best Alternatives
Azure DevOps ServicesTestComplete
Small Businesses
Docker
Docker
Score 9.2 out of 10
BrowserStack
BrowserStack
Score 8.3 out of 10
Medium-sized Companies
Docker
Docker
Score 9.2 out of 10
ReadyAPI
ReadyAPI
Score 8.1 out of 10
Enterprises
Docker
Docker
Score 9.2 out of 10
SoapUI Open Source
SoapUI Open Source
Score 7.8 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Azure DevOps ServicesTestComplete
Likelihood to Recommend
8.8
(66 ratings)
6.3
(88 ratings)
Likelihood to Renew
10.0
(3 ratings)
8.1
(6 ratings)
Usability
7.0
(5 ratings)
7.8
(7 ratings)
Support Rating
8.1
(11 ratings)
6.6
(7 ratings)
Implementation Rating
10.0
(1 ratings)
6.7
(4 ratings)
User Testimonials
Azure DevOps ServicesTestComplete
Likelihood to Recommend
Microsoft
ADO is well suited for the visibility of day-to-day tasks and responsibilities as well as things such as Features, user stories, etc. Off the top of my head, I can't think of any scenario where it might not be well suited, as you can customize ADO to your liking to a degree.
Read full review
SmartBear
Best suited to smaller unit test or tests broken up, couple of forms at a time Not suited - larger regressions test involving multiple systems. - my main regression involving payments has been unsuccessful for the last 3 years despite all working fine separately and while being watched
Read full review
Pros
Microsoft
  • Flexible Requirements Hierarchy Management: AZDO makes it easy to track items such as features or epics as a flat list, or as a hierarchy in which you can track the parent-child relationship.
  • Fast Data Entry: AZDO was designed to facilitate quick data entry to capture work items quickly, while still enabling detailed capture of acceptance criteria and item properties.
  • Excel Integration: AZDO stands out for its integration with MS Excel, which enables quick updates for bulk items.
Read full review
SmartBear
  • Identifying UI objects and application structure
  • Expandability of tests through scripts and script extensions/plugins
  • low barrier of entry (you can get started quickly, and other's don't need much explanation to contribute on a basic level)
  • Possibility of Jira integration for reporting
  • Relatively few (and usually easy to solve) git conflicts when working simultaneously
  • easy handling of test data, also for iterative tests
Read full review
Cons
Microsoft
  • Column sorting when in filtered states.
  • A way to show cross-team dependencies.
  • A customized "From" field for notifications. Sometimes when a mail comes from Azure DevOps the teams do not realize that I am sending it
  • A way to do online poker that doesn't require a plug-in.
Read full review
SmartBear
  • TestComplete could stand to have a simplified view for different types of users. For instance, as a manager/architecture guy, I'm not so interested in getting into the code and am more interested in file-based interactions.
  • TestComplete could use more integration with reporting for things like TeamCity to improve test status visibility.
Read full review
Likelihood to Renew
Microsoft
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
Read full review
SmartBear
We have bigger test automation pack using test complete at the same time we also think this is not good performing tool for large number of test automation scripts.
Read full review
Usability
Microsoft
Azure DevOps is a powerful, complex cloud application. As such there are a number of things it does great and something where there is room for improvement. One of those areas would be in usability. In my opinion it relies too much on search. There is no easy way to view all projects or to group them in a logical way. You need to search for everything.
Read full review
SmartBear
It is usable when you become accustomed to its quirks. Not using it for two months and then you need to re-learn the quirks for some features (but some quirks are so awful that they will never fade from your memory). So, when using it regularly, it is possible to be quite productive, if no big correction in name mapping is needed.
Read full review
Support Rating
Microsoft
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
Read full review
SmartBear
Some bugs were quickly resolved, but most UX quirks of the tool are just marked "as designed". No follow up for enhancement request.
Read full review
Implementation Rating
Microsoft
Was not part of the process.
Read full review
SmartBear
If you develop a mobile application and your testing process goes in cloud, probably you will face a problem - how to implement a stable connection between your mobile devices and testing servers
Read full review
Alternatives Considered
Microsoft
Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
Read full review
SmartBear
TestComplete stacks up against them in terms of GUI and seamless performance. It records each and every step and action been performed in the application and produces a detailed report in a well-structured manner. It can connect and access seamlessly among various databases directly to speed up the testing process.
Read full review
Return on Investment
Microsoft
  • It provides a great IDE to make things easier, clear, and compact. It has always been a positive ROI
  • It's worth the money. I don't think any other software could replace the VS. It has helped us a lot to making things ready on time
  • The only thing I dislike is that it takes a lot of memory space when in an idle state
Read full review
SmartBear
  • Saves hundreds of man-hours with either QA testing or data entry
  • With the small cost of the product, it has saved the company money with both employee costs as well as the cost of mistakes made by human error or software bugs
Read full review
ScreenShots