What users are saying about

Azure DevOps Services Formerly VSTS vs CircleCI

Azure DevOps Services
Top Rated
368 Ratings
CircleCI
45 Ratings

Azure DevOps Services

Top Rated
368 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.7 out of 100

Based on 368 reviews and ratings

CircleCI

45 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.5 out of 100

Based on 45 reviews and ratings

Attribute Ratings

  • Azure DevOps Services is rated higher in 1 area: Support Rating
  • CircleCI is rated higher in 2 areas: Likelihood to Recommend, Usability

Likelihood to Recommend

8.8

Azure DevOps Services

88%
56 Ratings
8.9

CircleCI

89%
25 Ratings

Likelihood to Renew

10.0

Azure DevOps Services

100%
3 Ratings

CircleCI

N/A
0 Ratings

Usability

7.1

Azure DevOps Services

71%
5 Ratings
10.0

CircleCI

100%
1 Rating

Performance

Azure DevOps Services

N/A
0 Ratings
7.8

CircleCI

78%
6 Ratings

Support Rating

8.4

Azure DevOps Services

84%
20 Ratings
6.9

CircleCI

69%
12 Ratings

Implementation Rating

10.0

Azure DevOps Services

100%
2 Ratings

CircleCI

N/A
0 Ratings

Likelihood to Recommend

Azure DevOps Services

[Azure DevOps Services (formerly VSTS)] is well suited for agile teams. It is a digital kanban for teams to access anywhere at any time. Especially during covid when most companies are still remote, it allows teams to fully perform and still be functional in operating within an agile methodology. It also gives visibility to teams capacity.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 56 answers on this topic

CircleCI

CircleCI is perfect for a CI/CD pipeline for an app using a standard build process. It'll take more work for a complex build process, but should still be up to the task unless you need a lot of integrations with other tools. If you have a big team and can spare someone to focus full time on just the CI/CD tools, maybe something like Jenkins is better, but if you're just looking to get your app built, tested, and delivered without a huge amount of effort, CircleCI is probably your preferred tool.

Read full review

John Grosjean | TrustRadius Reviewer
John Grosjean
View all 25 answers on this topic

Pros

Azure DevOps Services

  • Flexible Requirements Hierarchy Management: AZDO makes it easy to track items such as features or epics as a flat list, or as a hierarchy in which you can track the parent-child relationship.
  • Fast Data Entry: AZDO was designed to facilitate quick data entry to capture work items quickly, while still enabling detailed capture of acceptance criteria and item properties.
  • Excel Integration: AZDO stands out for its integration with MS Excel, which enables quick updates for bulk items.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 56 answers on this topic

CircleCI

  • Multiple builds can be run at the same time in parallel.
  • The CircleCI web interface (UI/UX) is very easy to understand and use.
  • Easy Configuration to learn and use. Just a single configuration YAML file.
  • Many integrations. We use the GItHub, Slack, and DataDog integrations.

Read full review

Gabriel Samaroo | TrustRadius Reviewer
Gabriel Samaroo
View all 25 answers on this topic

Cons

Azure DevOps Services

  • Column sorting when in filtered states.
  • A way to show cross-team dependencies.
  • A customized "From" field for notifications. Sometimes when a mail comes from Azure DevOps the teams do not realize that I am sending it
  • A way to do online poker that doesn't require a plug-in.

Read full review

Amy Liston | TrustRadius Reviewer
Amy Liston
View all 56 answers on this topic

CircleCI

  • The "phases" their config file uses to separate out options seem very arbitrary and are not very helpful for organizing your config file
  • No way that I know of to configure which version of MongoDB you use. You have to write your own shell script to download and start MongoDB if you want a specific version.
  • Hard to access build artifacts in the UI

Read full review

Valeri Karpov | TrustRadius Reviewer
Valeri Karpov
View all 25 answers on this topic

Pricing Details

Azure DevOps Services

General

Free Trial
—
Free/Freemium Version
—
Premium Consulting/Integration Services
—
Entry-level set up fee?
No

Starting Price

$2 per GB (first 2GB free)

Azure DevOps Services Editions & Modules

Edition
Basic Plan$61
Basic + Test Plan$522
Azure Artifacts$23
Azure Pipelines - Microsoft Hosted$404
Azure Pipelines - Self-Hosted$155
  1. per user per month (first 5 users free)
  2. per user per month
  3. per GB (first 2GB free)
  4. per parallel job (1,800 minutes free with 1 free parallel job)
  5. per extra parallel job (1 free parallel job with unlimited minutes)
Additional Pricing Details
—

CircleCI

General

Free Trial
—
Free/Freemium Version
—
Premium Consulting/Integration Services
—
Entry-level set up fee?
No

Starting Price

$0 per month

CircleCI Editions & Modules

Edition
Free$01
Performance$301
ScaleCustom Pricing
Server$353
  1. per month
  2. none
  3. per month
Additional Pricing Details
—

Likelihood to Renew

Azure DevOps Services

Azure DevOps Services 10.0
Based on 3 answers
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.

Read full review

Raylene Wall, PMP | TrustRadius Reviewer
Raylene Wall, PMP
View all 3 answers on this topic

CircleCI

No score
No answers yet
No answers on this topic

Usability

Azure DevOps Services

Azure DevOps Services 7.1
Based on 5 answers
Azure DevOps is a powerful, complex cloud application. As such there are a number of things it does great and something where there is room for improvement. One of those areas would be in usability. In my opinion it relies too much on search. There is no easy way to view all projects or to group them in a logical way. You need to search for everything.

Read full review

Kyle Kochtan | TrustRadius Reviewer
Kyle Kochtan
View all 5 answers on this topic

CircleCI

CircleCI 10.0
Based on 1 answer
CircleCI interface is awesome in that it is relatively modern and makes it clear exactly which parts of the engineering lifecycle you are in

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 1 answers on this topic

Performance

Azure DevOps Services

No score
No answers yet
No answers on this topic

CircleCI

CircleCI 7.8
Based on 6 answers
It's pretty snappy, even with using workflows with multiple steps and different docker images. I've seen builds take a long time if it's really involved, but from what I can tell, it's still at least on par if not faster than other build tools.

Read full review

John Grosjean | TrustRadius Reviewer
John Grosjean
View all 6 answers on this topic

Support Rating

Azure DevOps Services

Azure DevOps Services 8.4
Based on 20 answers
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 20 answers on this topic

CircleCI

CircleCI 6.9
Based on 12 answers
Unless you have a reasonably large account, you're going to be mainly stuck reading their documentation. Which has improved somewhat over the years but is still extremely limited compared to a platform like Digital Ocean who invested in the documentation and a community to ensure it's kept up to date. If you can't find your answer there, you can be stuck.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 12 answers on this topic

Implementation Rating

Azure DevOps Services

Azure DevOps Services 10.0
Based on 2 answers
Was not part of the process.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 2 answers on this topic

CircleCI

No score
No answers yet
No answers on this topic

Alternatives Considered

Azure DevOps Services

Azure DevOps is much easier to implement and use on a daily basis than VersionOne. This is based on end-user feedback and my personal experience as well. ADO has more features and seems to get updated more frequently than VersionOne as well. VersionOne is less expensive overall than ADO, but our company prefers to use ADO because it has a lot more benefits.

Read full review

Mark McCully | TrustRadius Reviewer
Mark McCully
View all 56 answers on this topic

CircleCI

Circle was the first CI with simple setup, great documentation, and tight integration with GitHub. Using Jenkins was too much maintenance and overhead, TeamCity was limited in how we could customize it and run concurrent builds, TravisCI was not available for private repos when we switched.

Read full review

Paul Hepworth | TrustRadius Reviewer
Paul Hepworth
View all 25 answers on this topic

Return on Investment

Azure DevOps Services

  • It provides a great IDE to make things easier, clear, and compact. It has always been a positive ROI
  • It's worth the money. I don't think any other software could replace the VS. It has helped us a lot to making things ready on time
  • The only thing I dislike is that it takes a lot of memory space when in an idle state

Read full review

AMANDEEP KUNDRAO | TrustRadius Reviewer
AMANDEEP KUNDRAO
View all 56 answers on this topic

CircleCI

  • It has eased the burden of standardizing our testing and deployment, making onboarding new developers much faster, and having to fix deployment mistakes much less often.
  • It allows us to focus our process around the GitHub workflow, ignoring the details of whatever environment the thing we're working on is actually hosted in. This saves us time.

Read full review

Ben McClure | TrustRadius Reviewer
Ben McClure
View all 25 answers on this topic

Add comparison