TrustRadius: an HG Insights company

Azure DevOps vs. Azure DevOps Server vs. Microsoft BI (MSBI)

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Azure DevOps

    Score8.1 out of 10
    N/AAzure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.

    $2

    per GB (first 2GB free)

    Azure DevOps Server

    Score8.5 out of 10
    N/AAzure DevOps Server (formerly Team Foundation Server, or TFS) is the on-premise version of Azure DevOps. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.N/A

    Microsoft BI (MSBI)

    Score8.5 out of 10
    N/AMicrosoft BI is a business intelligence product used for data analysis and generating reports on server-based data. It features unlimited data analysis capacity with its reporting engine, SQL Server Reporting Services alongside ETL, master data management, and data cleansing.

    $14

    per month per user

    Pricing
    Azure DevOpsAzure DevOps ServerMicrosoft BI (MSBI)
    Editions & Modules
    Azure Artifacts
    $2
    per GB (first 2GB free)
    Basic Plan
    $6
    per user per month (first 5 users free)
    Azure Pipelines - Self-Hosted
    $15
    per extra parallel job (1 free parallel job with unlimited minutes)
    Azure Pipelines - Microsoft Hosted
    $40
    per parallel job (1,800 minutes free with 1 free parallel job)
    Basic + Test Plan
    $52
    per user per month
    No answers on this topic
    Power BI Pro
    $14
    per month per user
    Power BI Premium
    $24
    per month per user
    Offerings
    Pricing Offerings
    Azure DevOpsAzure DevOps ServerMicrosoft BI (MSBI)
    Free Trial
    NoNoNo
    Free/Freemium Version
    NoYesYes
    Premium Consulting/Integration Services
    NoNoNo
    Entry-level Setup FeeNo setup feeNo setup feeNo setup fee
    Additional Details———
    More Pricing Information
    Community Pulse
    Azure DevOpsAzure DevOps ServerMicrosoft BI (MSBI)
    Considered Multiple Products
    Microsoft
    Chose Azure DevOps
    Beside all cloud benefits, the main advantage Azure DevOps Services compared to Azure DevOps Server is the easier remote access for third party team members, and always up to date software.
    On the other hand, on prem deployment (Azure DevOps Server) makes complex access or …
    Incentivized
    Chose Azure DevOps
    Compared to other tools we have used, Microsoft STS has been a much more complete tool. Communication, collaboration, tracking, management, automation, testing, speed to production—all these areas have been improved since we started using Microsoft STS. We have been looking for …
    Incentivized
    Chose Azure DevOps
    Excellent tool when used in Microsoft technology environment.
    Incentivized
    Chose Azure DevOps
    Our TFS was dated and in some ways was quite crude. VSTS is thoroughly modern and I don't have to worry about updating it since MS is always updating VSTS. Also, VSTS has better integration with other products such as JIRA than our older TFS would. I am sure you could integrate …
    Incentivized
    Chose Azure DevOps
    Being its predecessor, VSS has a very limited team-sharing view, providing little to no multiple-user, multiple-project support. Considering the fact that Microsoft has purged its support in favor of TFS and VSTS, it's only reasonable to believe they have something extra. Git …
    Incentivized
    Chose Azure DevOps
    Very simple to setup, easy connection to Visual Studio, nice web UI.
    Incentivized
    Chose Azure DevOps
    Haven't used a lot of similar products that have the full feature set as Visual Studio. It's highly effective development platform especially when used with SVN and TFS makes large Agile project easy to manage and collaborate.
    Incentivized
    Chose Azure DevOps
    I haven't used any other products, so I can't say how VSTS/TFS would stack against any competitors, but I know that for an SDLC management tool, VSTS/TFS has everything you need to help an organization meet the requirements needed to adhere to the specific/general practices …
    Incentivized
    Microsoft
    No answer on this topic
    Microsoft
    Chose Microsoft BI (MSBI)
    Outsourcing work is easy to understand, and there are plenty of resources available in the marketplace. It is expensive, but it is still significantly less costly than the alternatives. Results from Microsoft BI (MSBI) are dependable; therefore, there is no problem with trust. …
    Incentivized
    Chose Microsoft BI (MSBI)
    MSBI is great for data collection and reporting, but it lacks the visual appeal and features of Power BI. Even though it's still useful, it falls short of Power BI in terms of features. There's no reason to doubt MSBI's findings. MSBI has a proactive customer service team that …
    Incentivized
    Key User Insights
    Would buy again
    97%
    Would buy again
    38 Answers
    91%
    Would buy again
    21 Answers
    100%
    Would buy again
    15 Answers
    Delivers good value for the price
    100%
    Delivers good value for the price
    37 Answers
    100%
    Delivers good value for the price
    18 Answers
    100%
    Delivers good value for the price
    15 Answers
    Happy with the feature set
    100%
    Happy with the feature set
    39 Answers
    91%
    Happy with the feature set
    21 Answers
    100%
    Happy with the feature set
    15 Answers
    Lived up to sales and marketing promises
    96%
    Lived up to sales and marketing promises
    23 Answers
    100%
    Lived up to sales and marketing promises
    13 Answers
    100%
    Lived up to sales and marketing promises
    13 Answers
    Implementation went as expected
    100%
    Implementation went as expected
    32 Answers
    100%
    Implementation went as expected
    15 Answers
    100%
    Implementation went as expected
    11 Answers
    Features
    Azure DevOpsAzure DevOps ServerMicrosoft BI (MSBI)
    BI Standard Reporting
    Comparison of BI Standard Reporting features of Azure DevOps and Azure DevOps Server and Microsoft BI (MSBI)
    Feature
    Azure DevOps
    -
    Ratings
    Azure DevOps Server
    -
    Ratings
    Microsoft BI (MSBI)
    9.0
    53 Ratings
    10% above category average
    Pixel Perfect reports00 Ratings00 Ratings8.546 Ratings
    Customizable dashboards00 Ratings00 Ratings9.653 Ratings
    Report Formatting Templates00 Ratings00 Ratings8.951 Ratings
    Ad-hoc Reporting
    Comparison of Ad-hoc Reporting features of Azure DevOps and Azure DevOps Server and Microsoft BI (MSBI)
    Feature
    Azure DevOps
    -
    Ratings
    Azure DevOps Server
    -
    Ratings
    Microsoft BI (MSBI)
    8.5
    53 Ratings
    6% above category average
    Drill-down analysis00 Ratings00 Ratings8.548 Ratings
    Formatting capabilities00 Ratings00 Ratings8.253 Ratings
    Integration with R or other statistical packages00 Ratings00 Ratings8.342 Ratings
    Report sharing and collaboration00 Ratings00 Ratings8.953 Ratings
    Report Output and Scheduling
    Comparison of Report Output and Scheduling features of Azure DevOps and Azure DevOps Server and Microsoft BI (MSBI)
    Feature
    Azure DevOps
    -
    Ratings
    Azure DevOps Server
    -
    Ratings
    Microsoft BI (MSBI)
    8.5
    52 Ratings
    3% above category average
    Publish to Web00 Ratings00 Ratings9.348 Ratings
    Publish to PDF00 Ratings00 Ratings9.148 Ratings
    Report Versioning00 Ratings00 Ratings7.344 Ratings
    Report Delivery Scheduling00 Ratings00 Ratings8.547 Ratings
    Delivery to Remote Servers00 Ratings00 Ratings8.426 Ratings
    Data Discovery and Visualization
    Comparison of Data Discovery and Visualization features of Azure DevOps and Azure DevOps Server and Microsoft BI (MSBI)
    Feature
    Azure DevOps
    -
    Ratings
    Azure DevOps Server
    -
    Ratings
    Microsoft BI (MSBI)
    8.7
    52 Ratings
    9% above category average
    Pre-built visualization formats (heatmaps, scatter plots etc.)00 Ratings00 Ratings9.651 Ratings
    Location Analytics / Geographic Visualization00 Ratings00 Ratings8.748 Ratings
    Predictive Analytics00 Ratings00 Ratings7.745 Ratings
    Pattern Recognition and Data Mining00 Ratings00 Ratings8.76 Ratings
    Access Control and Security
    Comparison of Access Control and Security features of Azure DevOps and Azure DevOps Server and Microsoft BI (MSBI)
    Feature
    Azure DevOps
    -
    Ratings
    Azure DevOps Server
    -
    Ratings
    Microsoft BI (MSBI)
    9.3
    53 Ratings
    9% above category average
    Multi-User Support (named login)00 Ratings00 Ratings9.449 Ratings
    Role-Based Security Model00 Ratings00 Ratings9.347 Ratings
    Multiple Access Permission Levels (Create, Read, Delete)00 Ratings00 Ratings8.949 Ratings
    Report-Level Access Control00 Ratings00 Ratings9.36 Ratings
    Single Sign-On (SSO)00 Ratings00 Ratings9.431 Ratings
    Mobile Capabilities
    Comparison of Mobile Capabilities features of Azure DevOps and Azure DevOps Server and Microsoft BI (MSBI)
    Feature
    Azure DevOps
    -
    Ratings
    Azure DevOps Server
    -
    Ratings
    Microsoft BI (MSBI)
    8.0
    42 Ratings
    4% above category average
    Responsive Design for Web Access00 Ratings00 Ratings8.139 Ratings
    Mobile Application00 Ratings00 Ratings8.030 Ratings
    Dashboard / Report / Visualization Interactivity on Mobile00 Ratings00 Ratings7.739 Ratings
    Application Program Interfaces (APIs) / Embedding
    Comparison of Application Program Interfaces (APIs) / Embedding features of Azure DevOps and Azure DevOps Server and Microsoft BI (MSBI)
    Feature
    Azure DevOps
    -
    Ratings
    Azure DevOps Server
    -
    Ratings
    Microsoft BI (MSBI)
    8.5
    24 Ratings
    9% above category average
    REST API00 Ratings00 Ratings9.221 Ratings
    Javascript API00 Ratings00 Ratings8.821 Ratings
    iFrames00 Ratings00 Ratings8.820 Ratings
    Java API00 Ratings00 Ratings8.718 Ratings
    Themeable User Interface (UI)00 Ratings00 Ratings8.021 Ratings
    Customizable Platform (Open Source)00 Ratings00 Ratings7.219 Ratings
    Best Alternatives
    Azure DevOpsAzure DevOps ServerMicrosoft BI (MSBI)
    Small Businesses
    No answers on this topic
    No answers on this topic
    Cyfe
    Score4 out of 10
    Medium-sized Companies
    Azure DevOps Server
    Score8.5 out of 10
    Azure DevOps
    Score8.1 out of 10
    Qlik Cloud Analytics (Qlik Sense)
    Score8.1 out of 10
    Enterprises
    Azure DevOps Server
    Score8.5 out of 10
    Azure DevOps
    Score8.1 out of 10
    Jaspersoft Community Edition
    Score7 out of 10
    All AlternativesView all alternativesView all alternativesView all alternatives
    User Ratings
    Azure DevOpsAzure DevOps ServerMicrosoft BI (MSBI)
    Likelihood to Recommend
    8.9
    (74 ratings)
    9.0
    (48 ratings)
    8.9
    (77 ratings)
    Likelihood to Renew
    10.0
    (3 ratings)
    10.0
    (1 ratings)
    8.0
    (25 ratings)
    Usability
    8.4
    (13 ratings)
    6.0
    (4 ratings)
    8.9
    (19 ratings)
    Availability
    -
    (0 ratings)
    -
    (0 ratings)
    9.5
    (2 ratings)
    Performance
    -
    (0 ratings)
    -
    (0 ratings)
    7.0
    (2 ratings)
    Support Rating
    8.1
    (11 ratings)
    8.4
    (10 ratings)
    8.9
    (15 ratings)
    In-Person Training
    -
    (0 ratings)
    -
    (0 ratings)
    6.9
    (3 ratings)
    Online Training
    -
    (0 ratings)
    -
    (0 ratings)
    8.5
    (2 ratings)
    Implementation Rating
    10.0
    (1 ratings)
    8.0
    (1 ratings)
    9.6
    (7 ratings)
    Configurability
    -
    (0 ratings)
    -
    (0 ratings)
    10.0
    (2 ratings)
    Data Sharing and Collaboration
    -
    (0 ratings)
    -
    (0 ratings)
    8.5
    (42 ratings)
    Data Sources
    -
    (0 ratings)
    -
    (0 ratings)
    8.4
    (41 ratings)
    Ease of integration
    -
    (0 ratings)
    9.0
    (2 ratings)
    -
    (0 ratings)
    User Testimonials
    Azure DevOpsAzure DevOps ServerMicrosoft BI (MSBI)
    Likelihood to Recommend
    Microsoft
    Azure DevOps works well when you’ve got larger delivery efforts with multiple teams and a lot of moving parts, and you need one place to plan work, track it properly, and see how everything links together. It’s especially useful when delivery and development are closely tied and you want backlog items, code and releases connected rather than spread across tools. Where it’s less of a fit is for small teams or simple pieces of work, as it can feel like more setup and process than you really need, and non-technical users often struggle with the interface. It also isn’t great if you want instant, easy programme-level views or a very visual planning experience without putting time into configuration.
    Incentivized
    Read full review
    Microsoft
    Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
    Incentivized
    Read full review
    Microsoft
    Microsoft BI has a lot of features and is a very powerful tool, especially if you have folks on your team that know how to utilize all of its capabilities. To truly unlock all that it can do, it does require people to have a deep understanding of its capabilities. That's where the software really shines. If you are looking for a simpler, more basic reporting tool, there are other programs available that do not require such a steep learning curve.
    Incentivized
    Read full review
    Pros
    Microsoft
    • Utilize Git as a repository to share work between multiple users
    • Ability to configure Pipelines to build containers to run virtual deployments and testing scripts.
    • Split individual tasks and relate to master documents for quick navigation and ability to see overall picture of project.
    • Track status of each task
    • Integrate with Git to utilize branches, merging, approvals, history, etc.
    Incentivized
    Read full review
    Microsoft
    • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
    • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
    • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
    Incentivized
    Read full review
    Microsoft
    • Comparatively easy to use compared to other data analytics solutions, collaborating with other colleagues on data work is simple.
    • Using Visual Studio for database, ETL, reporting, and analytics development save time and money.
    • Transfer of data from one application to another via Excel and comparison of data attributes between applications
    • Dashboard functionality, as well as Python support, are available, allowing you to add additional charts and graphs.
    Incentivized
    Read full review
    Cons
    Microsoft
    • I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
    • The wiki is not the prettiest thing to look at, so it could have refinements there.
    • It could improve the search slightly better.
    Read full review
    Microsoft
    • Can add more build templates for specific technology requirements
    • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
    • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
    Incentivized
    Read full review
    Microsoft
    • MSBI designs can work on increasing data processing capabilities enough to handle the huge datasets etc.
    • It would be a lot better if it is a little low on cost.
    • it needs to create opportunities little more than they do regarding customization of some very unique visualization effects
    Read full review
    Likelihood to Renew
    Microsoft
    I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
    Incentivized
    Read full review
    Microsoft
    Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
    Incentivized
    Read full review
    Microsoft
    Microsoft BI is fundamental to our suite of BI applications. That being said, Northcraft Analytics is focused on delighting our customers, so if the underlying factors of our decision change, we would choose to re-write our BI applications on a different stack. Luckily, mathematics are the fundamental IP of our technology... and is portable across all BI platforms for the foreseeable future.
    Read full review
    Usability
    Microsoft
    It's a great help to get more information about new feature release and stay updated on what the dev team is working on. I like how easy it is to just login and read through the work items. Each work item has basic details: Title, Description, Assigned to, State, Area (what it belongs to), and iteration (when it’s worked on). See image above.They move through different states (New → Discovery → Ready for Prod → etc.).
    Incentivized
    Read full review
    Microsoft
    For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.
    Incentivized
    Read full review
    Microsoft
    The Microsoft BI tools have great usability for both developers and end users alike. For developers familiar with Visual Studio, there is little learning curve. For those not, the single Visual Studio IDE means not having to learn separate tools for each component. For end-users, the web interface for SSRS is simple to navigate with intuitive controls. For ad-hoc analysis, Excel can connect directly to SSAS and provide a pivot table like experience which is familiar to many users. For database development, there is beginning to be some confusion, as there are now three tool choices (VS, SSMS, Azure Data Studio) for developers. I would like to see Azure Data Studio become the superset of SSMS and eventually supplant it.
    Incentivized
    Read full review
    Reliability and Availability
    Microsoft
    No answers on this topic
    Microsoft
    No answers on this topic
    Microsoft
    The product has been reliable.
    Read full review
    Performance
    Microsoft
    No answers on this topic
    Microsoft
    No answers on this topic
    Microsoft
    SQL Server Reporting Services (SSRS) can drag at times. We created two report servers and placed them under an F5 load balancer. This configuration has worked well. We have seen sluggish performance at times due to the Windows Firewall.
    Read full review
    Support Rating
    Microsoft
    When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
    Incentivized
    Read full review
    Microsoft
    I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
    Incentivized
    Read full review
    Microsoft
    MSBI natively has a site that allows you to vote on user enhancements and bug fixes. This allows the largest nagging issues to float to the top and the development team can prioritize accordingly. As mentioned earlier, the large community base of MSBI developers assist technical resources in handling technical questions.
    Incentivized
    Read full review
    In-Person Training
    Microsoft
    No answers on this topic
    Microsoft
    No answers on this topic
    Microsoft
    This training was more directed toward what the product was capable of rather than actual programming.
    Read full review
    Online Training
    Microsoft
    No answers on this topic
    Microsoft
    No answers on this topic
    Microsoft
    I have used on-line training from Microsoft and from Pragmatic Works. I would recommend Pragmatic Works as the best way to get up to speed quickly, and then use the Microsoft on-line training to deep dive into specific features that you need to get depth with.
    Read full review
    Implementation Rating
    Microsoft
    Was not part of the process.
    Incentivized
    Read full review
    Microsoft
    Do research beforehand and, if possible, do a trial run before implementing into production environment.
    Incentivized
    Read full review
    Microsoft
    We are a consulting firm and as such our best resources are always billing on client projects. Our internal implementation has weaknesses, but that's true for any company like ours. My rating is based on the product's ease of implementation.
    Read full review
    Alternatives Considered
    Microsoft
    Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
    Incentivized
    Read full review
    Microsoft
    In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
    Incentivized
    Read full review
    Microsoft
    We have used the built in ConnectWise Manager reports and custom reports. The reports provide static data. PowerBI shows us live data we can drill down into and easily adjust parameters. It's much more useful than a static PDF report.
    Incentivized
    Read full review
    Return on Investment
    Microsoft
    • We have saved a ton of time not calculating metrics by hand.
    • We no longer spend time writing out cards during planning, it goes straight to the board.
    • We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.
    Incentivized
    Read full review
    Microsoft
    • It has streamlined the pipeline and project management for our agile effort.
    • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
    • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
    Incentivized
    Read full review
    Microsoft
    • As a SaaS provider we see being able to provide self-service BI to our client users as a competitive advantage. In fact the MSSQL enabled BI is a contributing factor to many winning RFPs we have done for prospective client organisations.
    • However MSSQL BI requires extensive knowledge and skills to design and develop data warehouses & data models as a foundation to support business analysts and users to interrogate data effectively and efficiently. Often times we find having strong in-house MSSQL expertise is a bless.
    Incentivized
    Read full review
    ScreenShots