TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    AutomationNG

    Score7.9 out of 10
    N/AIndecomm Global Services headquartered in New Jersey offers AutomationNG, a test automation and test management platform.N/A

    Azure DevOps

    Score8.1 out of 10
    N/AAzure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.

    $2

    per GB (first 2GB free)

    Pricing
    AutomationNGAzure DevOps
    Editions & Modules
    No answers on this topic
    Azure Artifacts
    $2
    per GB (first 2GB free)
    Basic Plan
    $6
    per user per month (first 5 users free)
    Azure Pipelines - Self-Hosted
    $15
    per extra parallel job (1 free parallel job with unlimited minutes)
    Azure Pipelines - Microsoft Hosted
    $40
    per parallel job (1,800 minutes free with 1 free parallel job)
    Basic + Test Plan
    $52
    per user per month
    Offerings
    Pricing Offerings
    AutomationNGAzure DevOps
    Free Trial
    NoNo
    Free/Freemium Version
    NoNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    AutomationNGAzure DevOps
    Considered Both Products
    Indecomm Global Services
    No answer on this topic
    Microsoft
    No answer on this topic
    Key User Insights
    Would buy again
    No answers on this topic
    97%
    Would buy again
    38 Answers
    Delivers good value for the price
    No answers on this topic
    100%
    Delivers good value for the price
    37 Answers
    Happy with the feature set
    No answers on this topic
    100%
    Happy with the feature set
    39 Answers
    Lived up to sales and marketing promises
    No answers on this topic
    96%
    Lived up to sales and marketing promises
    23 Answers
    Implementation went as expected
    No answers on this topic
    100%
    Implementation went as expected
    32 Answers
    Features
    AutomationNGAzure DevOps
    Test Management
    Comparison of Test Management features of AutomationNG and Azure DevOps
    Feature
    AutomationNG
    7.4
    1 Ratings
    9% below category average
    Azure DevOps
    -
    Ratings
    Centralized test management8.01 Ratings00 Ratings
    Manage test hosts and schedules7.01 Ratings00 Ratings
    Map tests to user stories9.01 Ratings00 Ratings
    Test execution reporting5.01 Ratings00 Ratings
    Defect management8.01 Ratings00 Ratings
    Best Alternatives
    AutomationNGAzure DevOps
    Small Businesses
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    No answers on this topic
    Azure DevOps Server
    Score8.5 out of 10
    Enterprises
    No answers on this topic
    Azure DevOps Server
    Score8.5 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    AutomationNGAzure DevOps
    Likelihood to Recommend
    8.0
    (1 ratings)
    8.9
    (74 ratings)
    Likelihood to Renew
    -
    (0 ratings)
    10.0
    (3 ratings)
    Usability
    -
    (0 ratings)
    8.4
    (13 ratings)
    Support Rating
    -
    (0 ratings)
    8.1
    (11 ratings)
    Implementation Rating
    -
    (0 ratings)
    10.0
    (1 ratings)
    User Testimonials
    AutomationNGAzure DevOps
    Likelihood to Recommend
    Indecomm Global Services
    AutomationNG is best suited for people with no programming language at all. It is easy to write tests and execute. Cross browser testing feature is the best part of this app. Cross browser testing can be tricky in other tools, but this app handles it very graciously. However, the tests are executed slowly compared to other tools like selenium but that requires programming knowledge
    Incentivized
    Read full review
    Microsoft
    Azure DevOps works well when you’ve got larger delivery efforts with multiple teams and a lot of moving parts, and you need one place to plan work, track it properly, and see how everything links together. It’s especially useful when delivery and development are closely tied and you want backlog items, code and releases connected rather than spread across tools. Where it’s less of a fit is for small teams or simple pieces of work, as it can feel like more setup and process than you really need, and non-technical users often struggle with the interface. It also isn’t great if you want instant, easy programme-level views or a very visual planning experience without putting time into configuration.
    Incentivized
    Read full review
    Pros
    Indecomm Global Services
    • Doesnt require any programming knowledge
    • Test cases are written in simple English-like
    • Cross browser testing is supported and is easy to perform
    • Integration with Jira
    • Takes significantly less time to write test scripts
    Incentivized
    Read full review
    Microsoft
    • Utilize Git as a repository to share work between multiple users
    • Ability to configure Pipelines to build containers to run virtual deployments and testing scripts.
    • Split individual tasks and relate to master documents for quick navigation and ability to see overall picture of project.
    • Track status of each task
    • Integrate with Git to utilize branches, merging, approvals, history, etc.
    Incentivized
    Read full review
    Cons
    Indecomm Global Services
    • UI is pretty outdated and needs major revamp
    • Test results UI can be improved
    • Speed of automation can be improved
    Incentivized
    Read full review
    Microsoft
    • I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
    • The wiki is not the prettiest thing to look at, so it could have refinements there.
    • It could improve the search slightly better.
    Read full review
    Likelihood to Renew
    Indecomm Global Services
    No answers on this topic
    Microsoft
    I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
    Incentivized
    Read full review
    Usability
    Indecomm Global Services
    No answers on this topic
    Microsoft
    It's a great help to get more information about new feature release and stay updated on what the dev team is working on. I like how easy it is to just login and read through the work items. Each work item has basic details: Title, Description, Assigned to, State, Area (what it belongs to), and iteration (when it’s worked on). See image above.They move through different states (New → Discovery → Ready for Prod → etc.).
    Incentivized
    Read full review
    Support Rating
    Indecomm Global Services
    No answers on this topic
    Microsoft
    When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
    Incentivized
    Read full review
    Implementation Rating
    Indecomm Global Services
    No answers on this topic
    Microsoft
    Was not part of the process.
    Incentivized
    Read full review
    Alternatives Considered
    Indecomm Global Services
    No answers on this topic
    Microsoft
    Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
    Incentivized
    Read full review
    Return on Investment
    Indecomm Global Services
    • Easy to write the test cases hence saves lot of time.
    • Helps us to manage the tests and identify bugs quite early
    • Cross browser testing is a major feature
    Incentivized
    Read full review
    Microsoft
    • We have saved a ton of time not calculating metrics by hand.
    • We no longer spend time writing out cards during planning, it goes straight to the board.
    • We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.
    Incentivized
    Read full review
    ScreenShots