Azure DevOps Server vs. CucumberStudio, from SmartBear

Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.

Incentivized

HipTest is good and helpful to create and run functional regressions but it is more complicated to use this tool to create and run API testing scenarios (it does not mean it can not be done). This tool is definitively not appropriate for running performance testing scenarios.

Incentivized

• Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
• Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
• Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.

Incentivized

• Good integration with Jira
• Includes integration with different tools for different porpuses
• You can build your own framework to automate scenarios and make it work with Hiptest

Incentivized

• Can add more build templates for specific technology requirements
• Can have more features in dashboards which can help dev teams stream line their tasks and priorities
• Can have raise alarm feature in case of any sort of failure in devops pipeline execution

Incentivized

• UX is not too obvious and easy (like generating a data table in a scenario or including a scenario in a test run) but you can get used to it relatively easy by playing around with the options, also the documentation is helpful.
• To get extra functionalities you have to pay for them separately.

Incentivized

Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.

Incentivized

For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.

Incentivized

I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus

Incentivized

The tool includes a basic but complete documentation that can be very helpful to get started using the tool. The UX sometimes does not feel very easy to understand but after some use you can get familiar without reading the documentation. The webinars are not very useful for using the tool, I have seen a couple of them and they are actually focused on promoting their HipTest product to new users instead of being useful and educational for current users.

Incentivized

Do research beforehand and, if possible, do a trial run before implementing into production environment.

Incentivized

In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!

Incentivized

• It has streamlined the pipeline and project management for our agile effort.
• It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
• The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.

Incentivized

• It helps to have organization in our scenarios.
• It helps to get regressions done faster than doing it manually
• It helps to graphically see the progress and results of executions.

Incentivized