Azure DevOps Server vs. Selenium

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure DevOps Server
Score 8.3 out of 10
N/A
AzureDevOps Server (formerly Team Foundation Server, or TFS) is a test management and application lifecycle management tool, from Microsoft's Visual Studio offerings. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.N/A
Selenium
Score 8.1 out of 10
N/A
Selenium is open source software for browser automation, primarily used for functional, load, or performance testing of applications.N/A
Pricing
Azure DevOps ServerSelenium
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
Azure DevOps ServerSelenium
Free Trial
NoNo
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
Azure DevOps ServerSelenium
Top Pros
Top Cons
Best Alternatives
Azure DevOps ServerSelenium
Small Businesses
Docker
Docker
Score 9.2 out of 10
BrowserStack
BrowserStack
Score 8.3 out of 10
Medium-sized Companies
Docker
Docker
Score 9.2 out of 10
ReadyAPI
ReadyAPI
Score 8.1 out of 10
Enterprises
Docker
Docker
Score 9.2 out of 10
ignio AIOps
ignio AIOps
Score 8.2 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Azure DevOps ServerSelenium
Likelihood to Recommend
8.4
(47 ratings)
9.2
(55 ratings)
Likelihood to Renew
10.0
(1 ratings)
9.2
(6 ratings)
Usability
8.7
(3 ratings)
8.8
(6 ratings)
Support Rating
8.4
(10 ratings)
8.3
(11 ratings)
Implementation Rating
8.0
(1 ratings)
9.0
(3 ratings)
Ease of integration
9.0
(2 ratings)
-
(0 ratings)
User Testimonials
Azure DevOps ServerSelenium
Likelihood to Recommend
Microsoft
Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
Read full review
Open Source
When you have to test the UI and how it behaves when certain actions are performed, you need something that can automate the browsers. This is where Selenium comes to the rescue. If you have to test APIs and not the frontend (UI), I would recommend going with other libraries that support HTTP Requests. Selenium is good only when you have no choice but to run the steps on a browser.
Read full review
Pros
Microsoft
  • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
  • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
  • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
Read full review
Open Source
  • For any web based UI automation, Selenium is the best tool out there to automate your tests.
  • It supports multiple coding languages like Java, Python, Ruby, C# etc.. to choose from.
  • There is a huge community of users and can get many answers on StackOverFlow.
  • It has lot of other plugins to make your tests even more efficient.
Read full review
Cons
Microsoft
  • Can add more build templates for specific technology requirements
  • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
  • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
Read full review
Open Source
  • Selenium is pretty user-friendly but sometimes tests tend to flake out. I'd say roughly one out of twenty tests yields a false positive.
  • Selenium software cannot read images. This is a minor negative because a free plug-in is available from alternate sources.
  • Slowness may be a minor factor with Selenium, though this is an issue with basically any testing software since waiting on a site to execute JavaScript requires the browser to wait for a particular action.
Read full review
Likelihood to Renew
Microsoft
Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Read full review
Open Source
We love this product mainly because of its high customization abilities and the ease of use. Moreover, its free and can be learned easily through online communities and videos. The tests are more consistent and reliable as compared to Manual tests. It has enabled us to test a large number of features all in one go, which would have impossible through manual tests. The reports generated at the end of the tests are really helpful for the QA and the development teams to get a fair view of the application.
Read full review
Usability
Microsoft
Azure DevOps Server or TFS is a complete suite in itself. From Developer's machine where the code is developed to the production environment where the code is meant to run it take care of complete flow within itself. It acts as a code repository you can check-in check-out codes using GIT interface. It also acts as a Build and Automation Test tool which can help you to judge sanctity of your code. It further acts as a release manager to deploy your application to the production environment. And all these steps can also be performed without any manual intervention with the option to have approval processes. Hence its a perfect blend of all set of tools and capabilities required to bring code to production.
Read full review
Open Source
As I mentioned earlier, the reason I use Selenium is because there is a fairly widespread community of users, and user support services are at a good level. because the application is open source, it works on many platforms (Windows, Linux, IOS) without any problems. In addition, it gives us a lot of options for writing functional tests. For errors that we receive through the application, we can easily find the reasons for errors in the forums.
Read full review
Support Rating
Microsoft
I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Read full review
Open Source
Selenium does not have technical support available easily. You have to go through forums to get the information you need. However, there are excellent forums out there that make it easy to troubleshoot. The open-source flexibility makes it difficult to have dedicated support.
Read full review
Implementation Rating
Microsoft
Do research beforehand and, if possible, do a trial run before implementing into production environment.
Read full review
Open Source
We did everything we needed to use it. Now we can execute our tests on different operational systems and browsers running few tests simultaneously. We also implemented Appium framework to execute our tests on mobile devices, such as iPhones, iPads, Android phones and tablets. We use SauceLabs for our test execution and Jenkins for continuous integration.
Read full review
Alternatives Considered
Microsoft
In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
Read full review
Open Source
At the time of adoption, there were not many other alternatives that were even close to being competitive when it comes to browser testing. As far as I know now to this day, there is still little competition to Selenium for what it does. Any other browser-based testing still utilises Selenium to interact with the browser.
Read full review
Return on Investment
Microsoft
  • It has streamlined the pipeline and project management for our agile effort.
  • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
  • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
Read full review
Open Source
  • There hasn’t been a downside to using it yet other than we’ve got to update the programs we create for each change.
  • This has saved us hundreds of hours of manpower by allowing our automation engineer to rapid fire tests.
  • We are able to screenshot and save entire sites before and after launch with a program the automation engineer created
  • We can compare large volumes of data against data in excel docs with a program created using Selenium
Read full review
ScreenShots