<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener'>Customer Verified: Read more.</a>
244 Ratings
Top Rated
245 Ratings

Azure DevOps Server (formerly TMS)

<a href='https://www.trustradius.com/static/about-trustradius-scoring#question3' target='_blank' rel='nofollow noopener'>Customer Verified: Read more.</a>
244 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.3 out of 100
Top Rated
245 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.8 out of 100

Attribute Ratings

  • Azure DevOps Server is rated higher in 2 areas: Likelihood to Renew, Support Rating
  • Selenium is rated higher in 2 areas: Likelihood to Recommend, Implementation Rating
  • Azure DevOps Server and Selenium are tied in 1 area: Usability

Likelihood to Recommend

8.6

Azure DevOps Server (formerly TMS)

86%
49 Ratings
9.3

Selenium

93%
55 Ratings

Likelihood to Renew

10.0

Azure DevOps Server (formerly TMS)

100%
1 Rating
9.2

Selenium

92%
6 Ratings

Usability

8.7

Azure DevOps Server (formerly TMS)

87%
3 Ratings
8.7

Selenium

87%
6 Ratings

Support Rating

8.5

Azure DevOps Server (formerly TMS)

85%
22 Ratings
8.1

Selenium

81%
19 Ratings

Implementation Rating

8.0

Azure DevOps Server (formerly TMS)

80%
2 Ratings
9.0

Selenium

90%
6 Ratings

Likelihood to Recommend

Azure DevOps Server (formerly TMS)

Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
Anonymous | TrustRadius Reviewer

Selenium

Selenium is one of the few tools on the market that allows interaction with a browser that is open-source, so it would be really hard to fault/beat it. It's actually available to use in many languages (like Java, Javascript, Python, etc.), so it does cater to many out there. The use case is simple, but powerful, "to imitate a real user interacting with a webpage". This opens up so much in regards to Front end automation and will automate many of your test cases which you would normally manually perform, in a much slower and error-prone way. In addition, you could write scripts to act as tools, if say an API isn't exposed to you. For example, you could create scripts to register an account on a website with different randomised usernames each time. So not just limited to testing. The only downside is that Selenium could hit a scenario where it becomes stuck, then it will crash and require you to debug where it went wrong. But this is more down to the logic of the scripts rather than Selenium itself. You would need to know your product well to cater to these scenarios as Selenium won't handhold you to why things crash/fail.
Anonymous | TrustRadius Reviewer

Pros

Azure DevOps Server (formerly TMS)

  • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
  • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
  • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
Anonymous | TrustRadius Reviewer

Selenium

  • For any web based UI automation, Selenium is the best tool out there to automate your tests.
  • It supports multiple coding languages like Java, Python, Ruby, C# etc.. to choose from.
  • There is a huge community of users and can get many answers on StackOverFlow.
  • It has lot of other plugins to make your tests even more efficient.
Anonymous | TrustRadius Reviewer

Cons

Azure DevOps Server (formerly TMS)

  • Can add more build templates for specific technology requirements
  • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
  • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
Anonymous | TrustRadius Reviewer

Selenium

  • Selenium is pretty user-friendly but sometimes tests tend to flake out. I'd say roughly one out of twenty tests yields a false positive.
  • Selenium software cannot read images. This is a minor negative because a free plug-in is available from alternate sources.
  • Slowness may be a minor factor with Selenium, though this is an issue with basically any testing software since waiting on a site to execute JavaScript requires the browser to wait for a particular action.
Anonymous | TrustRadius Reviewer

Pricing Details

Azure DevOps Server (formerly TMS)

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Starting Price

Selenium

General

Free Trial
Free/Freemium Version
Premium Consulting/Integration Services
Entry-level set up fee?
No

Starting Price

Likelihood to Renew

Azure DevOps Server (formerly TMS)

Azure DevOps Server (formerly TMS) 10.0
Based on 1 answer
Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Bill Starling | TrustRadius Reviewer

Selenium

Selenium 9.2
Based on 6 answers
We love this product mainly because of its high customization abilities and the ease of use. Moreover, its free and can be learned easily through online communities and videos. The tests are more consistent and reliable as compared to Manual tests. It has enabled us to test a large number of features all in one go, which would have impossible through manual tests. The reports generated at the end of the tests are really helpful for the QA and the development teams to get a fair view of the application.
Siddharth Walia | TrustRadius Reviewer

Usability

Azure DevOps Server (formerly TMS)

Azure DevOps Server (formerly TMS) 8.7
Based on 3 answers
Azure DevOps Server or TFS is a complete suite in itself. From Developer's machine where the code is developed to the production environment where the code is meant to run it take care of complete flow within itself. It acts as a code repository you can check-in check-out codes using GIT interface. It also acts as a Build and Automation Test tool which can help you to judge sanctity of your code. It further acts as a release manager to deploy your application to the production environment. And all these steps can also be performed without any manual intervention with the option to have approval processes. Hence its a perfect blend of all set of tools and capabilities required to bring code to production.
Anonymous | TrustRadius Reviewer

Selenium

Selenium 8.7
Based on 6 answers
As I mentioned earlier, the reason I use Selenium is because there is a fairly widespread community of users, and user support services are at a good level. because the application is open source, it works on many platforms (Windows, Linux, IOS) without any problems. In addition, it gives us a lot of options for writing functional tests. For errors that we receive through the application, we can easily find the reasons for errors in the forums.
zahit bogus | TrustRadius Reviewer

Support Rating

Azure DevOps Server (formerly TMS)

Azure DevOps Server (formerly TMS) 8.5
Based on 22 answers
I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Kellie Crawford | TrustRadius Reviewer

Selenium

Selenium 8.1
Based on 19 answers
Selenium does not have technical support available easily. You have to go through forums to get the information you need. However, there are excellent forums out there that make it easy to troubleshoot. The open-source flexibility makes it difficult to have dedicated support.
Anonymous | TrustRadius Reviewer

Implementation Rating

Azure DevOps Server (formerly TMS)

Azure DevOps Server (formerly TMS) 8.0
Based on 2 answers
Do research beforehand and, if possible, do a trial run before implementing into production environment.
Bill Starling | TrustRadius Reviewer

Selenium

Selenium 9.0
Based on 6 answers
We did everything we needed to use it.Now we can execute our tests on different operational systems and browsers running few tests simultaneously.We also implemented Appium framework to execute our tests on mobile devices, such as iPhones, iPads, Android phones and tablets.We use SauceLabs for our test execution and Jenkins for continuous integration.
Dmitry Shyshkin | TrustRadius Reviewer

Alternatives Considered

Azure DevOps Server (formerly TMS)

In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
Anonymous | TrustRadius Reviewer

Selenium

Sikuli is a GUI automation program that offers an alternative for web based (and any other engine) programs. Sikuli's native language is Python. However, users can customize the software with add-ons similar to Selenium add-ons. These add-ons extend the use of Sikuli to languages such as Java, JavaScript, many C based languages, etc.
Isaiah Hayes | TrustRadius Reviewer

Return on Investment

Azure DevOps Server (formerly TMS)

  • It has streamlined the pipeline and project management for our agile effort.
  • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
  • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
Brianne Netel | TrustRadius Reviewer

Selenium

  • There hasn’t been a downside to using it yet other than we’ve got to update the programs we create for each change.
  • This has saved us hundreds of hours of manpower by allowing our automation engineer to rapid fire tests.
  • We are able to screenshot and save entire sites before and after launch with a program the automation engineer created
  • We can compare large volumes of data against data in excel docs with a program created using Selenium
Janice Cruz (L.I.O.N.) | TrustRadius Reviewer

Add comparison