Azure DevOps vs. BlazeMeter

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure DevOps
Score 8.2 out of 10
N/A
Azure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.
$2
per GB (first 2GB free)
BlazeMeter
Score 8.0 out of 10
N/A
The BlazeMeter Continuous Testing Platform is a unified, end-to-end, next-generation software test automation platform built for both Agile and COE teams, from Perforce. BlazeMeter includes complete continuous testing capabilities deeply integrated into a single, intuitive workflow.
$199
per month
Pricing
Azure DevOpsBlazeMeter
Editions & Modules
Azure Artifacts
$2
per GB (first 2GB free)
Basic Plan
$6
per user per month (first 5 users free)
Azure Pipelines - Self-Hosted
$15
per extra parallel job (1 free parallel job with unlimited minutes)
Azure Pipelines - Microsoft Hosted
$40
per parallel job (1,800 minutes free with 1 free parallel job)
Basic + Test Plan
$52
per user per month
Basic
$149.00
per month
Pro
$649.00
per month
Offerings
Pricing Offerings
Azure DevOpsBlazeMeter
Free Trial
NoNo
Free/Freemium Version
NoYes
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
Azure DevOpsBlazeMeter
Features
Azure DevOpsBlazeMeter
Automation Testing
Comparison of Automation Testing features of Product A and Product B
Azure DevOps
-
Ratings
BlazeMeter
9.0
1 Ratings
6% above category average
CI/CD Tool Integration00 Ratings9.01 Ratings
Integrated Version Control00 Ratings9.01 Ratings
Data-Driven Testing00 Ratings9.01 Ratings
Testing Collaboration00 Ratings9.01 Ratings
Testing Reports & Analytics00 Ratings9.01 Ratings
Best Alternatives
Azure DevOpsBlazeMeter
Small Businesses
GitHub
GitHub
Score 9.1 out of 10
BrowserStack
BrowserStack
Score 8.5 out of 10
Medium-sized Companies
GitHub
GitHub
Score 9.1 out of 10
ReadyAPI
ReadyAPI
Score 6.4 out of 10
Enterprises
Perforce P4
Perforce P4
Score 7.0 out of 10
ignio AIOps
ignio AIOps
Score 8.1 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Azure DevOpsBlazeMeter
Likelihood to Recommend
8.4
(69 ratings)
9.0
(5 ratings)
Likelihood to Renew
10.0
(3 ratings)
-
(0 ratings)
Usability
7.7
(9 ratings)
-
(0 ratings)
Support Rating
8.1
(11 ratings)
-
(0 ratings)
Implementation Rating
10.0
(1 ratings)
-
(0 ratings)
User Testimonials
Azure DevOpsBlazeMeter
Likelihood to Recommend
Microsoft
Azure DevOps works well when you’ve got larger delivery efforts with multiple teams and a lot of moving parts, and you need one place to plan work, track it properly, and see how everything links together. It’s especially useful when delivery and development are closely tied and you want backlog items, code and releases connected rather than spread across tools. Where it’s less of a fit is for small teams or simple pieces of work, as it can feel like more setup and process than you really need, and non-technical users often struggle with the interface. It also isn’t great if you want instant, easy programme-level views or a very visual planning experience without putting time into configuration.
Read full review
Perforce Software
It is well suited for applications that are mission-critical or applications that can receive high traffic/transactions at unscheduled time periods. Using the load testing feature of BlazeMeter, we can test and ascertain the capacity of the application without the drawbacks of the usual Apache JMeter load testing which depends heavily on the host system from where the load testing is performed.
Read full review
Pros
Microsoft
  • Utilize Git as a repository to share work between multiple users
  • Ability to configure Pipelines to build containers to run virtual deployments and testing scripts.
  • Split individual tasks and relate to master documents for quick navigation and ability to see overall picture of project.
  • Track status of each task
  • Integrate with Git to utilize branches, merging, approvals, history, etc.
Read full review
Perforce Software
  • BlazeMeter takes the .jmx script that teams had written for JMeter. The transition from JMeter to BlazeMeter was seamless.
  • BlazeMeter offers its own cloud and hence we did not have to set it up on-premise.
  • BlazeMeter hits our application from various geographic locations that simulates real life users.
Read full review
Cons
Microsoft
  • I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
  • The wiki is not the prettiest thing to look at, so it could have refinements there.
  • It could improve the search slightly better.
Read full review
Perforce Software
  • Blazemeter reporting is very basic and shallow. There is no way to drill down or correlate. I can get better reports by using JMeter for free.
  • Blazemeter is very costly. Testing with volumes of more than 1K cu is expensive, and can be done for much cheaper if a company/team is willing to invest a bit of time to figure out how to use cloud instances and jmeter slaves, and to write a basic script to collect resulting xml output.
Read full review
Likelihood to Renew
Microsoft
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
Read full review
Perforce Software
No answers on this topic
Usability
Microsoft
It's a great help to get more information about new feature release and stay updated on what the dev team is working on. I like how easy it is to just login and read through the work items. Each work item has basic details: Title, Description, Assigned to, State, Area (what it belongs to), and iteration (when it’s worked on). See image above.They move through different states (New → Discovery → Ready for Prod → etc.).
Read full review
Perforce Software
Easy to setup to do API Performance Testing. Dashboard to showcase results Capability to showcase runtime results
Read full review
Support Rating
Microsoft
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
Read full review
Perforce Software
No answers on this topic
Implementation Rating
Microsoft
Was not part of the process.
Read full review
Perforce Software
No answers on this topic
Alternatives Considered
Microsoft
Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
Read full review
Perforce Software
In comparison with Blazemeter the closes competitor is JMeter but it has disadvantages like it is not a tool that can be use as a collaborative tool and works locally in a computer, Blazemeter is in the web so different people can access and run tests or collaborate do add, edit or delete the existent scripts.
Read full review
Return on Investment
Microsoft
  • We have saved a ton of time not calculating metrics by hand.
  • We no longer spend time writing out cards during planning, it goes straight to the board.
  • We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.
Read full review
Perforce Software
  • It helped positively by helping to identify the maximum capacity needed for high traffic periods
  • Saved revenue by eliminating unwanted duplication of systems
Read full review
ScreenShots