Azure DevOps vs. BitBar vs. TestMu AI

Azure DevOps works well when you’ve got larger delivery efforts with multiple teams and a lot of moving parts, and you need one place to plan work, track it properly, and see how everything links together. It’s especially useful when delivery and development are closely tied and you want backlog items, code and releases connected rather than spread across tools. Where it’s less of a fit is for small teams or simple pieces of work, as it can feel like more setup and process than you really need, and non-technical users often struggle with the interface. It also isn’t great if you want instant, easy programme-level views or a very visual planning experience without putting time into configuration.

Incentivized

CrossBrowserTesting is a great tool to use when you have a new page or new content that you want to test on an array of devices/browsers. In the diverse online world nowadays, it is nearly impossible to ensure optimization for every case. CBT allows you to get closer to that goal.

Incentivized

One day, I needed to test a specific issue that was occurring only on Pixel phones. I turned to LambdaTest, quickly identified the problem, and was able to fix it. There hasn't been a situation where I felt LambdaTest didn't help, it's my go-to solution for testing, as it solves many problems.

Incentivized

• Utilize Git as a repository to share work between multiple users
• Ability to configure Pipelines to build containers to run virtual deployments and testing scripts.
• Split individual tasks and relate to master documents for quick navigation and ability to see overall picture of project.
• Track status of each task
• Integrate with Git to utilize branches, merging, approvals, history, etc.

Incentivized

• Allows me to test on our development server with ease which is behind a firewall.
• Using automation for my tests.
• Screenshots of the problems on each page.
• Ability to jump between screen sizes quickly.

Incentivized

• Very accessible as multiple users can be added in each subscription
• Very reliable as it is very close to the actual device when it comes to operating system and version behavior
• There are a lot of options for devices and browsers that users can choose from when it comes to emulating and testing

• I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
• The wiki is not the prettiest thing to look at, so it could have refinements there.
• It could improve the search slightly better.

• Test case support is somewhat limited in customization ability.
• Not a unique problem to them (or their 'fault'), but content behind VPN or intranet cannot be scanned.
• Pricing with tier level and features can sometimes be confusing (ie. what is and what is not included).

Incentivized

• More real devices should be added like I have Samsung mobile but it was not in the list
• It takes time in checking the link on LambdaTest if we compare with real mobiles
• Sometimes exact results are not matching as from real mobiles

I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.

Incentivized

The reason i have given the 10 points becasue the problem LambdaTest solves is providing access to all devices in one place, allowing developers to identify the same errors they would encounter on real devices. This makes life much easier, especially for developers who regularly face cross-device functionality issues. It's a big plus point that positions LambdaTest as an all-in-one solution.

Incentivized

It's a great help to get more information about new feature release and stay updated on what the dev team is working on. I like how easy it is to just login and read through the work items. Each work item has basic details: Title, Description, Assigned to, State, Area (what it belongs to), and iteration (when it’s worked on). See image above.They move through different states (New → Discovery → Ready for Prod → etc.).

Incentivized

Because of the ease of use of the platform, we just save a lot of time and effort with this as its a feature rich solution, we just need to upload app binary once and for everytime we need to test on a different device we can just directly install that binary on the device without the pain of reupload.

yes always available

Incentivized

haven't found any glitch while using this

Incentivized

When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.

Incentivized

The customer support team is very active and cooperative. Once, I contacted them in their off timings because of an issue, I got an instant reply from the executive and he resolved the issue very efficiently. This is why we have been using LambdaTest for more than two years. It is best suited for us.

Was not part of the process.

Incentivized

Implementation of Lambdatest was very easy for different project requirements.

Incentivized

Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.

Incentivized

Selenium: 1. Selenium is Open source tool 2. Needs proper framework development and integration with multiple 3rd party tools 3. Not much secure 4. Needs scripting knowledge for people working on it 5. takes time and effort CrossBrowser Testing: 1. Licensed , so secure 2. Less time , less effort 3. Quick results 4. No scripting language knowledge needed 5. More coverage 6. Without any framework creation also we can test on multiple devices/browsers

Incentivized

While BrowserStack is also a well-established platform, we found LambdaTest to offer similar and even better features at reasonable pricing. LambdaTest is more cost-effective than BrowserStack. LambdaTest provides a free forever plan, while BrowserStack does not. Even manual testing plans are better priced than BrowserStack’s. In terms of UI and onboarding, we found LambdaTest more user-friendly as well.

not all department, but we're using for our clients

Incentivized

• We have saved a ton of time not calculating metrics by hand.
• We no longer spend time writing out cards during planning, it goes straight to the board.
• We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.

Incentivized

• By using CrossBrowserTesting we are saving many hours a week in manual work hours.
• Our automated Selenium tests run in a fraction of the time it takes to manually test our components, so we can spend more time building great user experiences and less time triaging bugs.

• Automation testing has a bit of a learning curve
• Lack of real device keep that bug in your head if not on the website.
• Need to wait for a while for a new OS or browser version on the contrary of immediate availability in case of owning a lab