AWS Device Farm vs. BMC AMI DevX vs. Visual Studio App Center (discontinued)

AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.

Incentivized

I love these tools! However, my company has not yet transitioned from SCLM to a modern repository, and this is causing most of our developers to remain within TSO for all their development. It's been a slow adoption up to this point, but we are moving toward more modernization this year and next, so with any luck, we'll see usage pick up. Success depends on the speed at which your management is willing to move.

Incentivized

Honestly, it's an all around solution that needs some enhancements. Need to build an app, check! Need to test that app, check! Need to debug that app, check! Visual Studio App Center is a well rounded platform for multiple types of builds and services.

Incentivized

• 100% compatibility with the installed user base. No simulation, but real results.
• Integration with Jenkins and other CI/CD tools.
• A considerable amount of device types available. Again, real devices in the cloud!

Incentivized

• The tool I use is fairly intuitive. It doesn't take long to be using it full time.
• Changing the layout/view is fairly easy. This allows it to fit individual preferences.
• It is helpful to be able to view specific windows in full screen. Usually, I have it set up to view multiple windows, but sometimes, I just want to view one window in full-screen mode.
• the debug utility is very useful. Place stopping points is easy and one can set parameters as to when you stop at a line of code. Changing the data on the fly is easy and usefull. The interface is easy to use and make sense.

Incentivized

• It supplies the right native integration for test cases both IOS and Android
• Constant device updates means you are working with the right builds to support product use cases
• Excels in automated test cases that are easy to implement, monitor, and digest results

Incentivized

• To be Frank, I have not found any room where it needs to improve. As whatever we used, It is useful for us

Incentivized

• Download source code plug-in on Azure DevOps to allow downloading prod version even if it's not in the assignment.
• Publishing Test Results on Azure DevOps from Total Test plugin
• Integration with DevEnterprise in Workbench and GenAI capabilities for enhance code analysis (Accross multiple programs/applications)

Incentivized

• Webview support was lacking
• User management seems a bit disconnected from the standard Microsoft ecosystem. Almost feels like you are managing local users and sharing access more than an enterprise solution
• Price could be better
• Buggy on some of the latest versions of windows

Incentivized

This is a very good range of tools that we use daily to maintain our programs

Incentivized

9 as it gives good smooth experience for all development tasks. Can be improved a little.

Incentivized

The tool is very reliable and we have had very few cases where we have had to contact support.

Incentivized

With one exception, we did not observe any slowdown in development activity when using the AMI DEVX Code DEBug tool.

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

Support has been amazing compared to Optim. Further, new features are very regular with File-AID - I can't remember the last time Optim had a significant update. File-AID support is very receptive to feature requests and reported bugs, including sending out hotfixes quickly.

Incentivized

The learning phase is relatively easy to implement.

Incentivized

The installation teams for these products have never complained about any difficulties during the integration of this range of tools into our IT system.

Incentivized

We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.

Incentivized

The names may have changed over the years, but anyone who has been around for a while will recognize them. For Software Configuration Management, I have used TSO/ISPF/SCLM, Panvalet, ChangeMan, Librarian, Endevor, and now Code Pipeline. All of them met the basic requirements. All of them had their advantages and disadvantages. Code Pipeline, however, stands head and shoulders above the rest in simplicity, completeness, effectiveness, efficiency, and elegance.

Incentivized

The biggest benefit is in integrations and plug-ins, as well as the fact that it's not open source. I know open source is popular, but we have all been on the downside of open source and waiting for things to be voted up or a contribution to fix an issue. This alone makes VSAC a nice solution! Plus, it comes with a complete IDE integration of services, documentation, and is light weight

Incentivized

• It impact more and more. Not in terms of ROI but in time as well

Incentivized

• Possitive impact. It is main product suite to enable devops in the mainframe applications team. All developers use these on day-to-day work.
• Negative impact: Recent usability issues caused disappointment in the application teams. It became hard motivate the development community to increase usage.

Incentivized

• Cut down on time to delivery enhancements and overall builds to users
• Helps test new proposed releases with ease
• Cuts down on local build issues as it does do a good job with local development environments as well

Incentivized