Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Appium
Score 9.0 out of 10
N/A
N/AN/A
BMC AMI DevX
Score 9.3 out of 10
N/A
BMC AMI DevX is an integrated software platform that provides mainframe development teams with modern Application Development and DevOps capabilities. The solution connects traditional mainframe environments with contemporary development practices through components for source code management, testing, debugging, and analytics.N/A
Katalon
Score 7.6 out of 10
N/A
Katalon Studio is provided by the vendor as a free and robust automation solution for API, Web and Mobile testing. It is designed to eliminate the complexities of building an automation framework by integrating all necessary test components with built-in keywords and project templates. Katalon Studio includes a full feature set for a complete test automation process covering multiple platforms and testing types. New users can get started with test automation using its easy-to-use…
$69
per month
Pricing
AppiumBMC AMI DevXKatalon
Editions & Modules
No answers on this topic
No answers on this topic
Node Locked License
$69.00
per month
Floating License
$1,529.00
per year
Offerings
Pricing Offerings
AppiumBMC AMI DevXKatalon
Free Trial
NoNoYes
Free/Freemium Version
NoNoYes
Premium Consulting/Integration Services
NoYesYes
Entry-level Setup FeeNo setup feeNo setup feeNo setup fee
Additional DetailsKatalon Studio was originated from KMS Technology R&D. It has been a successful solution for numerous automation projects ranging from small team to enterprise client. Katalon Studio is free for use, product development is funded by the testing services provided by KMS Technology. To support future releases, please consider subscribing to our business support services.
More Pricing Information
Community Pulse
AppiumBMC AMI DevXKatalon
Considered Multiple Products
Appium
Chose Appium
Most of mobile testing tools which are available in the market are paid license tools. But Appium is Open source mobile testing tool. We can create customised automation framework using Appium. It also supports various languages such as Java, Javascript etc. And also supports …
BMC AMI DevX

No answer on this topic

Katalon
Chose Katalon
Ready API is one of the most popular and widely used tool for API automation. Data driven testing and reporting are some of the features which makes this tool very useful. but if we compare this tool with Katalon Studio, this is only useful for API automation where as Katalon …
Chose Katalon
Katalon Studio is above both the tools is due to its codeless test automation feature and having API, desktop, web, and mobile automation in one place but obviously there is room for improvement when desktop automation is of primary importance in the automation.
Best Alternatives
AppiumBMC AMI DevXKatalon
Small Businesses
Swiftify
Swiftify
Score 9.0 out of 10
GitHub
GitHub
Score 9.1 out of 10
BrowserStack
BrowserStack
Score 8.5 out of 10
Medium-sized Companies
Swiftify
Swiftify
Score 9.0 out of 10
GitHub
GitHub
Score 9.1 out of 10
ReadyAPI
ReadyAPI
Score 6.2 out of 10
Enterprises
Swiftify
Swiftify
Score 9.0 out of 10
Perforce P4
Perforce P4
Score 7.2 out of 10
ignio AIOps
ignio AIOps
Score 8.1 out of 10
All AlternativesView all alternativesView all alternativesView all alternatives
User Ratings
AppiumBMC AMI DevXKatalon
Likelihood to Recommend
9.8
(10 ratings)
9.1
(17 ratings)
8.1
(11 ratings)
Likelihood to Renew
10.0
(1 ratings)
-
(0 ratings)
-
(0 ratings)
Usability
9.0
(1 ratings)
-
(0 ratings)
9.0
(1 ratings)
Support Rating
-
(0 ratings)
10.0
(1 ratings)
9.9
(2 ratings)
Ease of integration
-
(0 ratings)
7.4
(9 ratings)
-
(0 ratings)
User Testimonials
AppiumBMC AMI DevXKatalon
Likelihood to Recommend
JS Foundation
1. It's open source which supports range of languages, operating systems and languages. Well suited for Android and IOS mobile automation. Supports all kinds of apps, which makes it flexible and robust mobile testing tool 2. It is less appropriate where we need intercept network call to verify the API calls. Extensive coding experience is required to work Appium
Read full review
BMC Software Inc.
I love these tools! However, my company has not yet transitioned from SCLM to a modern repository, and this is causing most of our developers to remain within TSO for all their development. It's been a slow adoption up to this point, but we are moving toward more modernization this year and next, so with any luck, we'll see usage pick up. Success depends on the speed at which your management is willing to move.
Read full review
Katalon Inc
Katalon TestOps is well suited for an oraganization who want to organize their automation collections and have everything in one place. It provides good insight on test runs, failures and also helps in defect tracking. It is extremely easy to schedule and run test suites automatically. With the help of test history, it becomes easier to triage the report and identify if it is a product issue or a test flakiness. Also with the automation run scheduling features with custom options, user do not have to manually trigger the runs and just run the scheduler to do the job.
Read full review
Pros
JS Foundation
  • It uses WebDriver API so it makes it easy to use for former web test automation engineers.
  • It can be managed via the command line via an extensive set of parameters.
  • It handles implicit waits at the server side that is especially valuable in distributed infrastructure.
Read full review
BMC Software Inc.
  • The tool I use is fairly intuitive. It doesn't take long to be using it full time.
  • Changing the layout/view is fairly easy. This allows it to fit individual preferences.
  • It is helpful to be able to view specific windows in full screen. Usually, I have it set up to view multiple windows, but sometimes, I just want to view one window in full-screen mode.
  • the debug utility is very useful. Place stopping points is easy and one can set parameters as to when you stop at a line of code. Changing the data on the fly is easy and usefull. The interface is easy to use and make sense.
Read full review
Katalon Inc
  • Easy to setup and quick to get started: As Katalon comes with built-in features a new automation tester can automate easily. Script creation time is quick.
  • Test Analytics: Katalon also provides analytics which tells you the pattern of your automated tests at a different instance of time.
  • Third Party Integration: Katalon provides amazing integration with 3rd party tools like JIRA, ALM, GIT, JENKINS, etc.
  • Image-based testing: Katalon also provides inbuilt image based test automation.
Read full review
Cons
JS Foundation
  • Element browser sometimes is unreliable and has sporadic fails.
  • Appium running is a bit slow, compared to tests written with Appium and with Espresso or XCTest.
Read full review
BMC Software Inc.
  • Download source code plug-in on Azure DevOps to allow downloading prod version even if it's not in the assignment.
  • Publishing Test Results on Azure DevOps from Total Test plugin
  • Integration with DevEnterprise in Workbench and GenAI capabilities for enhance code analysis (Accross multiple programs/applications)
Read full review
Katalon Inc
  • Integration with Azure is painstakingly slow as it takes too much time to upload reports to Azure. When raised with the support team i was advised to contact Microsoft who promptly and correctly replied that its an issue with the katalon plugin.
  • Non Responsive Customer Support. Several mails were replied late.
  • The Desktop app uses too much memory when booting up and running tests even on a 16gb RAM.
Read full review
Likelihood to Renew
JS Foundation
I am rating 10/10 because Appium can use with multiple programming languages with multiple Test engines. Also, it works for both Android and iOS.
Read full review
BMC Software Inc.
This is a very good range of tools that we use daily to maintain our programs
Read full review
Katalon Inc
No answers on this topic
Usability
JS Foundation
I would like to give 9/10 rating to Appium because of it can easily integrate with popular frameworks and CI/CD tools, as well as it is reliable, flexible and easy to use. The setup can bit complex in initial step, but once on configured it's very easy to use and enables stable and scalable mobile automation for real and cloud devices.
Read full review
BMC Software Inc.
9 as it gives good smooth experience for all development tasks. Can be improved a little.
Read full review
Katalon Inc
Due to the slowness, there is an intermediate timeout. There is no other problem.
Read full review
Reliability and Availability
JS Foundation
No answers on this topic
BMC Software Inc.
The tool is very reliable and we have had very few cases where we have had to contact support.
Read full review
Katalon Inc
No answers on this topic
Performance
JS Foundation
No answers on this topic
BMC Software Inc.
With one exception, we did not observe any slowdown in development activity when using the AMI DEVX Code DEBug tool.
Read full review
Katalon Inc
No answers on this topic
Support Rating
JS Foundation
No answers on this topic
BMC Software Inc.
Support has been amazing compared to Optim. Further, new features are very regular with File-AID - I can't remember the last time Optim had a significant update. File-AID support is very receptive to feature requests and reported bugs, including sending out hotfixes quickly.
Read full review
Katalon Inc
I love the support. They have provided answers and solutions for most of our questions or doubts that could come up. They also have provided basic tutorials on how to get familiarized with the program.
Read full review
Online Training
JS Foundation
No answers on this topic
BMC Software Inc.
The learning phase is relatively easy to implement.
Read full review
Katalon Inc
No answers on this topic
Implementation Rating
JS Foundation
No answers on this topic
BMC Software Inc.
The installation teams for these products have never complained about any difficulties during the integration of this range of tools into our IT system.
Read full review
Katalon Inc
No answers on this topic
Alternatives Considered
JS Foundation
If you're an Apple developer, you use Xcode. It's practically a forced necessity. For system testing though, it doesn't have to be. You can have your development team focus on unit and integration tests in their platform and another team automate acceptance tests with a language they are more familiar with.
Read full review
BMC Software Inc.
The names may have changed over the years, but anyone who has been around for a while will recognize them. For Software Configuration Management, I have used TSO/ISPF/SCLM, Panvalet, ChangeMan, Librarian, Endevor, and now Code Pipeline. All of them met the basic requirements. All of them had their advantages and disadvantages. Code Pipeline, however, stands head and shoulders above the rest in simplicity, completeness, effectiveness, efficiency, and elegance.
Read full review
Katalon Inc
Katalon Studio is above both the tools is due to its codeless test automation feature and having API, desktop, web, and mobile automation in one place but obviously there is room for improvement when desktop automation is of primary importance in the automation.
Read full review
Return on Investment
JS Foundation
  • Appium is open source, so it's free. That's budget friendly right there.
  • The ability to write mobile automation tests has saved considerable time for our manual test team, but that is true with most automation tests.
  • We use Sauce Labs with our other automation, but Appium works great with Sauce Labs, as well, if I needed to run on emulators and simulators.
Read full review
BMC Software Inc.
  • Possitive impact. It is main product suite to enable devops in the mainframe applications team. All developers use these on day-to-day work.
  • Negative impact: Recent usability issues caused disappointment in the application teams. It became hard motivate the development community to increase usage.
Read full review
Katalon Inc
  • Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
  • Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
  • Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.
Read full review
ScreenShots

BMC AMI DevX Screenshots

Screenshot of BMC AMI DevX Workbench for VS CodeScreenshot of BMC AMI DevX Code Insights ft BMC AMI Assistant in Visual StudioScreenshot of BMC AMI DevX Code Insights ft Runtime VisualizerScreenshot of BMC AMI DevX Code PipelineScreenshot of BMC AMI zAdviser Enterprise

Katalon Screenshots

Screenshot of Project setup - fast start with pre-built templates and scriptsScreenshot of Run Single Tests or Suites on multiple configurations and data sets
Multiple Platform Support so you can run your automation tests on Windows, OSX, Android, and iOSScreenshot of Maintain TestsScreenshot of View Reports