BlazeMeter vs. Katalon

It is good for measurements of performance testing. It can be used to run API testing. I can not use this for monitoring but it can be used as a complement for monitoring tools (like Catchpoint or New Relic). It can help to produce load on your site and monitor.

Incentivized

Free trial version is fine but you don't get the adequate support and VFM for the licensed version. Customer service needs to be improved a lot and any QA's with less technical background or less time to troubleshoot issues in the software on their own would find it difficult to use.

• Blazemeter has very intuitive and uncluttered UI. It is very easy for a beginner to figure out and get started.
• Blazemeter allows several methods of creating performance tests - using several popular open source applications. Therefore most often there is no need to learn to use a new tool or language.

Incentivized

• Easy to setup and quick to get started: As Katalon comes with built-in features a new automation tester can automate easily. Script creation time is quick.
• Test Analytics: Katalon also provides analytics which tells you the pattern of your automated tests at a different instance of time.
• Third Party Integration: Katalon provides amazing integration with 3rd party tools like JIRA, ALM, GIT, JENKINS, etc.
• Image-based testing: Katalon also provides inbuilt image based test automation.

Incentivized

• BlazeMeter should not require the purchase of 2 dedicated IPs for each suite of performance tests.
• BlazeMeter should make custom packages cheaper than they are today when purchased for an enterprise and should include dedicated IPs in the package.
• BlazeMerer should have integration with Jenkins Pipeline 2.0.

Incentivized

• Katalon Studio supports only grovvy language for now. It will be nice to see support for other scripting languages.
• Performance issues; sudden crash of the tool.
• Debug button is provided only to licensed owner since Katalon 7+ version.
• New tool, few resources available to learn. So there is a mild learning curve here.

Incentivized

Easy to setup to do API Performance Testing. Dashboard to showcase results Capability to showcase runtime results

Incentivized

Due to the slowness, there is an intermediate timeout. There is no other problem.

Incentivized

I love the support. They have provided answers and solutions for most of our questions or doubts that could come up. They also have provided basic tutorials on how to get familiarized with the program.

Incentivized

BlazeMeter scores well against Apache JMeter in one Key point , the load generation from different cloud based systems. This helps to measure the capacity of the the application in a transparent way and not bogged down by the capacity of the system from where the test is executed (in this case Apache JMeter)

Incentivized

Initially, our oragnization had to integrate Katalon tests with the Jenkins to schedule the test runs. The reports were stored in company local database. To identify test flakiness or product issue one had to dig deep into the reports. This issue was all solved by Katalon TestOps. Katalon TestOps provides report history in one place and also helps in easy triage of the report by pointing out script flakiness

Incentivized

• BlazeMerter helped performance tests run on their cloud, thereby diminishing our on-prem setup costs tremendously.
• BlazeMeter pings our application from several geographical locations, thereby simulating real life users.
• BlazeMeter offers dedicated IPs so that firewall issues can be bypassed.

Incentivized

• Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
• Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
• Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.

Incentivized