BrowserStack vs. Katalon

As per my experience, BrowserStack is more suited for those organizations that have a remote work culture and also for those who need multiple device testing. Also, it is beneficial for those organizations that do not want to spend more on physical devices, as the devices update frequently in the market. It is not appropriate for those organizations which have lesser need of multi- device testing as the subscription model may not be feasible for them. Also a small organization with less number of employees would not opt for BrowserStack as it would be costlier for them.

Incentivized

Free trial version is fine but you don't get the adequate support and VFM for the licensed version. Customer service needs to be improved a lot and any QA's with less technical background or less time to troubleshoot issues in the software on their own would find it difficult to use.

• Test client website on 5x more platform.
• Provide a real device with features like media injection and Physical SIM testing for manual testing of a specific feature.
• Automate regression suite to execute parallel on multiple device.
• Provide an accessibility report for the website through automated scanning of the site using site.xml.

Incentivized

• Easy to setup and quick to get started: As Katalon comes with built-in features a new automation tester can automate easily. Script creation time is quick.
• Test Analytics: Katalon also provides analytics which tells you the pattern of your automated tests at a different instance of time.
• Third Party Integration: Katalon provides amazing integration with 3rd party tools like JIRA, ALM, GIT, JENKINS, etc.
• Image-based testing: Katalon also provides inbuilt image based test automation.

Incentivized

• I wish it didn't time out so quickly. I often move back and forth between my native Mac OS system and browsers to BrowserStack for Windows browsers and it often times out so I have to start over.
• I am not sure why, but when I've been testing in BrowserStack for a long period of time - maybe over a couple of hours, it sometimes gets buggy and unresponsive or slow to respond. It makes it hard to tell if I'm experiencing an issue with the site I'm testing or if it's an issue with BrowserStack.
• If I'm wishing for the moon and stars, I'd ask for the ability to use BrowserStack to also test with JAWS screen reader. But I'm happy having NVDA.

• Katalon Studio supports only grovvy language for now. It will be nice to see support for other scripting languages.
• Performance issues; sudden crash of the tool.
• Debug button is provided only to licensed owner since Katalon 7+ version.
• New tool, few resources available to learn. So there is a mild learning curve here.

Incentivized

It's simply a must-have tool. As a designer, I have to ensure my work is at least functional in older browsers. I also have to ensure that, when I design for mobile devices, any differences between platforms aren't problematic. BrowserStack allows me to test my work in a fraction of the time, with a whole lot more accuracy.

So many options that it can be a little overwhelming, but the core functions are easy to find and use and it's usually not too hard to figure things out for the more complex tasks. Very easy to boot up a device and a specific browser from the dashboard to begin a manual website test.

Incentivized

Due to the slowness, there is an intermediate timeout. There is no other problem.

Incentivized

I rated BrowserStack's availability a 10 because it is consistently reliable, with minimal to no downtime or unplanned outages. The platform is accessible whenever needed, ensuring uninterrupted testing. Its robust infrastructure and proactive monitoring ensure a seamless experience, allowing us to meet deadlines without delays caused by availability issues and all

The tests are fast considering the fact that they're Appium tests. I've seen tests reliably pass or fail when they're supposed to, with next to zero issues on the BrowserStack side of things. Tests launch only seconds after I kick off them off from my CLI.

Incentivized

I've not had much direct interaction with the BrowserStack support team. The help and community are great and we've not run into any issue that has really required us to reach out. I guess having a stable and easy to use system means you may never need to contact support.

Incentivized

I love the support. They have provided answers and solutions for most of our questions or doubts that could come up. They also have provided basic tutorials on how to get familiarized with the program.

Incentivized

Yes, it was online training on meet, and trainer looks like skilled and technical strong, he has covered end to end all the features and he has answers all the queries. because of this trainings we are able to implement it by our own in the organization, thank you for support and training.

Incentivized

It was a quick training from the support of browserstack, it was nice and easy to understand, thanks again for the support given by the team. and regularly I used to receive mails for training from support for any new feature they launch, I was able to spread same training to all my team and dev.

Incentivized

I rated the implementation satisfaction an 8 because while it went smoothly overall, there were some challenges during the initial learning phase and integration with existing tools. Key insights include the importance of providing sufficient training upfront and ensuring seamless integration with other systems to minimize disruptions and improve adoption speed.

We used LambdaTest, but ultimately it didn't work for us because it put us in a queue when we kicked off a testing job instead of starting immediately. Our continuous integration process is managed by Microsoft Azure DevOps, and the pipeline agents it provides have a 60-minute timeout. We need immediate tests instead of flipping a coin, which could cause a false positive failure due to timeouts.

Initially, our oragnization had to integrate Katalon tests with the Jenkins to schedule the test runs. The reports were stored in company local database. To identify test flakiness or product issue one had to dig deep into the reports. This issue was all solved by Katalon TestOps. Katalon TestOps provides report history in one place and also helps in easy triage of the report by pointing out script flakiness

Incentivized

I may not be the best person to answer this as I am only using it for 1 department and at 1 site but will still try my best As far as Scalability for Devices for Mobile Automation is concerned, it gets a Solid 10, as the users can run cases on upto 10 device parallel and also have the best choices of devices to choose

Incentivized

• Browserstack improved our internal confidence level when it came to signing off on testing
• Browserstack improved the confidence level of our clients by decreasing the number of bugs found during PVT and providing an entry level opportunity for our clients to perform UAT using the same tools.

Incentivized

• Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
• Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
• Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.

Incentivized