mabl is a regression test automation tool with test output visualization and performance regression for tracking the perceived speed of web apps and sites, from the company of the same name in Boston.
N/A
Playwright
Score 8.8 out of 10
N/A
A cross-browser testing tool, playwright supports all modern rendering engines including Chromium, WebKit, and Firefox. Users can test on Windows, Linux, and macOS, locally or on CI, headless or headed. It is also cross-language, so that the Playwright API can be used in TypeScript, JavaScript, Python, .NET, Java. Test Mobile Web. Native mobile emulation of Google Chrome for Android and Mobile Safari. The same rendering engine works on the Desktop and in the Cloud. Playright…
$0
Selenium
Score 8.3 out of 10
N/A
Selenium is open source software for browser automation, primarily used for functional, load, or performance testing of applications.
We ultimately selected mabl cause it most met our needs and our budget. We needed a low code UI automation test tool. We also have a suite of existing testing tools and other tools that it needed to be able to integrate with. Price was the only thing that ruled out some of the …
We selected Playwright over the rest for several reasons. The learning curve is faster, making it easier for our team to get up to speed quickly. The setup is pretty straithtforwared, minimal configurartion needed and a great example included in the configuration which includes …
The excel integration was key for using Selenium. I needed to be able to pull excel reports and use SQL, so I needed to find a program that would work with Excel natively. Selenium allowed me to reuse some of my existing SQL code and add a level of automation that I was not …
We haven't found a scenario yet where it hasn't been appropriate. We did have one function on our application that mabl couldn't do, but they solved it and got back to us very quickly. Our application is web-based and mabl is able to handle this very easily. We use the command line runner a lot. Being able to easily and quickly change from a cloud based run to a local run has been fantastic. Setting up flows and environments is a wonderful feature
Playwright is very well suited for any kind of frontend QA regression testing. It's perfect for ensuring that important features that are not often updated remain fully functional across updates or releases. It is not well suited for testing a feature that requires more developer updates before it is ready for end users. Playwright tests are not always simple to maintain if frequent updates are required to keep them relevant. Playwright can be used for API or database assertions as well, but it's not necessarily best suited for those scenarios. It does perform well enough to consider that use case for simplicity if Playwright is already relevant for any frontend QA regression tests that are needed.
When you have to test the UI and how it behaves when certain actions are performed, you need something that can automate the browsers. This is where Selenium comes to the rescue. If you have to test APIs and not the frontend (UI), I would recommend going with other libraries that support HTTP Requests. Selenium is good only when you have no choice but to run the steps on a browser.
Selenium is pretty user-friendly but sometimes tests tend to flake out. I'd say roughly one out of twenty tests yields a false positive.
Selenium software cannot read images. This is a minor negative because a free plug-in is available from alternate sources.
Slowness may be a minor factor with Selenium, though this is an issue with basically any testing software since waiting on a site to execute JavaScript requires the browser to wait for a particular action.
We love this product mainly because of its high customization abilities and the ease of use. Moreover, its free and can be learned easily through online communities and videos. The tests are more consistent and reliable as compared to Manual tests. It has enabled us to test a large number of features all in one go, which would have impossible through manual tests. The reports generated at the end of the tests are really helpful for the QA and the development teams to get a fair view of the application.
I find Playwright very intuitive and generally do not have any trouble using it on a daily basis. However, I do have coworkers with more limited experience in software who have struggled immensely in learning to use Playwright properly. Playwright is very well documented which helps if you plan to use AI to help you write any test automation (which I generally don't recommend, but is an option).
For those who are unfamiliar with coding, there is a bit of a learning curve. There is plenty of helpful documentation and resources but it can take a little time to get the software up and running. Once you get the hang of how Selenium works, and what it can do, you realize how many things you can use it for, and how many processes you can automate.
The Selenium app has a pretty fat community of users. For the problems we are experiencing, we are primarily receiving support from these communities. In addition, there is widespread service support. Instant support is given to the problems we experience when we need Online support. We and our team are happy to provide this support, especially before important deployment processes
We did everything we needed to use it. Now we can execute our tests on different operational systems and browsers running few tests simultaneously. We also implemented Appium framework to execute our tests on mobile devices, such as iPhones, iPads, Android phones and tablets. We use SauceLabs for our test execution and Jenkins for continuous integration.
We ultimately selected mabl cause it most met our needs and our budget. We needed a low code UI automation test tool. We also have a suite of existing testing tools and other tools that it needed to be able to integrate with. Price was the only thing that ruled out some of the above tools, we are a small start up, and don't have a huge budget. Some tools listed didn't have the same functionality or ease of use with the record and playback. mabl works on our machines and integrates with our existing tools
We selected Playwright over the rest for several reasons. The learning curve is faster, making it easier for our team to get up to speed quickly. The setup is pretty straithtforwared, minimal configurartion needed and a great example included in the configuration which includes all the basics to start writing using that spec as a placeholder. Compared to Cypress, Playwright support multiple browsers out of the box, giving us broader testing coverage. Appium is great for mobile testing, but extremely slow.
At the time of adoption, there were not many other alternatives that were even close to being competitive when it comes to browser testing. As far as I know now to this day, there is still little competition to Selenium for what it does. Any other browser-based testing still utilises Selenium to interact with the browser.
