LambdaTest vs. CucumberStudio, from SmartBear

LambdaTest is very well suited for cross-device testing as they provide a wide array of options to choose from. It is very reliable and mimics the actual device. In scenarios wherein the user is having an urgent issue and needs to emulate the bug, the app sometimes is quite slow and may hinder from having a very efficient testing.

HipTest is good and helpful to create and run functional regressions but it is more complicated to use this tool to create and run API testing scenarios (it does not mean it can not be done). This tool is definitively not appropriate for running performance testing scenarios.

Incentivized

• Offers geolocation testing in automation which is amazing!
• You can select browsers, timezone, country and run the capability to start testing instantly.
• We could scale up with parallel testing on local environment without any maintenance cost.
• Integration with project management tools like JIRA, CI/CD tools like Jenkins, Gitlab which makes our test cycle easier

• Good integration with Jira
• Includes integration with different tools for different porpuses
• You can build your own framework to automate scenarios and make it work with Hiptest

Incentivized

• Sometimes the live apps gets slow so its better that this doesn't happen more often
• Still room to add more device vendors like, Huawei now doesn't support play services so its better thay we also have some devices which are with Huawei services only

Incentivized

• UX is not too obvious and easy (like generating a data table in a scenario or including a scenario in a test run) but you can get used to it relatively easy by playing around with the options, also the documentation is helpful.
• To get extra functionalities you have to pay for them separately.

Incentivized

It is very reliable and can provide great results for all the stakeholders. Access is very quick and there are wide-array of devices that can be used to provide a robust application. Having limited resources on a remote setup really helps users to complete task with this emulator. This helps a lot in development team.

LambdaTest provides video recording and screenshots of all your tests in their test logs, which makes tracking easier. Test statuses, such as Lambda Error and VM allocation, allowed us to quickly troubleshoot any build that failed while executing. So overall, it's been great to use for our Tester and Developer team.

The customer support team is very active and cooperative. Once, I contacted them in their off timings because of an issue, I got an instant reply from the executive and he resolved the issue very efficiently. This is why we have been using LambdaTest for more than two years. It is best suited for us.

The tool includes a basic but complete documentation that can be very helpful to get started using the tool. The UX sometimes does not feel very easy to understand but after some use you can get familiar without reading the documentation. The webinars are not very useful for using the tool, I have seen a couple of them and they are actually focused on promoting their HipTest product to new users instead of being useful and educational for current users.

Incentivized

Implementation of Lambdatest was very easy for different project requirements.

Incentivized

LambdaTest offers me a large number of real-time mobile devices and browsers for testing, as well as debugging tools like Screenshot Testing and Issue Tracker. This is what I like the most about LambdaTest and prefer it over Sauce Labs. Additionally, my team has reported faster testing speeds with LambdaTest compared to SauceLabs

Incentivized

• Automation testing has a bit of a learning curve
• Lack of real device keep that bug in your head if not on the website.
• Need to wait for a while for a new OS or browser version on the contrary of immediate availability in case of owning a lab

• It helps to have organization in our scenarios.
• It helps to get regressions done faster than doing it manually
• It helps to graphically see the progress and results of executions.

Incentivized