Robot Framework vs. Testsigma

It suits for checking features of a simple web application or features that don't heavily rely on AJAX. You could create tests that check if application is running properly and raise alarm if required so someone can manually check for problems. However making big test sets to produce reliable results may prove to be difficult or impossible. Also running lots of test cases can take hours.

Incentivized

Independently Invited by TrustRadius

A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info

It's well suited for straightforward test cases that can run in batch in a short period of time. It's less appropriate for more complex cases that require visual or ID changes, simply because if you run a test case, it won't always see the same IDs and objects that you recorded. It's great for running batch cases on general functionality.

• Helps record and redo test cases without needing your own machine to run or record them.
• Is consistent with how it approaches test cases.
• Provides full recordings of test cases and error reports.

• AI Implementation sometimes throws test cases off the mark.
• Object and ID detection are not consistent (Recorder will detect, the test run will not).

It's not perfected yet; the app's detection and replication aren't 100% reliable, but they're reliable enough to run hundreds of cases a week. The cost-to-benefit ratio feels off and would deter companies from staying. Their staff is very communicative and eager to improve, which brings it back up.

The major benefit over the others so far is the ability to run test cases with other devices and have them run in the background as a separate machine. However, the app's cost works against this feature.

• Has saved hundreds of manual hours of test case runs.
• Has helped identify various issues previously unknown.