Testsigma

It's well suited for straightforward test cases that can run in batch in a short period of time. It's less appropriate for more complex cases that require visual or ID changes, simply because if you run a test case, it won't always see the same IDs and objects that you recorded. It's great for running batch cases on general functionality.

• Helps record and redo test cases without needing your own machine to run or record them.
• Is consistent with how it approaches test cases.
• Provides full recordings of test cases and error reports.

• AI Implementation sometimes throws test cases off the mark.
• Object and ID detection are not consistent (Recorder will detect, the test run will not).

It's not perfected yet; the app's detection and replication aren't 100% reliable, but they're reliable enough to run hundreds of cases a week. The cost-to-benefit ratio feels off and would deter companies from staying. Their staff is very communicative and eager to improve, which brings it back up.

The major benefit over the others so far is the ability to run test cases with other devices and have them run in the background as a separate machine. However, the app's cost works against this feature.

• Has saved hundreds of manual hours of test case runs.
• Has helped identify various issues previously unknown.