BrowserStack Observability Usage Review

We use BrowserStack observability in our organization. We use to track test reports for regression suite for various products in our org. It gives a nice GUI for all test runs and health status for a given suite and charts out time series test performance along with other metrics. The thing it lacks it understanding between a test rerunning as part of retry logic in TestNG, as currently it counts failure even if in retry the test is passed. It also has some issue with correctly understanding skip tests as it runs/counts that as well even when run is set to false. Support for other frameworks like Spock should be included.

Lacking visibility into test health status. It was difficult to consolidate different test suite and share reports with others. Slack reporting was not as useful and lacked insights. Configuring Alert was not possible. Understanding of flakiness was not as visible and being ignored sometimes. Also new failure vs old failures identification was difficult