| Test | Results | Pass | Fail | Flakiness | Flip | Verdict |
|---|---|---|---|---|---|---|
tests/checkout.spec.ts > pay button enables after address entry locator.click: Error: element is not enabled - waiting for element to be enabled |
4 | 6 | 60% | 89% | FLAKYQUARANTINE | |
com.tta.tests.CheckoutTest.applyCouponUpdatesTotal org.openqa.selenium.TimeoutException: Expected condition failed: waiting for visibility of element |
7 | 3 | 30% | 44% | FLAKY | |
tests/checkout.spec.ts > applies coupon code at checkout expect(locator).toHaveText: Timed out 5000ms waiting for expect(received).toHaveText(expected) |
8 | 2 | 20% | 44% | FLAKY | |
com.tta.tests.GridTest.runsOnRemoteNode org.openqa.selenium.remote.UnreachableBrowserException: Could not start a new session |
9 | 1 | 10% | 22% | FLAKY | |
tests/cart.spec.ts > cart badge updates on add expect(received).toBe(expected) - Expected: 3, Received: 2 |
9 | 1 | 10% | 11% | FLAKY | |
tests/search.spec.ts > search returns results locator.click: Error: strict mode violation: getByRole('button') resolved to 2 elements |
0 | 10 | 100% | 0% | BROKEN | |
com.tta.tests.LoginTest.loginWithValidUser |
10 | 0 | 0% | 0% | STABLE | |
tests/login.spec.ts > user can log in with valid credentials |
10 | 0 | 0% | 0% | STABLE |
flakiness rate = failures / attempts -
flip rate = outcome changes / (attempts - 1)FlakeScore = 100 x (1 - sum(flakiness of flaky tests) / total tests)