ci(sdk chain tests): Add Magento 2 tests #5
sdk-chain-tests.yml
on: push
Matrix: Run Bouncer lib tests / Test suite
Matrix: Run Magento 2 Engine module tests / Test suite
Matrix: Run Remediation Engine tests / Unit and integration test
Matrix: Run Standalone Bouncer tests / Test suite
Annotations
5 errors, 7 warnings, and 18 notices
[chromium] › detect-pages-scan.test.ts:84:7 › Detect pages scan › should NOT be banned if too many try (because disabled bounce):
__tests__/detect-pages-scan.test.ts#L133
1) [chromium] › detect-pages-scan.test.ts:84:7 › Detect pages scan › should NOT be banned if too many try (because disabled bounce)
Error: Timed out 30000ms waiting for expect(locator).toContainText(expected)
Locator: locator('#signals_push_result')
Expected pattern: /0 errors for 1 candidates/
Received string: "0 pushed signals (0 errors for 0 candidates)."
Call log:
- expect.toContainText with timeout 30000ms
- waiting for locator('#signals_push_result')
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locato
|
[chromium] › detect-pages-scan.test.ts:151:7 › Detect pages scan › should NOT be banned if too many try (because disabled local ban):
__tests__/detect-pages-scan.test.ts#L205
2) [chromium] › detect-pages-scan.test.ts:151:7 › Detect pages scan › should NOT be banned if too many try (because disabled local ban)
Error: Timed out 30000ms waiting for expect(locator).toContainText(expected)
Locator: locator('#signals_push_result')
Expected pattern: /0 errors for 1 candidates/
Received string: "0 pushed signals (0 errors for 0 candidates)."
Call log:
- expect.toContainText with timeout 30000ms
- waiting for locator('#signals_push_result')
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- lo
|
[chromium] › detect-pages-scan.test.ts:84:7 › Detect pages scan › should NOT be banned if too many try (because disabled bounce):
__tests__/detect-pages-scan.test.ts#L133
1) [chromium] › detect-pages-scan.test.ts:84:7 › Detect pages scan › should NOT be banned if too many try (because disabled bounce)
Error: Timed out 30000ms waiting for expect(locator).toContainText(expected)
Locator: locator('#signals_push_result')
Expected pattern: /0 errors for 1 candidates/
Received string: "0 pushed signals (0 errors for 0 candidates)."
Call log:
- expect.toContainText with timeout 30000ms
- waiting for locator('#signals_push_result')
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locato
|
[chromium] › detect-pages-scan.test.ts:151:7 › Detect pages scan › should NOT be banned if too many try (because disabled local ban):
__tests__/detect-pages-scan.test.ts#L205
2) [chromium] › detect-pages-scan.test.ts:151:7 › Detect pages scan › should NOT be banned if too many try (because disabled local ban)
Error: Timed out 30000ms waiting for expect(locator).toContainText(expected)
Locator: locator('#signals_push_result')
Expected pattern: /0 errors for 1 candidates/
Received string: "0 pushed signals (0 errors for 0 candidates)."
Call log:
- expect.toContainText with timeout 30000ms
- waiting for locator('#signals_push_result')
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- lo
|
[chromium] › detect-pages-scan.test.ts:84:7 › Detect pages scan › should NOT be banned if too many try (because disabled bounce):
__tests__/detect-pages-scan.test.ts#L133
1) [chromium] › detect-pages-scan.test.ts:84:7 › Detect pages scan › should NOT be banned if too many try (because disabled bounce)
Error: Timed out 30000ms waiting for expect(locator).toContainText(expected)
Locator: locator('#signals_push_result')
Expected pattern: /0 errors for 1 candidates/
Received string: "0 pushed signals (0 errors for 0 candidates)."
Call log:
- expect.toContainText with timeout 30000ms
- waiting for locator('#signals_push_result')
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locator resolved to <p class="success" id="signals_push_result">0 pushed signals (0 errors for 0 candidates).</p>
- unexpected value "0 pushed signals (0 errors for 0 candidates)."
- locato
|
Slow Test:
[chromium] › add-alert.test.ts#L1
[chromium] › add-alert.test.ts took 23.7s
|
Slow Test:
[chromium] › reports.test.ts#L1
[chromium] › reports.test.ts took 54.6s
|
Slow Test:
[chromium] › config.test.ts#L1
[chromium] › config.test.ts took 19.7s
|
Slow Test:
[chromium] › add-alert.test.ts#L1
[chromium] › add-alert.test.ts took 23.0s
|
Slow Test:
[chromium] › reports.test.ts#L1
[chromium] › reports.test.ts took 59.3s
|
Slow Test:
[chromium] › add-alert.test.ts#L1
[chromium] › add-alert.test.ts took 21.8s
|
Slow Test:
[chromium] › reports.test.ts#L1
[chromium] › reports.test.ts took 1.0m
|
🎭 Playwright Run Summary
3 passed (20.1s)
|
🎭 Playwright Run Summary
7 passed (29.4s)
|
🎭 Playwright Run Summary
6 passed (10.0s)
|
🎭 Playwright Run Summary
2 flaky
[chromium] › detect-pages-scan.test.ts:84:7 › Detect pages scan › should NOT be banned if too many try (because disabled bounce)
[chromium] › detect-pages-scan.test.ts:151:7 › Detect pages scan › should NOT be banned if too many try (because disabled local ban)
3 passed (1.9m)
|
🎭 Playwright Run Summary
7 passed (1.0m)
|
🎭 Playwright Run Summary
5 passed (30.5s)
|
🎭 Playwright Run Summary
3 passed (18.9s)
|
🎭 Playwright Run Summary
6 passed (9.0s)
|
🎭 Playwright Run Summary
5 passed (20.2s)
|
🎭 Playwright Run Summary
2 flaky
[chromium] › detect-pages-scan.test.ts:84:7 › Detect pages scan › should NOT be banned if too many try (because disabled bounce)
[chromium] › detect-pages-scan.test.ts:151:7 › Detect pages scan › should NOT be banned if too many try (because disabled local ban)
3 passed (1.8m)
|
🎭 Playwright Run Summary
7 passed (28.6s)
|
🎭 Playwright Run Summary
7 passed (1.1m)
|
🎭 Playwright Run Summary
7 passed (27.2s)
|
🎭 Playwright Run Summary
3 passed (17.9s)
|
🎭 Playwright Run Summary
1 flaky
[chromium] › detect-pages-scan.test.ts:84:7 › Detect pages scan › should NOT be banned if too many try (because disabled bounce)
4 passed (1.2m)
|
🎭 Playwright Run Summary
7 passed (1.1m)
|
🎭 Playwright Run Summary
5 passed (21.2s)
|
🎭 Playwright Run Summary
6 passed (9.4s)
|