Skip to content

Bump @playwright/test from 1.47.2 to 1.49.0 #251

Bump @playwright/test from 1.47.2 to 1.49.0

Bump @playwright/test from 1.47.2 to 1.49.0 #251

Triggered via pull request November 20, 2024 22:31
Status Failure
Total duration 24m 54s
Artifacts 2

build.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 1 notice
[webkit] › visual.spec.ts:6:5 › / › matches the saved screenshot: test/e2e/visual.spec.ts#L8
1) [webkit] › visual.spec.ts:6:5 › / › matches the saved screenshot ────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 2421 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/screenshot--webkit.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--matches-the-saved-screenshot-webkit/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--matches-the-saved-screenshot-webkit/screenshot-diff.png Call log: - expect.toHaveScreenshot(screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 501848 pixels (ratio 0.06 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 509389 pixels (ratio 0.06 of all image pixels) are different. - waiting 250ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 2421 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
[webkit] › visual.spec.ts:6:5 › / › matches the saved screenshot: test/e2e/visual.spec.ts#L8
1) [webkit] › visual.spec.ts:6:5 › / › matches the saved screenshot ────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 2421 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/screenshot--webkit.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--matches-the-saved-screenshot-webkit-retry1/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--matches-the-saved-screenshot-webkit-retry1/screenshot-diff.png Call log: - expect.toHaveScreenshot(screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 2421 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 2421 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
[webkit] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot: test/e2e/visual.spec.ts#L8
2) [webkit] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot Error: expect(page).toHaveScreenshot(expected) 7516 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/image/the-lobby-at-atlantis-the-palm-dubai/screenshot--webkit.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--image-the-lobby-at-c0a22-atches-the-saved-screenshot-webkit/image/the-lobby-at-atlantis-the-palm-dubai/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--image-the-lobby-at-c0a22-atches-the-saved-screenshot-webkit/image/the-lobby-at-atlantis-the-palm-dubai/screenshot-diff.png Call log: - expect.toHaveScreenshot(image/the-lobby-at-atlantis-the-palm-dubai/screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 7516 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7516 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
[webkit] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot: test/e2e/visual.spec.ts#L8
2) [webkit] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 7516 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/image/the-lobby-at-atlantis-the-palm-dubai/screenshot--webkit.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--image-the-lobby-at-c0a22-atches-the-saved-screenshot-webkit-retry1/image/the-lobby-at-atlantis-the-palm-dubai/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--image-the-lobby-at-c0a22-atches-the-saved-screenshot-webkit-retry1/image/the-lobby-at-atlantis-the-palm-dubai/screenshot-diff.png Call log: - expect.toHaveScreenshot(image/the-lobby-at-atlantis-the-palm-dubai/screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 382090 pixels (ratio 0.42 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 370225 pixels (ratio 0.41 of all image pixels) are different. - waiting 250ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7516 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
[ipad-7] › visual.spec.ts:6:5 › / › matches the saved screenshot: test/e2e/visual.spec.ts#L8
3) [ipad-7] › visual.spec.ts:6:5 › / › matches the saved screenshot ────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 2280 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/screenshot--ipad-7.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--matches-the-saved-screenshot-ipad-7/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--matches-the-saved-screenshot-ipad-7/screenshot-diff.png Call log: - expect.toHaveScreenshot(screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 2280 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 2280 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
[ipad-7] › visual.spec.ts:6:5 › / › matches the saved screenshot: test/e2e/visual.spec.ts#L8
3) [ipad-7] › visual.spec.ts:6:5 › / › matches the saved screenshot ────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 2280 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/screenshot--ipad-7.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--matches-the-saved-screenshot-ipad-7-retry1/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--matches-the-saved-screenshot-ipad-7-retry1/screenshot-diff.png Call log: - expect.toHaveScreenshot(screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 2280 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 2280 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
[ipad-7] › visual.spec.ts:6:5 › /2/ › matches the saved screenshot: test/e2e/visual.spec.ts#L8
4) [ipad-7] › visual.spec.ts:6:5 › /2/ › matches the saved screenshot ──────────────────────────── Error: expect(page).toHaveScreenshot(expected) 1970 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/2/screenshot--ipad-7.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--2-matches-the-saved-screenshot-ipad-7/2/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--2-matches-the-saved-screenshot-ipad-7/2/screenshot-diff.png Call log: - expect.toHaveScreenshot(2/screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1970 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1970 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
[ipad-7] › visual.spec.ts:6:5 › /2/ › matches the saved screenshot: test/e2e/visual.spec.ts#L8
4) [ipad-7] › visual.spec.ts:6:5 › /2/ › matches the saved screenshot ──────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 1970 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/2/screenshot--ipad-7.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--2-matches-the-saved-screenshot-ipad-7-retry1/2/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--2-matches-the-saved-screenshot-ipad-7-retry1/2/screenshot-diff.png Call log: - expect.toHaveScreenshot(2/screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1970 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1970 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
[ipad-7] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot: test/e2e/visual.spec.ts#L8
5) [ipad-7] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot Error: expect(page).toHaveScreenshot(expected) 7270 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/image/the-lobby-at-atlantis-the-palm-dubai/screenshot--ipad-7.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--image-the-lobby-at-c0a22-atches-the-saved-screenshot-ipad-7/image/the-lobby-at-atlantis-the-palm-dubai/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--image-the-lobby-at-c0a22-atches-the-saved-screenshot-ipad-7/image/the-lobby-at-atlantis-the-palm-dubai/screenshot-diff.png Call log: - expect.toHaveScreenshot(image/the-lobby-at-atlantis-the-palm-dubai/screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 7270 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7270 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
[ipad-7] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot: test/e2e/visual.spec.ts#L8
5) [ipad-7] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 7270 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/__screenshots__/visual.spec.ts/image/the-lobby-at-atlantis-the-palm-dubai/screenshot--ipad-7.png Received: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--image-the-lobby-at-c0a22-atches-the-saved-screenshot-ipad-7-retry1/image/the-lobby-at-atlantis-the-palm-dubai/screenshot-actual.png Diff: /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/output/artefacts/visual--image-the-lobby-at-c0a22-atches-the-saved-screenshot-ipad-7-retry1/image/the-lobby-at-atlantis-the-palm-dubai/screenshot-diff.png Call log: - expect.toHaveScreenshot(image/the-lobby-at-atlantis-the-palm-dubai/screenshot.png) with timeout 40000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 7270 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7270 pixels (ratio 0.01 of all image pixels) are different. 6 | test("matches the saved screenshot", async ({ page }) => { 7 | await page.goto(path) > 8 | await expect(page).toHaveScreenshot( | ^ 9 | [path.replaceAll(/(^\/|\/$)/g, ""), "screenshot.png"].filter( 10 | (pathSegment) => pathSegment, 11 | ), at /__w/photos.reupen.uk/photos.reupen.uk/test/e2e/visual.spec.ts:8:26
🎭 Playwright Run Summary
5 failed [webkit] › visual.spec.ts:6:5 › / › matches the saved screenshot ─────────────────────────────── [webkit] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot [ipad-7] › visual.spec.ts:6:5 › / › matches the saved screenshot ─────────────────────────────── [ipad-7] › visual.spec.ts:6:5 › /2/ › matches the saved screenshot ───────────────────────────── [ipad-7] › visual.spec.ts:6:5 › /image/the-lobby-at-atlantis-the-palm-dubai/ › matches the saved screenshot 85 passed (2.0m)

Artifacts

Produced during runtime
Name Size
e2e-test-results
374 MB
site Expired
122 MB