Skip to content

test: fixme WebSocket locale test in Chromium 150#41944

Merged
Skn0tt merged 2 commits into
mainfrom
fix-flakes/windows-latest-29987350696
Jul 23, 2026
Merged

test: fixme WebSocket locale test in Chromium 150#41944
Skn0tt merged 2 commits into
mainfrom
fix-flakes/windows-latest-29987350696

Conversation

@microsoft-playwright-automation

@microsoft-playwright-automation microsoft-playwright-automation Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

browsercontext-locale.spec.ts › should send Accept-Language header on WebSocket handshake fails in Chromium 150 branded builds, while newer branded versions pass:

  • Chrome 150.0.7871.181: 22/22 final runs fail on macOS, 23/23 on Ubuntu, and 22/22 on Windows.
  • Chrome Beta 151.0.7922.47: 22/22 pass on Ubuntu.
  • Edge 150.0.4078.83: 22/22 fail on Windows.
  • Edge Dev 152.0.4167.0: 22/22 pass on Windows.
  • Bundled Chromium passes on every OS.

Chromium 150 sends the browser's Accept-Language (en-US,en;q=0.9) on the WebSocket handshake instead of the emulated en-GB locale. Scope the fixme to that browser major so the test starts running again once stable rolls forward. This also teaches the fix-flakes agent to compare exact browser versions before using channel names in skip predicates.

Test added Jul 21 in #41904; related issue #23732.

Emoji run history - Edge 150 on Windows, oldest first:
🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥

Verified locally on macOS with Chrome 150.0.7871.130:

  • Bundled Chromium still runs and passes.
  • PWTEST_CHANNEL=chrome skips the test.
  • npm run flint passes.

Suggested-reviewer: yury-s

`browsercontext-locale.spec.ts › should send Accept-Language header on
WebSocket handshake` fails 100% on the branded Google Chrome and Microsoft
Edge channels while passing on Chromium. Branded builds send the browser's
own `Accept-Language` (`en-US,en;q=0.9`) on the WebSocket handshake instead
of the emulated `en-GB` locale, so the assertion always fails. Scope a
`fixme` to those channels, mirroring the existing Firefox `fixme`.

DB evidence (rolling window, expected_status=passed): 100% fail on every
branded bot that runs it, still failing through Jul 22 —
chrome-ubuntu-22.04 88/88, msedge-windows-latest 88/88, chrome-macos-latest
88/88, chrome-windows-latest 88/88. 0 failures on any chromium-* bot.
Error: expect(...).toContain('en-GB'); received 'en-US,en;q=0.9' (x352).
Test added Jul 21 in #41904; related issue
#23732.

Emoji run history — msedge-windows-latest (22 runs, oldest first):
[🟥](https://github.com/microsoft/playwright/actions/runs/29856729151/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29859883032/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29865460136/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29866867131/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29867308985/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29873996100/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29874748609/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29874783963/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29877078341/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29879172510/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29904950059/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29915407358/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29918102409/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29924682554/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29931173316/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29932910968/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29933325202/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29938598979/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29940740538/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29945241493/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29957712363/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29960743816/attempts/1)

Verified locally on windows-latest with msedge installed:
- PWTEST_CHANNEL=msedge --project=chromium-library: reproduced the failure
  (received 'en-US,en;q=0.9'), then confirmed skipped after the fixme.
- --project=chromium-library (no channel): still runs and passes.
- npm run flint clean (pre-existing unrelated html-reporter check-deps
  failure reproduces without this change).

CI run: https://github.com/microsoft/playwright/actions/runs/29987350696

Suggested-reviewer: yury-s
@Skn0tt
Skn0tt requested a review from yury-s July 23, 2026 07:31
Stable Chrome and Edge fail on Chromium 150, while Chrome Beta 151
and Edge Dev 152 pass. Gate on the affected version and teach the
fix-flakes workflow to compare browser versions before channel names.

Copilot-Session: 19d8bd17-13fd-482d-8228-94bd104679cf
@Skn0tt Skn0tt changed the title test: fixme WebSocket Accept-Language locale test on Chrome/Edge test: fixme WebSocket locale test in Chromium 150 Jul 23, 2026
@Skn0tt Skn0tt closed this Jul 23, 2026
@Skn0tt Skn0tt reopened this Jul 23, 2026
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

5 flaky ⚠️ [chromium-library] › library/chromium/chromium.spec.ts:177 › serviceWorker(), and fromServiceWorker() work `@chromium-ubuntu-22.04-arm-node20`
⚠️ [chromium-library] › library/beforeunload.spec.ts:130 › should support dismissing the dialog multiple times `@realtime-time-library-chromium-linux`
⚠️ [chromium-library] › library/video.spec.ts:664 › screencast › should capture full viewport `@chromium-ubuntu-22.04-node24`
⚠️ [firefox-library] › library/video.spec.ts:294 › screencast › should capture navigation `@firefox-ubuntu-22.04-node20`
⚠️ [firefox-page] › page/page-event-request.spec.ts:181 › should return response body when Cross-Origin-Opener-Policy is set `@firefox-ubuntu-22.04-node20`

50204 passed, 1190 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "MCP"

1 failed
❌ [chrome] › mcp/devtools.spec.ts:42 › browser_highlight with style @mcp-windows-latest-chrome

7785 passed, 1262 skipped


Merge workflow run.

@Skn0tt
Skn0tt merged commit bbbae6d into main Jul 23, 2026
49 of 50 checks passed
@Skn0tt
Skn0tt deleted the fix-flakes/windows-latest-29987350696 branch July 23, 2026 10:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants