Skip to content

fix(reporter): expose setup/teardown projects to preprocessSuite#41731

Open
Skn0tt wants to merge 2 commits into
microsoft:mainfrom
Skn0tt:skn0tt-preprocess-suite-timing
Open

fix(reporter): expose setup/teardown projects to preprocessSuite#41731
Skn0tt wants to merge 2 commits into
microsoft:mainfrom
Skn0tt:skn0tt-preprocess-suite-timing

Conversation

@Skn0tt

@Skn0tt Skn0tt commented Jul 10, 2026

Copy link
Copy Markdown
Member

preprocessSuite() only exposed the top-level project suites, so a shard-balancing reporter couldn't measure the tests inside setup/teardown projects and weigh them.

This moves the dependency projects into the root suite before preprocessSuite runs, so reporters can see them. They're read-only - skip()/fixme()/fail()/exclude() throw on a dependency test or suite, since these always run in full. Identify them via testProject.dependencies and testProject.teardown.

Sharding is unchanged: still splits only the top-level projects, keeps every dependency test.

Closes #41708

@github-actions

This comment has been minimized.

Dropped the reverse() so setup/teardown projects keep the same order
in the root suite as before, avoiding a spurious UI mode filter reorder.
@github-actions

This comment has been minimized.

@Skn0tt Skn0tt marked this pull request as ready for review July 10, 2026 15:18
@Skn0tt Skn0tt requested a review from dgozman July 10, 2026 15:18
@github-actions

Copy link
Copy Markdown
Contributor

Test results for "MCP"

5 failed
❌ [chrome] › mcp/cli-navigation.spec.ts:56 › goto chrome:// page that closes the tab does not crash the response @mcp-windows-latest-chrome
❌ [chromium] › mcp/annotate.spec.ts:230 › should capture annotations via show --annotate @mcp-macos-latest-chromium
❌ [chromium] › mcp/annotate.spec.ts:447 › should switch screencast to -s session on show --annotate @mcp-windows-latest-chromium
❌ [firefox] › mcp/annotate.spec.ts:173 › user-initiated annotate downloads zip with feedback.md @mcp-macos-latest-firefox
❌ [webkit] › mcp/cli-killall.spec.ts:42 › kill-all kills filtered dashboard pid @mcp-ubuntu-latest-webkit

7755 passed, 1249 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

3 flaky ⚠️ [chromium-library] › library/video.spec.ts:717 › screencast › should work with video+trace `@chromium-ubuntu-22.04-arm-node20`
⚠️ [chromium-library] › library/video.spec.ts:645 › screencast › should capture full viewport `@realtime-time-library-chromium-linux`
⚠️ [chromium-library] › library/chromium/chromium.spec.ts:299 › should report intercepted service worker requests in HAR `@chromium-ubuntu-22.04-node24`

49521 passed, 1161 skipped


Merge workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feedback on the new preprocessSuite API

1 participant