Skip to content

test(core): include registry parity suites by default #1702

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
NathanFlurry wants to merge 1 commit into from
+12 −8
Closed

test(core): include registry parity suites by default #1702

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 12 additions & 4 deletions docs-internal/registry-parity-worklist.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -526,9 +526,10 @@ so a reader sees the whole board at a glance.
For each: replace `describe.skip` with `describeIf(binaryPresent)` **and** write
real e2e tests that prove Linux-parity behavior — not smoke tests.

### 11. Disabled suites — git, duckdb, codex
- **Broken:** tests exist but are skipped or excluded from the default run, so
coverage can disappear even when the binary is present.
### 11. Disabled suites — git, duckdb, codex — DONE
- **Fixed:** the Git quickstart, DuckDB package, and Codex full-turn suites are no
longer excluded from the default core Vitest file set, so coverage cannot
disappear when the package artifacts are present.
- **Status:**
- **git — DONE.** The core quickstart e2e now exercises real upstream Git in a
VM for local origin creation, commit, branch, clone, checkout, `log`, and a
Expand Down Expand Up @@ -562,7 +563,14 @@ real e2e tests that prove Linux-parity behavior — not smoke tests.
`2026-07-08T12-48-46-0700-item11-codex-required-build-fresh-cargo-home.log`,
`2026-07-08T12-50-38-0700-item11-codex-required-build-path-dedot-cfg.log`.
Rev: `ryqtvoqv`.
- **rev:** one per command, e.g. `test(duckdb): real analytical-SQL e2e; un-skip`
- **Final proof:** after removing the remaining core Vitest exclusions, the
explicit suites pass with real VM coverage: Git quickstart 1/1 in
`2026-07-08T14-35-00-0700-item11-status-git-quickstart-final.log`; DuckDB
package 4/4 in
`2026-07-08T14-36-00-0700-item11-status-duckdb-package-final.log`; Codex
full-turn 4/4 in
`2026-07-08T14-37-00-0700-item11-status-codex-fullturn-final.log`.
- **rev:** `test(core): include registry parity suites by default`

### 12. No tests at all — 9 software + 5 agents
- **Broken:** zero e2e coverage: `gawk, sed, tar, gzip, jq, yq, diffutils,
Expand Down
4 changes: 0 additions & 4 deletions packages/core/vitest.config.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,6 @@ const SLOW_E2E_FILES = [
"tests/native-sidecar-process.test.ts",
"tests/pi-vanilla-bash.test.ts",
"tests/opencode-session.test.ts",
"tests/git-quickstart.test.ts",
"tests/filesystem-move-delete.test.ts",
"tests/batch-file-ops.test.ts",
"tests/agentos-base-filesystem.test.ts",
Expand All @@ -30,7 +29,6 @@ const SLOW_E2E_FILES = [
"tests/readdir-recursive.test.ts",
"tests/cron-integration.test.ts",
"tests/pi-cli-headless.test.ts",
"tests/codex-fullturn.test.ts",
];

// Pre-existing failures NOT caused by this branch (they were red before CI ever
Expand All @@ -51,9 +49,7 @@ const KNOWN_FAILING_E2E_FILES = [
"tests/pi-acp-adapter.test.ts",
"tests/process-lifecycle.test.ts",
// Registry-artifact / shell-behavior failures (red in both CI and local):
// - duckdb-package: imports secure-exec software/duckdb/dist (unbuilt WASM in CI).
// - shell-flat-api: openShell/writeShell/onShellData yields empty output.
"tests/duckdb-package.test.ts",
"tests/shell-flat-api.test.ts",
];

Expand Down