Skip to content

feat(xtask): auto-generate the edition registry docs from the Rust declarations#8878

Draft
joseph-isaacs wants to merge 1 commit into
developfrom
claude/auto-gen-editions-docs-r9otqn
Draft

feat(xtask): auto-generate the edition registry docs from the Rust declarations#8878
joseph-isaacs wants to merge 1 commit into
developfrom
claude/auto-gen-editions-docs-r9otqn

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Rationale for this change

Include editions in the vortex docs/

Follows #8871 (now merged), which introduced the edition declarations this generator reads.

What changes are included in this PR?

Add a manifest generator from rust (toml).

Uses the manifest to generate static docs.

@joseph-isaacs joseph-isaacs added the changelog/docs A docs change label Jul 21, 2026
@joseph-isaacs
joseph-isaacs force-pushed the claude/auto-gen-editions-docs-r9otqn branch from 286037c to b9741e0 Compare July 21, 2026 13:20
Base automatically changed from claude/editions-impl-fiicrg to develop July 21, 2026 13:47
@joseph-isaacs
joseph-isaacs force-pushed the claude/auto-gen-editions-docs-r9otqn branch from b9741e0 to ef8bb5f Compare July 21, 2026 13:51
@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done c4cbb90 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done ef8bb5f 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Verdict: Likely regression (medium confidence)
Attributed Vortex impact: +11.2%
Engines: DataFusion No clear signal (+8.3%, medium confidence) · DuckDB Likely regression (+14.2%, high confidence)
Vortex (geomean): 1.167x ❌
Parquet (geomean): 1.106x ❌
Shifts: Parquet (control) +10.6% · Median polish +18.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.240x ❌, 0↑ 2↓)
name PR c4cbb90 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 🚨 11348549 9541200 1.19
vortex_q01/datafusion:vortex-file-compressed 🚨 7719139 5974462 1.29
datafusion / parquet (1.144x ❌, 0↑ 2↓)
name PR c4cbb90 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 🚨 23935118 21214230 1.13
vortex_q01/datafusion:parquet 🚨 5498090 4736768 1.16
duckdb / vortex-file-compressed (1.222x ❌, 0↑ 2↓)
name PR c4cbb90 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 🚨 11857870 9885437 1.20
vortex_q01/duckdb:vortex-file-compressed 🚨 7499585 6028973 1.24
duckdb / parquet (1.070x ➖, 0↑ 0↓)
name PR c4cbb90 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 24996672 23250798 1.08
vortex_q01/duckdb:parquet 9978243 9373387 1.06

No file size changes detected.

…clarations

Generate the edition registry pages from the edition declarations in
`vortex/src/editions/`, in two stages:

1. A new `editions_manifest` example in the `vortex` crate validates the
   declarations and dumps them (with each edition's computed full encoding
   set) as a TOML manifest under `target/` — a build artifact, never
   committed.
2. A new `cargo xtask generate-editions-docs` subcommand runs the example,
   parses the manifest, and rewrites `docs/specs/editions/` wholesale:
   `index.md` with an editions table and a per-encoding index, plus one
   page per edition with its status, minimum Vortex reader, the encodings
   it adds, and its full encoding set.

The static pages link into the registry: `docs/specs/editions.md` from its
"Edition registry" section (previously a "Coming soon.." placeholder) and
the unknown-encoding troubleshooting flow, and the docs landing page from
a short static "Editions" section.

The generated-files CI job now also runs `generate-editions-docs` before
its "no files changed after regenerating" check, so a declaration change
without a regen fails CI, including added or removed registry pages.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XKRaAHmFNvb7JoKTJVW8Pw
Signed-off-by: Claude <noreply@anthropic.com>
@joseph-isaacs
joseph-isaacs force-pushed the claude/auto-gen-editions-docs-r9otqn branch from ef8bb5f to c4cbb90 Compare July 21, 2026 14:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/docs A docs change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants