Skip to content

docs: clarify benchmark version authorities and onboarding - #74

Merged
lanyue-llk merged 7 commits into
mainfrom
codex/document-web-search-release
Oct 28, 2026
Merged

lanyue-llk merged 7 commits into
mainfrom
codex/document-web-search-release

Conversation

@lanyue-llk

@lanyue-llk lanyue-llk commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Change

Remove the stale Web Search preview labels and make current benchmark identities come from the existing code and run bindings rather than duplicated version numbers in documentation. This applies to Fetch, Search, WebMainBench, WCXB, Browser Use and trajectory replay: Git sources resolve to full commits, optional release tags identify those commits, and input/scorer hashes fix the evaluated bytes. Preserve immutable historical experiment and attribution records.

The guides link to the owning locks, definition bindings, installation scripts and runtime checks. Remove repeated baseline commits, runtime installation versions and scorer commit tables from the dependency guide; read those values from code instead. Remove the extra Search package-version terminology and fixed current-version links. Add a release-metadata check covering every Git dependency, including optional dependencies, without adding a new version registry or changing any dependency pin.

Both README editions list the Global .com Artifact Site first and China .cn second, with labels translated for each language. Apply the same order in the report introduction and related-project table.

Validation

  • Targeted README, release metadata, Fetch/Search dependency, WebArena source, WebMainBench scorer and WCXB contract checks: 55 passed; 1 release-tag-only check skipped.
  • Temporary negative controls confirmed the new check rejects mismatched locked commits for Fetch, Search and optional WebArena, and rejects an unresolved branch in place of a full commit.
  • Installed Fetch/Search metadata matches the declared commits and frozen catalogs.
  • git diff --check passed. Dependency pins, frozen input files and historical release records are unchanged.

@lexmount-ocr lexmount-ocr Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Review complete · e2ed841

No findings in this review.

@lanyue-llk lanyue-llk changed the title docs(search): link the published benchmark release docs: align Search release status and Artifact Site links Oct 28, 2026

@lexmount-ocr lexmount-ocr Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Review complete · a25aa75

No findings in this review.

Comment thread docs/benchmarks.md Outdated
@lanyue-llk lanyue-llk changed the title docs: align Search release status and Artifact Site links docs: clarify benchmark version authorities and onboarding Oct 28, 2026

@lexmount-ocr lexmount-ocr Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ℹ️ Review skipped · 81253ca

No reviewable content was selected for this run.

@lexmount-ocr lexmount-ocr Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ℹ️ Review skipped · b09fb11

No reviewable content was selected for this run.

Comment thread docs/README.zh-CN.md Outdated

@lexmount-ocr lexmount-ocr Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ℹ️ Review skipped · ba9f1c5

No reviewable content was selected for this run.

@lexmount-ocr lexmount-ocr Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ℹ️ Review skipped · 3ecda97

No reviewable content was selected for this run.

@lanyue-llk
lanyue-llk merged commit a87cc6a into main Oct 28, 2026
3 checks passed
@lanyue-llk
lanyue-llk deleted the codex/document-web-search-release branch October 28, 2026 04:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant