Skip to content

Link release evidence backlog entries to tracker issues#232

Merged
punk6529 merged 3 commits into
mainfrom
codex/release-evidence-issue-links
Jun 13, 2026
Merged

Link release evidence backlog entries to tracker issues#232
punk6529 merged 3 commits into
mainfrom
codex/release-evidence-issue-links

Conversation

@punk6529

@punk6529 punk6529 commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add release-artifacts/latest/release-evidence-issue-links.json, a deterministic no-secret map from every generated release-evidence backlog row to a concrete GitHub tracker issue.
  • Add scripts/check_release_evidence_issue_links.py plus focused tests for missing links, stale entry IDs, URL/number mismatches, duplicate issue numbers, and CLI failure reporting.
  • Wire the issue-link check into make check, shell/PowerShell wrappers, CI, release manifest/checksum artifacts, release docs, roadmap, and the autonomous run state.

Validation

  • python -m py_compile scripts/check_release_evidence_issue_links.py scripts/test_release_evidence_issue_links.py scripts/generate_release_manifest.py scripts/test_release_manifest.py scripts/check_release_readiness.py scripts/test_release_readiness.py scripts/generate_release_artifacts.py scripts/test_release_artifacts.py
  • python scripts/test_release_evidence_issue_links.py
  • python scripts/check_release_evidence_issue_links.py
  • python scripts/test_release_artifacts.py
  • python scripts/test_release_manifest.py
  • python scripts/test_release_readiness.py
  • python scripts/check_release_readiness.py
  • python scripts/test_changelog_check.py
  • python scripts/check_changelog.py
  • python scripts/generate_release_manifest.py --check
  • python scripts/generate_release_checksums.py --check
  • python scripts/generate_release_artifacts.py --check
  • bash -n scripts/check.sh
  • PowerShell parser check for scripts/check.ps1
  • rg -n "^#|^##|^###" ops/ROADMAP.md ops/AUTONOMOUS_RUN.md docs/release-readiness.md docs/public-beta-evidence.md release-artifacts/README.md docs/tooling.md
  • git diff --check (passes with the existing Windows LF-to-CRLF warning for scripts/check.ps1)
  • make check (passes with existing Solidity compiler and Foundry trace warning noise only)

Closes #214

Summary by CodeRabbit

  • New Features

    • Added a committed release-evidence issue-link mapping artifact and integrated local/CI validation to ensure backlog rows map to durable tracker issues.
  • Tests

    • Added a test suite covering issue-link schema, backlog-to-issue mapping, policy checks, encoding/error handling, and CLI exit behavior.
  • Documentation

    • Updated release, tooling, readiness, and public-beta evidence docs to document the artifact and validation steps.
  • Chores

    • Wired validation into CI, check targets, manifests, and checksum listings.

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review to trigger a review and subscribe this PR to future pushes, or @claude review once for a one-time review.

Tip: disable this comment in your organization's Code Review settings.

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

@coderabbitai

coderabbitai Bot commented Jun 13, 2026

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 334202d1-f968-4d8a-8146-10bd8a71eb29

📥 Commits

Reviewing files that changed from the base of the PR and between 7d959c5 and d1a0245.

📒 Files selected for processing (3)
  • ops/AUTONOMOUS_RUN.md
  • scripts/check_release_evidence_issue_links.py
  • scripts/test_release_evidence_issue_links.py
✅ Files skipped from review due to trivial changes (1)
  • ops/AUTONOMOUS_RUN.md
🚧 Files skipped from review as they are similar to previous changes (2)
  • scripts/test_release_evidence_issue_links.py
  • scripts/check_release_evidence_issue_links.py

📝 Walkthrough

Walkthrough

This PR adds deterministic mapping from release-evidence backlog entries to GitHub tracker issues via a committed no-secret JSON artifact. It includes a validator script, unit tests, manifest integration, build-pipeline wiring, and comprehensive documentation updates reflecting the new validation gate and release-readiness criteria.

Changes

Release Evidence Issue Links

Layer / File(s) Summary
Issue-links validator logic
scripts/check_release_evidence_issue_links.py
Validates release evidence issue-links JSON against backlog JSON by enforcing schema versions, source-backlog path/schema, policy flags, per-entry field consistency (phase, status, issue_number, labels), unique constraints, and secret-content scanning.
Validator tests and readiness enforcement
scripts/test_release_evidence_issue_links.py, scripts/check_release_readiness.py, scripts/test_release_readiness.py
Adds unit tests exercising validator pass/fail scenarios, updates release-readiness checker to require issue-links phrase/commands/artifact reference, and reformats readiness test-fixture summaries.
Committed artifact, manifest, and checksums
release-artifacts/latest/release-evidence-issue-links.json, scripts/generate_release_manifest.py, release-artifacts/latest/release-manifest.json, release-artifacts/latest/SHA256SUMS, release-artifacts/latest/release-checksums.json, scripts/test_release_artifacts.py, scripts/test_release_manifest.py
Introduces the issue-links artifact mapping backlog entries to GitHub issues; extends manifest generation to include the new artifact entry; updates manifest, SHA256SUMS, and release-checksums digests for the artifact and changed docs; updates test fixtures to validate manifest generation/structure.
Build pipeline integration
.github/workflows/ci.yml, scripts/check.sh, scripts/check.ps1, Makefile, scripts/generate_release_artifacts.py
Adds issue-links test/check steps to CI hygiene/public-beta phases and check scripts; creates new Makefile target and wires it into check/release-manifest chains; excludes issue-links file from generated-artifact comparison.
Documentation and operations state
CHANGELOG.md, release-artifacts/README.md, docs/public-beta-evidence.md, docs/release-readiness.md, docs/tooling.md, ops/AUTONOMOUS_RUN.md, ops/ROADMAP.md
Updates all release/readiness/tooling docs to reference issue-links artifact and validation commands; advances autonomous-run state to record PR #213 merge and start Queue Item 110; expands ROADMAP release-artifact baseline and Gate G exit criteria.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~25 minutes

Possibly related issues

Possibly related PRs

  • 6529-Collections/6529Stream#106 — Earlier work on the release manifest generator is extended here to include the new release_evidence_issue_links manifest entry.

"🐰 Release evidence now maps to tracker issues—
Backlog rows point to GitHub with no guesses!
Validation checks all the links stay true,
No secrets leaked, just durable views. ✨"

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title 'Link release evidence backlog entries to tracker issues' directly summarizes the main change: adding a mapping from release evidence backlog entries to GitHub tracker issues.
Linked Issues check ✅ Passed The PR comprehensively fulfills all coding requirements from issue #214: creates the issue-links mapping JSON, adds validation scripts with tests, integrates checks into make/CI/docs, and ensures every backlog entry has a linked issue.
Out of Scope Changes check ✅ Passed All changes directly support the linked issue scope: adding the issue-links artifact, validation scripts, test coverage, integration into build/CI systems, and documentation updates for release readiness.
Docstring Coverage ✅ Passed Docstring coverage is 82.86% which is sufficient. The required threshold is 80.00%.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch codex/release-evidence-issue-links

Comment @coderabbitai help to get the list of available commands and usage tips.

@coderabbitai

coderabbitai Bot commented Jun 13, 2026

Copy link
Copy Markdown
✅ Action performed

Review finished.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

@coderabbitai

coderabbitai Bot commented Jun 13, 2026

Copy link
Copy Markdown
✅ Action performed

Review finished.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@scripts/check_release_evidence_issue_links.py`:
- Around line 44-50: The load_json function currently only catches
FileNotFoundError and json.JSONDecodeError; extend its exception handling to
also catch unreadable/IO and decode errors so they surface as validation
failures: catch OSError (which covers PermissionError and other IO problems) and
UnicodeDecodeError raised by path.open()/read, and re-raise them as
ReleaseEvidenceIssueLinksError with a clear message referencing the path (e.g.,
"unable to read {path}: {exc}" or "invalid encoding in {path}: {exc}"). Keep the
existing FileNotFoundError and json.JSONDecodeError handlers unchanged and use
the same pattern of "raise ReleaseEvidenceIssueLinksError(...) from exc" so
callers of load_json receive consistent failure semantics.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 87090629-71a8-4638-a330-b817a15b830f

📥 Commits

Reviewing files that changed from the base of the PR and between fc8df90 and 7d959c5.

📒 Files selected for processing (23)
  • .github/workflows/ci.yml
  • CHANGELOG.md
  • Makefile
  • docs/public-beta-evidence.md
  • docs/release-readiness.md
  • docs/tooling.md
  • ops/AUTONOMOUS_RUN.md
  • ops/ROADMAP.md
  • release-artifacts/README.md
  • release-artifacts/latest/SHA256SUMS
  • release-artifacts/latest/release-checksums.json
  • release-artifacts/latest/release-evidence-issue-links.json
  • release-artifacts/latest/release-manifest.json
  • scripts/check.ps1
  • scripts/check.sh
  • scripts/check_release_evidence_issue_links.py
  • scripts/check_release_readiness.py
  • scripts/generate_release_artifacts.py
  • scripts/generate_release_manifest.py
  • scripts/test_release_artifacts.py
  • scripts/test_release_evidence_issue_links.py
  • scripts/test_release_manifest.py
  • scripts/test_release_readiness.py

Comment thread scripts/check_release_evidence_issue_links.py

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

@coderabbitai

coderabbitai Bot commented Jun 13, 2026

Copy link
Copy Markdown
✅ Action performed

Review finished.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

@punk6529 punk6529 merged commit acfb942 into main Jun 13, 2026
2 checks passed
punk6529 added a commit that referenced this pull request Jun 13, 2026
Record PR #232 merge evidence in the durable autonomous run state and refresh roadmap verification metadata.

Closes #233
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Link release evidence backlog entries to GitHub tracker issues

1 participant