Skip to content

Produce explicit carried-finding rechecks in Direct and Strict reviews - #180

Merged
tzhouam merged 1 commit into
mainfrom
feat/carried-finding-rechecks
Sep 22, 2026
Merged

tzhouam merged 1 commit into
mainfrom
feat/carried-finding-rechecks

Conversation

@tzhouam

@tzhouam tzhouam commented Sep 22, 2026

Copy link
Copy Markdown
Collaborator

A later review omitting an old blocker does not prove it was fixed. Direct 1.1 and Strict 1.3 now accept carried findings and return explicit, head-bound fixed/still_affected/unverified answers for each ID. Direct binds the carried set to its issued context; Strict performs a read-only recheck and persists the answers through the public result contract.

Missing, duplicate, malformed, or wrong-head answers report incomplete rechecks, including runs that have not reached the review step. ReviewBot can use this contract to retain blockers until explicit resolution.

Validation: 131 targeted SDK, policy, review-step, and contract tests pass in the repository virtualenv; specification freshness passes; code review gate approved after adding pre-review failure and malformed-output regression tests.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 22, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-09-22T09:40:53.095084Z 5425931 PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@tzhouam
tzhouam merged commit 745f0a8 into main Sep 22, 2026
2 checks passed

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 54259315d6

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

extra_tools=review_repo_tools(_repo_path(ctx)),
)
rechecks, recheck_missing = checked_rechecks(
carried, recheck_output.get("finding_rechecks") if recheck_result.ok else [],

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Preserve valid rechecks when the agent escalates

When the recheck agent returns valid finding_rechecks with the permitted base status needs_review—a likely response when a finding is still_affected—run_agent_step sets recheck_result.ok to false, so this branch discards every answer by passing an empty list to checked_rechecks. The structured result then reports all carried IDs as missing instead of returning their explicit outcomes; validate the returned records independently of the agent's overall status, while recording any escalation separately.

Useful? React with 👍 / 👎.

duplicates.add(identity)
missing.append("duplicate finding recheck: " + identity)
seen.add(identity)
if (row.get("head_sha") != head_sha

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Compare recheck SHAs case-insensitively

For Direct requests that use uppercase hexadecimal SHAs, plan() and validate() accept and case-fold the expected/evidence heads, but a FindingRecheck using that same uppercase SHA is rejected here because its raw value is compared with the normalized lowercase head. Since commit SHA syntax elsewhere explicitly accepts either case, normalize row["head_sha"] before comparing so an otherwise valid completion is not reported as incomplete.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant