Repository navigation
Record Instinct final endpoint audit: 283 of 500 tasks - #69
Merged
Merged
Conversation
There was a problem hiding this comment.
1 issue found across 4 files
Prompt for AI agents (unresolved issues)
Check if these issues are valid — if so, understand the root cause of each and fix them. When an issue isn't valid or won't be fixed in this PR, reply in its thread with the reason and then resolve the thread. If appropriate, use sub-agents to investigate and fix each issue separately.
<file name="consumer_bench/website-examples.json">
<violation number="1" location="consumer_bench/website-examples.json:110">
P2: Keep incomplete proof unscored: the source maps this row to `unknown`, not `failure`, while `0/1` presents it as a failed endpoint. Use `null` or a distinct unverified score.</violation>
</file>
Reply with feedback, questions, or to request a fix.
View guided diff | Turn on auto-fix | Re-trigger cubic
| "agent": "Instinct", | ||
| "outcome": "Policy hold", | ||
| "score": null, | ||
| "score": "0/1", |
There was a problem hiding this comment.
P2: Keep incomplete proof unscored: the source maps this row to unknown, not failure, while 0/1 presents it as a failed endpoint. Use null or a distinct unverified score.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. When an issue isn't valid or won't be fixed in this PR, reply in its thread with the reason and then resolve the thread. At consumer_bench/website-examples.json, line 110:
<comment>Keep incomplete proof unscored: the source maps this row to `unknown`, not `failure`, while `0/1` presents it as a failed endpoint. Use `null` or a distinct unverified score.</comment>
<file context>
@@ -107,10 +107,10 @@
"agent": "Instinct",
"outcome": "Policy hold",
- "score": null,
+ "score": "0/1",
"captcha": "not reported",
- "date": "Oct 23, 2026 snapshot",
</file context>
Suggested change
| "score": "0/1", | |
| "score": null, |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Instinct supplies final records for its original 513-task run. Its endpoint audit reports 285/513 successes. The existing V10 exclusions yield 283/500 (56.6%).
The retained tasks include 116 failures, five holds, and 96 unverified results. Incomplete proof does not establish a website block. Preserve the earlier snapshot and ordinal 219's original terminal failure.
The update keeps all other provider results and the task selection unchanged. This provider audit does not certify full protocol compliance. Independent image review, original action histories, and runtime release receipts remain incomplete.
Validation: six scoring tests pass. All 513 IDs, ordinals, domains, endpoint labels, task texts, and task hashes match the frozen input. Nine ZIP files pass integrity checks. All 491 selected image hashes match the 596 received original images.