Repository navigation
feat: adapt offline Flare delivery evidence - #151
Conversation
Recompute client delivery TTFT from complete source-shaped Flare packets, preserve coalesced SSE groups and verify preparation/counter identities. Use peer checks before metric output and the existing validation command and evaluator to retain incomplete-evidence semantics. Agent-assisted-by: Codex (author) Signed-off-by: GUOGUO <xwdong1998@163.com>
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
|
Independent Dong1017 approval-agent review requested for head |
Give the real-command integration test a three-minute whole-run envelope. On Windows the one-minute envelope expired during source snapshots before the validation command could start; both metrics and source integrity passed. Keep the same output, comparison and INCONCLUSIVE assertions. Agent-assisted-by: Codex (author) Signed-off-by: GUOGUO <xwdong1998@163.com>
Dong1017
left a comment
There was a problem hiding this comment.
Independent reviewer: Codex subagent /root/issue147_review, separate from the Issue owner and implementer, acting under the explicitly invoked Issue-owner workflow.
LGTM aa19603
Reviewed head aa196034c3b7250b0ea99c2f4b889e074b9570c3 against base 65147a03e465dc838770474736a620e04d72337e. No blocking findings in the accepted Issue #147 P0 scope.
I checked all five changed files against the accepted criteria, pinned Flare bce032c014bae34502ba22d3304fa084d5b40afe performance/provenance code and native observation contract/producer, plus the existing executor/evaluator consumers. The adapter recomputes the selected TTFT from timestamped raw events, checks raw SSE and sidecar agreement, ignores null optional metadata, preserves coalesced delivery groups and separate clock domains, and gates export on complete groups, preparation capacity, actual reuse/counter agreement, resource conservation and matching pair identities. Invalid or incomparable inputs export no metric and retain the existing INCONCLUSIVE path.
I inspected the implementer's passing targeted Windows real-runner rerun (1 passed) and its artifacts: the valid synthetic pair is PASS with the expected fixture metric values; the incomplete peer is INCONCLUSIVE. The follow-up commit changes only the test's whole-run envelope from one to three minutes after the previous envelope expired before the validator launched; production code and all assertions are unchanged.
This is an offline contract review, with no service-quality, accelerator-performance or agent-efficacy qualification. Current-head CI and integration remain the Issue owner's separate merge gates.
|
Squash-merged under the owner's explicit batch instruction. Head aa19603; merge d99593f. Evidence verified before merge:
The current human merge instruction proceeds on scoped review, Ready tests and the actual required policy, not an assertion that every historical declarations job is green. Software/knowledge integration only; no Issue/campaign acceptance or model/hardware efficacy claim. |
Governing Issue and delivery slice
Refs #147
inferrsi-issueworkflow.Knowledge authorship declaration
Not applicable: no protected knowledge/policy path is changed. Material author: Codex (implementer). Model/effort settings are not asserted.
Changed artifacts and evidence
Flare summaries do not establish raw delivery semantics. The adapter recomputes median client
delivery_ttft_nsfor measuredttft-512requests from complete raw packets, preserving SSE token groups and native/client clock separation. Both measurement commands validate their peer before exporting metrics, so missing or incomparable evidence remainsINCONCLUSIVEin the existing evaluator.docs/flare-qualification.md,src/inferrsi/model/validators/flare.py; Flare contractbce032c014bae34502ba22d3304fa084d5b40afemeasure --packet --peerandvalidate-pair; unchanged RunSpec/runner/evaluatortests/fixtures/flare_packet.py,tests/test_flare_adapter.py; operation-guide entrysynthetic=trueChecks and dependencies
aa196034c3b7250b0ea99c2f4b889e074b9570c3; reviewed base65147a03e465dc838770474736a620e04d72337e.ruff check src tests toolsand diff whitespace checks passed. The unchanged adapter's 19 contract cases passed locally; the real-runner integration passed after allowing Windows source-snapshot overhead (1 passed in 150.37s).LGTM aa196034c3b7250b0ea99c2f4b889e074b9570c3.Remaining work and Issue closure
Real campaigns still need separately frozen task-quality and environment gates. Offline pair consistency does not establish service quality or a performance gain.