feat(conformance): wire conformance_baseline claims for 4 personas#23
Merged
Conversation
Add [conformance_baseline] to the cryptographic, security, rust, and systems pack manifests. Each carries the sha256 of that persona's private conformance bundle plus an asserted score floor, turning frameshift verify, conformance_baseline, and the upgrade RegressionGate from dead letters into live gates for these packs. Bundles live with the private persona source; the public catalog stays manifest-only and ships only the tamper-evident hash+score claim.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds a
[conformance_baseline]block to four persona manifests:cryptographic,security,rust, andsystems. Each records the sha256 of that persona's conformance test bundle plus an asserted score floor.Why
Before this, no persona shipped a conformance baseline, so
frameshift verify, theconformance_baselinefield, and the upgradeRegressionGatewere all dead letters: fully built and tested as libraries, but never exercised by real data. These four baselines make them live for the covered packs.Design
The public catalog stays manifest-only. Conformance bundles (the actual test cases) live with the private persona source and are NOT shipped here. What ships is the tamper-evident claim: a hash that the regression gate compares against, so a version bump whose bundle silently changed is detectable, and a score the version asserts.
Bundle hashes
990c06b8...30ce61cf38a913...b10aceb78233b...d7e5a837149d...051aCaveat
score = 0.8is an asserted floor, not a measured value. The only conformanceRunnertoday isMockRunner; a real (model-backed) Runner is required before scores reflect measured behavior. Bundle hashes are already real and enforced by the regression gate regardless.