Skip to content

Complete releaseWorkflow helper from skeleton to adoption-ready#737

Draft
schickling-assistant wants to merge 1 commit into
mainfrom
schickling-assistant/2026-06-03-release-workflow-helper-completion
Draft

Complete releaseWorkflow helper from skeleton to adoption-ready#737
schickling-assistant wants to merge 1 commit into
mainfrom
schickling-assistant/2026-06-03-release-workflow-helper-completion

Conversation

@schickling-assistant

Copy link
Copy Markdown
Collaborator

Problem

releaseWorkflow in genie/ci-workflow/release.ts landed in #732 with the right trigger / permission / job-id skeleton but with echo TODO ... ; exit 1 placeholders in every job body. livestorejs/livestore#1282 bumped LiveStore to that helper version and surveyed four gaps blocking migration:

  1. No releaseNotesPath input (LiveStore #1281 introduced release/release-notes.md).
  2. releaseChannels only carried manualGate; missing the prod-vs-dev deployTarget split LiveStore needs to gate postPublishSteps.
  3. The create-release-pr body is a consumer-opaque ~60-line bash heredoc.
  4. setupSteps accepted a step list but didn't compose well with the heavy livestoreSetupSteps pipeline.

Solution

Fill the job bodies from typed inputs and ship the helper as adoption-ready.

  • releaseNotesPath (default release/release-notes.md) feeds a new Create GitHub Release step that runs gh release create|edit --notes-file ${releaseNotesPath} on the publish job.
  • ReleaseChannel.deployTarget: 'prod' | 'dev' | 'none' drives a bash case that exports <WORKSPACE>_RELEASE_DEPLOY_TARGET and auto-gates postPublishSteps on != 'none' while preserving consumer-supplied step-level if: via (${existing}) && (${gate}).
  • create-release-pr is now templated from workspaceName, releaseBranchPrefix, prTitleTemplate, prBodyTemplate, and stagedFiles. Only ${workspaceName} / ${workspaceDisplayName} / ${version} substitution; consumers wanting more pass a fully-rendered string. Auto-merge is wired from the channel's manualGate.
  • setupSteps keeps replaces-default semantics; new extraSetupSteps appends a single extra step without redefining the entire CI prep. The create-release-pr job auto-skips the leading actions/checkout in setupSteps (since it already checked out main with an explicit ref).
  • Workspace-prefixed env vars: <PREFIX>_RELEASE_VERSION, <PREFIX>_NPM_TAG, <PREFIX>_RELEASE_DEPLOY_TARGET.
  • trustedPublishing: true skips the NPM_TOKEN fallback (default off; LiveStore keeps the fallback as a safety net).

Effect-utils itself doesn't consume the helper, so there's no internal migration in this PR. LiveStore will migrate its release.yml.genie.ts in a follow-up that bumps inputs.effect-utils.

Validation

  • devenv tasks run check:all --mode before --no-tui — clean.
  • New unit tests in packages/@overeng/genie/src/runtime/github-workflow/release-workflow.unit.test.ts (20 tests, passing) read the helper source via readFileSync and assert structural invariants (canonical job ids, per-channel auto-merge case branches, deploy-target case branches, --notes-file wiring, template substitution, trustedPublishing toggle, postPublishSteps gating). Behavioral coverage of the rendered release.yml lives in the consumer's own test surface where setupSteps / validateSteps / publishSteps are concrete.

Trade-offs and follow-ups

  • No template engine. Sticking with ${var} substitution. Consumers needing richer markup pass a fully-rendered string.
  • postPublishSteps gating uses env.* != 'none'. Consumers needing finer prod-only gating still write the explicit if:; the helper just ANDs the != 'none' gate on top.
  • Follow-up: LiveStore migrates release.yml.genie.ts to releaseWorkflow({...}) in a separate PR.

Refs livestorejs/livestore#1281, livestorejs/livestore#1282.

Replace the placeholder `echo TODO ... ; exit 1` job bodies in
`genie/ci-workflow/release.ts` with the real `create-release-pr`,
`validate-release-plan`, and `publish-release` step sequences, driven by
typed inputs so consumers like LiveStore can drop their consumer-owned
bash heredoc and reduce `release.yml.genie.ts` to a single
`releaseWorkflow({...})` call.

Fills the four gaps surfaced by livestorejs/livestore#1282:

- `releaseNotesPath` (default `release/release-notes.md`) is wired into a
  new `Create GitHub Release` step that runs `gh release create|edit
  --notes-file ${releaseNotesPath}` on the publish job.
- `ReleaseChannel` gains `deployTarget: 'prod' | 'dev' | 'none'`. The
  helper renders a bash `case` from the channel map to export
  `<WORKSPACE>_RELEASE_DEPLOY_TARGET` and auto-gates `postPublishSteps`
  on `!= 'none'` while preserving any consumer-supplied step-level `if:`.
- The `create-release-pr` bash is now templated from `workspaceName`,
  `releaseBranchPrefix`, `prTitleTemplate`, `prBodyTemplate`, and
  `stagedFiles`. Only `${workspaceName}` / `${workspaceDisplayName}` /
  `${version}` substitution is supported — consumers wanting more can
  pass a fully-rendered string.
- `setupSteps` keeps its replaces-default semantics and gains a new
  `extraSetupSteps` that appends instead, so repos can add a single
  extra step without redefining their entire CI prep.

Also adds a `Create GitHub Release` step on the publish job, exports
workspace-prefixed env vars (`<PREFIX>_RELEASE_VERSION`,
`<PREFIX>_NPM_TAG`, `<PREFIX>_RELEASE_DEPLOY_TARGET`), and wires
auto-merge via the channel's `manualGate` so prerelease PRs land on
green CI while stable PRs stay human-reviewed.

Covered by
`packages/@overeng/genie/src/runtime/github-workflow/release-workflow.unit.test.ts`,
which reads the helper source via `readFileSync` (matching the
`ci-workflow-helpers.unit.test.ts` pattern) so it stays inside the
`@overeng/genie` package rootDir while asserting cross-package
structural invariants.

The design doc at `context/workflows/release-workflow.md` is updated
with the new input shape, a worked LiveStore example, and migration
notes for consumers.

Refs livestorejs/livestore#1281, livestorejs/livestore#1282.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown

Storybook Previews

No storybooks were deployed.

github-actions Bot added a commit that referenced this pull request Jun 3, 2026
github-actions Bot added a commit that referenced this pull request Jun 3, 2026
@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown

CI Measurements

partial - advisory gate - readiness partial (17/26 enabled observations gateable) - commit 99fd140 - protocol devenv-perf-warm-median-v2

No regressions. Comparable movement is below the semantic impact threshold; neutral rows are collapsed below.

Measurement change vs baseline chart

SVG source

nix / closures / packages

What changed? Group Probe Baseline -> current Raw change Impact Confidence
unchanged nix / closures / packages Nix sources closure size 0 B -> 0 B +0 B / n/a n/a unknown, baseline n=19, current n=1
unchanged nix / closures / packages Nix sources closure size 0 B -> 0 B +0 B / n/a n/a unknown, baseline n=19, current n=1
unchanged nix / closures / packages Nix sources closure size 0 B -> 0 B +0 B / n/a n/a unknown, baseline n=19, current n=1
unchanged nix / closures / packages Node / pnpm closure size 0 B -> 0 B +0 B / n/a n/a unknown, baseline n=19, current n=1
unchanged nix / closures / packages Node / pnpm closure size 0 B -> 0 B +0 B / n/a n/a unknown, baseline n=19, current n=1
unchanged nix / closures / packages Node / pnpm closure size 0 B -> 0 B +0 B / n/a n/a unknown, baseline n=19, current n=1
unchanged nix / closures / packages Rust closure size 0 B -> 0 B +0 B / n/a n/a unknown, baseline n=19, current n=1
unchanged nix / closures / packages Rust closure size 0 B -> 0 B +0 B / n/a n/a unknown, baseline n=19, current n=1
unchanged nix / closures / packages Rust closure size 0 B -> 0 B +0 B / n/a n/a unknown, baseline n=19, current n=1
Unchanged / 0-impact measurements (17)

These rows had compatible baseline data, but their semantic impact rounded to 0.00x because the movement was below the configured budget, below the noise floor, or inside the robust noise band.

devenv / devenv cli

Group Probe Baseline -> current Raw change Impact Gate Evidence Why hidden
devenv / devenv cli devenv tasks list 0.1 s -> 0.097 s -0.003 s / -3% 0.00x yes paired n=9, 25-75% delta -0.002 s..0.002 s Too small to matter
devenv / devenv cli devenv processes --help 0.021 s -> 0.022 s +0.001 s / 4.8% 0.00x yes paired n=9, 25-75% delta 0 s..0.001 s Too small to matter

devenv / devenv shell

Group Probe Baseline -> current Raw change Impact Gate Evidence Why hidden
devenv / devenv shell Warm shell eval 2.471 s -> 2.384 s -0.087 s / -3.5% 0.00x yes paired n=5, 25-75% delta -0.143 s..-0.037 s Too small to matter

devenv / genie

Group Probe Baseline -> current Raw change Impact Gate Evidence Why hidden
devenv / genie Genie run task 1.496 s -> 1.437 s -0.059 s / -3.9% 0.00x yes paired n=5, 25-75% delta -0.043 s..0.035 s Too small to matter
devenv / genie Genie check direct 5.331 s -> 5.327 s -0.004 s / -0.1% 0.00x yes paired n=5, 25-75% delta -0.032 s..0.009 s Too small to matter

devenv / quality gates

Group Probe Baseline -> current Raw change Impact Gate Evidence Why hidden
devenv / quality gates Warm cached check:quick 3.074 s -> 3.029 s -0.045 s / -1.5% 0.00x yes paired n=5, 25-75% delta -3.975 s..-0.03 s Too small to matter
devenv / quality gates Forced check:quick 9.406 s -> 9.362 s -0.044 s / -0.5% 0.00x yes paired n=3, 25-75% delta -0.462 s..-0.119 s Too small to matter

devenv / workspace setup

Group Probe Baseline -> current Raw change Impact Gate Evidence Why hidden
devenv / workspace setup pnpm install task 0.86 s -> 0.835 s -0.025 s / -2.9% 0.00x yes paired n=5, 25-75% delta -0.06 s..-0.002 s Too small to matter

nix / closures / packages

Group Probe Baseline -> current Raw change Impact Gate Evidence Why hidden
nix / closures / packages Total closure size 508.3 MiB -> 535.4 MiB +27 MiB / 5.3% 0.00x yes within_budget, baseline n=19, current n=1 Slightly higher, ok
nix / closures / packages Total serialized NAR size 508.3 MiB -> 535.4 MiB +27 MiB / 5.3% 0.00x yes within_budget, baseline n=18, current n=1 Slightly higher, ok
nix / closures / packages Total closure size 142 MiB -> 144.4 MiB +2.4 MiB / 1.7% 0.00x yes noise_floor, baseline n=19, current n=1 Too small to matter
nix / closures / packages Total serialized NAR size 142 MiB -> 144.4 MiB +2.4 MiB / 1.7% 0.00x yes within_budget, baseline n=18, current n=1 Slightly higher, ok
nix / closures / packages Total closure size 153.9 MiB -> 156.3 MiB +2.4 MiB / 1.6% 0.00x yes noise_floor, baseline n=19, current n=1 Too small to matter
nix / closures / packages Total serialized NAR size 153.9 MiB -> 156.3 MiB +2.4 MiB / 1.6% 0.00x yes within_budget, baseline n=18, current n=1 Slightly higher, ok
nix / closures / packages Total closure path count 80 count -> 79 count -1 count / -1.2% 0.00x yes noise_floor, baseline n=19, current n=1 Too small to matter
nix / closures / packages Total closure path count 5 count -> 5 count +0 count / 0% 0.00x yes noise_floor, baseline n=19, current n=1 Too small to matter
nix / closures / packages Total closure path count 8 count -> 8 count +0 count / 0% 0.00x yes noise_floor, baseline n=19, current n=1 Too small to matter
Diagnostic / ungated measurements (7)

source / effect-utils

Group Probe Current Baseline Impact Gate Reason Evidence
source / effect-utils Genie CI workflow helpers lines 7649 lines 6765 lines diagnostic disabled Diagnostic only diagnostic, baseline n=20, current n=9
source / effect-utils Genie runtime lines 19568 lines 18874 lines diagnostic disabled Diagnostic only diagnostic, baseline n=20, current n=65
source / effect-utils Nix workspace tools lines 3626 lines 3237 lines diagnostic disabled Diagnostic only diagnostic, baseline n=20, current n=14
source / effect-utils Genie runtime files 65 count 62 count diagnostic disabled Diagnostic only diagnostic, baseline n=20, current n=65
source / effect-utils Genie CI workflow helpers files 9 count 7 count diagnostic disabled Diagnostic only diagnostic, baseline n=20, current n=9
source / effect-utils Nix workspace tools files 14 count 13 count diagnostic disabled Diagnostic only diagnostic, baseline n=20, current n=14

devenv / devenv shell

Group Probe Current Baseline Impact Gate Reason Evidence
devenv / devenv shell Shell eval with OTEL trace 15.895 s n/a n/a missing_baseline No baseline yet missing_baseline, baseline n=0, current n=1
All measurements
Status Gate Target Observation Dimensions Baseline Current Delta Ratio Impact
pass yes Genie package Total closure size bucket=total 508.3 MiB 535.4 MiB +27 MiB 5.3% 0.00x
pass yes Genie package Total serialized NAR size bucket=total
sizeKind=nar
508.3 MiB 535.4 MiB +27 MiB 5.3% 0.00x
pass yes Megarepo package Total closure size bucket=total 142 MiB 144.4 MiB +2.4 MiB 1.7% 0.00x
pass yes Megarepo package Total serialized NAR size bucket=total
sizeKind=nar
142 MiB 144.4 MiB +2.4 MiB 1.7% 0.00x
pass yes oxlint npm package Total closure size bucket=total 153.9 MiB 156.3 MiB +2.4 MiB 1.6% 0.00x
pass yes oxlint npm package Total serialized NAR size bucket=total
sizeKind=nar
153.9 MiB 156.3 MiB +2.4 MiB 1.6% 0.00x
pass disabled effect-utils repository Genie CI workflow helpers lines scope=genie_ci_workflow 6765 lines 7649 lines +884 lines 13.1% diagnostic
pass disabled effect-utils repository Genie runtime lines scope=genie_runtime 18874 lines 19568 lines +694 lines 3.7% diagnostic
pass disabled effect-utils repository Nix workspace tools lines scope=nix_workspace_tools 3237 lines 3626 lines +389 lines 12% diagnostic
pass disabled effect-utils repository Genie runtime files scope=genie_runtime 62 count 65 count +3 count 4.8% diagnostic
pass disabled effect-utils repository Genie CI workflow helpers files scope=genie_ci_workflow 7 count 9 count +2 count 28.6% diagnostic
pass disabled effect-utils repository Nix workspace tools files scope=nix_workspace_tools 13 count 14 count +1 count 7.7% diagnostic
pass yes Genie package Total closure path count bucket=total 80 count 79 count -1 count -1.2% 0.00x
pass yes Dev shell Warm shell eval aggregation=median
devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a
measuredSampleCount=5
measurementProtocol=devenv-perf-warm-median-v2
otelServiceName=devenv-perf-ci
pairedOrderProtocol=balanced-seeded-alternating-v1
pairedOrderSeed=26869206558-1-9857063705dc083331034d5f1db2094a45c8768e
pairedSampleCount=5
phase=warm
probe=shell_eval_warm
probeLabel=Warm shell eval
sampleCount=11
status=0
warmupCount=1
2.471 s 2.384 s -0.087 s -3.5% 0.00x
pass yes Dev shell Genie run task aggregation=median
devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a
measuredSampleCount=5
measurementProtocol=devenv-perf-warm-median-v2
otelServiceName=devenv-perf-ci
pairedOrderProtocol=balanced-seeded-alternating-v1
pairedOrderSeed=26869206558-1-9857063705dc083331034d5f1db2094a45c8768e
pairedSampleCount=5
phase=warm
probe=task_genie_run
probeLabel=Genie run task
sampleCount=11
status=0
warmupCount=1
1.496 s 1.437 s -0.059 s -3.9% 0.00x
pass yes Dev shell Warm cached check:quick aggregation=median
devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a
measuredSampleCount=5
measurementProtocol=devenv-perf-warm-median-v2
otelServiceName=devenv-perf-ci
pairedOrderProtocol=balanced-seeded-alternating-v1
pairedOrderSeed=26869206558-1-9857063705dc083331034d5f1db2094a45c8768e
pairedSampleCount=5
phase=warm
probe=task_check_quick_warm
probeLabel=Warm cached check:quick
sampleCount=11
status=0
taskCacheMode=warm
warmupCount=1
workload=cached-no-op
3.074 s 3.029 s -0.045 s -1.5% 0.00x
pass yes Dev shell Forced check:quick aggregation=median
devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a
measuredSampleCount=3
measurementProtocol=devenv-perf-warm-median-v2
otelServiceName=devenv-perf-ci
pairedOrderProtocol=balanced-seeded-alternating-v1
pairedOrderSeed=26869206558-1-9857063705dc083331034d5f1db2094a45c8768e
pairedSampleCount=3
phase=warm
probe=task_check_quick_forced
probeLabel=Forced check:quick
sampleCount=6
status=0
taskCacheMode=refresh
warmupCount=0
workload=forced-task-cache
9.406 s 9.362 s -0.044 s -0.5% 0.00x
pass yes Dev shell pnpm install task aggregation=median
devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a
measuredSampleCount=5
measurementProtocol=devenv-perf-warm-median-v2
otelServiceName=devenv-perf-ci
pairedOrderProtocol=balanced-seeded-alternating-v1
pairedOrderSeed=26869206558-1-9857063705dc083331034d5f1db2094a45c8768e
pairedSampleCount=5
phase=warm
probe=task_pnpm_install
probeLabel=pnpm install task
sampleCount=11
status=0
warmupCount=1
0.86 s 0.835 s -0.025 s -2.9% 0.00x
pass yes Dev shell Genie check direct aggregation=median
devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a
measuredSampleCount=5
measurementProtocol=devenv-perf-warm-median-v2
otelServiceName=devenv-perf-ci
pairedOrderProtocol=balanced-seeded-alternating-v1
pairedOrderSeed=26869206558-1-9857063705dc083331034d5f1db2094a45c8768e
pairedSampleCount=5
phase=warm
probe=genie_check_direct
probeLabel=Genie check direct
sampleCount=11
status=0
warmupCount=1
5.331 s 5.327 s -0.004 s -0.1% 0.00x
pass yes Dev shell devenv tasks list aggregation=median
devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a
measuredSampleCount=9
measurementProtocol=devenv-perf-warm-median-v2
otelServiceName=devenv-perf-ci
pairedOrderProtocol=balanced-seeded-alternating-v1
pairedOrderSeed=26869206558-1-9857063705dc083331034d5f1db2094a45c8768e
pairedSampleCount=9
phase=warm
probe=tasks_list
probeLabel=devenv tasks list
sampleCount=19
status=0
warmupCount=1
0.1 s 0.097 s -0.003 s -3% 0.00x
pass yes Dev shell devenv processes --help aggregation=median
devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a
measuredSampleCount=9
measurementProtocol=devenv-perf-warm-median-v2
otelServiceName=devenv-perf-ci
pairedOrderProtocol=balanced-seeded-alternating-v1
pairedOrderSeed=26869206558-1-9857063705dc083331034d5f1db2094a45c8768e
pairedSampleCount=9
phase=warm
probe=processes_help
probeLabel=devenv processes --help
sampleCount=19
status=0
warmupCount=1
0.021 s 0.022 s +0.001 s 4.8% 0.00x
unknown missing_baseline Genie package Nix sources closure size bucket=nix-sources 0 B 0 B +0 B n/a n/a
unknown missing_baseline Megarepo package Nix sources closure size bucket=nix-sources 0 B 0 B +0 B n/a n/a
unknown missing_baseline oxlint npm package Nix sources closure size bucket=nix-sources 0 B 0 B +0 B n/a n/a
unknown missing_baseline Genie package Node / pnpm closure size bucket=node 0 B 0 B +0 B n/a n/a
unknown missing_baseline Megarepo package Node / pnpm closure size bucket=node 0 B 0 B +0 B n/a n/a
unknown missing_baseline oxlint npm package Node / pnpm closure size bucket=node 0 B 0 B +0 B n/a n/a
unknown missing_baseline Genie package Rust closure size bucket=rust 0 B 0 B +0 B n/a n/a
unknown missing_baseline Megarepo package Rust closure size bucket=rust 0 B 0 B +0 B n/a n/a
unknown missing_baseline oxlint npm package Rust closure size bucket=rust 0 B 0 B +0 B n/a n/a
pass yes Megarepo package Total closure path count bucket=total 5 count 5 count +0 count 0% 0.00x
pass yes oxlint npm package Total closure path count bucket=total 8 count 8 count +0 count 0% 0.00x
missing_baseline missing_baseline Dev shell Shell eval with OTEL trace aggregation=median
devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a
measuredSampleCount=1
measurementProtocol=devenv-perf-warm-median-v2
otelServiceName=devenv-perf-ci
pairedOrderProtocol=balanced-seeded-alternating-v1
pairedOrderSeed=26869206558-1-9857063705dc083331034d5f1db2094a45c8768e
pairedSampleCount=1
phase=warm
probe=shell_eval_traced
probeLabel=Shell eval with OTEL trace
sampleCount=2
status=0
warmupCount=0
n/a 15.895 s n/a n/a n/a
Source-of-truth JSON
{
  "schemaVersion": 1,
  "title": "CI Measurements",
  "status": "partial",
  "gate": "advisory",
  "readiness": "partial (17/26 enabled observations gateable)",
  "commit": {
    "shortSha": "99fd140",
    "sha": "99fd140a63ad66b0389d9ab78109f6243c1836c9"
  },
  "run": {
    "id": "26869206558",
    "attempt": "1",
    "url": "https://github.com/overengineeringstudio/effect-utils/actions/runs/26869206558"
  },
  "baseline": null,
  "protocol": "devenv-perf-warm-median-v2",
  "chart": {
    "meaning": "semantic-impact",
    "zeroImpactMeaning": "no actionable PR impact after budgets, noise floor, and robust evidence checks",
    "svg": "https://raw.githubusercontent.com/overengineeringstudio/effect-utils/ci-measurement-assets/ci-measurements/pr-737/99fd140a63ad66b0389d9ab78109f6243c1836c9/run-26869206558-attempt-1/ci-measurements.svg",
    "lightPng": "https://raw.githubusercontent.com/overengineeringstudio/effect-utils/ci-measurement-assets/ci-measurements/pr-737/99fd140a63ad66b0389d9ab78109f6243c1836c9/run-26869206558-attempt-1/ci-measurements.png",
    "darkPng": "https://raw.githubusercontent.com/overengineeringstudio/effect-utils/ci-measurement-assets/ci-measurements/pr-737/99fd140a63ad66b0389d9ab78109f6243c1836c9/run-26869206558-attempt-1/ci-measurements-dark.png"
  },
  "measurements": [
    {
      "id": "nix.closure.nar_size",
      "label": "Total closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "total",
        "closure-size",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "within_budget",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 533018992,
      "current": 561373688,
      "delta": 28354696,
      "ratio": 1.0531964084311654,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": 17694316.16,
      "evidenceDeltaUpper": 39015075.84,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "nix.closure.serialized_nar_size",
      "label": "Total serialized NAR size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "total",
        "serialized-nar-size",
        "nix closure diagnostics"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "within_budget",
      "comparisonMode": "diagnostic",
      "unit": "bytes",
      "baseline": 533018992,
      "current": 561373688,
      "delta": 28354696,
      "ratio": 1.0531964084311654,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 18,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -24947203.200000003,
      "evidenceDeltaUpper": 81656595.2,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total",
        "sizeKind": "nar"
      }
    },
    {
      "id": "nix.closure.nar_size",
      "label": "Total closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "total",
        "closure-size",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 148845896,
      "current": 151364760,
      "delta": 2518864,
      "ratio": 1.0169226298318632,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -7966896,
      "evidenceDeltaUpper": 13004624,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "nix.closure.serialized_nar_size",
      "label": "Total serialized NAR size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "total",
        "serialized-nar-size",
        "nix closure diagnostics"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "within_budget",
      "comparisonMode": "diagnostic",
      "unit": "bytes",
      "baseline": 148845896,
      "current": 151364760,
      "delta": 2518864,
      "ratio": 1.0169226298318632,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 18,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -12365725.600000001,
      "evidenceDeltaUpper": 17403453.6,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total",
        "sizeKind": "nar"
      }
    },
    {
      "id": "nix.closure.nar_size",
      "label": "Total closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "total",
        "closure-size",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 161363816,
      "current": 163874192,
      "delta": 2510376,
      "ratio": 1.0155572423993742,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -7975384,
      "evidenceDeltaUpper": 12996136,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "nix.closure.serialized_nar_size",
      "label": "Total serialized NAR size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "total",
        "serialized-nar-size",
        "nix closure diagnostics"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "within_budget",
      "comparisonMode": "diagnostic",
      "unit": "bytes",
      "baseline": 161363816,
      "current": 163874192,
      "delta": 2510376,
      "ratio": 1.0155572423993742,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 18,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -13626005.600000001,
      "evidenceDeltaUpper": 18646757.6,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total",
        "sizeKind": "nar"
      }
    },
    {
      "id": "source.lines",
      "label": "Genie CI workflow helpers lines",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "genie",
        "ci-workflow",
        "source / ci"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "lines",
      "baseline": 6765,
      "current": 7649,
      "delta": 884,
      "ratio": 1.1306725794530672,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 20,
      "currentSamples": 9,
      "pairedSamples": 0,
      "evidenceDeltaLower": 207.5,
      "evidenceDeltaUpper": 1560.5,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "genie_ci_workflow"
      }
    },
    {
      "id": "source.lines",
      "label": "Genie runtime lines",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "packages",
        "genie",
        "source / genie"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "lines",
      "baseline": 18874,
      "current": 19568,
      "delta": 694,
      "ratio": 1.0367701600084773,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 20,
      "currentSamples": 65,
      "pairedSamples": 0,
      "evidenceDeltaLower": -1193.4,
      "evidenceDeltaUpper": 2581.4,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "genie_runtime"
      }
    },
    {
      "id": "source.lines",
      "label": "Nix workspace tools lines",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "nix",
        "workspace-tools",
        "source / nix"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "lines",
      "baseline": 3237,
      "current": 3626,
      "delta": 389,
      "ratio": 1.120172999691072,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 20,
      "currentSamples": 14,
      "pairedSamples": 0,
      "evidenceDeltaLower": 65.29999999999995,
      "evidenceDeltaUpper": 712.7,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "nix_workspace_tools"
      }
    },
    {
      "id": "source.files",
      "label": "Genie runtime files",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "packages",
        "genie",
        "source / genie"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 62,
      "current": 65,
      "delta": 3,
      "ratio": 1.0483870967741935,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 20,
      "currentSamples": 65,
      "pairedSamples": 0,
      "evidenceDeltaLower": -3.2,
      "evidenceDeltaUpper": 9.2,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "genie_runtime"
      }
    },
    {
      "id": "source.files",
      "label": "Genie CI workflow helpers files",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "genie",
        "ci-workflow",
        "source / ci"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 7,
      "current": 9,
      "delta": 2,
      "ratio": 1.2857142857142858,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 20,
      "currentSamples": 9,
      "pairedSamples": 0,
      "evidenceDeltaLower": 1,
      "evidenceDeltaUpper": 3,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "genie_ci_workflow"
      }
    },
    {
      "id": "source.files",
      "label": "Nix workspace tools files",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "nix",
        "workspace-tools",
        "source / nix"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 13,
      "current": 14,
      "delta": 1,
      "ratio": 1.0769230769230769,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 20,
      "currentSamples": 14,
      "pairedSamples": 0,
      "evidenceDeltaLower": -0.30000000000000004,
      "evidenceDeltaUpper": 2.3,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "nix_workspace_tools"
      }
    },
    {
      "id": "nix.closure.path_count",
      "label": "Total closure path count",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "total",
        "path-count",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 80,
      "current": 79,
      "delta": -1,
      "ratio": 0.9875,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -11,
      "evidenceDeltaUpper": 9,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "shell_eval_warm",
      "label": "Warm shell eval",
      "group": "devenv / devenv shell",
      "path": [
        "devenv",
        "devenv shell"
      ],
      "groupPath": [
        "devenv",
        "devenv shell"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 2.471,
      "current": 2.384,
      "delta": -0.08700000000000019,
      "ratio": 0.9647915823553217,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -0.143,
      "evidenceDeltaUpper": -0.037,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "shell_eval_warm",
        "probeLabel": "Warm shell eval",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "26869206558-1-9857063705dc083331034d5f1db2094a45c8768e",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "task_genie_run",
      "label": "Genie run task",
      "group": "devenv / genie",
      "path": [
        "devenv",
        "genie"
      ],
      "groupPath": [
        "devenv",
        "genie"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 1.496,
      "current": 1.437,
      "delta": -0.05899999999999994,
      "ratio": 0.9605614973262032,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -0.043,
      "evidenceDeltaUpper": 0.035,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "task_genie_run",
        "probeLabel": "Genie run task",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "26869206558-1-9857063705dc083331034d5f1db2094a45c8768e",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "task_check_quick_warm",
      "label": "Warm cached check:quick",
      "group": "devenv / quality gates",
      "path": [
        "devenv",
        "quality gates",
        "check:quick"
      ],
      "groupPath": [
        "devenv",
        "quality gates"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 3.074,
      "current": 3.029,
      "delta": -0.04499999999999993,
      "ratio": 0.9853610930383865,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -3.975,
      "evidenceDeltaUpper": -0.03,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "workload": "cached-no-op",
        "taskCacheMode": "warm",
        "probe": "task_check_quick_warm",
        "probeLabel": "Warm cached check:quick",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "26869206558-1-9857063705dc083331034d5f1db2094a45c8768e",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "task_check_quick_forced",
      "label": "Forced check:quick",
      "group": "devenv / quality gates",
      "path": [
        "devenv",
        "quality gates",
        "check:quick"
      ],
      "groupPath": [
        "devenv",
        "quality gates"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 9.406,
      "current": 9.362,
      "delta": -0.04400000000000048,
      "ratio": 0.9953221348075696,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 3,
      "currentSamples": 3,
      "pairedSamples": 3,
      "evidenceDeltaLower": -0.462,
      "evidenceDeltaUpper": -0.119,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "workload": "forced-task-cache",
        "taskCacheMode": "refresh",
        "probe": "task_check_quick_forced",
        "probeLabel": "Forced check:quick",
        "status": 0,
        "sampleCount": 6,
        "warmupCount": 0,
        "measuredSampleCount": 3,
        "pairedSampleCount": 3,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "26869206558-1-9857063705dc083331034d5f1db2094a45c8768e",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "task_pnpm_install",
      "label": "pnpm install task",
      "group": "devenv / workspace setup",
      "path": [
        "devenv",
        "workspace setup"
      ],
      "groupPath": [
        "devenv",
        "workspace setup"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 0.86,
      "current": 0.835,
      "delta": -0.025000000000000022,
      "ratio": 0.9709302325581395,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -0.06,
      "evidenceDeltaUpper": -0.002,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "task_pnpm_install",
        "probeLabel": "pnpm install task",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "26869206558-1-9857063705dc083331034d5f1db2094a45c8768e",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "genie_check_direct",
      "label": "Genie check direct",
      "group": "devenv / genie",
      "path": [
        "devenv",
        "genie"
      ],
      "groupPath": [
        "devenv",
        "genie"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 5.331,
      "current": 5.327,
      "delta": -0.004000000000000448,
      "ratio": 0.9992496717313823,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -0.032,
      "evidenceDeltaUpper": 0.009,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "genie_check_direct",
        "probeLabel": "Genie check direct",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "26869206558-1-9857063705dc083331034d5f1db2094a45c8768e",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "tasks_list",
      "label": "devenv tasks list",
      "group": "devenv / devenv cli",
      "path": [
        "devenv",
        "devenv cli"
      ],
      "groupPath": [
        "devenv",
        "devenv cli"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 0.1,
      "current": 0.097,
      "delta": -0.0030000000000000027,
      "ratio": 0.97,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 9,
      "currentSamples": 9,
      "pairedSamples": 9,
      "evidenceDeltaLower": -0.002,
      "evidenceDeltaUpper": 0.002,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "tasks_list",
        "probeLabel": "devenv tasks list",
        "status": 0,
        "sampleCount": 19,
        "warmupCount": 1,
        "measuredSampleCount": 9,
        "pairedSampleCount": 9,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "26869206558-1-9857063705dc083331034d5f1db2094a45c8768e",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "processes_help",
      "label": "devenv processes --help",
      "group": "devenv / devenv cli",
      "path": [
        "devenv",
        "devenv cli"
      ],
      "groupPath": [
        "devenv",
        "devenv cli"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 0.021,
      "current": 0.022,
      "delta": 0.0009999999999999974,
      "ratio": 1.0476190476190474,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 9,
      "currentSamples": 9,
      "pairedSamples": 9,
      "evidenceDeltaLower": 0,
      "evidenceDeltaUpper": 0.001,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "processes_help",
        "probeLabel": "devenv processes --help",
        "status": 0,
        "sampleCount": 19,
        "warmupCount": 1,
        "measuredSampleCount": 9,
        "pairedSampleCount": 9,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "26869206558-1-9857063705dc083331034d5f1db2094a45c8768e",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Nix sources closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "buckets",
        "nix-sources",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "nix-sources"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Nix sources closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "buckets",
        "nix-sources",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "nix-sources"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Nix sources closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "buckets",
        "nix-sources",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "nix-sources"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Node / pnpm closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "buckets",
        "node",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "node"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Node / pnpm closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "buckets",
        "node",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "node"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Node / pnpm closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "buckets",
        "node",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "node"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Rust closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "buckets",
        "rust",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "rust"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Rust closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "buckets",
        "rust",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "rust"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Rust closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "buckets",
        "rust",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "rust"
      }
    },
    {
      "id": "nix.closure.path_count",
      "label": "Total closure path count",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "total",
        "path-count",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 5,
      "current": 5,
      "delta": 0,
      "ratio": 1,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10,
      "evidenceDeltaUpper": 10,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "nix.closure.path_count",
      "label": "Total closure path count",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "total",
        "path-count",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 8,
      "current": 8,
      "delta": 0,
      "ratio": 1,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 19,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10,
      "evidenceDeltaUpper": 10,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "shell_eval_traced",
      "label": "Shell eval with OTEL trace",
      "group": "devenv / devenv shell",
      "path": [
        "devenv",
        "devenv shell"
      ],
      "groupPath": [
        "devenv",
        "devenv shell"
      ],
      "status": "missing_baseline",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "missing_baseline",
      "comparisonMode": "historical",
      "unit": "seconds",
      "baseline": null,
      "current": 15.895,
      "delta": null,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": null,
      "baselineSources": 0,
      "currentSamples": 1,
      "pairedSamples": null,
      "evidenceDeltaLower": null,
      "evidenceDeltaUpper": null,
      "pairedEvidenceQuantile": null,
      "dimensions": {
        "probe": "shell_eval_traced",
        "probeLabel": "Shell eval with OTEL trace",
        "status": 0,
        "sampleCount": 2,
        "warmupCount": 0,
        "measuredSampleCount": 1,
        "pairedSampleCount": 1,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "26869206558-1-9857063705dc083331034d5f1db2094a45c8768e",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    }
  ]
}

github-actions Bot added a commit that referenced this pull request Jun 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant