Add schema-first OTEL contracts by schickling-assistant · Pull Request #779 · overengineeringstudio/effect-utils

schickling-assistant · 2026-06-11T09:45:42Z

Problem

Otelite now provides a useful capture harness, but trace instrumentation and tests still need to hand-encode span attributes. That leaves room for drift between runtime span data, test expectations, and the Effect Schema contracts used elsewhere in the codebase.

Goal

Add schema-first OTEL contracts that make span attributes and span.label conventions explicit, reusable, and type checked, while keeping otelite as the capture and inspection backend for e2e trace assertions.

Decisions

Add schema-first OTEL attribute contracts under @overeng/utils/node/otel-attrs so runtime instrumentation can share the same contract shape as tests.
Compile an attribute field plan from Effect Schema AST once, and reject unsafe automatic encodings instead of guessing.
Require explicit policy for risky encodings such as arrays, nested structs, redacted values, and JSON/string coercion.
Add OtelSpan.define, OtelSpan.with, and OtelSpan.annotate helpers with an enforced span.label contract.
Extend otelite trace expectations with trace.expectSpan({ span, match }) and trace.expectAttributes({ attributes, match }), reusing the existing matcher stack.
Keep the Notion CLI fixed-output refresh as a separate mechanical commit so the full local gate can evaluate and complete.

Verification

Passed locally:

CI=1 pnpm --filter @overeng/utils exec vitest run src/node/otel-attrs.unit.test.ts
CI=1 pnpm --filter @overeng/utils-dev exec vitest run src/otelite/trace-expect.test.ts
pnpm --filter @overeng/utils-dev exec tsc -b --pretty false
pnpm --filter @overeng/utils exec tsc --noEmit --pretty false
pnpm exec oxfmt --check packages/@overeng/utils/src/node/otel-attrs.ts packages/@overeng/utils/src/node/otel-attrs.unit.test.ts packages/@overeng/utils-dev/src/otelite/trace-expect.ts packages/@overeng/utils-dev/src/otelite/trace-expect.test.ts packages/@overeng/utils-dev/src/otelite/mod.ts packages/@overeng/utils/src/node/mod.ts packages/@overeng/utils/src/node/otel.ts packages/@overeng/utils/package.json.genie.ts packages/@overeng/utils/package.json
pnpm --filter @overeng/utils exec oxlint src/node/otel-attrs.ts src/node/otel-attrs.unit.test.ts
pnpm exec bun packages/@overeng/genie/bin/genie.tsx --cwd packages/@overeng/utils --check --output ci-plain
devenv tasks run check:all

Full gate result: devenv tasks run check:all passed.

Complexity

This adds a small test/runtime contract layer on top of Effect Schema and the existing otelite expectation helpers. The extra abstraction is justified because it centralizes OTEL attribute encoding policy and makes tests assert the same contract that instrumentation uses.

Concerns

The schema compiler intentionally rejects ambiguous encodings, so some call sites may need explicit policy annotations instead of automatic conversion.
This does not try to model every OTLP concept. Raw otelite rows remain available for tests that need lower-level details.
The Notion CLI fixed-output refresh is unrelated to OTEL behavior, but was required for the full local gate to run.

Friction & bottlenecks

The first full gate could not evaluate because the Notion CLI pnpm deps fixed-output derivation hash was stale. That was refreshed mechanically in a separate commit before rerunning the full gate.

Follow-ups

Downstream repos can migrate remaining manual otelite span assertions to the new schema-first helpers.
If link/parentage assertions become common, add typed helpers for those instead of requiring raw row inspection.

References

Refs #777.

schickling · 2026-06-11T09:52:33Z

@codex

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b8f2ac50d8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

github-actions · 2026-06-11T10:12:17Z

Storybook Previews

No storybooks were deployed.

github-actions · 2026-06-11T10:25:28Z

CI Measurements

partial - advisory gate - readiness partial (17/26 enabled observations gateable) - commit 65740f5 - protocol devenv-perf-warm-median-v2

No regressions. Comparable movement is below the semantic impact threshold; neutral rows are collapsed below.

SVG source

nix / closures / packages

What changed?	Group	Probe	Baseline -> current	Raw change	Impact	Confidence
unchanged	nix / closures / packages	Nix sources closure size	0 B -> 0 B	+0 B / n/a	n/a	unknown, baseline n=23, current n=1
unchanged	nix / closures / packages	Nix sources closure size	0 B -> 0 B	+0 B / n/a	n/a	unknown, baseline n=23, current n=1
unchanged	nix / closures / packages	Nix sources closure size	0 B -> 0 B	+0 B / n/a	n/a	unknown, baseline n=23, current n=1
unchanged	nix / closures / packages	Node / pnpm closure size	0 B -> 0 B	+0 B / n/a	n/a	unknown, baseline n=23, current n=1
unchanged	nix / closures / packages	Node / pnpm closure size	0 B -> 0 B	+0 B / n/a	n/a	unknown, baseline n=23, current n=1
unchanged	nix / closures / packages	Node / pnpm closure size	0 B -> 0 B	+0 B / n/a	n/a	unknown, baseline n=23, current n=1
unchanged	nix / closures / packages	Rust closure size	0 B -> 0 B	+0 B / n/a	n/a	unknown, baseline n=23, current n=1
unchanged	nix / closures / packages	Rust closure size	0 B -> 0 B	+0 B / n/a	n/a	unknown, baseline n=23, current n=1
unchanged	nix / closures / packages	Rust closure size	0 B -> 0 B	+0 B / n/a	n/a	unknown, baseline n=23, current n=1

Unchanged / 0-impact measurements (17)

These rows had compatible baseline data, but their semantic impact rounded to 0.00x because the movement was below the configured budget, below the noise floor, or inside the robust noise band.

devenv / devenv cli

Group	Probe	Baseline -> current	Raw change	Impact	Gate	Evidence	Why hidden
devenv / devenv cli	devenv processes --help	0.018 s -> 0.019 s	+0.001 s / 5.6%	0.00x	yes	paired n=9, 25-75% delta 0 s..0.001 s	Too small to matter
devenv / devenv cli	devenv tasks list	0.041 s -> 0.04 s	-0.001 s / -2.4%	0.00x	yes	paired n=9, 25-75% delta -0.001 s..0 s	Too small to matter

devenv / devenv shell

Group	Probe	Baseline -> current	Raw change	Impact	Gate	Evidence	Why hidden
devenv / devenv shell	Warm shell eval	1.999 s -> 2.052 s	+0.053 s / 2.7%	0.00x	yes	paired n=5, 25-75% delta -0.048 s..0.094 s	Too small to matter

devenv / genie

Group	Probe	Baseline -> current	Raw change	Impact	Gate	Evidence	Why hidden
devenv / genie	Genie check direct	7.063 s -> 6.083 s	-0.98 s / -13.9%	0.00x	yes	paired n=5, 25-75% delta -0.337 s..-0.04 s	Unchanged
devenv / genie	Genie run task	1.298 s -> 1.273 s	-0.025 s / -1.9%	0.00x	yes	paired n=5, 25-75% delta -0.008 s..-0.005 s	Too small to matter

devenv / quality gates

Group	Probe	Baseline -> current	Raw change	Impact	Gate	Evidence	Why hidden
devenv / quality gates	Forced check:quick	9.805 s -> 10.04 s	+0.235 s / 2.4%	0.00x	yes	paired n=3, 25-75% delta -0.109 s..0.235 s	Too small to matter
devenv / quality gates	Warm cached check:quick	3.25 s -> 3.24 s	-0.01 s / -0.3%	0.00x	yes	paired n=5, 25-75% delta -0.076 s..0.086 s	Too small to matter

devenv / workspace setup

Group	Probe	Baseline -> current	Raw change	Impact	Gate	Evidence	Why hidden
devenv / workspace setup	pnpm install task	0.678 s -> 0.67 s	-0.008 s / -1.2%	0.00x	yes	paired n=5, 25-75% delta -0.019 s..-0.004 s	Too small to matter

nix / closures / packages

Group	Probe	Baseline -> current	Raw change	Impact	Gate	Evidence	Why hidden
nix / closures / packages	Total closure size	535.4 MiB -> 535.9 MiB	+535.7 KiB / 0.1%	0.00x	yes	noise_floor, baseline n=23, current n=1	Too small to matter
nix / closures / packages	Total serialized NAR size	535.4 MiB -> 535.9 MiB	+535.7 KiB / 0.1%	0.00x	yes	within_budget, baseline n=22, current n=1	Slightly higher, ok
nix / closures / packages	Total closure size	144.4 MiB -> 144.4 MiB	+60 KiB / 0%	0.00x	yes	noise_floor, baseline n=23, current n=1	Too small to matter
nix / closures / packages	Total serialized NAR size	144.4 MiB -> 144.4 MiB	+60 KiB / 0%	0.00x	yes	within_budget, baseline n=22, current n=1	Slightly higher, ok
nix / closures / packages	Total closure size	156.3 MiB -> 156.3 MiB	+9.8 KiB / 0%	0.00x	yes	noise_floor, baseline n=23, current n=1	Too small to matter
nix / closures / packages	Total serialized NAR size	156.3 MiB -> 156.3 MiB	+9.8 KiB / 0%	0.00x	yes	within_budget, baseline n=22, current n=1	Slightly higher, ok
nix / closures / packages	Total closure path count	79 count -> 79 count	+0 count / 0%	0.00x	yes	noise_floor, baseline n=23, current n=1	Too small to matter
nix / closures / packages	Total closure path count	5 count -> 5 count	+0 count / 0%	0.00x	yes	noise_floor, baseline n=23, current n=1	Too small to matter
nix / closures / packages	Total closure path count	8 count -> 8 count	+0 count / 0%	0.00x	yes	noise_floor, baseline n=23, current n=1	Too small to matter

Diagnostic / ungated measurements (7)

source / effect-utils

Group	Probe	Current	Baseline	Impact	Gate	Reason	Evidence
source / effect-utils	Genie runtime lines	20266 lines	19423 lines	diagnostic	disabled	Diagnostic only	diagnostic, baseline n=24, current n=67
source / effect-utils	Genie CI workflow helpers lines	7418 lines	7318 lines	diagnostic	disabled	Diagnostic only	diagnostic, baseline n=24, current n=9
source / effect-utils	Genie runtime files	67 count	64 count	diagnostic	disabled	Diagnostic only	diagnostic, baseline n=24, current n=67
source / effect-utils	Nix workspace tools lines	3632 lines	3631 lines	diagnostic	disabled	Diagnostic only	diagnostic, baseline n=24, current n=14
source / effect-utils	Genie CI workflow helpers files	9 count	9 count	diagnostic	disabled	Diagnostic only	diagnostic, baseline n=24, current n=9
source / effect-utils	Nix workspace tools files	14 count	14 count	diagnostic	disabled	Diagnostic only	diagnostic, baseline n=24, current n=14

devenv / devenv shell

Group	Probe	Current	Baseline	Impact	Gate	Reason	Evidence
devenv / devenv shell	Shell eval with OTEL trace	97.833 s	n/a	n/a	missing_baseline	No baseline yet	missing_baseline, baseline n=0, current n=1

All measurements

Status	Gate	Target	Observation	Dimensions	Baseline	Current	Delta	Ratio	Impact
pass	yes	Genie package	Total closure size	bucket=total	535.4 MiB	535.9 MiB	+535.7 KiB	0.1%	0.00x
pass	yes	Genie package	Total serialized NAR size	bucket=total sizeKind=nar	535.4 MiB	535.9 MiB	+535.7 KiB	0.1%	0.00x
pass	yes	Megarepo package	Total closure size	bucket=total	144.4 MiB	144.4 MiB	+60 KiB	0%	0.00x
pass	yes	Megarepo package	Total serialized NAR size	bucket=total sizeKind=nar	144.4 MiB	144.4 MiB	+60 KiB	0%	0.00x
pass	yes	oxlint npm package	Total closure size	bucket=total	156.3 MiB	156.3 MiB	+9.8 KiB	0%	0.00x
pass	yes	oxlint npm package	Total serialized NAR size	bucket=total sizeKind=nar	156.3 MiB	156.3 MiB	+9.8 KiB	0%	0.00x
pass	disabled	effect-utils repository	Genie runtime lines	scope=genie_runtime	19423 lines	20266 lines	+843 lines	4.3%	diagnostic
pass	disabled	effect-utils repository	Genie CI workflow helpers lines	scope=genie_ci_workflow	7318 lines	7418 lines	+100 lines	1.4%	diagnostic
pass	disabled	effect-utils repository	Genie runtime files	scope=genie_runtime	64 count	67 count	+3 count	4.7%	diagnostic
pass	disabled	effect-utils repository	Nix workspace tools lines	scope=nix_workspace_tools	3631 lines	3632 lines	+1 lines	0%	diagnostic
pass	yes	Dev shell	Genie check direct	aggregation=median devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a measuredSampleCount=5 measurementProtocol=devenv-perf-warm-median-v2 otelServiceName=devenv-perf-ci pairedOrderProtocol=balanced-seeded-alternating-v1 pairedOrderSeed=27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601 pairedSampleCount=5 phase=warm probe=genie_check_direct probeLabel=Genie check direct sampleCount=11 status=0 warmupCount=1	7.063 s	6.083 s	-0.98 s	-13.9%	0.00x
pass	yes	Dev shell	Forced check:quick	aggregation=median devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a measuredSampleCount=3 measurementProtocol=devenv-perf-warm-median-v2 otelServiceName=devenv-perf-ci pairedOrderProtocol=balanced-seeded-alternating-v1 pairedOrderSeed=27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601 pairedSampleCount=3 phase=warm probe=task_check_quick_forced probeLabel=Forced check:quick sampleCount=6 status=0 taskCacheMode=refresh warmupCount=0 workload=forced-task-cache	9.805 s	10.04 s	+0.235 s	2.4%	0.00x
pass	yes	Dev shell	Warm shell eval	aggregation=median devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a measuredSampleCount=5 measurementProtocol=devenv-perf-warm-median-v2 otelServiceName=devenv-perf-ci pairedOrderProtocol=balanced-seeded-alternating-v1 pairedOrderSeed=27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601 pairedSampleCount=5 phase=warm probe=shell_eval_warm probeLabel=Warm shell eval sampleCount=11 status=0 warmupCount=1	1.999 s	2.052 s	+0.053 s	2.7%	0.00x
pass	yes	Dev shell	Genie run task	aggregation=median devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a measuredSampleCount=5 measurementProtocol=devenv-perf-warm-median-v2 otelServiceName=devenv-perf-ci pairedOrderProtocol=balanced-seeded-alternating-v1 pairedOrderSeed=27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601 pairedSampleCount=5 phase=warm probe=task_genie_run probeLabel=Genie run task sampleCount=11 status=0 warmupCount=1	1.298 s	1.273 s	-0.025 s	-1.9%	0.00x
pass	yes	Dev shell	Warm cached check:quick	aggregation=median devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a measuredSampleCount=5 measurementProtocol=devenv-perf-warm-median-v2 otelServiceName=devenv-perf-ci pairedOrderProtocol=balanced-seeded-alternating-v1 pairedOrderSeed=27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601 pairedSampleCount=5 phase=warm probe=task_check_quick_warm probeLabel=Warm cached check:quick sampleCount=11 status=0 taskCacheMode=warm warmupCount=1 workload=cached-no-op	3.25 s	3.24 s	-0.01 s	-0.3%	0.00x
pass	yes	Dev shell	pnpm install task	aggregation=median devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a measuredSampleCount=5 measurementProtocol=devenv-perf-warm-median-v2 otelServiceName=devenv-perf-ci pairedOrderProtocol=balanced-seeded-alternating-v1 pairedOrderSeed=27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601 pairedSampleCount=5 phase=warm probe=task_pnpm_install probeLabel=pnpm install task sampleCount=11 status=0 warmupCount=1	0.678 s	0.67 s	-0.008 s	-1.2%	0.00x
pass	yes	Dev shell	devenv processes --help	aggregation=median devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a measuredSampleCount=9 measurementProtocol=devenv-perf-warm-median-v2 otelServiceName=devenv-perf-ci pairedOrderProtocol=balanced-seeded-alternating-v1 pairedOrderSeed=27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601 pairedSampleCount=9 phase=warm probe=processes_help probeLabel=devenv processes --help sampleCount=19 status=0 warmupCount=1	0.018 s	0.019 s	+0.001 s	5.6%	0.00x
pass	yes	Dev shell	devenv tasks list	aggregation=median devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a measuredSampleCount=9 measurementProtocol=devenv-perf-warm-median-v2 otelServiceName=devenv-perf-ci pairedOrderProtocol=balanced-seeded-alternating-v1 pairedOrderSeed=27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601 pairedSampleCount=9 phase=warm probe=tasks_list probeLabel=devenv tasks list sampleCount=19 status=0 warmupCount=1	0.041 s	0.04 s	-0.001 s	-2.4%	0.00x
pass	disabled	effect-utils repository	Genie CI workflow helpers files	scope=genie_ci_workflow	9 count	9 count	+0 count	0%	diagnostic
unknown	missing_baseline	Genie package	Nix sources closure size	bucket=nix-sources	0 B	0 B	+0 B	n/a	n/a
unknown	missing_baseline	Megarepo package	Nix sources closure size	bucket=nix-sources	0 B	0 B	+0 B	n/a	n/a
unknown	missing_baseline	oxlint npm package	Nix sources closure size	bucket=nix-sources	0 B	0 B	+0 B	n/a	n/a
pass	disabled	effect-utils repository	Nix workspace tools files	scope=nix_workspace_tools	14 count	14 count	+0 count	0%	diagnostic
unknown	missing_baseline	Genie package	Node / pnpm closure size	bucket=node	0 B	0 B	+0 B	n/a	n/a
unknown	missing_baseline	Megarepo package	Node / pnpm closure size	bucket=node	0 B	0 B	+0 B	n/a	n/a
unknown	missing_baseline	oxlint npm package	Node / pnpm closure size	bucket=node	0 B	0 B	+0 B	n/a	n/a
unknown	missing_baseline	Genie package	Rust closure size	bucket=rust	0 B	0 B	+0 B	n/a	n/a
unknown	missing_baseline	Megarepo package	Rust closure size	bucket=rust	0 B	0 B	+0 B	n/a	n/a
unknown	missing_baseline	oxlint npm package	Rust closure size	bucket=rust	0 B	0 B	+0 B	n/a	n/a
pass	yes	Genie package	Total closure path count	bucket=total	79 count	79 count	+0 count	0%	0.00x
pass	yes	Megarepo package	Total closure path count	bucket=total	5 count	5 count	+0 count	0%	0.00x
pass	yes	oxlint npm package	Total closure path count	bucket=total	8 count	8 count	+0 count	0%	0.00x
missing_baseline	missing_baseline	Dev shell	Shell eval with OTEL trace	aggregation=median devenvRev=2cf62a010000b70f15c78a72761fad7c9e6fb47a measuredSampleCount=1 measurementProtocol=devenv-perf-warm-median-v2 otelServiceName=devenv-perf-ci pairedOrderProtocol=balanced-seeded-alternating-v1 pairedOrderSeed=27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601 pairedSampleCount=1 phase=warm probe=shell_eval_traced probeLabel=Shell eval with OTEL trace sampleCount=2 status=0 warmupCount=0	n/a	97.833 s	n/a	n/a	n/a

Previous runs

Commit	Status	Gate	Top changes
f57edd7	partial	advisory	Too small to matter Genie package Total closure size +531.7 KiB / 0.1% Slightly higher, ok Genie package Total serialized NAR size +531.7 KiB / 0.1% Too small to matter Megarepo package Total closure size +56 KiB / 0%
57f7fef	partial	advisory	Too small to matter Dev shell Forced check:quick -0.722 s / -5.8% Too small to matter Genie package Total closure size +531.7 KiB / 0.1% Slightly higher, ok Genie package Total serialized NAR size +531.7 KiB / 0.1%
220e08f	partial	advisory	Slightly lower, ok Dev shell Genie check direct -0.26 s / -4.7% Too small to matter Genie package Total closure size +527.7 KiB / 0.1% Slightly higher, ok Genie package Total serialized NAR size +527.7 KiB / 0.1%
14981b2	partial	advisory	Uncertain wall-clock movement Dev shell Genie run task +0.398 s / 32.1% Too small to matter Genie package Total closure size +527.7 KiB / 0.1% Slightly higher, ok Genie package Total serialized NAR size +527.7 KiB / 0.1%
e88d8a5	partial	advisory	Too small to matter Genie package Total closure size +527.7 KiB / 0.1% Slightly higher, ok Genie package Total serialized NAR size +527.7 KiB / 0.1% Too small to matter Megarepo package Total closure size +48 KiB / 0%
019ed6d	partial	advisory	Slightly higher, ok Dev shell Genie check direct +0.199 s / 4% Too small to matter Genie package Total closure size +527.7 KiB / 0.1% Slightly higher, ok Genie package Total serialized NAR size +527.7 KiB / 0.1%
2a0ae46	partial	advisory	Too small to matter Genie package Total closure size +487.7 KiB / 0.1% Slightly higher, ok Genie package Total serialized NAR size +487.7 KiB / 0.1% Too small to matter oxlint npm package Total closure size +4.9 KiB / 0%
7dc6e8a	partial	advisory	Too small to matter Genie package Total closure size +487.7 KiB / 0.1% Slightly higher, ok Genie package Total serialized NAR size +487.7 KiB / 0.1% Too small to matter oxlint npm package Total closure size +4.9 KiB / 0%

Source-of-truth JSON

{
  "schemaVersion": 1,
  "title": "CI Measurements",
  "status": "partial",
  "gate": "advisory",
  "readiness": "partial (17/26 enabled observations gateable)",
  "commit": {
    "shortSha": "65740f5",
    "sha": "65740f567bc81d157bc85508fe52f616c2c37670"
  },
  "run": {
    "id": "27375390778",
    "attempt": "1",
    "url": "https://github.com/overengineeringstudio/effect-utils/actions/runs/27375390778"
  },
  "baseline": null,
  "protocol": "devenv-perf-warm-median-v2",
  "chart": {
    "meaning": "semantic-impact",
    "zeroImpactMeaning": "no actionable PR impact after budgets, noise floor, and robust evidence checks",
    "svg": "https://raw.githubusercontent.com/overengineeringstudio/effect-utils/ci-measurement-assets/ci-measurements/pr-779/65740f567bc81d157bc85508fe52f616c2c37670/run-27375390778-attempt-1/ci-measurements.svg",
    "lightPng": "https://raw.githubusercontent.com/overengineeringstudio/effect-utils/ci-measurement-assets/ci-measurements/pr-779/65740f567bc81d157bc85508fe52f616c2c37670/run-27375390778-attempt-1/ci-measurements.png",
    "darkPng": "https://raw.githubusercontent.com/overengineeringstudio/effect-utils/ci-measurement-assets/ci-measurements/pr-779/65740f567bc81d157bc85508fe52f616c2c37670/run-27375390778-attempt-1/ci-measurements-dark.png"
  },
  "measurements": [
    {
      "id": "nix.closure.nar_size",
      "label": "Total closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "total",
        "closure-size",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 561373688,
      "current": 561922280,
      "delta": 548592,
      "ratio": 1.0009772314088223,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10678881.76,
      "evidenceDeltaUpper": 11776065.76,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "nix.closure.serialized_nar_size",
      "label": "Total serialized NAR size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "total",
        "serialized-nar-size",
        "nix closure diagnostics"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "within_budget",
      "comparisonMode": "diagnostic",
      "unit": "bytes",
      "baseline": 561373688,
      "current": 561922280,
      "delta": 548592,
      "ratio": 1.0009772314088223,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 22,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -55588776.800000004,
      "evidenceDeltaUpper": 56685960.800000004,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total",
        "sizeKind": "nar"
      }
    },
    {
      "id": "nix.closure.nar_size",
      "label": "Total closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "total",
        "closure-size",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 151364760,
      "current": 151426200,
      "delta": 61440,
      "ratio": 1.000405906896691,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10424320,
      "evidenceDeltaUpper": 10547200,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "nix.closure.serialized_nar_size",
      "label": "Total serialized NAR size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "total",
        "serialized-nar-size",
        "nix closure diagnostics"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "within_budget",
      "comparisonMode": "diagnostic",
      "unit": "bytes",
      "baseline": 151364760,
      "current": 151426200,
      "delta": 61440,
      "ratio": 1.000405906896691,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 22,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -15075036,
      "evidenceDeltaUpper": 15197916,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total",
        "sizeKind": "nar"
      }
    },
    {
      "id": "nix.closure.nar_size",
      "label": "Total closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "total",
        "closure-size",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 163874192,
      "current": 163884208,
      "delta": 10016,
      "ratio": 1.0000611200572693,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10475744,
      "evidenceDeltaUpper": 10495776,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "nix.closure.serialized_nar_size",
      "label": "Total serialized NAR size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "total",
        "serialized-nar-size",
        "nix closure diagnostics"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "within_budget",
      "comparisonMode": "diagnostic",
      "unit": "bytes",
      "baseline": 163874192,
      "current": 163884208,
      "delta": 10016,
      "ratio": 1.0000611200572693,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 22,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -16377403.200000001,
      "evidenceDeltaUpper": 16397435.200000001,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total",
        "sizeKind": "nar"
      }
    },
    {
      "id": "source.lines",
      "label": "Genie runtime lines",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "packages",
        "genie",
        "source / genie"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "lines",
      "baseline": 19423,
      "current": 20266,
      "delta": 843,
      "ratio": 1.043402152087731,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 24,
      "currentSamples": 67,
      "pairedSamples": 0,
      "evidenceDeltaLower": -1099.3000000000002,
      "evidenceDeltaUpper": 2785.3,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "genie_runtime"
      }
    },
    {
      "id": "source.lines",
      "label": "Genie CI workflow helpers lines",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "genie",
        "ci-workflow",
        "source / ci"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "lines",
      "baseline": 7318,
      "current": 7418,
      "delta": 100,
      "ratio": 1.0136649357748018,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 24,
      "currentSamples": 9,
      "pairedSamples": 0,
      "evidenceDeltaLower": -631.8000000000001,
      "evidenceDeltaUpper": 831.8000000000001,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "genie_ci_workflow"
      }
    },
    {
      "id": "source.files",
      "label": "Genie runtime files",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "packages",
        "genie",
        "source / genie"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 64,
      "current": 67,
      "delta": 3,
      "ratio": 1.046875,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 24,
      "currentSamples": 67,
      "pairedSamples": 0,
      "evidenceDeltaLower": -3.4000000000000004,
      "evidenceDeltaUpper": 9.4,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "genie_runtime"
      }
    },
    {
      "id": "source.lines",
      "label": "Nix workspace tools lines",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "nix",
        "workspace-tools",
        "source / nix"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "regressed",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "lines",
      "baseline": 3631,
      "current": 3632,
      "delta": 1,
      "ratio": 1.0002754062241808,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 24,
      "currentSamples": 14,
      "pairedSamples": 0,
      "evidenceDeltaLower": -362.1,
      "evidenceDeltaUpper": 364.1,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "nix_workspace_tools"
      }
    },
    {
      "id": "genie_check_direct",
      "label": "Genie check direct",
      "group": "devenv / genie",
      "path": [
        "devenv",
        "genie"
      ],
      "groupPath": [
        "devenv",
        "genie"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "within_budget",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 7.063,
      "current": 6.083,
      "delta": -0.9799999999999995,
      "ratio": 0.8612487611496532,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -0.337,
      "evidenceDeltaUpper": -0.04,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "genie_check_direct",
        "probeLabel": "Genie check direct",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "task_check_quick_forced",
      "label": "Forced check:quick",
      "group": "devenv / quality gates",
      "path": [
        "devenv",
        "quality gates",
        "check:quick"
      ],
      "groupPath": [
        "devenv",
        "quality gates"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 9.805,
      "current": 10.04,
      "delta": 0.23499999999999943,
      "ratio": 1.023967363590005,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 3,
      "currentSamples": 3,
      "pairedSamples": 3,
      "evidenceDeltaLower": -0.109,
      "evidenceDeltaUpper": 0.235,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "workload": "forced-task-cache",
        "taskCacheMode": "refresh",
        "probe": "task_check_quick_forced",
        "probeLabel": "Forced check:quick",
        "status": 0,
        "sampleCount": 6,
        "warmupCount": 0,
        "measuredSampleCount": 3,
        "pairedSampleCount": 3,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "shell_eval_warm",
      "label": "Warm shell eval",
      "group": "devenv / devenv shell",
      "path": [
        "devenv",
        "devenv shell"
      ],
      "groupPath": [
        "devenv",
        "devenv shell"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 1.999,
      "current": 2.052,
      "delta": 0.052999999999999936,
      "ratio": 1.0265132566283142,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -0.048,
      "evidenceDeltaUpper": 0.094,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "shell_eval_warm",
        "probeLabel": "Warm shell eval",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "task_genie_run",
      "label": "Genie run task",
      "group": "devenv / genie",
      "path": [
        "devenv",
        "genie"
      ],
      "groupPath": [
        "devenv",
        "genie"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 1.298,
      "current": 1.273,
      "delta": -0.025000000000000133,
      "ratio": 0.9807395993836671,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -0.008,
      "evidenceDeltaUpper": -0.005,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "task_genie_run",
        "probeLabel": "Genie run task",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "task_check_quick_warm",
      "label": "Warm cached check:quick",
      "group": "devenv / quality gates",
      "path": [
        "devenv",
        "quality gates",
        "check:quick"
      ],
      "groupPath": [
        "devenv",
        "quality gates"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 3.25,
      "current": 3.24,
      "delta": -0.009999999999999787,
      "ratio": 0.996923076923077,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -0.076,
      "evidenceDeltaUpper": 0.086,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "workload": "cached-no-op",
        "taskCacheMode": "warm",
        "probe": "task_check_quick_warm",
        "probeLabel": "Warm cached check:quick",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "task_pnpm_install",
      "label": "pnpm install task",
      "group": "devenv / workspace setup",
      "path": [
        "devenv",
        "workspace setup"
      ],
      "groupPath": [
        "devenv",
        "workspace setup"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 0.678,
      "current": 0.67,
      "delta": -0.008000000000000007,
      "ratio": 0.9882005899705014,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 5,
      "currentSamples": 5,
      "pairedSamples": 5,
      "evidenceDeltaLower": -0.019,
      "evidenceDeltaUpper": -0.004,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "task_pnpm_install",
        "probeLabel": "pnpm install task",
        "status": 0,
        "sampleCount": 11,
        "warmupCount": 1,
        "measuredSampleCount": 5,
        "pairedSampleCount": 5,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "processes_help",
      "label": "devenv processes --help",
      "group": "devenv / devenv cli",
      "path": [
        "devenv",
        "devenv cli"
      ],
      "groupPath": [
        "devenv",
        "devenv cli"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 0.018,
      "current": 0.019,
      "delta": 0.0010000000000000009,
      "ratio": 1.0555555555555556,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 9,
      "currentSamples": 9,
      "pairedSamples": 9,
      "evidenceDeltaLower": 0,
      "evidenceDeltaUpper": 0.001,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "processes_help",
        "probeLabel": "devenv processes --help",
        "status": 0,
        "sampleCount": 19,
        "warmupCount": 1,
        "measuredSampleCount": 9,
        "pairedSampleCount": 9,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "tasks_list",
      "label": "devenv tasks list",
      "group": "devenv / devenv cli",
      "path": [
        "devenv",
        "devenv cli"
      ],
      "groupPath": [
        "devenv",
        "devenv cli"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "paired",
      "unit": "seconds",
      "baseline": 0.041,
      "current": 0.04,
      "delta": -0.0010000000000000009,
      "ratio": 0.975609756097561,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 9,
      "currentSamples": 9,
      "pairedSamples": 9,
      "evidenceDeltaLower": -0.001,
      "evidenceDeltaUpper": 0,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "probe": "tasks_list",
        "probeLabel": "devenv tasks list",
        "status": 0,
        "sampleCount": 19,
        "warmupCount": 1,
        "measuredSampleCount": 9,
        "pairedSampleCount": 9,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    },
    {
      "id": "source.files",
      "label": "Genie CI workflow helpers files",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "genie",
        "ci-workflow",
        "source / ci"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 9,
      "current": 9,
      "delta": 0,
      "ratio": 1,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 24,
      "currentSamples": 9,
      "pairedSamples": 0,
      "evidenceDeltaLower": -1,
      "evidenceDeltaUpper": 1,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "genie_ci_workflow"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Nix sources closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "buckets",
        "nix-sources",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "nix-sources"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Nix sources closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "buckets",
        "nix-sources",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "nix-sources"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Nix sources closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "buckets",
        "nix-sources",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "nix-sources"
      }
    },
    {
      "id": "source.files",
      "label": "Nix workspace tools files",
      "group": "source / effect-utils",
      "path": [
        "source",
        "effect-utils",
        "nix",
        "workspace-tools",
        "source / nix"
      ],
      "groupPath": [
        "source",
        "effect-utils"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": false,
      "gateReason": "disabled",
      "confidence": "diagnostic",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 14,
      "current": 14,
      "delta": 0,
      "ratio": 1,
      "semanticImpactScore": null,
      "semanticImpactKind": "diagnostic",
      "baselineSources": 24,
      "currentSamples": 14,
      "pairedSamples": 0,
      "evidenceDeltaLower": -1.4000000000000001,
      "evidenceDeltaUpper": 1.4000000000000001,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "scope": "nix_workspace_tools"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Node / pnpm closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "buckets",
        "node",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "node"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Node / pnpm closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "buckets",
        "node",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "node"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Node / pnpm closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "buckets",
        "node",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "node"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Rust closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "buckets",
        "rust",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "rust"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Rust closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "buckets",
        "rust",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "rust"
      }
    },
    {
      "id": "nix.closure.bucket.nar_size",
      "label": "Rust closure size",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "buckets",
        "rust",
        "nix closure buckets"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "unknown",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "unknown",
      "comparisonMode": "budget",
      "unit": "bytes",
      "baseline": 0,
      "current": 0,
      "delta": 0,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": "unknown",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10485760,
      "evidenceDeltaUpper": 10485760,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "rust"
      }
    },
    {
      "id": "nix.closure.path_count",
      "label": "Total closure path count",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "genie",
        "total",
        "path-count",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 79,
      "current": 79,
      "delta": 0,
      "ratio": 1,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10,
      "evidenceDeltaUpper": 10,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "nix.closure.path_count",
      "label": "Total closure path count",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "megarepo",
        "total",
        "path-count",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 5,
      "current": 5,
      "delta": 0,
      "ratio": 1,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10,
      "evidenceDeltaUpper": 10,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "nix.closure.path_count",
      "label": "Total closure path count",
      "group": "nix / closures / packages",
      "path": [
        "nix",
        "closures",
        "packages",
        "oxlint-npm",
        "total",
        "path-count",
        "nix closure"
      ],
      "groupPath": [
        "nix",
        "closures",
        "packages"
      ],
      "status": "pass",
      "direction": "unchanged",
      "gateable": true,
      "gateReason": "eligible",
      "confidence": "noise_floor",
      "comparisonMode": "budget",
      "unit": "count",
      "baseline": 8,
      "current": 8,
      "delta": 0,
      "ratio": 1,
      "semanticImpactScore": 0,
      "semanticImpactKind": "neutral",
      "baselineSources": 23,
      "currentSamples": 1,
      "pairedSamples": 0,
      "evidenceDeltaLower": -10,
      "evidenceDeltaUpper": 10,
      "pairedEvidenceQuantile": 0.25,
      "dimensions": {
        "bucket": "total"
      }
    },
    {
      "id": "shell_eval_traced",
      "label": "Shell eval with OTEL trace",
      "group": "devenv / devenv shell",
      "path": [
        "devenv",
        "devenv shell"
      ],
      "groupPath": [
        "devenv",
        "devenv shell"
      ],
      "status": "missing_baseline",
      "direction": "unknown",
      "gateable": false,
      "gateReason": "missing_baseline",
      "confidence": "missing_baseline",
      "comparisonMode": "historical",
      "unit": "seconds",
      "baseline": null,
      "current": 97.833,
      "delta": null,
      "ratio": null,
      "semanticImpactScore": null,
      "semanticImpactKind": null,
      "baselineSources": 0,
      "currentSamples": 1,
      "pairedSamples": null,
      "evidenceDeltaLower": null,
      "evidenceDeltaUpper": null,
      "pairedEvidenceQuantile": null,
      "dimensions": {
        "probe": "shell_eval_traced",
        "probeLabel": "Shell eval with OTEL trace",
        "status": 0,
        "sampleCount": 2,
        "warmupCount": 0,
        "measuredSampleCount": 1,
        "pairedSampleCount": 1,
        "pairedOrderProtocol": "balanced-seeded-alternating-v1",
        "pairedOrderSeed": "27375390778-1-549d282073b1b769121a32de58d5cef3d9a67601",
        "measurementProtocol": "devenv-perf-warm-median-v2",
        "aggregation": "median",
        "phase": "warm",
        "devenvRev": "2cf62a010000b70f15c78a72761fad7c9e6fb47a",
        "otelServiceName": "devenv-perf-ci"
      }
    }
  ]
}

schickling-assistant added 2 commits June 11, 2026 11:45

chore(notion-cli): refresh pnpm deps hash

dc722a0

feat(utils): add schema-first otel contracts

b8f2ac5

schickling-assistant marked this pull request as ready for review June 11, 2026 09:47

github-actions Bot requested a review from schickling June 11, 2026 09:47

chatgpt-codex-connector Bot reviewed Jun 11, 2026

View reviewed changes

Comment thread packages/@overeng/utils/src/node/otel-attrs.ts Outdated

schickling-assistant added 2 commits June 11, 2026 12:03

fix(utils): tighten otel attribute contracts

1292d30

chore(nix): refresh megarepo pnpm deps hash

f2edc83

schickling-assistant added 2 commits June 11, 2026 12:15

chore(nix): refresh tui-stories pnpm deps hash

7dc6e8a

chore(nix): refresh notion-md pnpm deps hash

2a0ae46

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart SVG for PR #779

f621a7e

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart PNG for PR #779

c3a1494

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update dark CI measurement chart PNG for PR #779

ce55cc2

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart SVG for PR #779

8f667a5

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart PNG for PR #779

41be336

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update dark CI measurement chart PNG for PR #779

fc53eea

schickling-assistant added 9 commits June 11, 2026 14:50

feat(otel): adopt schema-first span contracts

f6e2092

Adopt schema-backed notion-md OTEL spans

f92cc92

Adopt schema-first Playwright OTEL helpers

5a40004

feat(notion-datasource-sync): route otel through helpers

278b88e

fix(otel): route remaining sync spans through contracts

b95e3f3

fix(otel): keep pty name validation authoritative

16cf7ca

chore(nix): refresh tui stories deps hash

9929daa

chore(nix): refresh workflow report deps hash

76fc500

chore(nix): refresh notion md deps hash

019ed6d

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart SVG for PR #779

6f6153e

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart PNG for PR #779

a2701b3

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update dark CI measurement chart PNG for PR #779

b53b7de

schickling-assistant added 2 commits June 11, 2026 16:33

chore(nix): refresh notion md deps hash

14981b2

test(notion-md): relax cli subprocess timeout

220e08f

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart SVG for PR #779

c96ea63

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart PNG for PR #779

833eefe

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update dark CI measurement chart PNG for PR #779

8fb790a

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart SVG for PR #779

bca9a3f

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart PNG for PR #779

4339937

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update dark CI measurement chart PNG for PR #779

47d03ea

schickling-assistant added 6 commits June 11, 2026 19:32

refactor(otel): adopt schema-first contracts

76ebc3c

chore(nix): refresh otel adoption deps hashes

1cc2853

chore(nix): refresh remaining pnpm deps hashes

50c8013

refactor(restate): centralize observability contracts

09da497

docs(otel): remove raw span references

4c2d713

test(pty): wait for peek output in live test

57f7fef

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart SVG for PR #779

6f64f22

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart PNG for PR #779

9ce4f8f

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update dark CI measurement chart PNG for PR #779

f8a2cd4

schickling-assistant added 2 commits June 11, 2026 21:58

test(restate): cover schema-first baseline metrics

2e289e8

fix(otel): preserve typed sync contract errors

f57edd7

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart SVG for PR #779

298a2c0

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart PNG for PR #779

ebb3c79

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update dark CI measurement chart PNG for PR #779

721a744

schickling-assistant added 2 commits June 11, 2026 22:24

fix(otelite): support explicit binary path

1a34e49

feat(otel): add metric bridge facade

65740f5

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart SVG for PR #779

c596701

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update CI measurement chart PNG for PR #779

1c518c5

github-actions Bot added a commit that referenced this pull request Jun 11, 2026

Update dark CI measurement chart PNG for PR #779

57dd608

schickling-assistant mentioned this pull request Jun 11, 2026

notion-react scaled warm sync test times out on Linux CI #782

Open

schickling merged commit 3a397f7 into main Jun 12, 2026
58 of 60 checks passed

schickling deleted the schickling/2026-06-11-schema-otel-contracts branch June 12, 2026 07:29

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add schema-first OTEL contracts#779

Add schema-first OTEL contracts#779
schickling merged 36 commits into
mainfrom
schickling/2026-06-11-schema-otel-contracts

schickling-assistant commented Jun 11, 2026 •

edited

Loading

Uh oh!

schickling commented Jun 11, 2026

Uh oh!

chatgpt-codex-connector Bot left a comment

Uh oh!

Uh oh!

github-actions Bot commented Jun 11, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Jun 11, 2026 •

edited

Loading

devenv / devenv cli

devenv / devenv shell

devenv / genie

devenv / quality gates

devenv / workspace setup

nix / closures / packages

source / effect-utils

devenv / devenv shell

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

schickling-assistant commented Jun 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

schickling commented Jun 11, 2026

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

github-actions Bot commented Jun 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Storybook Previews

Uh oh!

github-actions Bot commented Jun 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

CI Measurements

nix / closures / packages

devenv / devenv cli

devenv / devenv shell

devenv / genie

devenv / quality gates

devenv / workspace setup

nix / closures / packages

source / effect-utils

devenv / devenv shell

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

schickling-assistant commented Jun 11, 2026 •

edited

Loading

github-actions Bot commented Jun 11, 2026 •

edited

Loading

github-actions Bot commented Jun 11, 2026 •

edited

Loading