Tool: evaluate layer-wise numerical-error propagation#525

Open

jlamypoirier wants to merge 31 commits into

mainfrom

jlp_evaluate_precision

Commits on May 27, 2026

Add tool to evaluate layer-wise numerical-error propagation

jlamypoirier
and
claude
committed
Collapse to a single config; require a checkpoint

jlamypoirier
and
claude
committed
Expose `model:` alongside `pretrained:` in the tool config

jlamypoirier
and
claude
committed
Inherit PretrainedGPTModelConfig; use Config update mechanism

jlamypoirier
and
claude
committed
Expand HF metadata allowlist for newer transformers configs

jlamypoirier
and
claude
committed
Reshape console table for readability

jlamypoirier
and
claude
committed
Merge tensor+kind, fix decimal precision in console table

jlamypoirier
and
claude
committed
Switch back to fixed-decimal formatting in the table

jlamypoirier
and
claude
committed
Wipe per-variant experiment dir before each run

jlamypoirier
and
claude
committed

Commits on May 28, 2026

Commits on May 29, 2026

Chosen-logprob loss, per-variant grad-scale auto-calibration, fp16 variants

jlamypoirier
and
claude
committed