Skip to content

Benchmark bool run-end decode over fixed corpora - #9020

Open
joseph-isaacs wants to merge 3 commits into
developfrom
claude/runend-bool-decode-benches
Open

Benchmark bool run-end decode over fixed corpora#9020
joseph-isaacs wants to merge 3 commits into
developfrom
claude/runend-bool-decode-benches

Draw corpus run lengths from a normal distribution

bd674b8
Select commit
Loading
Failed to load commit list.
CodSpeed HQ / CodSpeed Performance Analysis succeeded Jul 28, 2026 in 0s

Performance Gate Passed

✅ 1849 untouched benchmarks
🆕 18 new benchmarks
⏩ 46 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
🆕 Simulation decode_bool_corpus[128x16k_run16_even_nullable] N/A 6.2 ms N/A
🆕 Simulation decode_bool_corpus[128x16k_run16_even] N/A 4.2 ms N/A
🆕 Simulation decode_bool_corpus[128x16k_run16_skewed] N/A 3.1 ms N/A
🆕 Simulation decode_bool_corpus[128x16k_run4_even_nullable] N/A 19.4 ms N/A
🆕 Simulation decode_bool_corpus[128x16k_run4_even] N/A 12.8 ms N/A
🆕 Simulation decode_bool_corpus[128x16k_run4_skewed] N/A 10.6 ms N/A
🆕 Simulation decode_bool_corpus[128x16k_run64_even_nullable] N/A 2.2 ms N/A
🆕 Simulation decode_bool_corpus[128x16k_run64_even] N/A 1.4 ms N/A
🆕 Simulation decode_bool_corpus[128x16k_run64_skewed] N/A 1 ms N/A
🆕 Simulation decode_bool_corpus[4x100k_run16_even_nullable] N/A 1.2 ms N/A
🆕 Simulation decode_bool_corpus[4x100k_run16_even] N/A 786.8 µs N/A
🆕 Simulation decode_bool_corpus[4x100k_run16_skewed] N/A 582.8 µs N/A
🆕 Simulation decode_bool_corpus[4x100k_run4_even_nullable] N/A 3.7 ms N/A
🆕 Simulation decode_bool_corpus[4x100k_run4_even] N/A 2.4 ms N/A
🆕 Simulation decode_bool_corpus[4x100k_run4_skewed] N/A 2 ms N/A
🆕 Simulation decode_bool_corpus[4x100k_run64_even_nullable] N/A 401.1 µs N/A
🆕 Simulation decode_bool_corpus[4x100k_run64_even] N/A 252.9 µs N/A
🆕 Simulation decode_bool_corpus[4x100k_run64_skewed] N/A 196.2 µs N/A

Comparing claude/runend-bool-decode-benches (bd674b8) with develop (8c1dfc7)

Open in CodSpeed

Footnotes

  1. 46 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.