Skip to content

Improve limit pushdown with filter#7129

Closed
AdamGS wants to merge 1 commit intodevelopfrom
adamg/limit-pushdown-codex
Closed

Improve limit pushdown with filter#7129
AdamGS wants to merge 1 commit intodevelopfrom
adamg/limit-pushdown-codex

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Mar 23, 2026

trying to improve limit

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added changelog/performance A performance improvement action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Mar 23, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 23, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 23, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 13ccccf 3 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 13ccccf 2 Explore Profiling Data
🟢 Done 13ccccf 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress 13ccccf 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.037x ➖


datafusion / vortex-file-compressed (1.037x ➖, 0↑ 2↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 116829016 115747042 1.01
polarsignals_q01/datafusion:vortex-file-compressed 364411159 354042299 1.03
polarsignals_q02/datafusion:vortex-file-compressed 22604159 22519108 1.00
polarsignals_q03/datafusion:vortex-file-compressed 371713366 357593001 1.04
polarsignals_q04/datafusion:vortex-file-compressed 13021474 11849891 1.10
polarsignals_q05/datafusion:vortex-file-compressed 🚨 18146737 16190058 1.12
polarsignals_q06/datafusion:vortex-file-compressed 20570188 20625334 1.00
polarsignals_q07/datafusion:vortex-file-compressed 13503184 13094842 1.03
polarsignals_q08/datafusion:vortex-file-compressed 🚨 479957663 431111069 1.11
polarsignals_q09/datafusion:vortex-file-compressed 11300422 11989524 0.94

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.4%
Vortex (geomean): 1.056x ➖
Parquet (geomean): 1.012x ➖
Shifts: Parquet (control) +1.2% · Median polish +5.4%


datafusion / vortex-file-compressed (1.049x ➖, 0↑ 2↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 54720960 51785952 1.06
tpch_q02/datafusion:vortex-file-compressed 52580150 52580956 1.00
tpch_q03/datafusion:vortex-file-compressed 28636718 27375854 1.05
tpch_q04/datafusion:vortex-file-compressed 19591894 18784012 1.04
tpch_q05/datafusion:vortex-file-compressed 78882507 74764466 1.06
tpch_q06/datafusion:vortex-file-compressed 10937866 10078616 1.09
tpch_q07/datafusion:vortex-file-compressed 96164297 89189817 1.08
tpch_q08/datafusion:vortex-file-compressed 68064517 63831258 1.07
tpch_q09/datafusion:vortex-file-compressed 88472687 86438540 1.02
tpch_q10/datafusion:vortex-file-compressed 77781229 75057769 1.04
tpch_q11/datafusion:vortex-file-compressed 20028419 20031931 1.00
tpch_q12/datafusion:vortex-file-compressed 34811409 34318980 1.01
tpch_q13/datafusion:vortex-file-compressed 28053844 26899781 1.04
tpch_q14/datafusion:vortex-file-compressed 29641733 27444271 1.08
tpch_q15/datafusion:vortex-file-compressed 27364171 25650970 1.07
tpch_q16/datafusion:vortex-file-compressed 35004365 35129996 1.00
tpch_q17/datafusion:vortex-file-compressed 75492406 78130480 0.97
tpch_q18/datafusion:vortex-file-compressed 104988195 98697225 1.06
tpch_q19/datafusion:vortex-file-compressed 🚨 39380372 34391574 1.15
tpch_q20/datafusion:vortex-file-compressed 53190051 50809234 1.05
tpch_q21/datafusion:vortex-file-compressed 97332000 91645665 1.06
tpch_q22/datafusion:vortex-file-compressed 🚨 16177681 14470014 1.12
datafusion / vortex-compact (1.065x ➖, 0↑ 3↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 63967608 61153769 1.05
tpch_q02/datafusion:vortex-compact 57294713 54220744 1.06
tpch_q03/datafusion:vortex-compact 33655040 32881016 1.02
tpch_q04/datafusion:vortex-compact 🚨 25673710 23175733 1.11
tpch_q05/datafusion:vortex-compact 84936857 81475382 1.04
tpch_q06/datafusion:vortex-compact 14566627 13636207 1.07
tpch_q07/datafusion:vortex-compact 101253802 96693935 1.05
tpch_q08/datafusion:vortex-compact 74879363 73254485 1.02
tpch_q09/datafusion:vortex-compact 97795583 92396348 1.06
tpch_q10/datafusion:vortex-compact 82793081 77767022 1.06
tpch_q11/datafusion:vortex-compact 21543937 20097900 1.07
tpch_q12/datafusion:vortex-compact 45916882 42414015 1.08
tpch_q13/datafusion:vortex-compact 🚨 39931795 36223404 1.10
tpch_q14/datafusion:vortex-compact 35084586 32581204 1.08
tpch_q15/datafusion:vortex-compact 34665842 33850207 1.02
tpch_q16/datafusion:vortex-compact 42129743 38422420 1.10
tpch_q17/datafusion:vortex-compact 85516774 77782458 1.10
tpch_q18/datafusion:vortex-compact 113565275 107831468 1.05
tpch_q19/datafusion:vortex-compact 🚨 50771972 43969192 1.15
tpch_q20/datafusion:vortex-compact 56269289 56092303 1.00
tpch_q21/datafusion:vortex-compact 110836313 104049964 1.07
tpch_q22/datafusion:vortex-compact 16642251 15529307 1.07
datafusion / parquet (1.020x ➖, 3↑ 2↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 111766032 146174312 0.76
tpch_q02/datafusion:parquet 86386547 81633154 1.06
tpch_q03/datafusion:parquet 91324231 84418306 1.08
tpch_q04/datafusion:parquet 56571097 53996836 1.05
tpch_q05/datafusion:parquet 168032311 165062008 1.02
tpch_q06/datafusion:parquet 🚨 43446622 35830531 1.21
tpch_q07/datafusion:parquet 182051283 176470236 1.03
tpch_q08/datafusion:parquet 169699634 163367286 1.04
tpch_q09/datafusion:parquet 208888521 208734706 1.00
tpch_q10/datafusion:parquet 196513100 187200531 1.05
tpch_q11/datafusion:parquet 63205754 59750941 1.06
tpch_q12/datafusion:parquet 🚀 109383593 125383984 0.87
tpch_q13/datafusion:parquet 216997521 198184277 1.09
tpch_q14/datafusion:parquet 80576039 82581958 0.98
tpch_q15/datafusion:parquet 🚨 78445532 69741699 1.12
tpch_q16/datafusion:parquet 57741473 54965588 1.05
tpch_q17/datafusion:parquet 190804495 177389303 1.08
tpch_q18/datafusion:parquet 238540168 229214274 1.04
tpch_q19/datafusion:parquet 🚀 84198215 103216247 0.82
tpch_q20/datafusion:parquet 122591862 120839680 1.01
tpch_q21/datafusion:parquet 192710551 178965464 1.08
tpch_q22/datafusion:parquet 42225733 40275181 1.05
datafusion / arrow (1.079x ➖, 0↑ 5↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 67771087 64998313 1.04
tpch_q02/datafusion:arrow 23434391 22505855 1.04
tpch_q03/datafusion:arrow 39523489 36309786 1.09
tpch_q04/datafusion:arrow 32309259 30264999 1.07
tpch_q05/datafusion:arrow 98298079 92812934 1.06
tpch_q06/datafusion:arrow 23363874 21833309 1.07
tpch_q07/datafusion:arrow 🚨 197947532 171449417 1.15
tpch_q08/datafusion:arrow 52742632 49813941 1.06
tpch_q09/datafusion:arrow 84297092 78002073 1.08
tpch_q10/datafusion:arrow 63795382 59424407 1.07
tpch_q11/datafusion:arrow 🚨 13357235 12036058 1.11
tpch_q12/datafusion:arrow 62695744 60087672 1.04
tpch_q13/datafusion:arrow 53044779 50297836 1.05
tpch_q14/datafusion:arrow 28419619 26025161 1.09
tpch_q15/datafusion:arrow 54935852 50554483 1.09
tpch_q16/datafusion:arrow 25330129 23690581 1.07
tpch_q17/datafusion:arrow 86360676 81623241 1.06
tpch_q18/datafusion:arrow 176291575 169145190 1.04
tpch_q19/datafusion:arrow 🚨 47896919 41731076 1.15
tpch_q20/datafusion:arrow 43725085 41178095 1.06
tpch_q21/datafusion:arrow 🚨 273343458 240122942 1.14
tpch_q22/datafusion:arrow 🚨 23836718 21394286 1.11
duckdb / vortex-file-compressed (1.067x ➖, 0↑ 4↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 34027691 33014093 1.03
tpch_q02/duckdb:vortex-file-compressed 29160579 27587282 1.06
tpch_q03/duckdb:vortex-file-compressed 31021190 29151171 1.06
tpch_q04/duckdb:vortex-file-compressed 🚨 31572124 28037880 1.13
tpch_q05/duckdb:vortex-file-compressed 35565191 32503315 1.09
tpch_q06/duckdb:vortex-file-compressed 11193822 10749348 1.04
tpch_q07/duckdb:vortex-file-compressed 39508277 35946379 1.10
tpch_q08/duckdb:vortex-file-compressed 43087202 39559900 1.09
tpch_q09/duckdb:vortex-file-compressed 85587690 79166313 1.08
tpch_q10/duckdb:vortex-file-compressed 38806612 38850688 1.00
tpch_q11/duckdb:vortex-file-compressed 16559638 16953127 0.98
tpch_q12/duckdb:vortex-file-compressed 26684259 24850731 1.07
tpch_q13/duckdb:vortex-file-compressed 39354090 37608477 1.05
tpch_q14/duckdb:vortex-file-compressed 🚨 24685190 21474105 1.15
tpch_q15/duckdb:vortex-file-compressed 16636528 16112591 1.03
tpch_q16/duckdb:vortex-file-compressed 30980171 30178925 1.03
tpch_q17/duckdb:vortex-file-compressed 26281662 24225597 1.08
tpch_q18/duckdb:vortex-file-compressed 🚨 52620495 47231120 1.11
tpch_q19/duckdb:vortex-file-compressed 34269922 32059119 1.07
tpch_q20/duckdb:vortex-file-compressed 36597823 34061002 1.07
tpch_q21/duckdb:vortex-file-compressed 🚨 110684707 100406805 1.10
tpch_q22/duckdb:vortex-file-compressed 19183756 17999678 1.07
duckdb / vortex-compact (1.042x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40612909 39413125 1.03
tpch_q02/duckdb:vortex-compact 38522687 37930363 1.02
tpch_q03/duckdb:vortex-compact 33757278 32022048 1.05
tpch_q04/duckdb:vortex-compact 36448406 34430856 1.06
tpch_q05/duckdb:vortex-compact 39971335 38896080 1.03
tpch_q06/duckdb:vortex-compact 14663560 14794065 0.99
tpch_q07/duckdb:vortex-compact 43920187 42203364 1.04
tpch_q08/duckdb:vortex-compact 47937149 45540181 1.05
tpch_q09/duckdb:vortex-compact 96719121 89390122 1.08
tpch_q10/duckdb:vortex-compact 43313802 41100015 1.05
tpch_q11/duckdb:vortex-compact 21022477 19818034 1.06
tpch_q12/duckdb:vortex-compact 37476983 38087770 0.98
tpch_q13/duckdb:vortex-compact 49584322 47944200 1.03
tpch_q14/duckdb:vortex-compact 31666406 29784376 1.06
tpch_q15/duckdb:vortex-compact 20086408 19817858 1.01
tpch_q16/duckdb:vortex-compact 39187016 35746849 1.10
tpch_q17/duckdb:vortex-compact 31923512 32273570 0.99
tpch_q18/duckdb:vortex-compact 53440496 50317643 1.06
tpch_q19/duckdb:vortex-compact 39460501 38459454 1.03
tpch_q20/duckdb:vortex-compact 47914576 45105497 1.06
tpch_q21/duckdb:vortex-compact 117588532 111643611 1.05
tpch_q22/duckdb:vortex-compact 22018568 20381047 1.08
duckdb / parquet (1.004x ➖, 3↑ 2↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 76745732 107488074 0.71
tpch_q02/duckdb:parquet 40329337 38831943 1.04
tpch_q03/duckdb:parquet 71323300 69907513 1.02
tpch_q04/duckdb:parquet 57074809 55316903 1.03
tpch_q05/duckdb:parquet 68470935 66280705 1.03
tpch_q06/duckdb:parquet 20857424 21020412 0.99
tpch_q07/duckdb:parquet 🚀 69852623 81246770 0.86
tpch_q08/duckdb:parquet 82249898 81913521 1.00
tpch_q09/duckdb:parquet 161900213 156415657 1.04
tpch_q10/duckdb:parquet 129594658 126025188 1.03
tpch_q11/duckdb:parquet 23262583 21657177 1.07
tpch_q12/duckdb:parquet 46038529 47129077 0.98
tpch_q13/duckdb:parquet 280396117 260167912 1.08
tpch_q14/duckdb:parquet 50110919 49053497 1.02
tpch_q15/duckdb:parquet 24800180 24246139 1.02
tpch_q16/duckdb:parquet 57342411 55092180 1.04
tpch_q17/duckdb:parquet 56561840 60981670 0.93
tpch_q18/duckdb:parquet 122407041 119897989 1.02
tpch_q19/duckdb:parquet 🚨 89151137 69752039 1.28
tpch_q20/duckdb:parquet 🚀 64596327 74413073 0.87
tpch_q21/duckdb:parquet 🚨 178527294 157301853 1.13
tpch_q22/duckdb:parquet 52684019 51492186 1.02
duckdb / duckdb (1.040x ➖, 0↑ 2↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16763977 15895204 1.05
tpch_q02/duckdb:duckdb 13127022 12132094 1.08
tpch_q03/duckdb:duckdb 19904991 19087428 1.04
tpch_q04/duckdb:duckdb 20911539 19865031 1.05
tpch_q05/duckdb:duckdb 19793531 19470842 1.02
tpch_q06/duckdb:duckdb 5545210 5502283 1.01
tpch_q07/duckdb:duckdb 22592115 22680559 1.00
tpch_q08/duckdb:duckdb 🚨 23057272 20951704 1.10
tpch_q09/duckdb:duckdb 54813994 55922396 0.98
tpch_q10/duckdb:duckdb 48258277 45874229 1.05
tpch_q11/duckdb:duckdb 6055903 5786655 1.05
tpch_q12/duckdb:duckdb 14531697 13664838 1.06
tpch_q13/duckdb:duckdb 39207988 37459697 1.05
tpch_q14/duckdb:duckdb 18697178 18088133 1.03
tpch_q15/duckdb:duckdb 12066256 11593993 1.04
tpch_q16/duckdb:duckdb 23536414 24350311 0.97
tpch_q17/duckdb:duckdb 14462607 13585446 1.06
tpch_q18/duckdb:duckdb 39297817 39326192 1.00
tpch_q19/duckdb:duckdb 🚨 30409968 26364553 1.15
tpch_q20/duckdb:duckdb 22731922 22947373 0.99
tpch_q21/duckdb:duckdb 60094399 55216959 1.09
tpch_q22/duckdb:duckdb 25009574 24342343 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +4.3% -26.1% +41.1% +26.3% 🚨 regression
1 datafusion:vortex-compact +4.6% -26.1% +41.6% +28.0% 🚨 regression
1 datafusion:vortex-file-compressed +5.7% -26.1% +43.0% +26.6% 🚨 regression
1 duckdb:duckdb +5.5% -26.1% +42.7% +25.8% 🚨 regression
1 duckdb:vortex-compact +3.0% -26.1% +39.5% +25.2% 🚨 regression
1 duckdb:vortex-file-compressed +3.1% -26.1% +39.5% +26.3% 🚨 regression
2 datafusion:arrow +4.1% +4.8% -0.7% +24.4% ➖ noise
2 datafusion:vortex-compact +5.7% +4.8% +0.8% +24.4% ➖ noise
2 datafusion:vortex-file-compressed -0.0% +4.8% -4.6% +24.4% ➖ noise
2 duckdb:duckdb +8.2% +4.8% +3.2% +24.4% ➖ noise
2 duckdb:vortex-compact +1.6% +4.8% -3.1% +24.4% ➖ noise
2 duckdb:vortex-file-compressed +5.7% +4.8% +0.8% +24.4% ➖ noise
3 datafusion:arrow +8.9% +5.1% +3.6% +24.4% ➖ noise
3 datafusion:vortex-compact +2.4% +5.1% -2.6% +24.4% ➖ noise
3 datafusion:vortex-file-compressed +4.6% +5.1% -0.4% +24.4% ➖ noise
3 duckdb:duckdb +4.3% +5.1% -0.7% +24.4% ➖ noise
3 duckdb:vortex-compact +5.4% +5.1% +0.3% +24.4% ➖ noise
3 duckdb:vortex-file-compressed +6.4% +5.1% +1.3% +24.4% ➖ noise
4 datafusion:arrow +6.8% +4.0% +2.7% +24.4% ➖ noise
4 datafusion:vortex-compact +10.8% +4.0% +6.5% +24.4% ➖ noise
4 datafusion:vortex-file-compressed +4.3% +4.0% +0.3% +24.4% ➖ noise
4 duckdb:duckdb +5.3% +4.0% +1.2% +24.4% ➖ noise
4 duckdb:vortex-compact +5.9% +4.0% +1.8% +24.4% ➖ noise
4 duckdb:vortex-file-compressed +12.6% +4.0% +8.3% +24.4% ➖ noise
5 datafusion:arrow +5.9% +2.5% +3.3% +24.4% ➖ noise
5 datafusion:vortex-compact +4.2% +2.5% +1.7% +24.4% ➖ noise
5 datafusion:vortex-file-compressed +5.5% +2.5% +2.9% +24.4% ➖ noise
5 duckdb:duckdb +1.7% +2.5% -0.9% +24.4% ➖ noise
5 duckdb:vortex-compact +2.8% +2.5% +0.2% +24.4% ➖ noise
5 duckdb:vortex-file-compressed +9.4% +2.5% +6.7% +24.4% ➖ noise
6 datafusion:arrow +7.0% +9.7% -2.4% +24.4% ➖ noise
6 datafusion:vortex-compact +6.8% +9.7% -2.6% +24.4% ➖ noise
6 datafusion:vortex-file-compressed +8.5% +9.7% -1.1% +24.4% ➖ noise
6 duckdb:duckdb +0.8% +9.7% -8.1% +24.4% ➖ noise
6 duckdb:vortex-compact -0.9% +9.7% -9.6% +24.4% ➖ noise
6 duckdb:vortex-file-compressed +4.1% +9.7% -5.1% +24.4% ➖ noise
7 datafusion:arrow +15.5% -5.8% +22.6% +24.4% ➖ noise
7 datafusion:vortex-compact +4.7% -5.8% +11.2% +24.4% ➖ noise
7 datafusion:vortex-file-compressed +7.8% -5.8% +14.5% +24.4% ➖ noise
7 duckdb:duckdb -0.4% -5.8% +5.8% +24.4% ➖ noise
7 duckdb:vortex-compact +4.1% -5.8% +10.5% +24.4% ➖ noise
7 duckdb:vortex-file-compressed +9.9% -5.8% +16.7% +24.4% ➖ noise
8 datafusion:arrow +5.9% +2.1% +3.7% +24.4% ➖ noise
8 datafusion:vortex-compact +2.2% +2.1% +0.1% +24.4% ➖ noise
8 datafusion:vortex-file-compressed +6.6% +2.1% +4.4% +24.4% ➖ noise
8 duckdb:duckdb +10.0% +2.1% +7.8% +24.4% ➖ noise
8 duckdb:vortex-compact +5.3% +2.1% +3.1% +24.4% ➖ noise
8 duckdb:vortex-file-compressed +8.9% +2.1% +6.6% +24.4% ➖ noise
9 datafusion:arrow +8.1% +1.8% +6.2% +24.4% ➖ noise
9 datafusion:vortex-compact +5.8% +1.8% +4.0% +24.4% ➖ noise
9 datafusion:vortex-file-compressed +2.4% +1.8% +0.6% +24.4% ➖ noise
9 duckdb:duckdb -2.0% +1.8% -3.7% +24.4% ➖ noise
9 duckdb:vortex-compact +8.2% +1.8% +6.3% +24.4% ➖ noise
9 duckdb:vortex-file-compressed +8.1% +1.8% +6.2% +24.4% ➖ noise
10 datafusion:arrow +7.4% +3.9% +3.3% +24.4% ➖ noise
10 datafusion:vortex-compact +6.5% +3.9% +2.5% +24.4% ➖ noise
10 datafusion:vortex-file-compressed +3.6% +3.9% -0.3% +24.4% ➖ noise
10 duckdb:duckdb +5.2% +3.9% +1.3% +24.4% ➖ noise
10 duckdb:vortex-compact +5.4% +3.9% +1.4% +24.4% ➖ noise
10 duckdb:vortex-file-compressed -0.1% +3.9% -3.9% +24.4% ➖ noise
11 datafusion:arrow +11.0% +6.6% +4.1% +24.4% ➖ noise
11 datafusion:vortex-compact +7.2% +6.6% +0.6% +24.4% ➖ noise
11 datafusion:vortex-file-compressed -0.0% +6.6% -6.2% +24.4% ➖ noise
11 duckdb:duckdb +4.7% +6.6% -1.8% +24.4% ➖ noise
11 duckdb:vortex-compact +6.1% +6.6% -0.5% +24.4% ➖ noise
11 duckdb:vortex-file-compressed -2.3% +6.6% -8.4% +24.4% ➖ noise
12 datafusion:arrow +4.3% -7.7% +13.0% +24.4% ➖ noise
12 datafusion:vortex-compact +8.3% -7.7% +17.3% +24.4% ➖ noise
12 datafusion:vortex-file-compressed +1.4% -7.7% +9.9% +24.4% ➖ noise
12 duckdb:duckdb +6.3% -7.7% +15.2% +24.4% ➖ noise
12 duckdb:vortex-compact -1.6% -7.7% +6.6% +24.4% ➖ noise
12 duckdb:vortex-file-compressed +7.4% -7.7% +16.3% +24.4% ➖ noise
13 datafusion:arrow +5.5% +8.6% -2.9% +24.4% ➖ noise
13 datafusion:vortex-compact +10.2% +8.6% +1.5% +24.4% ➖ noise
13 datafusion:vortex-file-compressed +4.3% +8.6% -4.0% +24.4% ➖ noise
13 duckdb:duckdb +4.7% +8.6% -3.6% +24.4% ➖ noise
13 duckdb:vortex-compact +3.4% +8.6% -4.8% +24.4% ➖ noise
13 duckdb:vortex-file-compressed +4.6% +8.6% -3.7% +24.4% ➖ noise
14 datafusion:arrow +9.2% -0.2% +9.4% +24.4% ➖ noise
14 datafusion:vortex-compact +7.7% -0.2% +7.9% +24.4% ➖ noise
14 datafusion:vortex-file-compressed +8.0% -0.2% +8.2% +24.4% ➖ noise
14 duckdb:duckdb +3.4% -0.2% +3.5% +24.4% ➖ noise
14 duckdb:vortex-compact +6.3% -0.2% +6.5% +24.4% ➖ noise
14 duckdb:vortex-file-compressed +15.0% -0.2% +15.1% +24.4% ➖ noise
15 datafusion:arrow +8.7% +7.3% +1.3% +24.4% ➖ noise
15 datafusion:vortex-compact +2.4% +7.3% -4.5% +24.4% ➖ noise
15 datafusion:vortex-file-compressed +6.7% +7.3% -0.5% +24.4% ➖ noise
15 duckdb:duckdb +4.1% +7.3% -3.0% +24.4% ➖ noise
15 duckdb:vortex-compact +1.4% +7.3% -5.5% +24.4% ➖ noise
15 duckdb:vortex-file-compressed +3.3% +7.3% -3.7% +24.4% ➖ noise
16 datafusion:arrow +6.9% +4.6% +2.3% +24.4% ➖ noise
16 datafusion:vortex-compact +9.6% +4.6% +4.9% +24.4% ➖ noise
16 datafusion:vortex-file-compressed -0.4% +4.6% -4.7% +24.4% ➖ noise
16 duckdb:duckdb -3.3% +4.6% -7.6% +24.4% ➖ noise
16 duckdb:vortex-compact +9.6% +4.6% +4.8% +24.4% ➖ noise
16 duckdb:vortex-file-compressed +2.7% +4.6% -1.8% +24.4% ➖ noise
17 datafusion:arrow +5.8% -0.1% +5.9% +24.4% ➖ noise
17 datafusion:vortex-compact +9.9% -0.1% +10.1% +24.4% ➖ noise
17 datafusion:vortex-file-compressed -3.4% -0.1% -3.3% +24.4% ➖ noise
17 duckdb:duckdb +6.5% -0.1% +6.6% +24.4% ➖ noise
17 duckdb:vortex-compact -1.1% -0.1% -1.0% +24.4% ➖ noise
17 duckdb:vortex-file-compressed +8.5% -0.1% +8.6% +24.4% ➖ noise
18 datafusion:arrow +4.2% +3.1% +1.1% +24.4% ➖ noise
18 datafusion:vortex-compact +5.3% +3.1% +2.2% +24.4% ➖ noise
18 datafusion:vortex-file-compressed +6.4% +3.1% +3.2% +24.4% ➖ noise
18 duckdb:duckdb -0.1% +3.1% -3.1% +24.4% ➖ noise
18 duckdb:vortex-compact +6.2% +3.1% +3.0% +24.4% ➖ noise
18 duckdb:vortex-file-compressed +11.4% +3.1% +8.1% +24.4% ➖ noise
19 datafusion:arrow +14.8% +2.1% +12.4% +24.4% ➖ noise
19 datafusion:vortex-compact +15.5% +2.1% +13.1% +25.4% ➖ noise
19 datafusion:vortex-file-compressed +14.5% +2.1% +12.1% +24.4% ➖ noise
19 duckdb:duckdb +15.3% +2.1% +13.0% +24.4% ➖ noise
19 duckdb:vortex-compact +2.6% +2.1% +0.5% +24.4% ➖ noise
19 duckdb:vortex-file-compressed +6.9% +2.1% +4.7% +24.4% ➖ noise
20 datafusion:arrow +6.2% -6.2% +13.2% +24.4% ➖ noise
20 datafusion:vortex-compact +0.3% -6.2% +6.9% +24.4% ➖ noise
20 datafusion:vortex-file-compressed +4.7% -6.2% +11.6% +24.4% ➖ noise
20 duckdb:duckdb -0.9% -6.2% +5.6% +24.4% ➖ noise
20 duckdb:vortex-compact +6.2% -6.2% +13.2% +24.4% ➖ noise
20 duckdb:vortex-file-compressed +7.4% -6.2% +14.5% +24.4% ➖ noise
21 datafusion:arrow +13.8% +10.5% +3.0% +24.4% ➖ noise
21 datafusion:vortex-compact +6.5% +10.5% -3.6% +24.4% ➖ noise
21 datafusion:vortex-file-compressed +6.2% +10.5% -3.9% +24.4% ➖ noise
21 duckdb:duckdb +8.8% +10.5% -1.6% +24.4% ➖ noise
21 duckdb:vortex-compact +5.3% +10.5% -4.7% +24.4% ➖ noise
21 duckdb:vortex-file-compressed +10.2% +10.5% -0.3% +24.4% ➖ noise
22 datafusion:arrow +11.4% +3.6% +7.6% +24.4% ➖ noise
22 datafusion:vortex-compact +7.2% +3.6% +3.5% +24.4% ➖ noise
22 datafusion:vortex-file-compressed +11.8% +3.6% +7.9% +24.4% ➖ noise
22 duckdb:duckdb +2.7% +3.6% -0.8% +24.4% ➖ noise
22 duckdb:vortex-compact +8.0% +3.6% +4.3% +24.4% ➖ noise
22 duckdb:vortex-file-compressed +6.6% +3.6% +2.9% +24.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Vortex (geomean): 0.926x ➖
Parquet (geomean): 0.924x ➖
Shifts: Parquet (control) -7.6% · Median polish -8.4%


datafusion / vortex-file-compressed (0.953x ➖, 2↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4399096 5866318 0.75
fineweb_q01/datafusion:vortex-file-compressed 26510765 28090384 0.94
fineweb_q02/datafusion:vortex-file-compressed 31302722 29738261 1.05
fineweb_q03/datafusion:vortex-file-compressed 83477652 80363924 1.04
fineweb_q04/datafusion:vortex-file-compressed 🚀 249445347 290335290 0.86
fineweb_q05/datafusion:vortex-file-compressed 228573518 234983883 0.97
fineweb_q06/datafusion:vortex-file-compressed 65352187 64433945 1.01
fineweb_q07/datafusion:vortex-file-compressed 68693485 71586202 0.96
fineweb_q08/datafusion:vortex-file-compressed 24577418 23872162 1.03
datafusion / vortex-compact (0.935x ➖, 2↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4645704 4706680 0.99
fineweb_q01/datafusion:vortex-compact 161180167 170316222 0.95
fineweb_q02/datafusion:vortex-compact 164512725 176758576 0.93
fineweb_q03/datafusion:vortex-compact 🚀 1442757888 1660859759 0.87
fineweb_q04/datafusion:vortex-compact 1549877153 1716689930 0.90
fineweb_q05/datafusion:vortex-compact 🚀 1227661633 1401331195 0.88
fineweb_q06/datafusion:vortex-compact 686201048 752361158 0.91
fineweb_q07/datafusion:vortex-compact 733549491 799889874 0.92
fineweb_q08/datafusion:vortex-compact 24332092 22208355 1.10
datafusion / parquet (0.919x ➖, 3↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6117119 6099054 1.00
fineweb_q01/datafusion:parquet 🚀 268154818 300231635 0.89
fineweb_q02/datafusion:parquet 🚀 267288617 301051324 0.89
fineweb_q03/datafusion:parquet 269443551 291344175 0.92
fineweb_q04/datafusion:parquet 284860468 309103631 0.92
fineweb_q05/datafusion:parquet 284827021 306902557 0.93
fineweb_q06/datafusion:parquet 🚀 275629217 315593421 0.87
fineweb_q07/datafusion:parquet 269130428 293878183 0.92
fineweb_q08/datafusion:parquet 271048243 290479483 0.93
duckdb / vortex-file-compressed (0.912x ➖, 4↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3219491 3670640 0.88
fineweb_q01/duckdb:vortex-file-compressed 🚀 27792064 34412588 0.81
fineweb_q02/duckdb:vortex-file-compressed 28450275 29165686 0.98
fineweb_q03/duckdb:vortex-file-compressed 🚀 130888714 156809955 0.83
fineweb_q04/duckdb:vortex-file-compressed 226073255 247505293 0.91
fineweb_q05/duckdb:vortex-file-compressed 220808634 224493942 0.98
fineweb_q06/duckdb:vortex-file-compressed 69260980 66114510 1.05
fineweb_q07/duckdb:vortex-file-compressed 🚀 64219937 75362237 0.85
fineweb_q08/duckdb:vortex-file-compressed 24388757 25809584 0.94
duckdb / vortex-compact (0.905x ➖, 6↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 3850968 4427991 0.87
fineweb_q01/duckdb:vortex-compact 108378050 105612837 1.03
fineweb_q02/duckdb:vortex-compact 116446427 123833619 0.94
fineweb_q03/duckdb:vortex-compact 🚀 850554964 964774472 0.88
fineweb_q04/duckdb:vortex-compact 🚀 908684672 1022641012 0.89
fineweb_q05/duckdb:vortex-compact 812780507 900577950 0.90
fineweb_q06/duckdb:vortex-compact 🚀 457336214 518876884 0.88
fineweb_q07/duckdb:vortex-compact 🚀 477011686 535912729 0.89
fineweb_q08/duckdb:vortex-compact 🚀 23187628 26477569 0.88
duckdb / parquet (0.928x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35904610 38056166 0.94
fineweb_q01/duckdb:parquet 92039088 99121194 0.93
fineweb_q02/duckdb:parquet 95318354 101437837 0.94
fineweb_q03/duckdb:parquet 307175140 335582430 0.92
fineweb_q04/duckdb:parquet 437528291 470968285 0.93
fineweb_q05/duckdb:parquet 408699954 440780140 0.93
fineweb_q06/duckdb:parquet 197180663 211783550 0.93
fineweb_q07/duckdb:parquet 209318598 223838469 0.94
fineweb_q08/duckdb:parquet 56575706 62831139 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -1.3% -2.7% +1.5% +43.1% ➖ noise
0 datafusion:vortex-file-compressed -25.0% -2.7% -22.9% +78.9% ➖ noise
0 duckdb:vortex-compact -13.0% -2.7% -10.6% +41.9% ➖ noise
0 duckdb:vortex-file-compressed -12.3% -2.7% -9.8% +51.4% ➖ noise
1 datafusion:vortex-compact -5.4% -8.9% +3.9% +12.5% ➖ noise
1 datafusion:vortex-file-compressed -5.6% -8.9% +3.6% +19.2% ➖ noise
1 duckdb:vortex-compact +2.6% -8.9% +12.7% +17.0% ➖ noise
1 duckdb:vortex-file-compressed -19.2% -8.9% -11.3% +41.2% ➖ noise
2 datafusion:vortex-compact -6.9% -8.7% +1.9% +10.2% ➖ noise
2 datafusion:vortex-file-compressed +5.3% -8.7% +15.2% +18.8% ➖ noise
2 duckdb:vortex-compact -6.0% -8.7% +3.0% +14.5% ➖ noise
2 duckdb:vortex-file-compressed -2.5% -8.7% +6.8% +14.4% ➖ noise
3 datafusion:vortex-compact -13.1% -8.0% -5.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.9% -8.0% +12.9% +34.3% ➖ noise
3 duckdb:vortex-compact -11.8% -8.0% -4.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -16.5% -8.0% -9.3% +19.4% ➖ noise
4 datafusion:vortex-compact -9.7% -7.5% -2.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -14.1% -7.5% -7.1% +10.2% ➖ noise
4 duckdb:vortex-compact -11.1% -7.5% -4.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -8.7% -7.5% -1.3% +10.0% ➖ noise
5 datafusion:vortex-compact -12.4% -7.2% -5.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.7% -7.2% +4.9% +10.0% ➖ noise
5 duckdb:vortex-compact -9.7% -7.2% -2.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.6% -7.2% +6.0% +10.0% ➖ noise
6 datafusion:vortex-compact -8.8% -9.8% +1.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.4% -9.8% +12.5% +10.5% 🚨 regression
6 duckdb:vortex-compact -11.9% -9.8% -2.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.8% -9.8% +16.2% +10.0% 🚨 regression
7 datafusion:vortex-compact -8.3% -7.5% -0.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -4.0% -7.5% +3.7% +10.0% ➖ noise
7 duckdb:vortex-compact -11.0% -7.5% -3.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -14.8% -7.5% -7.9% +10.0% ➖ noise
8 datafusion:vortex-compact +9.6% -8.3% +19.5% +22.4% ➖ noise
8 datafusion:vortex-file-compressed +3.0% -8.3% +12.3% +14.5% ➖ noise
8 duckdb:vortex-compact -12.4% -8.3% -4.5% +26.3% ➖ noise
8 duckdb:vortex-file-compressed -5.5% -8.3% +3.1% +19.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 23, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.9%
Vortex (geomean): 0.934x ➖
Parquet (geomean): 0.952x ➖
Shifts: Parquet (control) -4.8% · Median polish -3.7%


datafusion / vortex-file-compressed (0.937x ➖, 22↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 27676848 42130225 0.66
tpcds_q02/datafusion:vortex-file-compressed 75988396 78189710 0.97
tpcds_q03/datafusion:vortex-file-compressed 27017857 29342661 0.92
tpcds_q04/datafusion:vortex-file-compressed 🚀 381947703 433621066 0.88
tpcds_q05/datafusion:vortex-file-compressed 69612018 73682340 0.94
tpcds_q06/datafusion:vortex-file-compressed 73832922 77468369 0.95
tpcds_q07/datafusion:vortex-file-compressed 🚀 73088697 91491619 0.80
tpcds_q08/datafusion:vortex-file-compressed 🚀 40691681 56481567 0.72
tpcds_q09/datafusion:vortex-file-compressed 46835153 47850898 0.98
tpcds_q10/datafusion:vortex-file-compressed 49269512 49570969 0.99
tpcds_q11/datafusion:vortex-file-compressed 233923293 251617395 0.93
tpcds_q12/datafusion:vortex-file-compressed 36481689 37042040 0.98
tpcds_q13/datafusion:vortex-file-compressed 75727395 77961626 0.97
tpcds_q14/datafusion:vortex-file-compressed 215727770 228701332 0.94
tpcds_q15/datafusion:vortex-file-compressed 49325487 51751535 0.95
tpcds_q16/datafusion:vortex-file-compressed 28787607 29024900 0.99
tpcds_q17/datafusion:vortex-file-compressed 111408888 114361630 0.97
tpcds_q18/datafusion:vortex-file-compressed 🚀 98093743 123056571 0.80
tpcds_q19/datafusion:vortex-file-compressed 47351099 46333299 1.02
tpcds_q20/datafusion:vortex-file-compressed 41100368 41553704 0.99
tpcds_q21/datafusion:vortex-file-compressed 🚀 172730209 202641994 0.85
tpcds_q22/datafusion:vortex-file-compressed 68957134 70248331 0.98
tpcds_q23/datafusion:vortex-file-compressed 183873170 193908559 0.95
tpcds_q24/datafusion:vortex-file-compressed 176468662 191481391 0.92
tpcds_q25/datafusion:vortex-file-compressed 112006682 112508447 1.00
tpcds_q26/datafusion:vortex-file-compressed 🚀 61380412 74395091 0.83
tpcds_q27/datafusion:vortex-file-compressed 170119643 181023195 0.94
tpcds_q28/datafusion:vortex-file-compressed 50748078 50203322 1.01
tpcds_q29/datafusion:vortex-file-compressed 🚀 108973574 139047107 0.78
tpcds_q30/datafusion:vortex-file-compressed 🚀 29946721 33443566 0.90
tpcds_q31/datafusion:vortex-file-compressed 177528636 184348892 0.96
tpcds_q32/datafusion:vortex-file-compressed 23575413 24663360 0.96
tpcds_q33/datafusion:vortex-file-compressed 🚀 35724269 40022772 0.89
tpcds_q34/datafusion:vortex-file-compressed 🚀 36236114 54334910 0.67
tpcds_q35/datafusion:vortex-file-compressed 🚀 59871840 80555025 0.74
tpcds_q36/datafusion:vortex-file-compressed 104867271 112687305 0.93
tpcds_q37/datafusion:vortex-file-compressed 38604082 38282244 1.01
tpcds_q38/datafusion:vortex-file-compressed 87733873 90187168 0.97
tpcds_q39/datafusion:vortex-file-compressed 🚀 194576291 231848793 0.84
tpcds_q40/datafusion:vortex-file-compressed 58913424 56828616 1.04
tpcds_q41/datafusion:vortex-file-compressed 13999601 14057911 1.00
tpcds_q42/datafusion:vortex-file-compressed 30139545 29925996 1.01
tpcds_q43/datafusion:vortex-file-compressed 47399341 51911579 0.91
tpcds_q44/datafusion:vortex-file-compressed 🚀 39229085 58442363 0.67
tpcds_q45/datafusion:vortex-file-compressed 🚀 48860463 62496578 0.78
tpcds_q46/datafusion:vortex-file-compressed 65068576 69020397 0.94
tpcds_q47/datafusion:vortex-file-compressed 274673863 277674498 0.99
tpcds_q48/datafusion:vortex-file-compressed 🚀 66107424 81506249 0.81
tpcds_q49/datafusion:vortex-file-compressed 67061874 67521955 0.99
tpcds_q50/datafusion:vortex-file-compressed 75394166 73298514 1.03
tpcds_q51/datafusion:vortex-file-compressed 96841476 91516945 1.06
tpcds_q52/datafusion:vortex-file-compressed 29733074 31509323 0.94
tpcds_q53/datafusion:vortex-file-compressed 29963953 29199582 1.03
tpcds_q54/datafusion:vortex-file-compressed 47962264 46310188 1.04
tpcds_q55/datafusion:vortex-file-compressed 30143561 31743460 0.95
tpcds_q56/datafusion:vortex-file-compressed 47467893 47710635 0.99
tpcds_q57/datafusion:vortex-file-compressed 183043057 190368555 0.96
tpcds_q58/datafusion:vortex-file-compressed 109022564 111596895 0.98
tpcds_q59/datafusion:vortex-file-compressed 93263693 94979193 0.98
tpcds_q60/datafusion:vortex-file-compressed 45164472 46806267 0.96
tpcds_q61/datafusion:vortex-file-compressed 56317246 59468939 0.95
tpcds_q62/datafusion:vortex-file-compressed 44848882 47017745 0.95
tpcds_q63/datafusion:vortex-file-compressed 🚀 30075686 34541938 0.87
tpcds_q64/datafusion:vortex-file-compressed 694718412 716739677 0.97
tpcds_q65/datafusion:vortex-file-compressed 50349529 48928393 1.03
tpcds_q66/datafusion:vortex-file-compressed 102842346 105173118 0.98
tpcds_q67/datafusion:vortex-file-compressed 144334822 151187686 0.95
tpcds_q68/datafusion:vortex-file-compressed 62392602 64710511 0.96
tpcds_q69/datafusion:vortex-file-compressed 45981029 44166136 1.04
tpcds_q70/datafusion:vortex-file-compressed 132924848 126029921 1.05
tpcds_q71/datafusion:vortex-file-compressed 30352206 30292959 1.00
tpcds_q72/datafusion:vortex-file-compressed 3360998001 3687802951 0.91
tpcds_q73/datafusion:vortex-file-compressed 38156142 40700742 0.94
tpcds_q74/datafusion:vortex-file-compressed 171284961 170987882 1.00
tpcds_q75/datafusion:vortex-file-compressed 133224178 137581085 0.97
tpcds_q76/datafusion:vortex-file-compressed 64217070 62046846 1.03
tpcds_q77/datafusion:vortex-file-compressed 54603442 57549647 0.95
tpcds_q78/datafusion:vortex-file-compressed 175794583 186782505 0.94
tpcds_q79/datafusion:vortex-file-compressed 🚀 40532029 45390744 0.89
tpcds_q80/datafusion:vortex-file-compressed 117677358 125594688 0.94
tpcds_q81/datafusion:vortex-file-compressed 🚀 35547531 39911578 0.89
tpcds_q82/datafusion:vortex-file-compressed 41274181 41059593 1.01
tpcds_q83/datafusion:vortex-file-compressed 65081785 68141333 0.96
tpcds_q84/datafusion:vortex-file-compressed 15437212 16646549 0.93
tpcds_q85/datafusion:vortex-file-compressed 135556963 137182518 0.99
tpcds_q86/datafusion:vortex-file-compressed 31263747 31576967 0.99
tpcds_q87/datafusion:vortex-file-compressed 87133517 90783715 0.96
tpcds_q88/datafusion:vortex-file-compressed 🚀 75523683 86227032 0.88
tpcds_q89/datafusion:vortex-file-compressed 60714565 58065075 1.05
tpcds_q90/datafusion:vortex-file-compressed 🚀 16166633 18175723 0.89
tpcds_q91/datafusion:vortex-file-compressed 🚀 24824233 28988957 0.86
tpcds_q92/datafusion:vortex-file-compressed 18959867 19336482 0.98
tpcds_q93/datafusion:vortex-file-compressed 37881265 36177411 1.05
tpcds_q94/datafusion:vortex-file-compressed 26509625 26121552 1.01
tpcds_q95/datafusion:vortex-file-compressed 86405886 89358885 0.97
tpcds_q96/datafusion:vortex-file-compressed 14620239 15696310 0.93
tpcds_q97/datafusion:vortex-file-compressed 31482372 34586544 0.91
tpcds_q98/datafusion:vortex-file-compressed 50511343 49196807 1.03
tpcds_q99/datafusion:vortex-file-compressed 63213002 62197105 1.02
datafusion / vortex-compact (0.936x ➖, 26↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35850519 36658991 0.98
tpcds_q02/datafusion:vortex-compact 81666229 81066897 1.01
tpcds_q03/datafusion:vortex-compact 🚀 32777327 37519511 0.87
tpcds_q04/datafusion:vortex-compact 431974582 478655467 0.90
tpcds_q05/datafusion:vortex-compact 🚀 83062655 97796894 0.85
tpcds_q06/datafusion:vortex-compact 82841706 87442288 0.95
tpcds_q07/datafusion:vortex-compact 🚀 94393922 108772128 0.87
tpcds_q08/datafusion:vortex-compact 48163657 52553204 0.92
tpcds_q09/datafusion:vortex-compact 🚀 96605730 114216108 0.85
tpcds_q10/datafusion:vortex-compact 69187743 68975684 1.00
tpcds_q11/datafusion:vortex-compact 🚀 263654970 299492180 0.88
tpcds_q12/datafusion:vortex-compact 🚀 38793130 47518168 0.82
tpcds_q13/datafusion:vortex-compact 141018566 152875630 0.92
tpcds_q14/datafusion:vortex-compact 🚀 264814322 303123296 0.87
tpcds_q15/datafusion:vortex-compact 🚀 52982232 66825505 0.79
tpcds_q16/datafusion:vortex-compact 41926229 43538113 0.96
tpcds_q17/datafusion:vortex-compact 126448727 131621756 0.96
tpcds_q18/datafusion:vortex-compact 🚀 116673619 134798841 0.87
tpcds_q19/datafusion:vortex-compact 🚀 60979068 69914930 0.87
tpcds_q20/datafusion:vortex-compact 47786342 50621255 0.94
tpcds_q21/datafusion:vortex-compact 🚀 179591813 200253208 0.90
tpcds_q22/datafusion:vortex-compact 🚀 81061270 94656204 0.86
tpcds_q23/datafusion:vortex-compact 231605929 253207220 0.91
tpcds_q24/datafusion:vortex-compact 🚀 209366120 237699299 0.88
tpcds_q25/datafusion:vortex-compact 🚀 127715037 154519772 0.83
tpcds_q26/datafusion:vortex-compact 74538729 78838758 0.95
tpcds_q27/datafusion:vortex-compact 206725822 218175789 0.95
tpcds_q28/datafusion:vortex-compact 100927274 103394207 0.98
tpcds_q29/datafusion:vortex-compact 134220306 127786647 1.05
tpcds_q30/datafusion:vortex-compact 35581034 35583150 1.00
tpcds_q31/datafusion:vortex-compact 207980322 215797509 0.96
tpcds_q32/datafusion:vortex-compact 🚀 28718243 33865705 0.85
tpcds_q33/datafusion:vortex-compact 49984330 54026962 0.93
tpcds_q34/datafusion:vortex-compact 56001213 58632546 0.96
tpcds_q35/datafusion:vortex-compact 74541183 76750101 0.97
tpcds_q36/datafusion:vortex-compact 126507096 135707028 0.93
tpcds_q37/datafusion:vortex-compact 51295454 51244035 1.00
tpcds_q38/datafusion:vortex-compact 99667326 107891695 0.92
tpcds_q39/datafusion:vortex-compact 221851253 224622300 0.99
tpcds_q40/datafusion:vortex-compact 61326185 62227314 0.99
tpcds_q41/datafusion:vortex-compact 15142271 14809427 1.02
tpcds_q42/datafusion:vortex-compact 37004373 36580752 1.01
tpcds_q43/datafusion:vortex-compact 52776109 56453944 0.93
tpcds_q44/datafusion:vortex-compact 70579624 76594207 0.92
tpcds_q45/datafusion:vortex-compact 52293718 52611338 0.99
tpcds_q46/datafusion:vortex-compact 89531924 90098541 0.99
tpcds_q47/datafusion:vortex-compact 310961727 307564829 1.01
tpcds_q48/datafusion:vortex-compact 108805612 108532451 1.00
tpcds_q49/datafusion:vortex-compact 🚀 98797185 122546493 0.81
tpcds_q50/datafusion:vortex-compact 94433496 98517591 0.96
tpcds_q51/datafusion:vortex-compact 100304840 110179312 0.91
tpcds_q52/datafusion:vortex-compact 37260754 38553741 0.97
tpcds_q53/datafusion:vortex-compact 39365348 40018614 0.98
tpcds_q54/datafusion:vortex-compact 🚀 64748535 78195749 0.83
tpcds_q55/datafusion:vortex-compact 35524127 35684474 1.00
tpcds_q56/datafusion:vortex-compact 59341465 65020558 0.91
tpcds_q57/datafusion:vortex-compact 197775528 200683723 0.99
tpcds_q58/datafusion:vortex-compact 🚀 118319808 144208524 0.82
tpcds_q59/datafusion:vortex-compact 🚀 107206180 124426624 0.86
tpcds_q60/datafusion:vortex-compact 58325692 60632396 0.96
tpcds_q61/datafusion:vortex-compact 81619312 82720405 0.99
tpcds_q62/datafusion:vortex-compact 🚀 44588398 49888155 0.89
tpcds_q63/datafusion:vortex-compact 🚀 39451395 49528398 0.80
tpcds_q64/datafusion:vortex-compact 801551203 887906120 0.90
tpcds_q65/datafusion:vortex-compact 67608389 74501254 0.91
tpcds_q66/datafusion:vortex-compact 108729368 110680009 0.98
tpcds_q67/datafusion:vortex-compact 155351967 151879342 1.02
tpcds_q68/datafusion:vortex-compact 91882501 88646866 1.04
tpcds_q69/datafusion:vortex-compact 64285490 68205953 0.94
tpcds_q70/datafusion:vortex-compact 140057488 139909890 1.00
tpcds_q71/datafusion:vortex-compact 🚀 43317937 52350014 0.83
tpcds_q72/datafusion:vortex-compact 🚀 3373986453 3852898645 0.88
tpcds_q73/datafusion:vortex-compact 58444533 57373743 1.02
tpcds_q74/datafusion:vortex-compact 182621352 198292693 0.92
tpcds_q75/datafusion:vortex-compact 179457303 193522817 0.93
tpcds_q76/datafusion:vortex-compact 77766947 77529820 1.00
tpcds_q77/datafusion:vortex-compact 66245824 68926506 0.96
tpcds_q78/datafusion:vortex-compact 204662349 211782531 0.97
tpcds_q79/datafusion:vortex-compact 66350098 69610410 0.95
tpcds_q80/datafusion:vortex-compact 135528940 138151795 0.98
tpcds_q81/datafusion:vortex-compact 43448971 44650814 0.97
tpcds_q82/datafusion:vortex-compact 51998785 55092423 0.94
tpcds_q83/datafusion:vortex-compact 66894588 68908748 0.97
tpcds_q84/datafusion:vortex-compact 18116951 17899259 1.01
tpcds_q85/datafusion:vortex-compact 159320799 159174918 1.00
tpcds_q86/datafusion:vortex-compact 🚀 31412039 35940526 0.87
tpcds_q87/datafusion:vortex-compact 104023264 106316391 0.98
tpcds_q88/datafusion:vortex-compact 132349584 134161656 0.99
tpcds_q89/datafusion:vortex-compact 62954643 66850994 0.94
tpcds_q90/datafusion:vortex-compact 21790998 22125234 0.98
tpcds_q91/datafusion:vortex-compact 41731697 41086905 1.02
tpcds_q92/datafusion:vortex-compact 22031536 21039412 1.05
tpcds_q93/datafusion:vortex-compact 53191731 51164873 1.04
tpcds_q94/datafusion:vortex-compact 33115785 33681221 0.98
tpcds_q95/datafusion:vortex-compact 98283435 106082088 0.93
tpcds_q96/datafusion:vortex-compact 🚀 24862815 32643372 0.76
tpcds_q97/datafusion:vortex-compact 🚀 43229614 52535003 0.82
tpcds_q98/datafusion:vortex-compact 56871305 57667218 0.99
tpcds_q99/datafusion:vortex-compact 62390932 65797285 0.95
datafusion / parquet (0.972x ➖, 11↑ 1↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36399220 35391187 1.03
tpcds_q02/datafusion:parquet 50551111 52381613 0.97
tpcds_q03/datafusion:parquet 17890911 16847054 1.06
tpcds_q04/datafusion:parquet 359978827 367644559 0.98
tpcds_q05/datafusion:parquet 89843035 91120353 0.99
tpcds_q06/datafusion:parquet 94874574 94936476 1.00
tpcds_q07/datafusion:parquet 139417253 133687310 1.04
tpcds_q08/datafusion:parquet 39889871 37282113 1.07
tpcds_q09/datafusion:parquet 55302631 55336892 1.00
tpcds_q10/datafusion:parquet 101620887 103629872 0.98
tpcds_q11/datafusion:parquet 224181183 235285519 0.95
tpcds_q12/datafusion:parquet 28394049 30196478 0.94
tpcds_q13/datafusion:parquet 135871060 143564949 0.95
tpcds_q14/datafusion:parquet 213212556 212169617 1.00
tpcds_q15/datafusion:parquet 55634622 56161951 0.99
tpcds_q16/datafusion:parquet 33674536 34707144 0.97
tpcds_q17/datafusion:parquet 180641802 173425963 1.04
tpcds_q18/datafusion:parquet 180245411 176406751 1.02
tpcds_q19/datafusion:parquet 36436656 36017952 1.01
tpcds_q20/datafusion:parquet 24327342 24372504 1.00
tpcds_q21/datafusion:parquet 26968921 28385919 0.95
tpcds_q22/datafusion:parquet 🚀 153363472 170477584 0.90
tpcds_q23/datafusion:parquet 180184453 182825410 0.99
tpcds_q24/datafusion:parquet 216993545 216377145 1.00
tpcds_q25/datafusion:parquet 176386745 174288692 1.01
tpcds_q26/datafusion:parquet 113243587 113685513 1.00
tpcds_q27/datafusion:parquet 249256254 258363523 0.96
tpcds_q28/datafusion:parquet 52649739 52559219 1.00
tpcds_q29/datafusion:parquet 185561731 180899595 1.03
tpcds_q30/datafusion:parquet 44075767 44194933 1.00
tpcds_q31/datafusion:parquet 106910845 107883887 0.99
tpcds_q32/datafusion:parquet 30318615 30265878 1.00
tpcds_q33/datafusion:parquet 36866471 36537068 1.01
tpcds_q34/datafusion:parquet 35421198 37106259 0.95
tpcds_q35/datafusion:parquet 94966506 96820475 0.98
tpcds_q36/datafusion:parquet 82300414 82228845 1.00
tpcds_q37/datafusion:parquet 26603476 25773217 1.03
tpcds_q38/datafusion:parquet 61648956 62745837 0.98
tpcds_q39/datafusion:parquet 101391425 98826146 1.03
tpcds_q40/datafusion:parquet 35765440 35839647 1.00
tpcds_q41/datafusion:parquet 12432817 12923718 0.96
tpcds_q42/datafusion:parquet 15189137 15958988 0.95
tpcds_q43/datafusion:parquet 26333297 26921866 0.98
tpcds_q44/datafusion:parquet 40672777 40927873 0.99
tpcds_q45/datafusion:parquet 67559652 69007783 0.98
tpcds_q46/datafusion:parquet 52619008 51650107 1.02
tpcds_q47/datafusion:parquet 183409632 184933215 0.99
tpcds_q48/datafusion:parquet 131785893 128123841 1.03
tpcds_q49/datafusion:parquet 🚀 73425676 82341509 0.89
tpcds_q50/datafusion:parquet 107723584 109517655 0.98
tpcds_q51/datafusion:parquet 104404688 103254537 1.01
tpcds_q52/datafusion:parquet 16329130 15266786 1.07
tpcds_q53/datafusion:parquet 30605265 31098662 0.98
tpcds_q54/datafusion:parquet 49388997 53169688 0.93
tpcds_q55/datafusion:parquet 16224094 17753753 0.91
tpcds_q56/datafusion:parquet 35449753 38646054 0.92
tpcds_q57/datafusion:parquet 133153626 144610192 0.92
tpcds_q58/datafusion:parquet 73581439 72665397 1.01
tpcds_q59/datafusion:parquet 74067146 74978075 0.99
tpcds_q60/datafusion:parquet 36587644 40411740 0.91
tpcds_q61/datafusion:parquet 66294514 67299298 0.99
tpcds_q62/datafusion:parquet 🚨 46922473 41140774 1.14
tpcds_q63/datafusion:parquet 32646955 30851525 1.06
tpcds_q64/datafusion:parquet 996185448 1017595196 0.98
tpcds_q65/datafusion:parquet 48818647 50889746 0.96
tpcds_q66/datafusion:parquet 🚀 88910633 99075180 0.90
tpcds_q67/datafusion:parquet 🚀 175027938 197841975 0.88
tpcds_q68/datafusion:parquet 52084254 53024726 0.98
tpcds_q69/datafusion:parquet 97798212 97959916 1.00
tpcds_q70/datafusion:parquet 110845858 119282285 0.93
tpcds_q71/datafusion:parquet 29393833 29524189 1.00
tpcds_q72/datafusion:parquet 862783995 924129064 0.93
tpcds_q73/datafusion:parquet 36070886 34957270 1.03
tpcds_q74/datafusion:parquet 🚀 127360242 144615639 0.88
tpcds_q75/datafusion:parquet 138749415 133597470 1.04
tpcds_q76/datafusion:parquet 90392276 88930927 1.02
tpcds_q77/datafusion:parquet 🚀 57235936 70451256 0.81
tpcds_q78/datafusion:parquet 183525155 193371587 0.95
tpcds_q79/datafusion:parquet 🚀 41690456 50538892 0.82
tpcds_q80/datafusion:parquet 112666606 112431087 1.00
tpcds_q81/datafusion:parquet 43643108 44460460 0.98
tpcds_q82/datafusion:parquet 29181143 31664040 0.92
tpcds_q83/datafusion:parquet 🚀 56052986 71801586 0.78
tpcds_q84/datafusion:parquet 48474155 47905072 1.01
tpcds_q85/datafusion:parquet 245717764 269048313 0.91
tpcds_q86/datafusion:parquet 20882498 22213883 0.94
tpcds_q87/datafusion:parquet 63549567 64268248 0.99
tpcds_q88/datafusion:parquet 79035242 81512942 0.97
tpcds_q89/datafusion:parquet 35242296 37865138 0.93
tpcds_q90/datafusion:parquet 🚀 18423824 20577010 0.90
tpcds_q91/datafusion:parquet 81057539 77252070 1.05
tpcds_q92/datafusion:parquet 25003224 26724381 0.94
tpcds_q93/datafusion:parquet 39210741 39641023 0.99
tpcds_q94/datafusion:parquet 28562073 30011779 0.95
tpcds_q95/datafusion:parquet 134273857 135033955 0.99
tpcds_q96/datafusion:parquet 🚀 14385157 16264238 0.88
tpcds_q97/datafusion:parquet 37745525 38537667 0.98
tpcds_q98/datafusion:parquet 35262639 38686038 0.91
tpcds_q99/datafusion:parquet 🚀 50110704 62155296 0.81
duckdb / vortex-file-compressed (0.920x ➖, 35↑ 2↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 27344778 26203258 1.04
tpcds_q02/duckdb:vortex-file-compressed 85247819 88421446 0.96
tpcds_q03/duckdb:vortex-file-compressed 23128162 25658042 0.90
tpcds_q04/duckdb:vortex-file-compressed 111370251 111617651 1.00
tpcds_q05/duckdb:vortex-file-compressed 103357602 111347371 0.93
tpcds_q06/duckdb:vortex-file-compressed 35464773 37745744 0.94
tpcds_q07/duckdb:vortex-file-compressed 🚀 24000395 29031345 0.83
tpcds_q08/duckdb:vortex-file-compressed 24136792 25079026 0.96
tpcds_q09/duckdb:vortex-file-compressed 40470210 42693123 0.95
tpcds_q10/duckdb:vortex-file-compressed 38007120 37979882 1.00
tpcds_q11/duckdb:vortex-file-compressed 63072859 64436102 0.98
tpcds_q12/duckdb:vortex-file-compressed 15159609 14047093 1.08
tpcds_q13/duckdb:vortex-file-compressed 32962656 33976368 0.97
tpcds_q14/duckdb:vortex-file-compressed 204034762 199976685 1.02
tpcds_q15/duckdb:vortex-file-compressed 41707319 42804455 0.97
tpcds_q16/duckdb:vortex-file-compressed 31118361 32824156 0.95
tpcds_q17/duckdb:vortex-file-compressed 38229362 41477844 0.92
tpcds_q18/duckdb:vortex-file-compressed 45117063 49254652 0.92
tpcds_q19/duckdb:vortex-file-compressed 🚀 32081844 36310093 0.88
tpcds_q20/duckdb:vortex-file-compressed 🚀 16026639 18023636 0.89
tpcds_q21/duckdb:vortex-file-compressed 21285163 20708900 1.03
tpcds_q22/duckdb:vortex-file-compressed 111266621 114272824 0.97
tpcds_q23/duckdb:vortex-file-compressed 139025051 131193285 1.06
tpcds_q24/duckdb:vortex-file-compressed 56240533 57431577 0.98
tpcds_q25/duckdb:vortex-file-compressed 38377236 41762747 0.92
tpcds_q26/duckdb:vortex-file-compressed 41255967 41189708 1.00
tpcds_q27/duckdb:vortex-file-compressed 88443872 90509639 0.98
tpcds_q28/duckdb:vortex-file-compressed 38556465 39651912 0.97
tpcds_q29/duckdb:vortex-file-compressed 37874879 37666320 1.01
tpcds_q30/duckdb:vortex-file-compressed 28449702 30431479 0.93
tpcds_q31/duckdb:vortex-file-compressed 26807286 27757434 0.97
tpcds_q32/duckdb:vortex-file-compressed 🚨 17730781 16021505 1.11
tpcds_q33/duckdb:vortex-file-compressed 67817525 66439867 1.02
tpcds_q34/duckdb:vortex-file-compressed 18486603 20517617 0.90
tpcds_q35/duckdb:vortex-file-compressed 63273549 68754939 0.92
tpcds_q36/duckdb:vortex-file-compressed 28095564 27130965 1.04
tpcds_q37/duckdb:vortex-file-compressed 23375051 25724798 0.91
tpcds_q38/duckdb:vortex-file-compressed 38538167 36529032 1.06
tpcds_q39/duckdb:vortex-file-compressed 45947346 47264736 0.97
tpcds_q40/duckdb:vortex-file-compressed 25086445 25561946 0.98
tpcds_q41/duckdb:vortex-file-compressed 13739051 12810703 1.07
tpcds_q42/duckdb:vortex-file-compressed 12246552 11639377 1.05
tpcds_q43/duckdb:vortex-file-compressed 20757200 20320136 1.02
tpcds_q44/duckdb:vortex-file-compressed 23719311 25680772 0.92
tpcds_q45/duckdb:vortex-file-compressed 🚀 26416827 29734733 0.89
tpcds_q46/duckdb:vortex-file-compressed 🚀 46057965 54455400 0.85
tpcds_q47/duckdb:vortex-file-compressed 🚀 49680595 63788503 0.78
tpcds_q48/duckdb:vortex-file-compressed 30058299 31565752 0.95
tpcds_q49/duckdb:vortex-file-compressed 🚀 30567807 34939811 0.87
tpcds_q50/duckdb:vortex-file-compressed 🚀 32437001 36118382 0.90
tpcds_q51/duckdb:vortex-file-compressed 105075426 116359626 0.90
tpcds_q52/duckdb:vortex-file-compressed 13109187 12146082 1.08
tpcds_q53/duckdb:vortex-file-compressed 🚀 17214153 19190903 0.90
tpcds_q54/duckdb:vortex-file-compressed 🚀 51701497 62912261 0.82
tpcds_q55/duckdb:vortex-file-compressed 🚀 11716892 16711092 0.70
tpcds_q56/duckdb:vortex-file-compressed 🚀 68183150 82680590 0.82
tpcds_q57/duckdb:vortex-file-compressed 🚀 44238420 55338861 0.80
tpcds_q58/duckdb:vortex-file-compressed 🚀 32429423 37755383 0.86
tpcds_q59/duckdb:vortex-file-compressed 🚀 56162324 64631301 0.87
tpcds_q60/duckdb:vortex-file-compressed 🚀 67319309 77455676 0.87
tpcds_q61/duckdb:vortex-file-compressed 🚀 37868771 45772588 0.83
tpcds_q62/duckdb:vortex-file-compressed 22386220 23480652 0.95
tpcds_q63/duckdb:vortex-file-compressed 🚀 17318746 22255444 0.78
tpcds_q64/duckdb:vortex-file-compressed 🚀 79227485 98089291 0.81
tpcds_q65/duckdb:vortex-file-compressed 🚀 23146411 31745032 0.73
tpcds_q66/duckdb:vortex-file-compressed 🚀 59569590 76949499 0.77
tpcds_q67/duckdb:vortex-file-compressed 🚀 146611515 170552314 0.86
tpcds_q68/duckdb:vortex-file-compressed 🚀 38966837 52940409 0.74
tpcds_q69/duckdb:vortex-file-compressed 🚀 38949705 47571723 0.82
tpcds_q70/duckdb:vortex-file-compressed 25035048 26065938 0.96
tpcds_q71/duckdb:vortex-file-compressed 🚀 22109601 27083541 0.82
tpcds_q72/duckdb:vortex-file-compressed 🚀 177757658 202027535 0.88
tpcds_q73/duckdb:vortex-file-compressed 🚀 19151466 25536242 0.75
tpcds_q74/duckdb:vortex-file-compressed 🚀 51114734 67627087 0.76
tpcds_q75/duckdb:vortex-file-compressed 🚀 57666584 80111100 0.72
tpcds_q76/duckdb:vortex-file-compressed 58102894 62934479 0.92
tpcds_q77/duckdb:vortex-file-compressed 🚀 64469019 90620887 0.71
tpcds_q78/duckdb:vortex-file-compressed 81117664 81419439 1.00
tpcds_q79/duckdb:vortex-file-compressed 🚀 32651047 36485838 0.89
tpcds_q80/duckdb:vortex-file-compressed 89989854 92021700 0.98
tpcds_q81/duckdb:vortex-file-compressed 31976036 34044935 0.94
tpcds_q82/duckdb:vortex-file-compressed 🚀 22410810 25378014 0.88
tpcds_q83/duckdb:vortex-file-compressed 29930748 27792005 1.08
tpcds_q84/duckdb:vortex-file-compressed 17400703 17159268 1.01
tpcds_q85/duckdb:vortex-file-compressed 46404627 47550287 0.98
tpcds_q86/duckdb:vortex-file-compressed 17672867 19019916 0.93
tpcds_q87/duckdb:vortex-file-compressed 38695054 39605029 0.98
tpcds_q88/duckdb:vortex-file-compressed 40686989 43817965 0.93
tpcds_q89/duckdb:vortex-file-compressed 18403496 18828956 0.98
tpcds_q90/duckdb:vortex-file-compressed 14953928 15214539 0.98
tpcds_q91/duckdb:vortex-file-compressed 27852043 27413186 1.02
tpcds_q92/duckdb:vortex-file-compressed 🚨 15679461 14093750 1.11
tpcds_q93/duckdb:vortex-file-compressed 29424236 30383475 0.97
tpcds_q94/duckdb:vortex-file-compressed 🚀 21696522 25098802 0.86
tpcds_q95/duckdb:vortex-file-compressed 156014527 155363416 1.00
tpcds_q96/duckdb:vortex-file-compressed 🚀 16234393 19356937 0.84
tpcds_q97/duckdb:vortex-file-compressed 37845921 39558962 0.96
tpcds_q98/duckdb:vortex-file-compressed 18201483 19527695 0.93
tpcds_q99/duckdb:vortex-file-compressed 🚀 32238441 39209430 0.82
duckdb / vortex-compact (0.943x ➖, 20↑ 2↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 34855435 34480856 1.01
tpcds_q02/duckdb:vortex-compact 126054144 133584067 0.94
tpcds_q03/duckdb:vortex-compact 50906217 52255239 0.97
tpcds_q04/duckdb:vortex-compact 129659321 128761649 1.01
tpcds_q05/duckdb:vortex-compact 173406290 174789163 0.99
tpcds_q06/duckdb:vortex-compact 41499022 41609562 1.00
tpcds_q07/duckdb:vortex-compact 39330867 41154929 0.96
tpcds_q08/duckdb:vortex-compact 29414127 31765517 0.93
tpcds_q09/duckdb:vortex-compact 110047981 121602394 0.90
tpcds_q10/duckdb:vortex-compact 🚀 48843335 60558520 0.81
tpcds_q11/duckdb:vortex-compact 77343948 81951353 0.94
tpcds_q12/duckdb:vortex-compact 18966791 19504612 0.97
tpcds_q13/duckdb:vortex-compact 54959539 56058358 0.98
tpcds_q14/duckdb:vortex-compact 291950542 319562691 0.91
tpcds_q15/duckdb:vortex-compact 46196043 49797673 0.93
tpcds_q16/duckdb:vortex-compact 🚀 36022493 51939081 0.69
tpcds_q17/duckdb:vortex-compact 🚀 50967227 58113857 0.88
tpcds_q18/duckdb:vortex-compact 67631156 71390600 0.95
tpcds_q19/duckdb:vortex-compact 41050012 41876643 0.98
tpcds_q20/duckdb:vortex-compact 20029962 21565031 0.93
tpcds_q21/duckdb:vortex-compact 28169761 28682285 0.98
tpcds_q22/duckdb:vortex-compact 120855742 131922243 0.92
tpcds_q23/duckdb:vortex-compact 170099864 178128313 0.95
tpcds_q24/duckdb:vortex-compact 77105179 85123741 0.91
tpcds_q25/duckdb:vortex-compact 🚀 51453320 67939080 0.76
tpcds_q26/duckdb:vortex-compact 49410306 54866989 0.90
tpcds_q27/duckdb:vortex-compact 145052019 148266663 0.98
tpcds_q28/duckdb:vortex-compact 108592624 110191438 0.99
tpcds_q29/duckdb:vortex-compact 53054789 53729338 0.99
tpcds_q30/duckdb:vortex-compact 32917095 36192581 0.91
tpcds_q31/duckdb:vortex-compact 🚀 27939687 31119984 0.90
tpcds_q32/duckdb:vortex-compact 22644921 24360377 0.93
tpcds_q33/duckdb:vortex-compact 146009507 143472352 1.02
tpcds_q34/duckdb:vortex-compact 🚀 30077063 33765609 0.89
tpcds_q35/duckdb:vortex-compact 🚀 70877057 79613908 0.89
tpcds_q36/duckdb:vortex-compact 35463979 38406614 0.92
tpcds_q37/duckdb:vortex-compact 29729853 32461483 0.92
tpcds_q38/duckdb:vortex-compact 🚀 40413322 45988914 0.88
tpcds_q39/duckdb:vortex-compact 52563440 54530671 0.96
tpcds_q40/duckdb:vortex-compact 🚀 31479512 37775455 0.83
tpcds_q41/duckdb:vortex-compact 16947183 17509609 0.97
tpcds_q42/duckdb:vortex-compact 15744838 15869680 0.99
tpcds_q43/duckdb:vortex-compact 🚀 24866278 28877914 0.86
tpcds_q44/duckdb:vortex-compact 🚀 35381732 40145190 0.88
tpcds_q45/duckdb:vortex-compact 34743651 32929324 1.06
tpcds_q46/duckdb:vortex-compact 62268791 61286105 1.02
tpcds_q47/duckdb:vortex-compact 55771482 54713799 1.02
tpcds_q48/duckdb:vortex-compact 46250562 46339530 1.00
tpcds_q49/duckdb:vortex-compact 48650324 47719167 1.02
tpcds_q50/duckdb:vortex-compact 55470442 54797522 1.01
tpcds_q51/duckdb:vortex-compact 104657892 106649880 0.98
tpcds_q52/duckdb:vortex-compact 15334212 14863239 1.03
tpcds_q53/duckdb:vortex-compact 22837381 23178187 0.99
tpcds_q54/duckdb:vortex-compact 85218283 87206187 0.98
tpcds_q55/duckdb:vortex-compact 16135532 17025990 0.95
tpcds_q56/duckdb:vortex-compact 141323650 147280040 0.96
tpcds_q57/duckdb:vortex-compact 48621822 47868603 1.02
tpcds_q58/duckdb:vortex-compact 40470055 39889377 1.01
tpcds_q59/duckdb:vortex-compact 67977636 67322489 1.01
tpcds_q60/duckdb:vortex-compact 147025134 152747085 0.96
tpcds_q61/duckdb:vortex-compact 54050191 56675634 0.95
tpcds_q62/duckdb:vortex-compact 🚀 21507585 29507796 0.73
tpcds_q63/duckdb:vortex-compact 22454593 24662702 0.91
tpcds_q64/duckdb:vortex-compact 108009598 108346841 1.00
tpcds_q65/duckdb:vortex-compact 28152145 29586425 0.95
tpcds_q66/duckdb:vortex-compact 97162392 105440674 0.92
tpcds_q67/duckdb:vortex-compact 151046562 158874711 0.95
tpcds_q68/duckdb:vortex-compact 56560384 58297855 0.97
tpcds_q69/duckdb:vortex-compact 49045979 49635389 0.99
tpcds_q70/duckdb:vortex-compact 29404863 29462157 1.00
tpcds_q71/duckdb:vortex-compact 27413133 27455031 1.00
tpcds_q72/duckdb:vortex-compact 200766092 201589554 1.00
tpcds_q73/duckdb:vortex-compact 28755366 28626044 1.00
tpcds_q74/duckdb:vortex-compact 57490049 58447717 0.98
tpcds_q75/duckdb:vortex-compact 71415782 77695869 0.92
tpcds_q76/duckdb:vortex-compact 🚀 128231741 142815839 0.90
tpcds_q77/duckdb:vortex-compact 🚀 138522077 156592925 0.88
tpcds_q78/duckdb:vortex-compact 🚀 89006126 114895923 0.77
tpcds_q79/duckdb:vortex-compact 🚀 61644188 70929267 0.87
tpcds_q80/duckdb:vortex-compact 166828359 179358287 0.93
tpcds_q81/duckdb:vortex-compact 🚀 38819320 44400372 0.87
tpcds_q82/duckdb:vortex-compact 31707090 34102363 0.93
tpcds_q83/duckdb:vortex-compact 44831277 46437656 0.97
tpcds_q84/duckdb:vortex-compact 21115474 22532719 0.94
tpcds_q85/duckdb:vortex-compact 61079085 63835356 0.96
tpcds_q86/duckdb:vortex-compact 🚨 24096449 21540897 1.12
tpcds_q87/duckdb:vortex-compact 44549036 44908109 0.99
tpcds_q88/duckdb:vortex-compact 45663417 45214557 1.01
tpcds_q89/duckdb:vortex-compact 23667323 23347174 1.01
tpcds_q90/duckdb:vortex-compact 16099130 16175007 1.00
tpcds_q91/duckdb:vortex-compact 46702579 47378369 0.99
tpcds_q92/duckdb:vortex-compact 🚀 20156229 22751605 0.89
tpcds_q93/duckdb:vortex-compact 37462649 39402207 0.95
tpcds_q94/duckdb:vortex-compact 27448781 29027327 0.95
tpcds_q95/duckdb:vortex-compact 164891955 165771199 0.99
tpcds_q96/duckdb:vortex-compact 🚨 23791637 20028661 1.19
tpcds_q97/duckdb:vortex-compact 43895099 45657209 0.96
tpcds_q98/duckdb:vortex-compact 🚀 23031967 32630755 0.71
tpcds_q99/duckdb:vortex-compact 🚀 35946114 42452097 0.85
duckdb / parquet (0.932x ➖, 22↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚀 45167521 59134889 0.76
tpcds_q02/duckdb:parquet 61058693 61493057 0.99
tpcds_q03/duckdb:parquet 11867137 12261748 0.97
tpcds_q04/duckdb:parquet 127483347 133129647 0.96
tpcds_q05/duckdb:parquet 72560647 76570925 0.95
tpcds_q06/duckdb:parquet 28598329 29893736 0.96
tpcds_q07/duckdb:parquet 🚀 22997402 28553197 0.81
tpcds_q08/duckdb:parquet 🚀 28148706 37214559 0.76
tpcds_q09/duckdb:parquet 39898961 39865067 1.00
tpcds_q10/duckdb:parquet 34969432 36175993 0.97
tpcds_q11/duckdb:parquet 🚀 87993378 108521328 0.81
tpcds_q12/duckdb:parquet 🚀 14380660 20037241 0.72
tpcds_q13/duckdb:parquet 33846120 33071918 1.02
tpcds_q14/duckdb:parquet 161926438 158087759 1.02
tpcds_q15/duckdb:parquet 🚀 30928195 37194198 0.83
tpcds_q16/duckdb:parquet 🚀 22292977 29016175 0.77
tpcds_q17/duckdb:parquet 38349002 38791147 0.99
tpcds_q18/duckdb:parquet 46619978 46353329 1.01
tpcds_q19/duckdb:parquet 30843071 30041530 1.03
tpcds_q20/duckdb:parquet 🚀 15659228 21494837 0.73
tpcds_q21/duckdb:parquet 🚀 11161191 13471706 0.83
tpcds_q22/duckdb:parquet 68502488 70719757 0.97
tpcds_q23/duckdb:parquet 114958311 121408876 0.95
tpcds_q24/duckdb:parquet 44589781 46041078 0.97
tpcds_q25/duckdb:parquet 32251935 32637012 0.99
tpcds_q26/duckdb:parquet 38351146 40166538 0.95
tpcds_q27/duckdb:parquet 88494177 89934242 0.98
tpcds_q28/duckdb:parquet 37183278 37516189 0.99
tpcds_q29/duckdb:parquet 36899789 40861501 0.90
tpcds_q30/duckdb:parquet 🚀 39687952 49154567 0.81
tpcds_q31/duckdb:parquet 22692222 24027343 0.94
tpcds_q32/duckdb:parquet 11883124 12592010 0.94
tpcds_q33/duckdb:parquet 73795202 71756597 1.03
tpcds_q34/duckdb:parquet 🚀 21993380 27546835 0.80
tpcds_q35/duckdb:parquet 🚀 60612506 76302643 0.79
tpcds_q36/duckdb:parquet 20276535 22034646 0.92
tpcds_q37/duckdb:parquet 13367572 13355594 1.00
tpcds_q38/duckdb:parquet 33649044 35636599 0.94
tpcds_q39/duckdb:parquet 🚀 32995064 43040749 0.77
tpcds_q40/duckdb:parquet 🚀 18359220 25850542 0.71
tpcds_q41/duckdb:parquet 🚀 7465944 11005357 0.68
tpcds_q42/duckdb:parquet 10343366 10390677 1.00
tpcds_q43/duckdb:parquet 15344871 16991368 0.90
tpcds_q44/duckdb:parquet 21017899 22325448 0.94
tpcds_q45/duckdb:parquet 27025072 28148871 0.96
tpcds_q46/duckdb:parquet 🚀 46250899 57168978 0.81
tpcds_q47/duckdb:parquet 🚀 45712371 64452111 0.71
tpcds_q48/duckdb:parquet 31696182 31689769 1.00
tpcds_q49/duckdb:parquet 🚀 23783765 26879974 0.88
tpcds_q50/duckdb:parquet 25040973 25473349 0.98
tpcds_q51/duckdb:parquet 🚀 94335596 124557270 0.76
tpcds_q52/duckdb:parquet 11052866 11223212 0.98
tpcds_q53/duckdb:parquet 16411386 15782586 1.04
tpcds_q54/duckdb:parquet 40933063 43727535 0.94
tpcds_q55/duckdb:parquet 10896592 11075715 0.98
tpcds_q56/duckdb:parquet 69094124 71121528 0.97
tpcds_q57/duckdb:parquet 🚀 35395399 47747994 0.74
tpcds_q58/duckdb:parquet 21800796 21339351 1.02
tpcds_q59/duckdb:parquet 36632335 36365367 1.01
tpcds_q60/duckdb:parquet 75349614 74117613 1.02
tpcds_q61/duckdb:parquet 🚀 30843163 35783619 0.86
tpcds_q62/duckdb:parquet 12849030 12974202 0.99
tpcds_q63/duckdb:parquet 15789327 15958602 0.99
tpcds_q64/duckdb:parquet 74031071 75716583 0.98
tpcds_q65/duckdb:parquet 🚀 20766191 23730829 0.88
tpcds_q66/duckdb:parquet 56574163 56571447 1.00
tpcds_q67/duckdb:parquet 140019903 146052298 0.96
tpcds_q68/duckdb:parquet 38219158 38805672 0.98
tpcds_q69/duckdb:parquet 38559603 39421671 0.98
tpcds_q70/duckdb:parquet 20530335 21012335 0.98
tpcds_q71/duckdb:parquet 19162074 17938195 1.07
tpcds_q72/duckdb:parquet 166046737 166456924 1.00
tpcds_q73/duckdb:parquet 18532938 17982724 1.03
tpcds_q74/duckdb:parquet 50744755 50642837 1.00
tpcds_q75/duckdb:parquet 54405013 52917065 1.03
tpcds_q76/duckdb:parquet 70935308 71706478 0.99
tpcds_q77/duckdb:parquet 64143010 63817746 1.01
tpcds_q78/duckdb:parquet 76662155 80296244 0.95
tpcds_q79/duckdb:parquet 27977854 28427909 0.98
tpcds_q80/duckdb:parquet 86311865 84647659 1.02
tpcds_q81/duckdb:parquet 47527881 46744629 1.02
tpcds_q82/duckdb:parquet 16300199 17213151 0.95
tpcds_q83/duckdb:parquet 16917354 16949754 1.00
tpcds_q84/duckdb:parquet 19456615 20528043 0.95
tpcds_q85/duckdb:parquet 40242925 40680197 0.99
tpcds_q86/duckdb:parquet 12447157 13101912 0.95
tpcds_q87/duckdb:parquet 38702375 38263829 1.01
tpcds_q88/duckdb:parquet 29670684 29696466 1.00
tpcds_q89/duckdb:parquet 17462088 18119416 0.96
tpcds_q90/duckdb:parquet 7628572 7616660 1.00
tpcds_q91/duckdb:parquet 22650753 23520748 0.96
tpcds_q92/duckdb:parquet 12234656 12608541 0.97
tpcds_q93/duckdb:parquet 30473180 29655635 1.03
tpcds_q94/duckdb:parquet 16737323 18430165 0.91
tpcds_q95/duckdb:parquet 134707665 135954870 0.99
tpcds_q96/duckdb:parquet 9433240 10372163 0.91
tpcds_q97/duckdb:parquet 35399558 35856518 0.99
tpcds_q98/duckdb:parquet 18588855 18640581 1.00
tpcds_q99/duckdb:parquet 20043261 20321813 0.99
duckdb / duckdb (0.932x ➖, 22↑ 1↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20361704 19278697 1.06
tpcds_q02/duckdb:duckdb 🚀 16920361 19595047 0.86
tpcds_q03/duckdb:duckdb 🚀 8311190 12084145 0.69
tpcds_q04/duckdb:duckdb 162923174 165715624 0.98
tpcds_q05/duckdb:duckdb 🚀 18754658 23591232 0.79
tpcds_q06/duckdb:duckdb 22467406 21927996 1.02
tpcds_q07/duckdb:duckdb 39093638 38617414 1.01
tpcds_q08/duckdb:duckdb 120974490 123915706 0.98
tpcds_q09/duckdb:duckdb 19517885 19580991 1.00
tpcds_q10/duckdb:duckdb 22655952 23900089 0.95
tpcds_q11/duckdb:duckdb 141751266 145713715 0.97
tpcds_q12/duckdb:duckdb 10690247 11394415 0.94
tpcds_q13/duckdb:duckdb 23689324 24000418 0.99
tpcds_q14/duckdb:duckdb 94713436 94871472 1.00
tpcds_q15/duckdb:duckdb 🚀 24291238 33858947 0.72
tpcds_q16/duckdb:duckdb 17288584 18652582 0.93
tpcds_q17/duckdb:duckdb 22532925 21174331 1.06
tpcds_q18/duckdb:duckdb 45441416 44468452 1.02
tpcds_q19/duckdb:duckdb 16320858 16400633 1.00
tpcds_q20/duckdb:duckdb 🚀 11231303 12717715 0.88
tpcds_q21/duckdb:duckdb 🚀 6499057 10560432 0.62
tpcds_q22/duckdb:duckdb 61015787 66974225 0.91
tpcds_q23/duckdb:duckdb 81121266 81812184 0.99
tpcds_q24/duckdb:duckdb 🚀 23573550 30719270 0.77
tpcds_q25/duckdb:duckdb 🚀 16668906 23215291 0.72
tpcds_q26/duckdb:duckdb 24028552 26551755 0.90
tpcds_q27/duckdb:duckdb 40265753 41362721 0.97
tpcds_q28/duckdb:duckdb 21249398 22016099 0.97
tpcds_q29/duckdb:duckdb 🚀 20326171 26789295 0.76
tpcds_q30/duckdb:duckdb 🚀 28173923 37572308 0.75
tpcds_q31/duckdb:duckdb 18950355 20282748 0.93
tpcds_q32/duckdb:duckdb 7442326 7755216 0.96
tpcds_q33/duckdb:duckdb 13028070 12678963 1.03
tpcds_q34/duckdb:duckdb 14969703 16080939 0.93
tpcds_q35/duckdb:duckdb 🚀 32687927 42785489 0.76
tpcds_q36/duckdb:duckdb 67650435 73947072 0.91
tpcds_q37/duckdb:duckdb 7598652 7753557 0.98
tpcds_q38/duckdb:duckdb 31321199 29755746 1.05
tpcds_q39/duckdb:duckdb 🚀 25706882 32448638 0.79
tpcds_q40/duckdb:duckdb 🚀 14758166 19425231 0.76
tpcds_q41/duckdb:duckdb 🚀 8141848 11400255 0.71
tpcds_q42/duckdb:duckdb 6122708 6224600 0.98
tpcds_q43/duckdb:duckdb 11164614 11383204 0.98
tpcds_q44/duckdb:duckdb 13651401 13869191 0.98
tpcds_q45/duckdb:duckdb 17416941 17411992 1.00
tpcds_q46/duckdb:duckdb 35143971 36391561 0.97
tpcds_q47/duckdb:duckdb 40704373 39622122 1.03
tpcds_q48/duckdb:duckdb 21384578 21417892 1.00
tpcds_q49/duckdb:duckdb 16451899 17594246 0.94
tpcds_q50/duckdb:duckdb 🚀 14013920 17891682 0.78
tpcds_q51/duckdb:duckdb 90259315 96119503 0.94
tpcds_q52/duckdb:duckdb 7324886 7396323 0.99
tpcds_q53/duckdb:duckdb 11771410 11899357 0.99
tpcds_q54/duckdb:duckdb 🚀 15863285 18129624 0.87
tpcds_q55/duckdb:duckdb 🚀 6767433 7843926 0.86
tpcds_q56/duckdb:duckdb 13604623 13990147 0.97
tpcds_q57/duckdb:duckdb 31123998 32859682 0.95
tpcds_q58/duckdb:duckdb 11699047 12933792 0.90
tpcds_q59/duckdb:duckdb 35131018 36022970 0.98
tpcds_q60/duckdb:duckdb 🚀 13798855 17592927 0.78
tpcds_q61/duckdb:duckdb 13812843 14680803 0.94
tpcds_q62/duckdb:duckdb 9259035 10230142 0.91
tpcds_q63/duckdb:duckdb 11343652 11546881 0.98
tpcds_q64/duckdb:duckdb 53188407 55617635 0.96
tpcds_q65/duckdb:duckdb 🚀 31813053 40168322 0.79
tpcds_q66/duckdb:duckdb 24169701 25222435 0.96
tpcds_q67/duckdb:duckdb 127250562 129569251 0.98
tpcds_q68/duckdb:duckdb 24810356 24919791 1.00
tpcds_q69/duckdb:duckdb 23401040 23814419 0.98
tpcds_q70/duckdb:duckdb 13799275 14617581 0.94
tpcds_q71/duckdb:duckdb 12692533 13836104 0.92
tpcds_q72/duckdb:duckdb 43129157 43524687 0.99
tpcds_q73/duckdb:duckdb 10757713 11548639 0.93
tpcds_q74/duckdb:duckdb 97736501 99075884 0.99
tpcds_q75/duckdb:duckdb 42621037 40857637 1.04
tpcds_q76/duckdb:duckdb 🚀 11048664 12318599 0.90
tpcds_q77/duckdb:duckdb 12134316 11753185 1.03
tpcds_q78/duckdb:duckdb 62864446 61423628 1.02
tpcds_q79/duckdb:duckdb 17581775 17605600 1.00
tpcds_q80/duckdb:duckdb 28586955 29016470 0.99
tpcds_q81/duckdb:duckdb 37714792 37719866 1.00
tpcds_q82/duckdb:duckdb 8408222 9173874 0.92
tpcds_q83/duckdb:duckdb 9039062 9591489 0.94
tpcds_q84/duckdb:duckdb 13334375 14175780 0.94
tpcds_q85/duckdb:duckdb 22830151 23766644 0.96
tpcds_q86/duckdb:duckdb 11470967 10912822 1.05
tpcds_q87/duckdb:duckdb 33842615 33262825 1.02
tpcds_q88/duckdb:duckdb 23949158 24783168 0.97
tpcds_q89/duckdb:duckdb 13551673 12826218 1.06
tpcds_q90/duckdb:duckdb 5671848 5400782 1.05
tpcds_q91/duckdb:duckdb 12989530 13473626 0.96
tpcds_q92/duckdb:duckdb 9124132 9033344 1.01
tpcds_q93/duckdb:duckdb 🚀 20773627 24018241 0.86
tpcds_q94/duckdb:duckdb 12576927 13719886 0.92
tpcds_q95/duckdb:duckdb 🚨 130081984 108999877 1.19
tpcds_q96/duckdb:duckdb 4330779 4665637 0.93
tpcds_q97/duckdb:duckdb 29272518 32054080 0.91
tpcds_q98/duckdb:duckdb 🚀 12964503 14787192 0.88
tpcds_q99/duckdb:duckdb 16558621 16070232 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.2% -11.4% +10.3% +16.2% ➖ noise
1 datafusion:vortex-file-compressed -34.3% -11.4% -25.9% +16.2% ✅ faster
1 duckdb:duckdb +5.6% -11.4% +19.2% +22.9% ➖ noise
1 duckdb:vortex-compact +1.1% -11.4% +14.1% +16.2% ➖ noise
1 duckdb:vortex-file-compressed +4.4% -11.4% +17.7% +16.2% 🚨 regression
2 datafusion:vortex-compact +0.7% -2.1% +2.9% +16.2% ➖ noise
2 datafusion:vortex-file-compressed -2.8% -2.1% -0.7% +16.3% ➖ noise
2 duckdb:duckdb -13.6% -2.1% -11.8% +19.6% ➖ noise
2 duckdb:vortex-compact -5.6% -2.1% -3.6% +16.2% ➖ noise
2 duckdb:vortex-file-compressed -3.6% -2.1% -1.5% +16.2% ➖ noise
3 datafusion:vortex-compact -12.6% +1.4% -13.8% +17.0% ➖ noise
3 datafusion:vortex-file-compressed -7.9% +1.4% -9.2% +16.2% ➖ noise
3 duckdb:duckdb -31.2% +1.4% -32.2% +19.0% ✅ faster
3 duckdb:vortex-compact -2.6% +1.4% -3.9% +17.1% ➖ noise
3 duckdb:vortex-file-compressed -9.9% +1.4% -11.1% +16.2% ➖ noise
4 datafusion:vortex-compact -9.8% -3.2% -6.8% +16.2% ➖ noise
4 datafusion:vortex-file-compressed -11.9% -3.2% -9.0% +25.6% ➖ noise
4 duckdb:duckdb -1.7% -3.2% +1.5% +16.6% ➖ noise
4 duckdb:vortex-compact +0.7% -3.2% +4.0% +16.2% ➖ noise
4 duckdb:vortex-file-compressed -0.2% -3.2% +3.0% +16.2% ➖ noise
5 datafusion:vortex-compact -15.1% -3.3% -12.1% +16.2% ➖ noise
5 datafusion:vortex-file-compressed -5.5% -3.3% -2.3% +16.2% ➖ noise
5 duckdb:duckdb -20.5% -3.3% -17.8% +23.4% ➖ noise
5 duckdb:vortex-compact -0.8% -3.3% +2.6% +16.2% ➖ noise
5 duckdb:vortex-file-compressed -7.2% -3.3% -4.0% +16.2% ➖ noise
6 datafusion:vortex-compact -5.3% -2.2% -3.1% +16.9% ➖ noise
6 datafusion:vortex-file-compressed -4.7% -2.2% -2.5% +16.2% ➖ noise
6 duckdb:duckdb +2.5% -2.2% +4.8% +16.2% ➖ noise
6 duckdb:vortex-compact -0.3% -2.2% +2.0% +16.2% ➖ noise
6 duckdb:vortex-file-compressed -6.0% -2.2% -3.9% +16.2% ➖ noise
7 datafusion:vortex-compact -13.2% -8.4% -5.3% +16.2% ➖ noise
7 datafusion:vortex-file-compressed -20.1% -8.4% -12.8% +22.7% ➖ noise
7 duckdb:duckdb +1.2% -8.4% +10.5% +19.8% ➖ noise
7 duckdb:vortex-compact -4.4% -8.4% +4.3% +16.2% ➖ noise
7 duckdb:vortex-file-compressed -17.3% -8.4% -9.8% +16.2% ➖ noise
8 datafusion:vortex-compact -8.4% -10.0% +1.9% +16.2% ➖ noise
8 datafusion:vortex-file-compressed -28.0% -10.0% -19.9% +16.2% ✅ faster
8 duckdb:duckdb -2.4% -10.0% +8.5% +16.2% ➖ noise
8 duckdb:vortex-compact -7.4% -10.0% +2.9% +16.2% ➖ noise
8 duckdb:vortex-file-compressed -3.8% -10.0% +7.0% +16.2% ➖ noise
9 datafusion:vortex-compact -15.4% +0.0% -15.4% +16.2% ✅ faster
9 datafusion:vortex-file-compressed -2.1% +0.0% -2.1% +28.8% ➖ noise
9 duckdb:duckdb -0.3% +0.0% -0.3% +16.2% ➖ noise
9 duckdb:vortex-compact -9.5% +0.0% -9.5% +16.2% ➖ noise
9 duckdb:vortex-file-compressed -5.2% +0.0% -5.2% +16.2% ➖ noise
10 datafusion:vortex-compact +0.3% -2.6% +3.0% +16.2% ➖ noise
10 datafusion:vortex-file-compressed -0.6% -2.6% +2.1% +16.2% ➖ noise
10 duckdb:duckdb -5.2% -2.6% -2.6% +16.2% ➖ noise
10 duckdb:vortex-compact -19.3% -2.6% -17.2% +16.2% ✅ faster
10 duckdb:vortex-file-compressed +0.1% -2.6% +2.8% +16.2% ➖ noise
11 datafusion:vortex-compact -12.0% -12.1% +0.2% +16.2% ➖ noise
11 datafusion:vortex-file-compressed -7.0% -12.1% +5.8% +21.4% ➖ noise
11 duckdb:duckdb -2.7% -12.1% +10.7% +16.2% ➖ noise
11 duckdb:vortex-compact -5.6% -12.1% +7.4% +16.2% ➖ noise
11 duckdb:vortex-file-compressed -2.1% -12.1% +11.4% +16.2% ➖ noise
12 datafusion:vortex-compact -18.4% -17.9% -0.6% +17.3% ➖ noise
12 datafusion:vortex-file-compressed -1.5% -17.9% +19.9% +16.2% 🚨 regression
12 duckdb:duckdb -6.2% -17.9% +14.2% +16.2% ➖ noise
12 duckdb:vortex-compact -2.8% -17.9% +18.4% +17.3% 🚨 regression
12 duckdb:vortex-file-compressed +7.9% -17.9% +31.4% +17.7% 🚨 regression
13 datafusion:vortex-compact -7.8% -1.6% -6.3% +16.2% ➖ noise
13 datafusion:vortex-file-compressed -2.9% -1.6% -1.3% +16.2% ➖ noise
13 duckdb:duckdb -1.3% -1.6% +0.3% +16.2% ➖ noise
13 duckdb:vortex-compact -2.0% -1.6% -0.4% +16.2% ➖ noise
13 duckdb:vortex-file-compressed -3.0% -1.6% -1.4% +16.2% ➖ noise
14 datafusion:vortex-compact -12.6% +1.5% -13.9% +16.2% ➖ noise
14 datafusion:vortex-file-compressed -5.7% +1.5% -7.0% +16.2% ➖ noise
14 duckdb:duckdb -0.2% +1.5% -1.6% +16.2% ➖ noise
14 duckdb:vortex-compact -8.6% +1.5% -10.0% +16.2% ➖ noise
14 duckdb:vortex-file-compressed +2.0% +1.5% +0.6% +16.2% ➖ noise
15 datafusion:vortex-compact -20.7% -9.2% -12.6% +16.2% ➖ noise
15 datafusion:vortex-file-compressed -4.7% -9.2% +5.0% +16.2% ➖ noise
15 duckdb:duckdb -28.3% -9.2% -21.0% +19.1% ✅ faster
15 duckdb:vortex-compact -7.2% -9.2% +2.2% +17.0% ➖ noise
15 duckdb:vortex-file-compressed -2.6% -9.2% +7.4% +16.4% ➖ noise
16 datafusion:vortex-compact -3.7% -13.7% +11.5% +16.2% ➖ noise
16 datafusion:vortex-file-compressed -0.8% -13.7% +14.9% +16.2% ➖ noise
16 duckdb:duckdb -7.3% -13.7% +7.4% +24.5% ➖ noise
16 duckdb:vortex-compact -30.6% -13.7% -19.7% +19.2% ✅ faster
16 duckdb:vortex-file-compressed -5.2% -13.7% +9.8% +16.2% ➖ noise
17 datafusion:vortex-compact -3.9% +1.5% -5.3% +16.2% ➖ noise
17 datafusion:vortex-file-compressed -2.6% +1.5% -4.0% +16.2% ➖ noise
17 duckdb:duckdb +6.4% +1.5% +4.9% +16.2% ➖ noise
17 duckdb:vortex-compact -12.3% +1.5% -13.6% +17.4% ➖ noise
17 duckdb:vortex-file-compressed -7.8% +1.5% -9.2% +16.2% ➖ noise
18 datafusion:vortex-compact -13.4% +1.4% -14.6% +16.2% ✅ faster
18 datafusion:vortex-file-compressed -20.3% +1.4% -21.4% +16.2% ✅ faster
18 duckdb:duckdb +2.2% +1.4% +0.8% +16.2% ➖ noise
18 duckdb:vortex-compact -5.3% +1.4% -6.5% +16.2% ➖ noise
18 duckdb:vortex-file-compressed -8.4% +1.4% -9.6% +16.2% ➖ noise
19 datafusion:vortex-compact -12.8% +1.9% -14.4% +16.2% ✅ faster
19 datafusion:vortex-file-compressed +2.2% +1.9% +0.3% +16.2% ➖ noise
19 duckdb:duckdb -0.5% +1.9% -2.4% +16.2% ➖ noise
19 duckdb:vortex-compact -2.0% +1.9% -3.8% +16.2% ➖ noise
19 duckdb:vortex-file-compressed -11.6% +1.9% -13.3% +16.2% ➖ noise
20 datafusion:vortex-compact -5.6% -14.7% +10.7% +16.2% ➖ noise
20 datafusion:vortex-file-compressed -1.1% -14.7% +16.0% +16.2% ➖ noise
20 duckdb:duckdb -11.7% -14.7% +3.6% +16.2% ➖ noise
20 duckdb:vortex-compact -7.1% -14.7% +8.9% +16.2% ➖ noise
20 duckdb:vortex-file-compressed -11.1% -14.7% +4.3% +16.2% ➖ noise
21 datafusion:vortex-compact -10.3% -11.3% +1.1% +16.2% ➖ noise
21 datafusion:vortex-file-compressed -14.8% -11.3% -3.9% +19.4% ➖ noise
21 duckdb:duckdb -38.5% -11.3% -30.6% +18.4% ✅ faster
21 duckdb:vortex-compact -1.8% -11.3% +10.7% +16.2% ➖ noise
21 duckdb:vortex-file-compressed +2.8% -11.3% +15.8% +16.7% ➖ noise
22 datafusion:vortex-compact -14.4% -6.7% -8.3% +16.2% ➖ noise
22 datafusion:vortex-file-compressed -1.8% -6.7% +5.2% +16.2% ➖ noise
22 duckdb:duckdb -8.9% -6.7% -2.4% +38.3% ➖ noise
22 duckdb:vortex-compact -8.4% -6.7% -1.9% +26.7% ➖ noise
22 duckdb:vortex-file-compressed -2.6% -6.7% +4.3% +16.2% ➖ noise
23 datafusion:vortex-compact -8.5% -3.4% -5.3% +16.2% ➖ noise
23 datafusion:vortex-file-compressed -5.2% -3.4% -1.8% +18.0% ➖ noise
23 duckdb:duckdb -0.8% -3.4% +2.6% +16.2% ➖ noise
23 duckdb:vortex-compact -4.5% -3.4% -1.1% +16.2% ➖ noise
23 duckdb:vortex-file-compressed +6.0% -3.4% +9.7% +16.2% ➖ noise
24 datafusion:vortex-compact -11.9% -1.4% -10.6% +16.2% ➖ noise
24 datafusion:vortex-file-compressed -7.8% -1.4% -6.5% +16.2% ➖ noise
24 duckdb:duckdb -23.3% -1.4% -22.1% +16.2% ✅ faster
24 duckdb:vortex-compact -9.4% -1.4% -8.1% +20.0% ➖ noise
24 duckdb:vortex-file-compressed -2.1% -1.4% -0.6% +16.2% ➖ noise
25 datafusion:vortex-compact -17.3% +0.0% -17.4% +16.2% ✅ faster
25 datafusion:vortex-file-compressed -0.4% +0.0% -0.5% +16.2% ➖ noise
25 duckdb:duckdb -28.2% +0.0% -28.2% +16.2% ✅ faster
25 duckdb:vortex-compact -24.3% +0.0% -24.3% +16.2% ✅ faster
25 duckdb:vortex-file-compressed -8.1% +0.0% -8.1% +16.2% ➖ noise
26 datafusion:vortex-compact -5.5% -2.5% -3.1% +19.8% ➖ noise
26 datafusion:vortex-file-compressed -17.5% -2.5% -15.4% +16.2% ✅ faster
26 duckdb:duckdb -9.5% -2.5% -7.2% +19.8% ➖ noise
26 duckdb:vortex-compact -9.9% -2.5% -7.7% +16.2% ➖ noise
26 duckdb:vortex-file-compressed +0.2% -2.5% +2.7% +16.2% ➖ noise
27 datafusion:vortex-compact -5.2% -2.6% -2.8% +16.2% ➖ noise
27 datafusion:vortex-file-compressed -6.0% -2.6% -3.5% +16.2% ➖ noise
27 duckdb:duckdb -2.7% -2.6% -0.1% +21.0% ➖ noise
27 duckdb:vortex-compact -2.2% -2.6% +0.4% +16.2% ➖ noise
27 duckdb:vortex-file-compressed -2.3% -2.6% +0.3% +16.2% ➖ noise
28 datafusion:vortex-compact -2.4% -0.4% -2.0% +16.2% ➖ noise
28 datafusion:vortex-file-compressed +1.1% -0.4% +1.4% +16.2% ➖ noise
28 duckdb:duckdb -3.5% -0.4% -3.1% +16.2% ➖ noise
28 duckdb:vortex-compact -1.5% -0.4% -1.1% +16.2% ➖ noise
28 duckdb:vortex-file-compressed -2.8% -0.4% -2.4% +16.2% ➖ noise
29 datafusion:vortex-compact +5.0% -3.8% +9.1% +16.2% ➖ noise
29 datafusion:vortex-file-compressed -21.6% -3.8% -18.6% +16.2% ✅ faster
29 duckdb:duckdb -24.1% -3.8% -21.2% +16.2% ✅ faster
29 duckdb:vortex-compact -1.3% -3.8% +2.6% +16.2% ➖ noise
29 duckdb:vortex-file-compressed +0.6% -3.8% +4.5% +16.8% ➖ noise
30 datafusion:vortex-compact -0.0% -10.3% +11.4% +16.2% ➖ noise
30 datafusion:vortex-file-compressed -10.5% -10.3% -0.2% +18.8% ➖ noise
30 duckdb:duckdb -25.0% -10.3% -16.4% +16.2% ✅ faster
30 duckdb:vortex-compact -9.1% -10.3% +1.4% +16.3% ➖ noise
30 duckdb:vortex-file-compressed -6.5% -10.3% +4.2% +16.2% ➖ noise
31 datafusion:vortex-compact -3.6% -3.3% -0.4% +16.2% ➖ noise
31 datafusion:vortex-file-compressed -3.7% -3.3% -0.5% +16.2% ➖ noise
31 duckdb:duckdb -6.6% -3.3% -3.4% +16.2% ➖ noise
31 duckdb:vortex-compact -10.2% -3.3% -7.2% +16.2% ➖ noise
31 duckdb:vortex-file-compressed -3.4% -3.3% -0.2% +16.2% ➖ noise
32 datafusion:vortex-compact -15.2% -2.8% -12.8% +16.2% ➖ noise
32 datafusion:vortex-file-compressed -4.4% -2.8% -1.7% +16.2% ➖ noise
32 duckdb:duckdb -4.0% -2.8% -1.3% +23.9% ➖ noise
32 duckdb:vortex-compact -7.0% -2.8% -4.4% +18.9% ➖ noise
32 duckdb:vortex-file-compressed +10.7% -2.8% +13.8% +17.1% ➖ noise
33 datafusion:vortex-compact -7.5% +1.9% -9.2% +16.2% ➖ noise
33 datafusion:vortex-file-compressed -10.7% +1.9% -12.4% +16.2% ➖ noise
33 duckdb:duckdb +2.8% +1.9% +0.9% +16.2% ➖ noise
33 duckdb:vortex-compact +1.8% +1.9% -0.1% +17.6% ➖ noise
33 duckdb:vortex-file-compressed +2.1% +1.9% +0.2% +16.2% ➖ noise
34 datafusion:vortex-compact -4.5% -12.7% +9.4% +16.2% ➖ noise
34 datafusion:vortex-file-compressed -33.3% -12.7% -23.6% +16.2% ✅ faster
34 duckdb:duckdb -6.9% -12.7% +6.6% +16.2% ➖ noise
34 duckdb:vortex-compact -10.9% -12.7% +2.0% +16.2% ➖ noise
34 duckdb:vortex-file-compressed -9.9% -12.7% +3.2% +16.2% ➖ noise
35 datafusion:vortex-compact -2.9% -11.7% +10.0% +16.2% ➖ noise
35 datafusion:vortex-file-compressed -25.7% -11.7% -15.8% +16.2% ✅ faster
35 duckdb:duckdb -23.6% -11.7% -13.4% +16.3% ➖ noise
35 duckdb:vortex-compact -11.0% -11.7% +0.9% +19.4% ➖ noise
35 duckdb:vortex-file-compressed -8.0% -11.7% +4.3% +16.4% ➖ noise
36 datafusion:vortex-compact -6.8% -4.0% -2.9% +16.2% ➖ noise
36 datafusion:vortex-file-compressed -6.9% -4.0% -3.0% +16.2% ➖ noise
36 duckdb:duckdb -8.5% -4.0% -4.7% +16.2% ➖ noise
36 duckdb:vortex-compact -7.7% -4.0% -3.8% +16.2% ➖ noise
36 duckdb:vortex-file-compressed +3.6% -4.0% +7.9% +16.2% ➖ noise
37 datafusion:vortex-compact +0.1% +1.6% -1.5% +16.2% ➖ noise
37 datafusion:vortex-file-compressed +0.8% +1.6% -0.8% +16.2% ➖ noise
37 duckdb:duckdb -2.0% +1.6% -3.6% +27.1% ➖ noise
37 duckdb:vortex-compact -8.4% +1.6% -9.9% +19.6% ➖ noise
37 duckdb:vortex-file-compressed -9.1% +1.6% -10.6% +28.4% ➖ noise
38 datafusion:vortex-compact -7.6% -3.7% -4.1% +16.2% ➖ noise
38 datafusion:vortex-file-compressed -2.7% -3.7% +1.0% +16.2% ➖ noise
38 duckdb:duckdb +5.3% -3.7% +9.3% +16.2% ➖ noise
38 duckdb:vortex-compact -12.1% -3.7% -8.8% +19.1% ➖ noise
38 duckdb:vortex-file-compressed +5.5% -3.7% +9.5% +16.2% ➖ noise
39 datafusion:vortex-compact -1.2% -11.3% +11.4% +19.3% ➖ noise
39 datafusion:vortex-file-compressed -16.1% -11.3% -5.4% +29.7% ➖ noise
39 duckdb:duckdb -20.8% -11.3% -10.7% +24.4% ➖ noise
39 duckdb:vortex-compact -3.6% -11.3% +8.7% +16.2% ➖ noise
39 duckdb:vortex-file-compressed -2.8% -11.3% +9.6% +16.2% ➖ noise
40 datafusion:vortex-compact -1.4% -15.8% +17.1% +16.2% 🚨 regression
40 datafusion:vortex-file-compressed +3.7% -15.8% +23.1% +16.2% 🚨 regression
40 duckdb:duckdb -24.0% -15.8% -9.8% +21.8% ➖ noise
40 duckdb:vortex-compact -16.7% -15.8% -1.0% +16.2% ➖ noise
40 duckdb:vortex-file-compressed -1.9% -15.8% +16.6% +16.2% 🚨 regression
41 datafusion:vortex-compact +2.2% -19.2% +26.6% +16.2% 🚨 regression
41 datafusion:vortex-file-compressed -0.4% -19.2% +23.3% +16.2% 🚨 regression
41 duckdb:duckdb -28.6% -19.2% -11.6% +18.2% ➖ noise
41 duckdb:vortex-compact -3.2% -19.2% +19.8% +16.2% 🚨 regression
41 duckdb:vortex-file-compressed +7.2% -19.2% +32.8% +16.2% 🚨 regression
42 datafusion:vortex-compact +1.2% -2.7% +3.9% +16.2% ➖ noise
42 datafusion:vortex-file-compressed +0.7% -2.7% +3.5% +16.2% ➖ noise
42 duckdb:duckdb -1.6% -2.7% +1.1% +18.3% ➖ noise
42 duckdb:vortex-compact -0.8% -2.7% +1.9% +16.2% ➖ noise
42 duckdb:vortex-file-compressed +5.2% -2.7% +8.1% +16.8% ➖ noise
43 datafusion:vortex-compact -6.5% -6.0% -0.5% +16.2% ➖ noise
43 datafusion:vortex-file-compressed -8.7% -6.0% -2.9% +16.2% ➖ noise
43 duckdb:duckdb -1.9% -6.0% +4.4% +16.2% ➖ noise
43 duckdb:vortex-compact -13.9% -6.0% -8.4% +16.2% ➖ noise
43 duckdb:vortex-file-compressed +2.2% -6.0% +8.7% +16.2% ➖ noise
44 datafusion:vortex-compact -7.9% -3.3% -4.7% +16.2% ➖ noise
44 datafusion:vortex-file-compressed -32.9% -3.3% -30.6% +16.2% ✅ faster
44 duckdb:duckdb -1.6% -3.3% +1.8% +16.2% ➖ noise
44 duckdb:vortex-compact -11.9% -3.3% -8.9% +16.2% ➖ noise
44 duckdb:vortex-file-compressed -7.6% -3.3% -4.5% +16.2% ➖ noise
45 datafusion:vortex-compact -0.6% -3.1% +2.5% +16.2% ➖ noise
45 datafusion:vortex-file-compressed -21.8% -3.1% -19.4% +16.2% ✅ faster
45 duckdb:duckdb +0.0% -3.1% +3.2% +16.9% ➖ noise
45 duckdb:vortex-compact +5.5% -3.1% +8.8% +16.2% ➖ noise
45 duckdb:vortex-file-compressed -11.2% -3.1% -8.4% +16.2% ➖ noise
46 datafusion:vortex-compact -0.6% -9.2% +9.5% +16.2% ➖ noise
46 datafusion:vortex-file-compressed -5.7% -9.2% +3.8% +19.3% ➖ noise
46 duckdb:duckdb -3.4% -9.2% +6.4% +16.2% ➖ noise
46 duckdb:vortex-compact +1.6% -9.2% +11.9% +16.2% ➖ noise
46 duckdb:vortex-file-compressed -15.4% -9.2% -6.8% +22.5% ➖ noise
47 datafusion:vortex-compact +1.1% -16.1% +20.6% +18.3% 🚨 regression
47 datafusion:vortex-file-compressed -1.1% -16.1% +17.9% +29.3% ➖ noise
47 duckdb:duckdb +2.7% -16.1% +22.5% +16.2% 🚨 regression
47 duckdb:vortex-compact +1.9% -16.1% +21.5% +16.2% 🚨 regression
47 duckdb:vortex-file-compressed -22.1% -16.1% -7.1% +16.2% ➖ noise
48 datafusion:vortex-compact +0.3% +1.4% -1.2% +16.2% ➖ noise
48 datafusion:vortex-file-compressed -18.9% +1.4% -20.0% +16.2% ✅ faster
48 duckdb:duckdb -0.2% +1.4% -1.6% +16.2% ➖ noise
48 duckdb:vortex-compact -0.2% +1.4% -1.6% +16.2% ➖ noise
48 duckdb:vortex-file-compressed -4.8% +1.4% -6.1% +16.5% ➖ noise
49 datafusion:vortex-compact -19.4% -11.2% -9.2% +16.2% ➖ noise
49 datafusion:vortex-file-compressed -0.7% -11.2% +11.8% +16.2% ➖ noise
49 duckdb:duckdb -6.5% -11.2% +5.3% +18.4% ➖ noise
49 duckdb:vortex-compact +2.0% -11.2% +14.8% +22.9% ➖ noise
49 duckdb:vortex-file-compressed -12.5% -11.2% -1.5% +25.0% ➖ noise
50 datafusion:vortex-compact -4.1% -1.7% -2.5% +16.2% ➖ noise
50 datafusion:vortex-file-compressed +2.9% -1.7% +4.6% +16.2% ➖ noise
50 duckdb:duckdb -21.7% -1.7% -20.3% +16.2% ✅ faster
50 duckdb:vortex-compact +1.2% -1.7% +2.9% +16.2% ➖ noise
50 duckdb:vortex-file-compressed -10.2% -1.7% -8.7% +23.8% ➖ noise
51 datafusion:vortex-compact -9.0% -12.5% +4.0% +18.4% ➖ noise
51 datafusion:vortex-file-compressed +5.8% -12.5% +20.9% +17.3% 🚨 regression
51 duckdb:duckdb -6.1% -12.5% +7.3% +24.4% ➖ noise
51 duckdb:vortex-compact -1.9% -12.5% +12.1% +19.2% ➖ noise
51 duckdb:vortex-file-compressed -9.7% -12.5% +3.2% +27.2% ➖ noise
52 datafusion:vortex-compact -3.4% +2.6% -5.8% +16.2% ➖ noise
52 datafusion:vortex-file-compressed -5.6% +2.6% -8.1% +16.2% ➖ noise
52 duckdb:duckdb -1.0% +2.6% -3.5% +24.1% ➖ noise
52 duckdb:vortex-compact +3.2% +2.6% +0.5% +16.4% ➖ noise
52 duckdb:vortex-file-compressed +7.9% +2.6% +5.2% +16.9% ➖ noise
53 datafusion:vortex-compact -1.6% +1.2% -2.8% +16.2% ➖ noise
53 datafusion:vortex-file-compressed +2.6% +1.2% +1.4% +16.2% ➖ noise
53 duckdb:duckdb -1.1% +1.2% -2.2% +16.2% ➖ noise
53 duckdb:vortex-compact -1.5% +1.2% -2.6% +16.2% ➖ noise
53 duckdb:vortex-file-compressed -10.3% +1.2% -11.3% +16.2% ➖ noise
54 datafusion:vortex-compact -17.2% -6.8% -11.2% +16.2% ➖ noise
54 datafusion:vortex-file-compressed +3.6% -6.8% +11.1% +16.2% ➖ noise
54 duckdb:duckdb -12.5% -6.8% -6.2% +16.2% ➖ noise
54 duckdb:vortex-compact -2.3% -6.8% +4.8% +16.2% ➖ noise
54 duckdb:vortex-file-compressed -17.8% -6.8% -11.9% +23.5% ➖ noise
55 datafusion:vortex-compact -0.4% -5.2% +5.0% +16.4% ➖ noise
55 datafusion:vortex-file-compressed -5.0% -5.2% +0.1% +16.2% ➖ noise
55 duckdb:duckdb -13.7% -5.2% -9.0% +22.2% ➖ noise
55 duckdb:vortex-compact -5.2% -5.2% -0.1% +18.5% ➖ noise
55 duckdb:vortex-file-compressed -29.9% -5.2% -26.1% +25.2% ✅ faster
56 datafusion:vortex-compact -8.7% -5.6% -3.3% +16.2% ➖ noise
56 datafusion:vortex-file-compressed -0.5% -5.6% +5.4% +16.2% ➖ noise
56 duckdb:duckdb -2.8% -5.6% +3.0% +16.2% ➖ noise
56 duckdb:vortex-compact -4.0% -5.6% +1.6% +16.2% ➖ noise
56 duckdb:vortex-file-compressed -17.5% -5.6% -12.6% +23.6% ➖ noise
57 datafusion:vortex-compact -1.4% -17.4% +19.3% +16.2% 🚨 regression
57 datafusion:vortex-file-compressed -3.8% -17.4% +16.4% +16.2% 🚨 regression
57 duckdb:duckdb -5.3% -17.4% +14.6% +19.6% ➖ noise
57 duckdb:vortex-compact +1.6% -17.4% +22.9% +18.1% 🚨 regression
57 duckdb:vortex-file-compressed -20.1% -17.4% -3.2% +22.4% ➖ noise
58 datafusion:vortex-compact -18.0% +1.7% -19.3% +16.2% ✅ faster
58 datafusion:vortex-file-compressed -2.3% +1.7% -3.9% +16.2% ➖ noise
58 duckdb:duckdb -9.5% +1.7% -11.1% +18.1% ➖ noise
58 duckdb:vortex-compact +1.5% +1.7% -0.3% +16.2% ➖ noise
58 duckdb:vortex-file-compressed -14.1% +1.7% -15.6% +24.9% ➖ noise
59 datafusion:vortex-compact -13.8% -0.2% -13.6% +16.2% ➖ noise
59 datafusion:vortex-file-compressed -1.8% -0.2% -1.6% +16.2% ➖ noise
59 duckdb:duckdb -2.5% -0.2% -2.2% +16.5% ➖ noise
59 duckdb:vortex-compact +1.0% -0.2% +1.2% +16.2% ➖ noise
59 duckdb:vortex-file-compressed -13.1% -0.2% -12.9% +16.2% ➖ noise
60 datafusion:vortex-compact -3.8% -4.1% +0.3% +16.2% ➖ noise
60 datafusion:vortex-file-compressed -3.5% -4.1% +0.6% +16.2% ➖ noise
60 duckdb:duckdb -21.6% -4.1% -18.2% +16.2% ✅ faster
60 duckdb:vortex-compact -3.7% -4.1% +0.3% +16.2% ➖ noise
60 duckdb:vortex-file-compressed -13.1% -4.1% -9.4% +23.3% ➖ noise
61 datafusion:vortex-compact -1.3% -7.9% +7.1% +16.2% ➖ noise
61 datafusion:vortex-file-compressed -5.3% -7.9% +2.8% +16.2% ➖ noise
61 duckdb:duckdb -5.9% -7.9% +2.1% +16.2% ➖ noise
61 duckdb:vortex-compact -4.6% -7.9% +3.5% +16.2% ➖ noise
61 duckdb:vortex-file-compressed -17.3% -7.9% -10.2% +17.2% ➖ noise
62 datafusion:vortex-compact -10.6% +6.3% -15.9% +16.2% ✅ faster
62 datafusion:vortex-file-compressed -4.6% +6.3% -10.2% +16.2% ➖ noise
62 duckdb:duckdb -9.5% +6.3% -14.8% +16.2% ✅ faster
62 duckdb:vortex-compact -27.1% +6.3% -31.4% +23.8% ✅ faster
62 duckdb:vortex-file-compressed -4.7% +6.3% -10.3% +20.2% ➖ noise
63 datafusion:vortex-compact -20.3% +2.3% -22.2% +16.2% ✅ faster
63 datafusion:vortex-file-compressed -12.9% +2.3% -14.9% +20.0% ➖ noise
63 duckdb:duckdb -1.8% +2.3% -4.0% +16.2% ➖ noise
63 duckdb:vortex-compact -9.0% +2.3% -11.0% +16.2% ➖ noise
63 duckdb:vortex-file-compressed -22.2% +2.3% -23.9% +17.6% ✅ faster
64 datafusion:vortex-compact -9.7% -2.2% -7.7% +16.2% ➖ noise
64 datafusion:vortex-file-compressed -3.1% -2.2% -0.9% +16.2% ➖ noise
64 duckdb:duckdb -4.4% -2.2% -2.3% +16.2% ➖ noise
64 duckdb:vortex-compact -0.3% -2.2% +1.9% +16.2% ➖ noise
64 duckdb:vortex-file-compressed -19.2% -2.2% -17.4% +16.2% ✅ faster
65 datafusion:vortex-compact -9.3% -8.4% -1.0% +16.2% ➖ noise
65 datafusion:vortex-file-compressed +2.9% -8.4% +12.3% +16.2% ➖ noise
65 duckdb:duckdb -20.8% -8.4% -13.6% +25.3% ➖ noise
65 duckdb:vortex-compact -4.8% -8.4% +3.9% +16.2% ➖ noise
65 duckdb:vortex-file-compressed -27.1% -8.4% -20.4% +16.2% ✅ faster
66 datafusion:vortex-compact -1.8% -5.3% +3.7% +16.2% ➖ noise
66 datafusion:vortex-file-compressed -2.2% -5.3% +3.2% +16.2% ➖ noise
66 duckdb:duckdb -4.2% -5.3% +1.2% +16.2% ➖ noise
66 duckdb:vortex-compact -7.9% -5.3% -2.7% +16.2% ➖ noise
66 duckdb:vortex-file-compressed -22.6% -5.3% -18.3% +16.2% ✅ faster
67 datafusion:vortex-compact +2.3% -7.9% +11.1% +16.2% ➖ noise
67 datafusion:vortex-file-compressed -4.5% -7.9% +3.7% +16.2% ➖ noise
67 duckdb:duckdb -1.8% -7.9% +6.6% +16.2% ➖ noise
67 duckdb:vortex-compact -4.9% -7.9% +3.2% +16.2% ➖ noise
67 duckdb:vortex-file-compressed -14.0% -7.9% -6.7% +16.2% ➖ noise
68 datafusion:vortex-compact +3.7% -1.6% +5.4% +16.2% ➖ noise
68 datafusion:vortex-file-compressed -3.6% -1.6% -2.0% +16.2% ➖ noise
68 duckdb:duckdb -0.4% -1.6% +1.2% +16.2% ➖ noise
68 duckdb:vortex-compact -3.0% -1.6% -1.4% +16.2% ➖ noise
68 duckdb:vortex-file-compressed -26.4% -1.6% -25.2% +18.2% ✅ faster
69 datafusion:vortex-compact -5.7% -1.2% -4.6% +16.2% ➖ noise
69 datafusion:vortex-file-compressed +4.1% -1.2% +5.4% +16.2% ➖ noise
69 duckdb:duckdb -1.7% -1.2% -0.6% +16.2% ➖ noise
69 duckdb:vortex-compact -1.2% -1.2% -0.0% +16.2% ➖ noise
69 duckdb:vortex-file-compressed -18.1% -1.2% -17.1% +16.2% ✅ faster
70 datafusion:vortex-compact +0.1% -4.7% +5.1% +16.2% ➖ noise
70 datafusion:vortex-file-compressed +5.5% -4.7% +10.7% +16.2% ➖ noise
70 duckdb:duckdb -5.6% -4.7% -0.9% +16.2% ➖ noise
70 duckdb:vortex-compact -0.2% -4.7% +4.7% +16.2% ➖ noise
70 duckdb:vortex-file-compressed -4.0% -4.7% +0.8% +16.2% ➖ noise
71 datafusion:vortex-compact -17.3% +3.1% -19.8% +16.2% ✅ faster
71 datafusion:vortex-file-compressed +0.2% +3.1% -2.8% +16.2% ➖ noise
71 duckdb:duckdb -8.3% +3.1% -11.0% +23.4% ➖ noise
71 duckdb:vortex-compact -0.2% +3.1% -3.2% +18.8% ➖ noise
71 duckdb:vortex-file-compressed -18.4% +3.1% -20.8% +18.5% ✅ faster
72 datafusion:vortex-compact -12.4% -3.5% -9.3% +16.2% ➖ noise
72 datafusion:vortex-file-compressed -8.9% -3.5% -5.6% +16.2% ➖ noise
72 duckdb:duckdb -0.9% -3.5% +2.7% +16.2% ➖ noise
72 duckdb:vortex-compact -0.4% -3.5% +3.2% +16.2% ➖ noise
72 duckdb:vortex-file-compressed -12.0% -3.5% -8.8% +16.2% ➖ noise
73 datafusion:vortex-compact +1.9% +3.1% -1.2% +21.8% ➖ noise
73 datafusion:vortex-file-compressed -6.3% +3.1% -9.1% +19.6% ➖ noise
73 duckdb:duckdb -6.8% +3.1% -9.7% +16.2% ➖ noise
73 duckdb:vortex-compact +0.5% +3.1% -2.6% +16.2% ➖ noise
73 duckdb:vortex-file-compressed -25.0% +3.1% -27.3% +16.2% ✅ faster
74 datafusion:vortex-compact -7.9% -6.1% -2.0% +17.1% ➖ noise
74 datafusion:vortex-file-compressed +0.2% -6.1% +6.6% +16.2% ➖ noise
74 duckdb:duckdb -1.4% -6.1% +5.0% +16.2% ➖ noise
74 duckdb:vortex-compact -1.6% -6.1% +4.7% +16.2% ➖ noise
74 duckdb:vortex-file-compressed -24.4% -6.1% -19.5% +16.2% ✅ faster
75 datafusion:vortex-compact -7.3% +3.3% -10.3% +16.2% ➖ noise
75 datafusion:vortex-file-compressed -3.2% +3.3% -6.3% +16.2% ➖ noise
75 duckdb:duckdb +4.3% +3.3% +1.0% +17.8% ➖ noise
75 duckdb:vortex-compact -8.1% +3.3% -11.0% +16.2% ➖ noise
75 duckdb:vortex-file-compressed -28.0% +3.3% -30.3% +19.6% ✅ faster
76 datafusion:vortex-compact +0.3% +0.3% +0.0% +16.4% ➖ noise
76 datafusion:vortex-file-compressed +3.5% +0.3% +3.2% +16.2% ➖ noise
76 duckdb:duckdb -10.3% +0.3% -10.6% +22.7% ➖ noise
76 duckdb:vortex-compact -10.2% +0.3% -10.5% +17.0% ➖ noise
76 duckdb:vortex-file-compressed -7.7% +0.3% -7.9% +29.6% ➖ noise
77 datafusion:vortex-compact -3.9% -9.6% +6.4% +16.4% ➖ noise
77 datafusion:vortex-file-compressed -5.1% -9.6% +5.0% +16.2% ➖ noise
77 duckdb:duckdb +3.2% -9.6% +14.3% +17.4% ➖ noise
77 duckdb:vortex-compact -11.5% -9.6% -2.1% +16.2% ➖ noise
77 duckdb:vortex-file-compressed -28.9% -9.6% -21.3% +22.1% ✅ faster
78 datafusion:vortex-compact -3.4% -4.8% +1.5% +22.4% ➖ noise
78 datafusion:vortex-file-compressed -5.9% -4.8% -1.1% +16.2% ➖ noise
78 duckdb:duckdb +2.3% -4.8% +7.5% +16.2% ➖ noise
78 duckdb:vortex-compact -22.5% -4.8% -18.6% +21.9% ✅ faster
78 duckdb:vortex-file-compressed -0.4% -4.8% +4.7% +16.2% ➖ noise
79 datafusion:vortex-compact -4.7% -9.9% +5.8% +16.2% ➖ noise
79 datafusion:vortex-file-compressed -10.7% -9.9% -0.9% +16.2% ➖ noise
79 duckdb:duckdb -0.1% -9.9% +10.8% +16.2% ➖ noise
79 duckdb:vortex-compact -13.1% -9.9% -3.5% +16.2% ➖ noise
79 duckdb:vortex-file-compressed -10.5% -9.9% -0.7% +16.2% ➖ noise
80 datafusion:vortex-compact -1.9% +1.1% -3.0% +16.2% ➖ noise
80 datafusion:vortex-file-compressed -6.3% +1.1% -7.3% +16.2% ➖ noise
80 duckdb:duckdb -1.5% +1.1% -2.5% +16.2% ➖ noise
80 duckdb:vortex-compact -7.0% +1.1% -8.0% +17.3% ➖ noise
80 duckdb:vortex-file-compressed -2.2% +1.1% -3.3% +16.2% ➖ noise
81 datafusion:vortex-compact -2.7% -0.1% -2.6% +16.2% ➖ noise
81 datafusion:vortex-file-compressed -10.9% -0.1% -10.8% +16.2% ➖ noise
81 duckdb:duckdb -0.0% -0.1% +0.1% +16.2% ➖ noise
81 duckdb:vortex-compact -12.6% -0.1% -12.5% +19.5% ➖ noise
81 duckdb:vortex-file-compressed -6.1% -0.1% -6.0% +16.2% ➖ noise
82 datafusion:vortex-compact -5.6% -6.6% +1.0% +16.2% ➖ noise
82 datafusion:vortex-file-compressed +0.5% -6.6% +7.6% +16.2% ➖ noise
82 duckdb:duckdb -8.3% -6.6% -1.9% +16.2% ➖ noise
82 duckdb:vortex-compact -7.0% -6.6% -0.5% +16.3% ➖ noise
82 duckdb:vortex-file-compressed -11.7% -6.6% -5.5% +16.2% ➖ noise
83 datafusion:vortex-compact -2.9% -11.7% +10.0% +16.2% ➖ noise
83 datafusion:vortex-file-compressed -4.5% -11.7% +8.2% +16.2% ➖ noise
83 duckdb:duckdb -5.8% -11.7% +6.8% +16.2% ➖ noise
83 duckdb:vortex-compact -3.5% -11.7% +9.4% +16.2% ➖ noise
83 duckdb:vortex-file-compressed +7.7% -11.7% +22.0% +16.2% 🚨 regression
84 datafusion:vortex-compact +1.2% -2.1% +3.4% +16.2% ➖ noise
84 datafusion:vortex-file-compressed -7.3% -2.1% -5.3% +16.2% ➖ noise
84 duckdb:duckdb -5.9% -2.1% -3.9% +16.2% ➖ noise
84 duckdb:vortex-compact -6.3% -2.1% -4.3% +16.2% ➖ noise
84 duckdb:vortex-file-compressed +1.4% -2.1% +3.5% +16.2% ➖ noise
85 datafusion:vortex-compact +0.1% -4.9% +5.3% +16.2% ➖ noise
85 datafusion:vortex-file-compressed -1.2% -4.9% +4.0% +16.2% ➖ noise
85 duckdb:duckdb -3.9% -4.9% +1.1% +16.2% ➖ noise
85 duckdb:vortex-compact -4.3% -4.9% +0.7% +16.2% ➖ noise
85 duckdb:vortex-file-compressed -2.4% -4.9% +2.7% +16.2% ➖ noise
86 datafusion:vortex-compact -12.6% -5.5% -7.5% +16.2% ➖ noise
86 datafusion:vortex-file-compressed -1.0% -5.5% +4.8% +16.2% ➖ noise
86 duckdb:duckdb +5.1% -5.5% +11.2% +30.8% ➖ noise
86 duckdb:vortex-compact +11.9% -5.5% +18.4% +24.8% ➖ noise
86 duckdb:vortex-file-compressed -7.1% -5.5% -1.7% +16.2% ➖ noise
87 datafusion:vortex-compact -2.2% +0.0% -2.2% +16.2% ➖ noise
87 datafusion:vortex-file-compressed -4.0% +0.0% -4.0% +16.2% ➖ noise
87 duckdb:duckdb +1.7% +0.0% +1.7% +16.2% ➖ noise
87 duckdb:vortex-compact -0.8% +0.0% -0.8% +16.2% ➖ noise
87 duckdb:vortex-file-compressed -2.3% +0.0% -2.3% +16.2% ➖ noise
88 datafusion:vortex-compact -1.4% -1.6% +0.2% +16.2% ➖ noise
88 datafusion:vortex-file-compressed -12.4% -1.6% -11.0% +16.2% ➖ noise
88 duckdb:duckdb -3.4% -1.6% -1.8% +16.2% ➖ noise
88 duckdb:vortex-compact +1.0% -1.6% +2.6% +16.2% ➖ noise
88 duckdb:vortex-file-compressed -7.1% -1.6% -5.7% +16.2% ➖ noise
89 datafusion:vortex-compact -5.8% -5.3% -0.6% +16.2% ➖ noise
89 datafusion:vortex-file-compressed +4.6% -5.3% +10.4% +16.2% ➖ noise
89 duckdb:duckdb +5.7% -5.3% +11.6% +16.2% ➖ noise
89 duckdb:vortex-compact +1.4% -5.3% +7.0% +16.2% ➖ noise
89 duckdb:vortex-file-compressed -2.3% -5.3% +3.2% +16.2% ➖ noise
90 datafusion:vortex-compact -1.5% -5.3% +4.0% +16.2% ➖ noise
90 datafusion:vortex-file-compressed -11.1% -5.3% -6.1% +16.2% ➖ noise
90 duckdb:duckdb +5.0% -5.3% +10.9% +16.2% ➖ noise
90 duckdb:vortex-compact -0.5% -5.3% +5.1% +16.2% ➖ noise
90 duckdb:vortex-file-compressed -1.7% -5.3% +3.8% +16.2% ➖ noise
91 datafusion:vortex-compact +1.6% +0.5% +1.0% +16.2% ➖ noise
91 datafusion:vortex-file-compressed -14.4% +0.5% -14.8% +16.2% ✅ faster
91 duckdb:duckdb -3.6% +0.5% -4.1% +16.2% ➖ noise
91 duckdb:vortex-compact -1.4% +0.5% -1.9% +16.2% ➖ noise
91 duckdb:vortex-file-compressed +1.6% +0.5% +1.1% +16.2% ➖ noise
92 datafusion:vortex-compact +4.7% -4.7% +9.9% +16.2% ➖ noise
92 datafusion:vortex-file-compressed -1.9% -4.7% +2.9% +16.2% ➖ noise
92 duckdb:duckdb +1.0% -4.7% +6.0% +16.2% ➖ noise
92 duckdb:vortex-compact -11.4% -4.7% -7.0% +18.3% ➖ noise
92 duckdb:vortex-file-compressed +11.3% -4.7% +16.8% +16.6% 🚨 regression
93 datafusion:vortex-compact +4.0% +0.8% +3.1% +16.2% ➖ noise
93 datafusion:vortex-file-compressed +4.7% +0.8% +3.9% +16.2% ➖ noise
93 duckdb:duckdb -13.5% +0.8% -14.2% +16.2% ✅ faster
93 duckdb:vortex-compact -4.9% +0.8% -5.7% +16.6% ➖ noise
93 duckdb:vortex-file-compressed -3.2% +0.8% -3.9% +16.2% ➖ noise
94 datafusion:vortex-compact -1.7% -7.0% +5.8% +16.2% ➖ noise
94 datafusion:vortex-file-compressed +1.5% -7.0% +9.2% +16.2% ➖ noise
94 duckdb:duckdb -8.3% -7.0% -1.4% +16.2% ➖ noise
94 duckdb:vortex-compact -5.4% -7.0% +1.7% +21.0% ➖ noise
94 duckdb:vortex-file-compressed -13.6% -7.0% -7.0% +16.2% ➖ noise
95 datafusion:vortex-compact -7.4% -0.7% -6.7% +20.3% ➖ noise
95 datafusion:vortex-file-compressed -3.3% -0.7% -2.6% +16.2% ➖ noise
95 duckdb:duckdb +19.3% -0.7% +20.2% +19.9% 🚨 regression
95 duckdb:vortex-compact -0.5% -0.7% +0.2% +22.3% ➖ noise
95 duckdb:vortex-file-compressed +0.4% -0.7% +1.2% +16.8% ➖ noise
96 datafusion:vortex-compact -23.8% -10.3% -15.1% +16.2% ✅ faster
96 datafusion:vortex-file-compressed -6.9% -10.3% +3.9% +16.2% ➖ noise
96 duckdb:duckdb -7.2% -10.3% +3.5% +16.7% ➖ noise
96 duckdb:vortex-compact +18.8% -10.3% +32.4% +24.3% 🚨 regression
96 duckdb:vortex-file-compressed -16.1% -10.3% -6.5% +18.7% ➖ noise
97 datafusion:vortex-compact -17.7% -1.7% -16.3% +22.3% ➖ noise
97 datafusion:vortex-file-compressed -9.0% -1.7% -7.4% +16.2% ➖ noise
97 duckdb:duckdb -8.7% -1.7% -7.1% +16.2% ➖ noise
97 duckdb:vortex-compact -3.9% -1.7% -2.2% +16.2% ➖ noise
97 duckdb:vortex-file-compressed -4.3% -1.7% -2.7% +16.2% ➖ noise
98 datafusion:vortex-compact -1.4% -4.7% +3.4% +16.2% ➖ noise
98 datafusion:vortex-file-compressed +2.7% -4.7% +7.7% +16.2% ➖ noise
98 duckdb:duckdb -12.3% -4.7% -8.0% +16.2% ➖ noise
98 duckdb:vortex-compact -29.4% -4.7% -26.0% +16.2% ✅ faster
98 duckdb:vortex-file-compressed -6.8% -4.7% -2.2% +16.2% ➖ noise
99 datafusion:vortex-compact -5.2% -10.8% +6.3% +21.4% ➖ noise
99 datafusion:vortex-file-compressed +1.6% -10.8% +14.0% +16.2% ➖ noise
99 duckdb:duckdb +3.0% -10.8% +15.6% +28.5% ➖ noise
99 duckdb:vortex-compact -15.3% -10.8% -5.0% +23.4% ➖ noise
99 duckdb:vortex-file-compressed -17.8% -10.8% -7.8% +26.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.9%
Vortex (geomean): 0.959x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -2.2%


datafusion / vortex-file-compressed (0.959x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 427980609 441384229 0.97
tpch_q02/datafusion:vortex-file-compressed 158910127 171449640 0.93
tpch_q03/datafusion:vortex-file-compressed 247829962 262958375 0.94
tpch_q04/datafusion:vortex-file-compressed 104607069 114068880 0.92
tpch_q05/datafusion:vortex-file-compressed 459363809 488573033 0.94
tpch_q06/datafusion:vortex-file-compressed 41308084 43049577 0.96
tpch_q07/datafusion:vortex-file-compressed 641651532 712894200 0.90
tpch_q08/datafusion:vortex-file-compressed 467593226 497044890 0.94
tpch_q09/datafusion:vortex-file-compressed 808713707 848707007 0.95
tpch_q10/datafusion:vortex-file-compressed 291910956 294807495 0.99
tpch_q11/datafusion:vortex-file-compressed 117665422 119971017 0.98
tpch_q12/datafusion:vortex-file-compressed 126912202 128749063 0.99
tpch_q13/datafusion:vortex-file-compressed 223977814 233356777 0.96
tpch_q14/datafusion:vortex-file-compressed 73655512 75055053 0.98
tpch_q15/datafusion:vortex-file-compressed 110020585 112753276 0.98
tpch_q16/datafusion:vortex-file-compressed 92858933 97032223 0.96
tpch_q17/datafusion:vortex-file-compressed 743248515 820947703 0.91
tpch_q18/datafusion:vortex-file-compressed 961919374 1004373278 0.96
tpch_q19/datafusion:vortex-file-compressed 131365911 134987355 0.97
tpch_q20/datafusion:vortex-file-compressed 205339677 205305660 1.00
tpch_q21/datafusion:vortex-file-compressed 759658664 774267561 0.98
tpch_q22/datafusion:vortex-file-compressed 60419859 60404827 1.00
datafusion / vortex-compact (0.978x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 457475124 477303751 0.96
tpch_q02/datafusion:vortex-compact 164070922 169746507 0.97
tpch_q03/datafusion:vortex-compact 264984814 272263423 0.97
tpch_q04/datafusion:vortex-compact 125602326 129818864 0.97
tpch_q05/datafusion:vortex-compact 473116965 484954753 0.98
tpch_q06/datafusion:vortex-compact 62838320 64773790 0.97
tpch_q07/datafusion:vortex-compact 672154637 695965285 0.97
tpch_q08/datafusion:vortex-compact 479775590 494154323 0.97
tpch_q09/datafusion:vortex-compact 823141572 846404846 0.97
tpch_q10/datafusion:vortex-compact 325035731 327573892 0.99
tpch_q11/datafusion:vortex-compact 123095383 122698025 1.00
tpch_q12/datafusion:vortex-compact 181102908 183402958 0.99
tpch_q13/datafusion:vortex-compact 274125266 275876100 0.99
tpch_q14/datafusion:vortex-compact 89561268 89949321 1.00
tpch_q15/datafusion:vortex-compact 163435537 166677357 0.98
tpch_q16/datafusion:vortex-compact 99247490 98909386 1.00
tpch_q17/datafusion:vortex-compact 743731510 750883374 0.99
tpch_q18/datafusion:vortex-compact 981475042 1011309443 0.97
tpch_q19/datafusion:vortex-compact 230796190 233181042 0.99
tpch_q20/datafusion:vortex-compact 226483253 241852382 0.94
tpch_q21/datafusion:vortex-compact 803311078 837021757 0.96
tpch_q22/datafusion:vortex-compact 71385784 71468473 1.00
datafusion / parquet (0.977x ➖, 1↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 466610824 459440130 1.02
tpch_q02/datafusion:parquet 258266458 253552207 1.02
tpch_q03/datafusion:parquet 391997997 399196372 0.98
tpch_q04/datafusion:parquet 148136239 150931766 0.98
tpch_q05/datafusion:parquet 578332074 583989798 0.99
tpch_q06/datafusion:parquet 126671948 123155651 1.03
tpch_q07/datafusion:parquet 796871755 798004998 1.00
tpch_q08/datafusion:parquet 637603809 645104417 0.99
tpch_q09/datafusion:parquet 968322621 974770677 0.99
tpch_q10/datafusion:parquet 603439415 620154785 0.97
tpch_q11/datafusion:parquet 188475735 197276931 0.96
tpch_q12/datafusion:parquet 243564046 241185042 1.01
tpch_q13/datafusion:parquet 340575482 357757214 0.95
tpch_q14/datafusion:parquet 202632514 202474465 1.00
tpch_q15/datafusion:parquet 278897356 273661155 1.02
tpch_q16/datafusion:parquet 174496606 187020596 0.93
tpch_q17/datafusion:parquet 835415049 876398378 0.95
tpch_q18/datafusion:parquet 1025722507 1083924339 0.95
tpch_q19/datafusion:parquet 338546333 334250398 1.01
tpch_q20/datafusion:parquet 377910632 412091279 0.92
tpch_q21/datafusion:parquet 🚀 889800006 997590453 0.89
tpch_q22/datafusion:parquet 223519503 234603781 0.95
datafusion / arrow (0.909x ➖, 10↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 719280440 782837798 0.92
tpch_q02/datafusion:arrow 198315329 202361401 0.98
tpch_q03/datafusion:arrow 🚀 539794151 626579900 0.86
tpch_q04/datafusion:arrow 390673124 415219502 0.94
tpch_q05/datafusion:arrow 1047937118 1111071793 0.94
tpch_q06/datafusion:arrow 🚀 315734494 356536220 0.89
tpch_q07/datafusion:arrow 1345395945 1470685480 0.91
tpch_q08/datafusion:arrow 🚀 1256874000 1409766667 0.89
tpch_q09/datafusion:arrow 1535369733 1644876656 0.93
tpch_q10/datafusion:arrow 666598272 734201414 0.91
tpch_q11/datafusion:arrow 176498182 188060080 0.94
tpch_q12/datafusion:arrow 🚀 723207110 808669251 0.89
tpch_q13/datafusion:arrow 526035034 542783932 0.97
tpch_q14/datafusion:arrow 353349464 378874307 0.93
tpch_q15/datafusion:arrow 🚀 744711989 832120984 0.89
tpch_q16/datafusion:arrow 125308822 122272752 1.02
tpch_q17/datafusion:arrow 🚀 1553849637 1823732366 0.85
tpch_q18/datafusion:arrow 🚀 2086307393 2431053555 0.86
tpch_q19/datafusion:arrow 🚀 578623512 674008900 0.86
tpch_q20/datafusion:arrow 🚀 542884858 688867014 0.79
tpch_q21/datafusion:arrow 🚀 3819060386 4435010487 0.86
tpch_q22/datafusion:arrow 173987397 179346010 0.97
duckdb / vortex-file-compressed (0.970x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176648173 178310205 0.99
tpch_q02/duckdb:vortex-file-compressed 53388692 57050198 0.94
tpch_q03/duckdb:vortex-file-compressed 128215477 132351830 0.97
tpch_q04/duckdb:vortex-file-compressed 149075421 156037035 0.96
tpch_q05/duckdb:vortex-file-compressed 132414668 136437713 0.97
tpch_q06/duckdb:vortex-file-compressed 48857384 50965381 0.96
tpch_q07/duckdb:vortex-file-compressed 143143481 149096974 0.96
tpch_q08/duckdb:vortex-file-compressed 177474754 180640539 0.98
tpch_q09/duckdb:vortex-file-compressed 337069887 339767422 0.99
tpch_q10/duckdb:vortex-file-compressed 154217731 152509947 1.01
tpch_q11/duckdb:vortex-file-compressed 36068264 38446241 0.94
tpch_q12/duckdb:vortex-file-compressed 98482596 96640086 1.02
tpch_q13/duckdb:vortex-file-compressed 246650916 247539322 1.00
tpch_q14/duckdb:vortex-file-compressed 68993843 72190686 0.96
tpch_q15/duckdb:vortex-file-compressed 97570644 100692242 0.97
tpch_q16/duckdb:vortex-file-compressed 79794252 81814356 0.98
tpch_q17/duckdb:vortex-file-compressed 102707645 108304866 0.95
tpch_q18/duckdb:vortex-file-compressed 299110886 287869808 1.04
tpch_q19/duckdb:vortex-file-compressed 92369479 100645400 0.92
tpch_q20/duckdb:vortex-file-compressed 164001995 173965772 0.94
tpch_q21/duckdb:vortex-file-compressed 558084273 603580937 0.92
tpch_q22/duckdb:vortex-file-compressed 77744546 77056844 1.01
duckdb / vortex-compact (0.929x ➖, 5↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230125545 238221796 0.97
tpch_q02/duckdb:vortex-compact 58313202 61024336 0.96
tpch_q03/duckdb:vortex-compact 139616136 146443164 0.95
tpch_q04/duckdb:vortex-compact 🚀 173434556 200557607 0.86
tpch_q05/duckdb:vortex-compact 146445963 153767780 0.95
tpch_q06/duckdb:vortex-compact 🚀 84215125 95042331 0.89
tpch_q07/duckdb:vortex-compact 203595472 209150371 0.97
tpch_q08/duckdb:vortex-compact 🚀 188099663 213289485 0.88
tpch_q09/duckdb:vortex-compact 363582193 399909378 0.91
tpch_q10/duckdb:vortex-compact 183854904 193175309 0.95
tpch_q11/duckdb:vortex-compact 42518364 46272057 0.92
tpch_q12/duckdb:vortex-compact 209965645 213383408 0.98
tpch_q13/duckdb:vortex-compact 296608722 317991688 0.93
tpch_q14/duckdb:vortex-compact 103538308 108690986 0.95
tpch_q15/duckdb:vortex-compact 121429366 131509896 0.92
tpch_q16/duckdb:vortex-compact 85402000 89117991 0.96
tpch_q17/duckdb:vortex-compact 🚀 116652134 137002072 0.85
tpch_q18/duckdb:vortex-compact 296533681 324163739 0.91
tpch_q19/duckdb:vortex-compact 114384067 116386425 0.98
tpch_q20/duckdb:vortex-compact 🚀 208353005 235757250 0.88
tpch_q21/duckdb:vortex-compact 630608169 692309046 0.91
tpch_q22/duckdb:vortex-compact 89398884 93506902 0.96
duckdb / parquet (0.973x ➖, 2↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260284991 262566216 0.99
tpch_q02/duckdb:parquet 🚀 92661722 108446693 0.85
tpch_q03/duckdb:parquet 214421866 212631756 1.01
tpch_q04/duckdb:parquet 134687258 139960846 0.96
tpch_q05/duckdb:parquet 214806384 222946731 0.96
tpch_q06/duckdb:parquet 65776828 68421904 0.96
tpch_q07/duckdb:parquet 179678629 185630609 0.97
tpch_q08/duckdb:parquet 260796433 265497692 0.98
tpch_q09/duckdb:parquet 463956314 472965069 0.98
tpch_q10/duckdb:parquet 608997646 622174577 0.98
tpch_q11/duckdb:parquet 🚀 42093167 47235252 0.89
tpch_q12/duckdb:parquet 123166132 128080602 0.96
tpch_q13/duckdb:parquet 460012226 457837271 1.00
tpch_q14/duckdb:parquet 173073781 173298172 1.00
tpch_q15/duckdb:parquet 102001360 100417124 1.02
tpch_q16/duckdb:parquet 161088605 163483887 0.99
tpch_q17/duckdb:parquet 181892438 177455923 1.03
tpch_q18/duckdb:parquet 356365493 363426100 0.98
tpch_q19/duckdb:parquet 281088804 292270517 0.96
tpch_q20/duckdb:parquet 226355022 230385563 0.98
tpch_q21/duckdb:parquet 564610229 584222733 0.97
tpch_q22/duckdb:parquet 294730011 294639799 1.00
duckdb / duckdb (0.995x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116265785 118628956 0.98
tpch_q02/duckdb:duckdb 46612276 47562846 0.98
tpch_q03/duckdb:duckdb 97077032 98796619 0.98
tpch_q04/duckdb:duckdb 132192679 133303135 0.99
tpch_q05/duckdb:duckdb 109238991 109959226 0.99
tpch_q06/duckdb:duckdb 36895167 39356099 0.94
tpch_q07/duckdb:duckdb 86785881 85869932 1.01
tpch_q08/duckdb:duckdb 110298392 110711339 1.00
tpch_q09/duckdb:duckdb 278326053 276218910 1.01
tpch_q10/duckdb:duckdb 203714403 205309705 0.99
tpch_q11/duckdb:duckdb 15885827 15529321 1.02
tpch_q12/duckdb:duckdb 84550555 84411578 1.00
tpch_q13/duckdb:duckdb 252983526 250126697 1.01
tpch_q14/duckdb:duckdb 70315872 72887839 0.96
tpch_q15/duckdb:duckdb 80051954 78497303 1.02
tpch_q16/duckdb:duckdb 72285957 73481733 0.98
tpch_q17/duckdb:duckdb 84953435 84881476 1.00
tpch_q18/duckdb:duckdb 214308192 212285924 1.01
tpch_q19/duckdb:duckdb 115099644 115117899 1.00
tpch_q20/duckdb:duckdb 110363232 110678645 1.00
tpch_q21/duckdb:duckdb 307714535 302016890 1.02
tpch_q22/duckdb:duckdb 64640656 65402747 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -8.1% +0.3% -8.4% +10.4% ➖ noise
1 datafusion:vortex-compact -4.2% +0.3% -4.5% +11.3% ➖ noise
1 datafusion:vortex-file-compressed -3.0% +0.3% -3.4% +14.6% ➖ noise
1 duckdb:duckdb -2.0% +0.3% -2.3% +10.2% ➖ noise
1 duckdb:vortex-compact -3.4% +0.3% -3.7% +10.5% ➖ noise
1 duckdb:vortex-file-compressed -0.9% +0.3% -1.3% +10.9% ➖ noise
2 datafusion:arrow -2.0% -6.7% +5.0% +10.0% ➖ noise
2 datafusion:vortex-compact -3.3% -6.7% +3.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -7.3% -6.7% -0.6% +10.0% ➖ noise
2 duckdb:duckdb -2.0% -6.7% +5.0% +10.0% ➖ noise
2 duckdb:vortex-compact -4.4% -6.7% +2.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -6.4% -6.7% +0.3% +10.2% ➖ noise
3 datafusion:arrow -13.9% -0.5% -13.4% +10.0% ✅ faster
3 datafusion:vortex-compact -2.7% -0.5% -2.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -5.8% -0.5% -5.3% +10.0% ➖ noise
3 duckdb:duckdb -1.7% -0.5% -1.3% +10.0% ➖ noise
3 duckdb:vortex-compact -4.7% -0.5% -4.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.1% -0.5% -2.6% +10.0% ➖ noise
4 datafusion:arrow -5.9% -2.8% -3.2% +10.0% ➖ noise
4 datafusion:vortex-compact -3.2% -2.8% -0.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -8.3% -2.8% -5.6% +10.0% ➖ noise
4 duckdb:duckdb -0.8% -2.8% +2.0% +10.0% ➖ noise
4 duckdb:vortex-compact -13.5% -2.8% -11.0% +10.0% ✅ faster
4 duckdb:vortex-file-compressed -4.5% -2.8% -1.7% +10.0% ➖ noise
5 datafusion:arrow -5.7% -2.3% -3.4% +10.0% ➖ noise
5 datafusion:vortex-compact -2.4% -2.3% -0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.0% -2.3% -3.7% +10.0% ➖ noise
5 duckdb:duckdb -0.7% -2.3% +1.7% +10.0% ➖ noise
5 duckdb:vortex-compact -4.8% -2.3% -2.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.9% -2.3% -0.6% +10.0% ➖ noise
6 datafusion:arrow -11.4% -0.6% -10.9% +10.0% ✅ faster
6 datafusion:vortex-compact -3.0% -0.6% -2.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.0% -0.6% -3.5% +10.0% ➖ noise
6 duckdb:duckdb -6.3% -0.6% -5.7% +18.8% ➖ noise
6 duckdb:vortex-compact -11.4% -0.6% -10.9% +11.5% ✅ faster
6 duckdb:vortex-file-compressed -4.1% -0.6% -3.6% +10.0% ➖ noise
7 datafusion:arrow -8.5% -1.7% -7.0% +10.0% ➖ noise
7 datafusion:vortex-compact -3.4% -1.7% -1.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -10.0% -1.7% -8.4% +10.0% ➖ noise
7 duckdb:duckdb +1.1% -1.7% +2.8% +10.0% ➖ noise
7 duckdb:vortex-compact -2.7% -1.7% -1.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.0% -1.7% -2.3% +10.0% ➖ noise
8 datafusion:arrow -10.8% -1.5% -9.5% +10.0% ✅ faster
8 datafusion:vortex-compact -2.9% -1.5% -1.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -5.9% -1.5% -4.5% +10.0% ➖ noise
8 duckdb:duckdb -0.4% -1.5% +1.1% +10.0% ➖ noise
8 duckdb:vortex-compact -11.8% -1.5% -10.5% +10.0% ✅ faster
8 duckdb:vortex-file-compressed -1.8% -1.5% -0.3% +10.0% ➖ noise
9 datafusion:arrow -6.7% -1.3% -5.4% +10.0% ➖ noise
9 datafusion:vortex-compact -2.7% -1.3% -1.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -4.7% -1.3% -3.5% +10.0% ➖ noise
9 duckdb:duckdb +0.8% -1.3% +2.1% +10.0% ➖ noise
9 duckdb:vortex-compact -9.1% -1.3% -7.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.8% -1.3% +0.5% +10.0% ➖ noise
10 datafusion:arrow -9.2% -2.4% -7.0% +10.0% ➖ noise
10 datafusion:vortex-compact -0.8% -2.4% +1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.0% -2.4% +1.5% +10.0% ➖ noise
10 duckdb:duckdb -0.8% -2.4% +1.7% +10.0% ➖ noise
10 duckdb:vortex-compact -4.8% -2.4% -2.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.1% -2.4% +3.6% +10.0% ➖ noise
11 datafusion:arrow -6.1% -7.7% +1.7% +10.0% ➖ noise
11 datafusion:vortex-compact +0.3% -7.7% +8.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.9% -7.7% +6.3% +11.8% ➖ noise
11 duckdb:duckdb +2.3% -7.7% +10.9% +16.6% ➖ noise
11 duckdb:vortex-compact -8.1% -7.7% -0.4% +16.7% ➖ noise
11 duckdb:vortex-file-compressed -6.2% -7.7% +1.7% +14.3% ➖ noise
12 datafusion:arrow -10.6% -1.5% -9.2% +40.3% ➖ noise
12 datafusion:vortex-compact -1.3% -1.5% +0.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.4% -1.5% +0.0% +10.0% ➖ noise
12 duckdb:duckdb +0.2% -1.5% +1.6% +10.0% ➖ noise
12 duckdb:vortex-compact -1.6% -1.5% -0.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.9% -1.5% +3.4% +10.0% ➖ noise
13 datafusion:arrow -3.1% -2.2% -0.9% +10.0% ➖ noise
13 datafusion:vortex-compact -0.6% -2.2% +1.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -4.0% -2.2% -1.9% +10.0% ➖ noise
13 duckdb:duckdb +1.1% -2.2% +3.4% +10.0% ➖ noise
13 duckdb:vortex-compact -6.7% -2.2% -4.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.4% -2.2% +1.9% +10.0% ➖ noise
14 datafusion:arrow -6.7% -0.0% -6.7% +10.0% ➖ noise
14 datafusion:vortex-compact -0.4% -0.0% -0.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.9% -0.0% -1.8% +10.0% ➖ noise
14 duckdb:duckdb -3.5% -0.0% -3.5% +10.0% ➖ noise
14 duckdb:vortex-compact -4.7% -0.0% -4.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -4.4% -0.0% -4.4% +11.5% ➖ noise
15 datafusion:arrow -10.5% +1.7% -12.0% +10.0% ✅ faster
15 datafusion:vortex-compact -1.9% +1.7% -3.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -2.4% +1.7% -4.1% +10.0% ➖ noise
15 duckdb:duckdb +2.0% +1.7% +0.2% +10.0% ➖ noise
15 duckdb:vortex-compact -7.7% +1.7% -9.2% +10.0% ✅ faster
15 duckdb:vortex-file-compressed -3.1% +1.7% -4.8% +10.0% ➖ noise
16 datafusion:arrow +2.5% -4.1% +6.9% +15.2% ➖ noise
16 datafusion:vortex-compact +0.3% -4.1% +4.6% +10.7% ➖ noise
16 datafusion:vortex-file-compressed -4.3% -4.1% -0.2% +10.0% ➖ noise
16 duckdb:duckdb -1.6% -4.1% +2.6% +10.0% ➖ noise
16 duckdb:vortex-compact -4.2% -4.1% -0.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -2.5% -4.1% +1.7% +10.0% ➖ noise
17 datafusion:arrow -14.8% -1.2% -13.8% +10.0% ✅ faster
17 datafusion:vortex-compact -1.0% -1.2% +0.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -9.5% -1.2% -8.4% +10.0% ➖ noise
17 duckdb:duckdb +0.1% -1.2% +1.3% +10.0% ➖ noise
17 duckdb:vortex-compact -14.9% -1.2% -13.9% +10.0% ✅ faster
17 duckdb:vortex-file-compressed -5.2% -1.2% -4.1% +10.0% ➖ noise
18 datafusion:arrow -14.2% -3.7% -10.9% +10.0% ✅ faster
18 datafusion:vortex-compact -3.0% -3.7% +0.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -4.2% -3.7% -0.6% +10.0% ➖ noise
18 duckdb:duckdb +1.0% -3.7% +4.8% +10.0% ➖ noise
18 duckdb:vortex-compact -8.5% -3.7% -5.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.9% -3.7% +7.9% +10.0% ➖ noise
19 datafusion:arrow -14.2% -1.3% -13.0% +10.0% ✅ faster
19 datafusion:vortex-compact -1.0% -1.3% +0.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -2.7% -1.3% -1.4% +10.0% ➖ noise
19 duckdb:duckdb -0.0% -1.3% +1.3% +10.0% ➖ noise
19 duckdb:vortex-compact -1.7% -1.3% -0.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -8.2% -1.3% -7.0% +10.0% ➖ noise
20 datafusion:arrow -21.2% -5.1% -17.0% +10.0% ✅ faster
20 datafusion:vortex-compact -6.4% -5.1% -1.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.0% -5.1% +5.4% +10.0% ➖ noise
20 duckdb:duckdb -0.3% -5.1% +5.0% +10.0% ➖ noise
20 duckdb:vortex-compact -11.6% -5.1% -6.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -5.7% -5.1% -0.7% +10.0% ➖ noise
21 datafusion:arrow -13.9% -7.2% -7.3% +10.0% ➖ noise
21 datafusion:vortex-compact -4.0% -7.2% +3.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.9% -7.2% +5.7% +10.0% ➖ noise
21 duckdb:duckdb +1.9% -7.2% +9.7% +10.0% ➖ noise
21 duckdb:vortex-compact -8.9% -7.2% -1.9% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -7.5% -7.2% -0.4% +10.0% ➖ noise
22 datafusion:arrow -3.0% -2.4% -0.6% +10.0% ➖ noise
22 datafusion:vortex-compact -0.1% -2.4% +2.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.0% -2.4% +2.5% +10.0% ➖ noise
22 duckdb:duckdb -1.2% -2.4% +1.2% +10.0% ➖ noise
22 duckdb:vortex-compact -4.4% -2.4% -2.1% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.9% -2.4% +3.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.9%
Vortex (geomean): 1.025x ➖
Parquet (geomean): 0.987x ➖
Shifts: Parquet (control) -1.3% · Median polish +1.6%


duckdb / vortex-file-compressed (1.029x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11636127 10828287 1.07
statpopgen_q01/duckdb:vortex-file-compressed 28562141 27632287 1.03
statpopgen_q02/duckdb:vortex-file-compressed 1348606058 1290760933 1.04
statpopgen_q03/duckdb:vortex-file-compressed 3097632044 3099751620 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3070528952 3080489482 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1402275379 1382648408 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2081478556 2058366167 1.01
statpopgen_q07/duckdb:vortex-file-compressed 210107873 195973191 1.07
statpopgen_q08/duckdb:vortex-file-compressed 226595273 211908939 1.07
statpopgen_q09/duckdb:vortex-file-compressed 2868907231 2888470450 0.99
statpopgen_q10/duckdb:vortex-file-compressed 4676362898 4610166279 1.01
duckdb / vortex-compact (1.022x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11120421 10651348 1.04
statpopgen_q01/duckdb:vortex-compact 168609369 166729144 1.01
statpopgen_q02/duckdb:vortex-compact 1841321194 1817143643 1.01
statpopgen_q03/duckdb:vortex-compact 3562531153 3513250740 1.01
statpopgen_q04/duckdb:vortex-compact 3603083071 3505620703 1.03
statpopgen_q05/duckdb:vortex-compact 1880335663 1822932809 1.03
statpopgen_q06/duckdb:vortex-compact 2710819569 2667170284 1.02
statpopgen_q07/duckdb:vortex-compact 954403177 943653779 1.01
statpopgen_q08/duckdb:vortex-compact 1005595958 981634375 1.02
statpopgen_q09/duckdb:vortex-compact 3389544495 3316310862 1.02
statpopgen_q10/duckdb:vortex-compact 5472613875 5345149908 1.02
duckdb / parquet (0.987x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 320981548 332107379 0.97
statpopgen_q01/duckdb:parquet 410868255 420682279 0.98
statpopgen_q02/duckdb:parquet 1015166402 1088751415 0.93
statpopgen_q03/duckdb:parquet 1544947036 1629541811 0.95
statpopgen_q04/duckdb:parquet 1504028079 1603935420 0.94
statpopgen_q05/duckdb:parquet 1011826926 1003567780 1.01
statpopgen_q06/duckdb:parquet 1513768724 1474813031 1.03
statpopgen_q07/duckdb:parquet 1924441142 1852655895 1.04
statpopgen_q08/duckdb:parquet 1933614632 1870746526 1.03
statpopgen_q09/duckdb:parquet 1342969353 1371004599 0.98
statpopgen_q10/duckdb:parquet 2696135681 2663323828 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +4.4% -3.4% +8.0% +10.7% ➖ noise
0 duckdb:vortex-file-compressed +7.5% -3.4% +11.2% +10.7% 🚨 regression
1 duckdb:vortex-compact +1.1% -2.3% +3.5% +42.0% ➖ noise
1 duckdb:vortex-file-compressed +3.4% -2.3% +5.8% +270.2% ➖ noise
2 duckdb:vortex-compact +1.3% -6.8% +8.7% +10.7% ➖ noise
2 duckdb:vortex-file-compressed +4.5% -6.8% +12.1% +10.7% 🚨 regression
3 duckdb:vortex-compact +1.4% -5.2% +7.0% +10.7% ➖ noise
3 duckdb:vortex-file-compressed -0.1% -5.2% +5.4% +10.7% ➖ noise
4 duckdb:vortex-compact +2.8% -6.2% +9.6% +10.7% ➖ noise
4 duckdb:vortex-file-compressed -0.3% -6.2% +6.3% +10.7% ➖ noise
5 duckdb:vortex-compact +3.1% +0.8% +2.3% +10.7% ➖ noise
5 duckdb:vortex-file-compressed +1.4% +0.8% +0.6% +10.7% ➖ noise
6 duckdb:vortex-compact +1.6% +2.6% -1.0% +10.7% ➖ noise
6 duckdb:vortex-file-compressed +1.1% +2.6% -1.5% +10.7% ➖ noise
7 duckdb:vortex-compact +1.1% +3.9% -2.6% +10.7% ➖ noise
7 duckdb:vortex-file-compressed +7.2% +3.9% +3.2% +10.7% ➖ noise
8 duckdb:vortex-compact +2.4% +3.4% -0.9% +10.7% ➖ noise
8 duckdb:vortex-file-compressed +6.9% +3.4% +3.5% +10.7% ➖ noise
9 duckdb:vortex-compact +2.2% -2.0% +4.3% +10.7% ➖ noise
9 duckdb:vortex-file-compressed -0.7% -2.0% +1.4% +10.7% ➖ noise
10 duckdb:vortex-compact +2.4% +1.2% +1.1% +10.7% ➖ noise
10 duckdb:vortex-file-compressed +1.4% +1.2% +0.2% +10.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 0.994x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%


datafusion / vortex-file-compressed (1.007x ➖, 2↑ 2↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚀 1638745 1841716 0.89
clickbench_q01/datafusion:vortex-file-compressed 🚀 13031002 14526209 0.90
clickbench_q02/datafusion:vortex-file-compressed 31390164 31535086 1.00
clickbench_q03/datafusion:vortex-file-compressed 36946943 35662107 1.04
clickbench_q04/datafusion:vortex-file-compressed 317200074 312306067 1.02
clickbench_q05/datafusion:vortex-file-compressed 315750201 309717218 1.02
clickbench_q06/datafusion:vortex-file-compressed 1696790 1665341 1.02
clickbench_q07/datafusion:vortex-file-compressed 17996846 16922600 1.06
clickbench_q08/datafusion:vortex-file-compressed 385908518 384322616 1.00
clickbench_q09/datafusion:vortex-file-compressed 568694731 569701795 1.00
clickbench_q10/datafusion:vortex-file-compressed 74742077 71343250 1.05
clickbench_q11/datafusion:vortex-file-compressed 81406667 80276450 1.01
clickbench_q12/datafusion:vortex-file-compressed 277219557 272927508 1.02
clickbench_q13/datafusion:vortex-file-compressed 417856832 412634836 1.01
clickbench_q14/datafusion:vortex-file-compressed 255376919 258786603 0.99
clickbench_q15/datafusion:vortex-file-compressed 374941181 375956026 1.00
clickbench_q16/datafusion:vortex-file-compressed 721180625 720986064 1.00
clickbench_q17/datafusion:vortex-file-compressed 711348627 711005269 1.00
clickbench_q18/datafusion:vortex-file-compressed 1512777700 1450276193 1.04
clickbench_q19/datafusion:vortex-file-compressed 25571654 23573250 1.08
clickbench_q20/datafusion:vortex-file-compressed 350774468 349036422 1.00
clickbench_q21/datafusion:vortex-file-compressed 405149409 400909390 1.01
clickbench_q22/datafusion:vortex-file-compressed 539159026 520505230 1.04
clickbench_q23/datafusion:vortex-file-compressed 🚨 706081942 597806388 1.18
clickbench_q24/datafusion:vortex-file-compressed 44667348 47028459 0.95
clickbench_q25/datafusion:vortex-file-compressed 64694016 69775669 0.93
clickbench_q26/datafusion:vortex-file-compressed 🚨 53897676 45714108 1.18
clickbench_q27/datafusion:vortex-file-compressed 783583276 807810815 0.97
clickbench_q28/datafusion:vortex-file-compressed 6801655583 6690251866 1.02
clickbench_q29/datafusion:vortex-file-compressed 234437217 242279209 0.97
clickbench_q30/datafusion:vortex-file-compressed 238912168 234974076 1.02
clickbench_q31/datafusion:vortex-file-compressed 270344910 278759057 0.97
clickbench_q32/datafusion:vortex-file-compressed 1309964472 1325847845 0.99
clickbench_q33/datafusion:vortex-file-compressed 1401428883 1432127475 0.98
clickbench_q34/datafusion:vortex-file-compressed 1394936458 1435326742 0.97
clickbench_q35/datafusion:vortex-file-compressed 525785077 507774395 1.04
clickbench_q36/datafusion:vortex-file-compressed 78901587 79177789 1.00
clickbench_q37/datafusion:vortex-file-compressed 36959752 37144127 1.00
clickbench_q38/datafusion:vortex-file-compressed 24416457 24040731 1.02
clickbench_q39/datafusion:vortex-file-compressed 151022461 154026159 0.98
clickbench_q40/datafusion:vortex-file-compressed 19974365 19768962 1.01
clickbench_q41/datafusion:vortex-file-compressed 18520294 18688166 0.99
clickbench_q42/datafusion:vortex-file-compressed 22534100 21727989 1.04
datafusion / parquet (1.001x ➖, 1↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1545504 1531670 1.01
clickbench_q01/datafusion:parquet 21821459 21162770 1.03
clickbench_q02/datafusion:parquet 50292085 47658338 1.06
clickbench_q03/datafusion:parquet 40544535 42537418 0.95
clickbench_q04/datafusion:parquet 337792541 341008297 0.99
clickbench_q05/datafusion:parquet 381581391 375249420 1.02
clickbench_q06/datafusion:parquet 1542003 1545308 1.00
clickbench_q07/datafusion:parquet 26515163 26832860 0.99
clickbench_q08/datafusion:parquet 414338223 416039842 1.00
clickbench_q09/datafusion:parquet 645620035 653441194 0.99
clickbench_q10/datafusion:parquet 115234100 117106656 0.98
clickbench_q11/datafusion:parquet 141228286 143216677 0.99
clickbench_q12/datafusion:parquet 376892197 368872299 1.02
clickbench_q13/datafusion:parquet 518143609 513220847 1.01
clickbench_q14/datafusion:parquet 365666347 362655797 1.01
clickbench_q15/datafusion:parquet 387453258 398541378 0.97
clickbench_q16/datafusion:parquet 730173460 728977824 1.00
clickbench_q17/datafusion:parquet 734791281 721644150 1.02
clickbench_q18/datafusion:parquet 1497712842 1569026475 0.95
clickbench_q19/datafusion:parquet 🚀 33253802 37850659 0.88
clickbench_q20/datafusion:parquet 616736205 623027131 0.99
clickbench_q21/datafusion:parquet 692243439 675628508 1.02
clickbench_q22/datafusion:parquet 1004567386 996325782 1.01
clickbench_q23/datafusion:parquet 3735212753 3750820428 1.00
clickbench_q24/datafusion:parquet 96308087 92340727 1.04
clickbench_q25/datafusion:parquet 152591891 151583997 1.01
clickbench_q26/datafusion:parquet 95795335 94909900 1.01
clickbench_q27/datafusion:parquet 1067550361 1061186824 1.01
clickbench_q28/datafusion:parquet 6509129145 6455048847 1.01
clickbench_q29/datafusion:parquet 236735837 241101715 0.98
clickbench_q30/datafusion:parquet 371457112 379010555 0.98
clickbench_q31/datafusion:parquet 406314829 405308616 1.00
clickbench_q32/datafusion:parquet 1368601740 1320034356 1.04
clickbench_q33/datafusion:parquet 1547927306 1552785374 1.00
clickbench_q34/datafusion:parquet 1545961163 1529864853 1.01
clickbench_q35/datafusion:parquet 542454834 554709869 0.98
clickbench_q36/datafusion:parquet 141564364 141114625 1.00
clickbench_q37/datafusion:parquet 59120011 58814450 1.01
clickbench_q38/datafusion:parquet 97482679 89551453 1.09
clickbench_q39/datafusion:parquet 282249058 279196000 1.01
clickbench_q40/datafusion:parquet 35702986 36257134 0.98
clickbench_q41/datafusion:parquet 30512254 30122678 1.01
clickbench_q42/datafusion:parquet 32079353 31522266 1.02
duckdb / vortex-file-compressed (0.981x ➖, 2↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5918179 5750590 1.03
clickbench_q01/duckdb:vortex-file-compressed 13371354 13390529 1.00
clickbench_q02/duckdb:vortex-file-compressed 21815110 23645650 0.92
clickbench_q03/duckdb:vortex-file-compressed 30214869 30603506 0.99
clickbench_q04/duckdb:vortex-file-compressed 183881862 174666277 1.05
clickbench_q05/duckdb:vortex-file-compressed 195081965 196310588 0.99
clickbench_q06/duckdb:vortex-file-compressed 18890987 18806573 1.00
clickbench_q07/duckdb:vortex-file-compressed 15899093 16173767 0.98
clickbench_q08/duckdb:vortex-file-compressed 262334793 264091995 0.99
clickbench_q09/duckdb:vortex-file-compressed 371351331 375036418 0.99
clickbench_q10/duckdb:vortex-file-compressed 71950069 72310163 1.00
clickbench_q11/duckdb:vortex-file-compressed 78663172 79675251 0.99
clickbench_q12/duckdb:vortex-file-compressed 216330883 213151579 1.01
clickbench_q13/duckdb:vortex-file-compressed 437865967 443840748 0.99
clickbench_q14/duckdb:vortex-file-compressed 243513889 240388977 1.01
clickbench_q15/duckdb:vortex-file-compressed 222089619 206960458 1.07
clickbench_q16/duckdb:vortex-file-compressed 696230365 706163741 0.99
clickbench_q17/duckdb:vortex-file-compressed 557450416 577329293 0.97
clickbench_q18/duckdb:vortex-file-compressed 1225917132 1213729971 1.01
clickbench_q19/duckdb:vortex-file-compressed 22310509 20480181 1.09
clickbench_q20/duckdb:vortex-file-compressed 399310828 393700220 1.01
clickbench_q21/duckdb:vortex-file-compressed 401765172 413217620 0.97
clickbench_q22/duckdb:vortex-file-compressed 676664434 663626437 1.02
clickbench_q23/duckdb:vortex-file-compressed 1322252911 1406888115 0.94
clickbench_q24/duckdb:vortex-file-compressed 38857470 43011364 0.90
clickbench_q25/duckdb:vortex-file-compressed 78138375 72889450 1.07
clickbench_q26/duckdb:vortex-file-compressed 40370165 44823458 0.90
clickbench_q27/duckdb:vortex-file-compressed 515810391 526694405 0.98
clickbench_q28/duckdb:vortex-file-compressed 2996247600 2995328124 1.00
clickbench_q29/duckdb:vortex-file-compressed 26054572 28498123 0.91
clickbench_q30/duckdb:vortex-file-compressed 170357436 172957656 0.98
clickbench_q31/duckdb:vortex-file-compressed 250012983 254999685 0.98
clickbench_q32/duckdb:vortex-file-compressed 1345367654 1320219399 1.02
clickbench_q33/duckdb:vortex-file-compressed 1604758085 1659827138 0.97
clickbench_q34/duckdb:vortex-file-compressed 1719200456 1692468453 1.02
clickbench_q35/duckdb:vortex-file-compressed 363695344 365027986 1.00
clickbench_q36/duckdb:vortex-file-compressed 30950352 32491349 0.95
clickbench_q37/duckdb:vortex-file-compressed 21591686 23062921 0.94
clickbench_q38/duckdb:vortex-file-compressed 23383185 25837501 0.91
clickbench_q39/duckdb:vortex-file-compressed 45206652 45669288 0.99
clickbench_q40/duckdb:vortex-file-compressed 🚀 22483102 26195538 0.86
clickbench_q41/duckdb:vortex-file-compressed 21575654 22995272 0.94
clickbench_q42/duckdb:vortex-file-compressed 🚀 23044548 26173270 0.88
duckdb / parquet (0.992x ➖, 1↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 217403621 213634416 1.02
clickbench_q01/duckdb:parquet 49719201 49651483 1.00
clickbench_q02/duckdb:parquet 65557148 65575643 1.00
clickbench_q03/duckdb:parquet 62800962 62951241 1.00
clickbench_q04/duckdb:parquet 204559089 204116995 1.00
clickbench_q05/duckdb:parquet 276331845 280134385 0.99
clickbench_q06/duckdb:parquet 59846092 58732751 1.02
clickbench_q07/duckdb:parquet 51027111 51437532 0.99
clickbench_q08/duckdb:parquet 267930281 269932762 0.99
clickbench_q09/duckdb:parquet 394704159 395143263 1.00
clickbench_q10/duckdb:parquet 94121732 98218468 0.96
clickbench_q11/duckdb:parquet 106361831 109202716 0.97
clickbench_q12/duckdb:parquet 297760125 294543094 1.01
clickbench_q13/duckdb:parquet 512367315 504583254 1.02
clickbench_q14/duckdb:parquet 329382080 326011016 1.01
clickbench_q15/duckdb:parquet 241103581 242746884 0.99
clickbench_q16/duckdb:parquet 609797304 604658158 1.01
clickbench_q17/duckdb:parquet 508410244 511858360 0.99
clickbench_q18/duckdb:parquet 1067233412 1050881863 1.02
clickbench_q19/duckdb:parquet 49393003 49523318 1.00
clickbench_q20/duckdb:parquet 427393660 432932908 0.99
clickbench_q21/duckdb:parquet 546450208 559475658 0.98
clickbench_q22/duckdb:parquet 930980579 935520998 1.00
clickbench_q23/duckdb:parquet 306438716 321666682 0.95
clickbench_q24/duckdb:parquet 76782591 77985500 0.98
clickbench_q25/duckdb:parquet 139786821 141048675 0.99
clickbench_q26/duckdb:parquet 52242685 51475302 1.01
clickbench_q27/duckdb:parquet 653557945 641682891 1.02
clickbench_q28/duckdb:parquet 4870520337 4820550428 1.01
clickbench_q29/duckdb:parquet 61893160 60888910 1.02
clickbench_q30/duckdb:parquet 306215683 305080914 1.00
clickbench_q31/duckdb:parquet 348941616 348566776 1.00
clickbench_q32/duckdb:parquet 1135576418 1225642231 0.93
clickbench_q33/duckdb:parquet 🚀 1193835693 1347130008 0.89
clickbench_q34/duckdb:parquet 1342331031 1323415431 1.01
clickbench_q35/duckdb:parquet 353069885 351491689 1.00
clickbench_q36/duckdb:parquet 64431325 63282812 1.02
clickbench_q37/duckdb:parquet 53668821 54473597 0.99
clickbench_q38/duckdb:parquet 57845799 59045824 0.98
clickbench_q39/duckdb:parquet 94722652 97714546 0.97
clickbench_q40/duckdb:parquet 54314448 54440789 1.00
clickbench_q41/duckdb:parquet 57242812 59433774 0.96
clickbench_q42/duckdb:parquet 49882033 49472250 1.01
duckdb / duckdb (0.999x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17895219 17409233 1.03
clickbench_q01/duckdb:duckdb 32347814 33136749 0.98
clickbench_q02/duckdb:duckdb 45378327 46193669 0.98
clickbench_q03/duckdb:duckdb 46486972 46294121 1.00
clickbench_q04/duckdb:duckdb 234461181 221304647 1.06
clickbench_q05/duckdb:duckdb 324100181 349470598 0.93
clickbench_q06/duckdb:duckdb 35582453 34987833 1.02
clickbench_q07/duckdb:duckdb 35320621 34998173 1.01
clickbench_q08/duckdb:duckdb 329569919 321829067 1.02
clickbench_q09/duckdb:duckdb 496943188 499249644 1.00
clickbench_q10/duckdb:duckdb 96091034 98447131 0.98
clickbench_q11/duckdb:duckdb 105923881 107013784 0.99
clickbench_q12/duckdb:duckdb 320074943 315043562 1.02
clickbench_q13/duckdb:duckdb 550561568 544950430 1.01
clickbench_q14/duckdb:duckdb 354942017 349928495 1.01
clickbench_q15/duckdb:duckdb 267994331 265068757 1.01
clickbench_q16/duckdb:duckdb 687099197 677036091 1.01
clickbench_q17/duckdb:duckdb 579920927 589301161 0.98
clickbench_q18/duckdb:duckdb 1288134097 1279991304 1.01
clickbench_q19/duckdb:duckdb 34836816 34789665 1.00
clickbench_q20/duckdb:duckdb 1012194660 1012118299 1.00
clickbench_q21/duckdb:duckdb 1087746513 1110845394 0.98
clickbench_q22/duckdb:duckdb 1101442191 1104009389 1.00
clickbench_q23/duckdb:duckdb 253395353 251951383 1.01
clickbench_q24/duckdb:duckdb 58572656 61212954 0.96
clickbench_q25/duckdb:duckdb 122773139 124118130 0.99
clickbench_q26/duckdb:duckdb 51897793 54974178 0.94
clickbench_q27/duckdb:duckdb 1117259894 1110014371 1.01
clickbench_q28/duckdb:duckdb 4644990171 4656719699 1.00
clickbench_q29/duckdb:duckdb 47918312 48167456 0.99
clickbench_q30/duckdb:duckdb 291827793 310815193 0.94
clickbench_q31/duckdb:duckdb 421974096 441862507 0.95
clickbench_q32/duckdb:duckdb 1417371805 1528960672 0.93
clickbench_q33/duckdb:duckdb 2020656824 1959075640 1.03
clickbench_q34/duckdb:duckdb 2162164059 2020896314 1.07
clickbench_q35/duckdb:duckdb 262670985 263687898 1.00
clickbench_q36/duckdb:duckdb 42029921 38776130 1.08
clickbench_q37/duckdb:duckdb 31133208 31035923 1.00
clickbench_q38/duckdb:duckdb 30825281 31085548 0.99
clickbench_q39/duckdb:duckdb 66287883 62784669 1.06
clickbench_q40/duckdb:duckdb 31154870 31287504 1.00
clickbench_q41/duckdb:duckdb 29796995 29727255 1.00
clickbench_q42/duckdb:duckdb 31199406 31307083 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -11.0% +1.3% -12.2% +746.3% ➖ noise
0 duckdb:duckdb +2.8% +1.3% +1.4% +315.6% ➖ noise
0 duckdb:vortex-file-compressed +2.9% +1.3% +1.6% +373.4% ➖ noise
1 datafusion:vortex-file-compressed -10.3% +1.6% -11.7% +38.7% ➖ noise
1 duckdb:duckdb -2.4% +1.6% -3.9% +76.4% ➖ noise
1 duckdb:vortex-file-compressed -0.1% +1.6% -1.7% +16.2% ➖ noise
2 datafusion:vortex-file-compressed -0.5% +2.7% -3.1% +33.3% ➖ noise
2 duckdb:duckdb -1.8% +2.7% -4.4% +29.3% ➖ noise
2 duckdb:vortex-file-compressed -7.7% +2.7% -10.2% +14.0% ➖ noise
3 datafusion:vortex-file-compressed +3.6% -2.5% +6.2% +180.0% ➖ noise
3 duckdb:duckdb +0.4% -2.5% +3.0% +73.9% ➖ noise
3 duckdb:vortex-file-compressed -1.3% -2.5% +1.2% +31.0% ➖ noise
4 datafusion:vortex-file-compressed +1.6% -0.4% +1.9% +10.0% ➖ noise
4 duckdb:duckdb +5.9% -0.4% +6.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +5.3% -0.4% +5.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.9% +0.2% +1.8% +10.0% ➖ noise
5 duckdb:duckdb -7.3% +0.2% -7.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.6% +0.2% -0.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.9% +0.8% +1.0% +44.6% ➖ noise
6 duckdb:duckdb +1.7% +0.8% +0.9% +29.3% ➖ noise
6 duckdb:vortex-file-compressed +0.4% +0.8% -0.4% +19.5% ➖ noise
7 datafusion:vortex-file-compressed +6.3% -1.0% +7.4% +11.1% ➖ noise
7 duckdb:duckdb +0.9% -1.0% +1.9% +11.9% ➖ noise
7 duckdb:vortex-file-compressed -1.7% -1.0% -0.7% +10.1% ➖ noise
8 datafusion:vortex-file-compressed +0.4% -0.6% +1.0% +10.0% ➖ noise
8 duckdb:duckdb +2.4% -0.6% +3.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.7% -0.6% -0.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.2% -0.7% +0.5% +10.0% ➖ noise
9 duckdb:duckdb -0.5% -0.7% +0.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.0% -0.7% -0.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.8% -2.9% +7.9% +10.4% ➖ noise
10 duckdb:duckdb -2.4% -2.9% +0.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.5% -2.9% +2.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.4% -2.0% +3.5% +10.0% ➖ noise
11 duckdb:duckdb -1.0% -2.0% +1.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.3% -2.0% +0.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.6% +1.6% -0.1% +10.0% ➖ noise
12 duckdb:duckdb +1.6% +1.6% -0.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.5% +1.6% -0.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.3% +1.3% +0.0% +10.0% ➖ noise
13 duckdb:duckdb +1.0% +1.3% -0.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.3% +1.3% -2.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.3% +0.9% -2.2% +10.0% ➖ noise
14 duckdb:duckdb +1.4% +0.9% +0.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.3% +0.9% +0.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.3% -1.7% +1.5% +10.0% ➖ noise
15 duckdb:duckdb +1.1% -1.7% +2.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +7.3% -1.7% +9.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.0% +0.5% -0.5% +10.0% ➖ noise
16 duckdb:duckdb +1.5% +0.5% +1.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.4% +0.5% -1.9% +13.3% ➖ noise
17 datafusion:vortex-file-compressed +0.0% +0.6% -0.5% +10.0% ➖ noise
17 duckdb:duckdb -1.6% +0.6% -2.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -3.4% +0.6% -4.0% +12.7% ➖ noise
18 datafusion:vortex-file-compressed +4.3% -1.5% +5.9% +10.0% ➖ noise
18 duckdb:duckdb +0.6% -1.5% +2.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.0% -1.5% +2.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +8.5% -6.4% +15.9% +23.4% ➖ noise
19 duckdb:duckdb +0.1% -6.4% +7.0% +21.6% ➖ noise
19 duckdb:vortex-file-compressed +8.9% -6.4% +16.4% +35.1% ➖ noise
20 datafusion:vortex-file-compressed +0.5% -1.1% +1.7% +187.6% ➖ noise
20 duckdb:duckdb +0.0% -1.1% +1.2% +28.9% ➖ noise
20 duckdb:vortex-file-compressed +1.4% -1.1% +2.6% +10.1% ➖ noise
21 datafusion:vortex-file-compressed +1.1% +0.0% +1.0% +10.0% ➖ noise
21 duckdb:duckdb -2.1% +0.0% -2.1% +11.6% ➖ noise
21 duckdb:vortex-file-compressed -2.8% +0.0% -2.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +3.6% +0.2% +3.4% +10.0% ➖ noise
22 duckdb:duckdb -0.2% +0.2% -0.4% +12.9% ➖ noise
22 duckdb:vortex-file-compressed +2.0% +0.2% +1.8% +22.1% ➖ noise
23 datafusion:vortex-file-compressed +18.1% -2.6% +21.3% +57.8% ➖ noise
23 duckdb:duckdb +0.6% -2.6% +3.3% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -6.0% -2.6% -3.5% +12.9% ➖ noise
24 datafusion:vortex-file-compressed -5.0% +1.3% -6.3% +14.6% ➖ noise
24 duckdb:duckdb -4.3% +1.3% -5.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -9.7% +1.3% -10.8% +42.7% ➖ noise
25 datafusion:vortex-file-compressed -7.3% -0.1% -7.2% +10.0% ➖ noise
25 duckdb:duckdb -1.1% -0.1% -1.0% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +7.2% -0.1% +7.3% +10.6% ➖ noise
26 datafusion:vortex-file-compressed +17.9% +1.2% +16.5% +16.2% 🚨 regression
26 duckdb:duckdb -5.6% +1.2% -6.7% +12.6% ➖ noise
26 duckdb:vortex-file-compressed -9.9% +1.2% -11.0% +14.2% ➖ noise
27 datafusion:vortex-file-compressed -3.0% +1.2% -4.2% +10.0% ➖ noise
27 duckdb:duckdb +0.7% +1.2% -0.6% +10.4% ➖ noise
27 duckdb:vortex-file-compressed -2.1% +1.2% -3.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.7% +0.9% +0.7% +10.0% ➖ noise
28 duckdb:duckdb -0.3% +0.9% -1.2% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.0% +0.9% -0.9% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -3.2% -0.1% -3.1% +10.0% ➖ noise
29 duckdb:duckdb -0.5% -0.1% -0.4% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -8.6% -0.1% -8.5% +10.8% ➖ noise
30 datafusion:vortex-file-compressed +1.7% -0.8% +2.5% +10.0% ➖ noise
30 duckdb:duckdb -6.1% -0.8% -5.3% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.5% -0.8% -0.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -3.0% +0.2% -3.2% +10.0% ➖ noise
31 duckdb:duckdb -4.5% +0.2% -4.7% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -2.0% +0.2% -2.1% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -1.2% -2.0% +0.8% +16.6% ➖ noise
32 duckdb:duckdb -7.3% -2.0% -5.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +1.9% -2.0% +4.0% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -2.1% -6.0% +4.1% +12.6% ➖ noise
33 duckdb:duckdb +3.1% -6.0% +9.7% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -3.3% -6.0% +2.9% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -2.8% +1.2% -4.0% +10.0% ➖ noise
34 duckdb:duckdb +7.0% +1.2% +5.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +1.6% +1.2% +0.3% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +3.5% -0.9% +4.5% +10.0% ➖ noise
35 duckdb:duckdb -0.4% -0.9% +0.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.4% -0.9% +0.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -0.3% +1.1% -1.4% +10.0% ➖ noise
36 duckdb:duckdb +8.4% +1.1% +7.3% +13.7% ➖ noise
36 duckdb:vortex-file-compressed -4.7% +1.1% -5.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -0.5% -0.5% -0.0% +10.0% ➖ noise
37 duckdb:duckdb +0.3% -0.5% +0.8% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -6.4% -0.5% -5.9% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +1.6% +3.3% -1.7% +10.0% ➖ noise
38 duckdb:duckdb -0.8% +3.3% -4.0% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -9.5% +3.3% -12.4% +10.0% ✅ faster
39 datafusion:vortex-file-compressed -2.0% -1.0% -1.0% +10.0% ➖ noise
39 duckdb:duckdb +5.6% -1.0% +6.7% +21.8% ➖ noise
39 duckdb:vortex-file-compressed -1.0% -1.0% -0.0% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +1.0% -0.9% +1.9% +10.0% ➖ noise
40 duckdb:duckdb -0.4% -0.9% +0.5% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -14.2% -0.9% -13.4% +12.4% ✅ faster
41 datafusion:vortex-file-compressed -0.9% -1.2% +0.3% +10.0% ➖ noise
41 duckdb:duckdb +0.2% -1.2% +1.5% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -6.2% -1.2% -5.0% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +3.7% +1.3% +2.4% +10.0% ➖ noise
42 duckdb:duckdb -0.3% +1.3% -1.6% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -12.0% +1.3% -13.1% +12.9% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.5%
Vortex (geomean): 0.989x ➖
Parquet (geomean): 1.046x ➖
Shifts: Parquet (control) +4.6% · Median polish +2.1%


datafusion / vortex-file-compressed (0.901x ➖, 4↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 239124370 238391655 1.00
tpch_q02/datafusion:vortex-file-compressed 543861987 593077938 0.92
tpch_q03/datafusion:vortex-file-compressed 396756433 564904622 0.70
tpch_q04/datafusion:vortex-file-compressed 269122418 281469564 0.96
tpch_q05/datafusion:vortex-file-compressed 571971324 446840385 1.28
tpch_q06/datafusion:vortex-file-compressed 331667917 295347845 1.12
tpch_q07/datafusion:vortex-file-compressed 628121649 509874746 1.23
tpch_q08/datafusion:vortex-file-compressed 855261118 688339455 1.24
tpch_q09/datafusion:vortex-file-compressed 568897431 773482574 0.74
tpch_q10/datafusion:vortex-file-compressed 🚀 508225347 772218947 0.66
tpch_q11/datafusion:vortex-file-compressed 🚀 301112308 542871871 0.55
tpch_q12/datafusion:vortex-file-compressed 574516144 603465934 0.95
tpch_q13/datafusion:vortex-file-compressed 232120016 204085851 1.14
tpch_q14/datafusion:vortex-file-compressed 🚀 255310295 398291111 0.64
tpch_q15/datafusion:vortex-file-compressed 🚀 388539305 602169119 0.65
tpch_q16/datafusion:vortex-file-compressed 208778308 230018883 0.91
tpch_q17/datafusion:vortex-file-compressed 389496883 448133730 0.87
tpch_q18/datafusion:vortex-file-compressed 382557323 499749575 0.77
tpch_q19/datafusion:vortex-file-compressed 452127715 465624981 0.97
tpch_q20/datafusion:vortex-file-compressed 518024898 438260821 1.18
tpch_q21/datafusion:vortex-file-compressed 539744012 714799476 0.76
tpch_q22/datafusion:vortex-file-compressed 291978481 249013854 1.17
datafusion / vortex-compact (1.068x ➖, 0↑ 1↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 256449737 238952260 1.07
tpch_q02/datafusion:vortex-compact 445633441 422333772 1.06
tpch_q03/datafusion:vortex-compact 337322384 337278847 1.00
tpch_q04/datafusion:vortex-compact 312973712 251552570 1.24
tpch_q05/datafusion:vortex-compact 482645097 381405110 1.27
tpch_q06/datafusion:vortex-compact 🚨 390197145 298814919 1.31
tpch_q07/datafusion:vortex-compact 467814057 410323304 1.14
tpch_q08/datafusion:vortex-compact 504198470 523578690 0.96
tpch_q09/datafusion:vortex-compact 491410736 483385314 1.02
tpch_q10/datafusion:vortex-compact 460100051 508483452 0.90
tpch_q11/datafusion:vortex-compact 257785860 297088800 0.87
tpch_q12/datafusion:vortex-compact 516202832 431005266 1.20
tpch_q13/datafusion:vortex-compact 242346718 226495115 1.07
tpch_q14/datafusion:vortex-compact 317332110 367007044 0.86
tpch_q15/datafusion:vortex-compact 543015684 495281905 1.10
tpch_q16/datafusion:vortex-compact 229216359 198753578 1.15
tpch_q17/datafusion:vortex-compact 408766417 326904564 1.25
tpch_q18/datafusion:vortex-compact 396157833 333945133 1.19
tpch_q19/datafusion:vortex-compact 495121664 428989145 1.15
tpch_q20/datafusion:vortex-compact 506161665 471041741 1.07
tpch_q21/datafusion:vortex-compact 607299805 557567333 1.09
tpch_q22/datafusion:vortex-compact 144116769 193921410 0.74
datafusion / parquet (1.064x ➖, 0↑ 3↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 245025734 211152094 1.16
tpch_q02/datafusion:parquet 🚨 634824278 478412390 1.33
tpch_q03/datafusion:parquet 407472949 359788076 1.13
tpch_q04/datafusion:parquet 191962734 211121918 0.91
tpch_q05/datafusion:parquet 693262372 570321905 1.22
tpch_q06/datafusion:parquet 203362306 251349249 0.81
tpch_q07/datafusion:parquet 631265912 585748220 1.08
tpch_q08/datafusion:parquet 796198570 787603321 1.01
tpch_q09/datafusion:parquet 563587232 616030002 0.91
tpch_q10/datafusion:parquet 629981561 773221751 0.81
tpch_q11/datafusion:parquet 🚨 474527417 351367741 1.35
tpch_q12/datafusion:parquet 288135218 291137389 0.99
tpch_q13/datafusion:parquet 471077361 436310023 1.08
tpch_q14/datafusion:parquet 265786012 218077219 1.22
tpch_q15/datafusion:parquet 🚨 420025209 291041244 1.44
tpch_q16/datafusion:parquet 220742110 201966902 1.09
tpch_q17/datafusion:parquet 513618556 407173310 1.26
tpch_q18/datafusion:parquet 592806918 550846758 1.08
tpch_q19/datafusion:parquet 385685106 450039002 0.86
tpch_q20/datafusion:parquet 441414601 446968829 0.99
tpch_q21/datafusion:parquet 661058278 668051009 0.99
tpch_q22/datafusion:parquet 175363774 177939023 0.99
duckdb / vortex-file-compressed (0.992x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 316055991 320134815 0.99
tpch_q02/duckdb:vortex-file-compressed 1013127345 960034959 1.06
tpch_q03/duckdb:vortex-file-compressed 647496299 617157829 1.05
tpch_q04/duckdb:vortex-file-compressed 398650004 399713707 1.00
tpch_q05/duckdb:vortex-file-compressed 832006749 850293264 0.98
tpch_q06/duckdb:vortex-file-compressed 327999031 358996247 0.91
tpch_q07/duckdb:vortex-file-compressed 758076540 753695573 1.01
tpch_q08/duckdb:vortex-file-compressed 1091088882 911204882 1.20
tpch_q09/duckdb:vortex-file-compressed 928238097 921891096 1.01
tpch_q10/duckdb:vortex-file-compressed 726743057 827199521 0.88
tpch_q11/duckdb:vortex-file-compressed 523844366 509655594 1.03
tpch_q12/duckdb:vortex-file-compressed 515659801 504998030 1.02
tpch_q13/duckdb:vortex-file-compressed 447682499 444200287 1.01
tpch_q14/duckdb:vortex-file-compressed 418081246 540859770 0.77
tpch_q15/duckdb:vortex-file-compressed 284769998 308462979 0.92
tpch_q16/duckdb:vortex-file-compressed 363277948 350968928 1.04
tpch_q17/duckdb:vortex-file-compressed 607412945 693626732 0.88
tpch_q18/duckdb:vortex-file-compressed 563446509 550346631 1.02
tpch_q19/duckdb:vortex-file-compressed 495852833 409957933 1.21
tpch_q20/duckdb:vortex-file-compressed 780828271 817620289 0.96
tpch_q21/duckdb:vortex-file-compressed 1035268415 1040601513 0.99
tpch_q22/duckdb:vortex-file-compressed 381242163 377257695 1.01
duckdb / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 301287121 328862290 0.92
tpch_q02/duckdb:vortex-compact 929786405 936615460 0.99
tpch_q03/duckdb:vortex-compact 541304966 560736608 0.97
tpch_q04/duckdb:vortex-compact 368867045 444585158 0.83
tpch_q05/duckdb:vortex-compact 927439827 912461450 1.02
tpch_q06/duckdb:vortex-compact 393507280 459203816 0.86
tpch_q07/duckdb:vortex-compact 731643157 802878218 0.91
tpch_q08/duckdb:vortex-compact 886337994 968743719 0.91
tpch_q09/duckdb:vortex-compact 913524437 868815152 1.05
tpch_q10/duckdb:vortex-compact 683365849 739525608 0.92
tpch_q11/duckdb:vortex-compact 480176238 506617915 0.95
tpch_q12/duckdb:vortex-compact 436879808 438183588 1.00
tpch_q13/duckdb:vortex-compact 443987008 434181903 1.02
tpch_q14/duckdb:vortex-compact 475124991 452644704 1.05
tpch_q15/duckdb:vortex-compact 323332463 260777292 1.24
tpch_q16/duckdb:vortex-compact 353590352 278701431 1.27
tpch_q17/duckdb:vortex-compact 649404905 629254961 1.03
tpch_q18/duckdb:vortex-compact 570695205 477203881 1.20
tpch_q19/duckdb:vortex-compact 470200728 444732236 1.06
tpch_q20/duckdb:vortex-compact 787472242 807415658 0.98
tpch_q21/duckdb:vortex-compact 1061801217 1084914849 0.98
tpch_q22/duckdb:vortex-compact 354949421 361441870 0.98
duckdb / parquet (1.027x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 634838688 488478702 1.30
tpch_q02/duckdb:parquet 1645772143 1315328158 1.25
tpch_q03/duckdb:parquet 1169815449 961099176 1.22
tpch_q04/duckdb:parquet 636651316 656830562 0.97
tpch_q05/duckdb:parquet 1734771017 1507667728 1.15
tpch_q06/duckdb:parquet 466452335 378001627 1.23
tpch_q07/duckdb:parquet 1395267485 1233377546 1.13
tpch_q08/duckdb:parquet 1794918717 1720483148 1.04
tpch_q09/duckdb:parquet 1461930017 1438288507 1.02
tpch_q10/duckdb:parquet 1386142963 1390681559 1.00
tpch_q11/duckdb:parquet 879192297 848139268 1.04
tpch_q12/duckdb:parquet 643729659 675186367 0.95
tpch_q13/duckdb:parquet 941975463 905537437 1.04
tpch_q14/duckdb:parquet 628436494 759937076 0.83
tpch_q15/duckdb:parquet 545475523 478646463 1.14
tpch_q16/duckdb:parquet 574649747 538099030 1.07
tpch_q17/duckdb:parquet 787199870 803937390 0.98
tpch_q18/duckdb:parquet 848273595 870302994 0.97
tpch_q19/duckdb:parquet 797927279 952441413 0.84
tpch_q20/duckdb:parquet 1017923652 1247569866 0.82
tpch_q21/duckdb:parquet 1256535402 1364086848 0.92
tpch_q22/duckdb:parquet 510972751 570485687 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +7.3% +22.8% -12.6% +126.7% ➖ noise
1 datafusion:vortex-file-compressed +0.3% +22.8% -18.3% +103.3% ➖ noise
1 duckdb:vortex-compact -8.4% +22.8% -25.4% +47.8% ➖ noise
1 duckdb:vortex-file-compressed -1.3% +22.8% -19.6% +50.5% ➖ noise
2 datafusion:vortex-compact +5.5% +28.9% -18.1% +50.8% ➖ noise
2 datafusion:vortex-file-compressed -8.3% +28.9% -28.8% +36.1% ✅ faster
2 duckdb:vortex-compact -0.7% +28.9% -23.0% +36.1% ➖ noise
2 duckdb:vortex-file-compressed +5.5% +28.9% -18.1% +36.1% ➖ noise
3 datafusion:vortex-compact +0.0% +17.4% -14.8% +58.5% ➖ noise
3 datafusion:vortex-file-compressed -29.8% +17.4% -40.2% +62.7% ✅ faster
3 duckdb:vortex-compact -3.5% +17.4% -17.8% +36.1% ➖ noise
3 duckdb:vortex-file-compressed +4.9% +17.4% -10.6% +36.1% ➖ noise
4 datafusion:vortex-compact +24.4% -6.1% +32.5% +53.8% ➖ noise
4 datafusion:vortex-file-compressed -4.4% -6.1% +1.8% +36.1% ➖ noise
4 duckdb:vortex-compact -17.0% -6.1% -11.6% +36.1% ➖ noise
4 duckdb:vortex-file-compressed -0.3% -6.1% +6.2% +36.1% ➖ noise
5 datafusion:vortex-compact +26.5% +18.3% +7.0% +39.6% ➖ noise
5 datafusion:vortex-file-compressed +28.0% +18.3% +8.2% +37.8% ➖ noise
5 duckdb:vortex-compact +1.6% +18.3% -14.1% +36.1% ➖ noise
5 duckdb:vortex-file-compressed -2.2% +18.3% -17.3% +36.1% ➖ noise
6 datafusion:vortex-compact +30.6% -0.1% +30.7% +36.1% ➖ noise
6 datafusion:vortex-file-compressed +12.3% -0.1% +12.4% +36.1% ➖ noise
6 duckdb:vortex-compact -14.3% -0.1% -14.2% +36.1% ➖ noise
6 duckdb:vortex-file-compressed -8.6% -0.1% -8.6% +36.1% ➖ noise
7 datafusion:vortex-compact +14.0% +10.4% +3.3% +36.1% ➖ noise
7 datafusion:vortex-file-compressed +23.2% +10.4% +11.6% +36.1% ➖ noise
7 duckdb:vortex-compact -8.9% +10.4% -17.5% +36.1% ➖ noise
7 duckdb:vortex-file-compressed +0.6% +10.4% -8.9% +36.1% ➖ noise
8 datafusion:vortex-compact -3.7% +2.7% -6.2% +36.1% ➖ noise
8 datafusion:vortex-file-compressed +24.2% +2.7% +21.0% +36.1% ➖ noise
8 duckdb:vortex-compact -8.5% +2.7% -10.9% +36.1% ➖ noise
8 duckdb:vortex-file-compressed +19.7% +2.7% +16.6% +36.1% ➖ noise
9 datafusion:vortex-compact +1.7% -3.6% +5.4% +36.1% ➖ noise
9 datafusion:vortex-file-compressed -26.4% -3.6% -23.7% +36.1% ➖ noise
9 duckdb:vortex-compact +5.1% -3.6% +9.0% +36.1% ➖ noise
9 duckdb:vortex-file-compressed +0.7% -3.6% +4.4% +36.1% ➖ noise
10 datafusion:vortex-compact -9.5% -9.9% +0.4% +36.1% ➖ noise
10 datafusion:vortex-file-compressed -34.2% -9.9% -27.0% +36.1% ✅ faster
10 duckdb:vortex-compact -7.6% -9.9% +2.5% +36.1% ➖ noise
10 duckdb:vortex-file-compressed -12.1% -9.9% -2.5% +36.1% ➖ noise
11 datafusion:vortex-compact -13.2% +18.3% -26.7% +36.1% ✅ faster
11 datafusion:vortex-file-compressed -44.5% +18.3% -53.1% +36.1% ✅ faster
11 duckdb:vortex-compact -5.2% +18.3% -19.9% +36.1% ➖ noise
11 duckdb:vortex-file-compressed +2.8% +18.3% -13.1% +36.1% ➖ noise
12 datafusion:vortex-compact +19.8% -2.9% +23.3% +36.1% ➖ noise
12 datafusion:vortex-file-compressed -4.8% -2.9% -2.0% +41.9% ➖ noise
12 duckdb:vortex-compact -0.3% -2.9% +2.6% +36.1% ➖ noise
12 duckdb:vortex-file-compressed +2.1% -2.9% +5.1% +36.1% ➖ noise
13 datafusion:vortex-compact +7.0% +6.0% +1.0% +36.1% ➖ noise
13 datafusion:vortex-file-compressed +13.7% +6.0% +7.3% +51.3% ➖ noise
13 duckdb:vortex-compact +2.3% +6.0% -3.5% +36.1% ➖ noise
13 duckdb:vortex-file-compressed +0.8% +6.0% -4.9% +36.1% ➖ noise
14 datafusion:vortex-compact -13.5% +0.4% -13.9% +36.1% ➖ noise
14 datafusion:vortex-file-compressed -35.9% +0.4% -36.1% +77.7% ➖ noise
14 duckdb:vortex-compact +5.0% +0.4% +4.6% +36.1% ➖ noise
14 duckdb:vortex-file-compressed -22.7% +0.4% -23.0% +39.1% ➖ noise
15 datafusion:vortex-compact +9.6% +28.2% -14.5% +36.1% ➖ noise
15 datafusion:vortex-file-compressed -35.5% +28.2% -49.7% +53.0% ✅ faster
15 duckdb:vortex-compact +24.0% +28.2% -3.3% +36.1% ➖ noise
15 duckdb:vortex-file-compressed -7.7% +28.2% -28.0% +36.1% ✅ faster
16 datafusion:vortex-compact +15.3% +8.0% +6.7% +36.1% ➖ noise
16 datafusion:vortex-file-compressed -9.2% +8.0% -16.0% +36.1% ➖ noise
16 duckdb:vortex-compact +26.9% +8.0% +17.4% +36.1% ➖ noise
16 duckdb:vortex-file-compressed +3.5% +8.0% -4.2% +36.1% ➖ noise
17 datafusion:vortex-compact +25.0% +11.1% +12.5% +36.1% ➖ noise
17 datafusion:vortex-file-compressed -13.1% +11.1% -21.8% +40.9% ➖ noise
17 duckdb:vortex-compact +3.2% +11.1% -7.1% +36.1% ➖ noise
17 duckdb:vortex-file-compressed -12.4% +11.1% -21.2% +36.1% ➖ noise
18 datafusion:vortex-compact +18.6% +2.4% +15.8% +36.1% ➖ noise
18 datafusion:vortex-file-compressed -23.5% +2.4% -25.3% +84.4% ➖ noise
18 duckdb:vortex-compact +19.6% +2.4% +16.8% +36.1% ➖ noise
18 duckdb:vortex-file-compressed +2.4% +2.4% -0.0% +36.1% ➖ noise
19 datafusion:vortex-compact +15.4% -15.3% +36.2% +36.1% 🚨 regression
19 datafusion:vortex-file-compressed -2.9% -15.3% +14.6% +36.1% ➖ noise
19 duckdb:vortex-compact +5.7% -15.3% +24.8% +36.1% ➖ noise
19 duckdb:vortex-file-compressed +21.0% -15.3% +42.7% +42.8% ➖ noise
20 datafusion:vortex-compact +7.5% -10.2% +19.7% +36.1% ➖ noise
20 datafusion:vortex-file-compressed +18.2% -10.2% +31.7% +36.1% ➖ noise
20 duckdb:vortex-compact -2.5% -10.2% +8.6% +36.1% ➖ noise
20 duckdb:vortex-file-compressed -4.5% -10.2% +6.4% +36.1% ➖ noise
21 datafusion:vortex-compact +8.9% -4.5% +14.1% +36.1% ➖ noise
21 datafusion:vortex-file-compressed -24.5% -4.5% -20.9% +36.1% ➖ noise
21 duckdb:vortex-compact -2.1% -4.5% +2.5% +36.1% ➖ noise
21 duckdb:vortex-file-compressed -0.5% -4.5% +4.2% +36.1% ➖ noise
22 datafusion:vortex-compact -25.7% -6.0% -20.9% +36.1% ➖ noise
22 datafusion:vortex-file-compressed +17.3% -6.0% +24.8% +63.8% ➖ noise
22 duckdb:vortex-compact -1.8% -6.0% +4.5% +36.3% ➖ noise
22 duckdb:vortex-file-compressed +1.1% -6.0% +7.6% +36.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.1%
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.029x ➖
Shifts: Parquet (control) +2.9% · Median polish +0.1%


datafusion / vortex-file-compressed (1.166x ➖, 0↑ 2↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 35594784 33826178 1.05
fineweb_q01/datafusion:vortex-file-compressed 🚨 945469665 590974585 1.60
fineweb_q02/datafusion:vortex-file-compressed 🚨 872428975 530580784 1.64
fineweb_q03/datafusion:vortex-file-compressed 1400511816 1380552968 1.01
fineweb_q04/datafusion:vortex-file-compressed 1429675981 1391921572 1.03
fineweb_q05/datafusion:vortex-file-compressed 1409076685 1372546807 1.03
fineweb_q06/datafusion:vortex-file-compressed 1582834039 1481667774 1.07
fineweb_q07/datafusion:vortex-file-compressed 1453528518 1409625638 1.03
fineweb_q08/datafusion:vortex-file-compressed 704238731 575061921 1.22
datafusion / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34396705 36041576 0.95
fineweb_q01/datafusion:vortex-compact 740304799 744899585 0.99
fineweb_q02/datafusion:vortex-compact 859393389 704295489 1.22
fineweb_q03/datafusion:vortex-compact 1853154738 1992550100 0.93
fineweb_q04/datafusion:vortex-compact 2295082378 2413466637 0.95
fineweb_q05/datafusion:vortex-compact 1724155734 1733960409 0.99
fineweb_q06/datafusion:vortex-compact 1461130696 1515368524 0.96
fineweb_q07/datafusion:vortex-compact 1376621806 1297457660 1.06
fineweb_q08/datafusion:vortex-compact 417904392 416954465 1.00
datafusion / parquet (1.056x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1270263983 985755640 1.29
fineweb_q01/datafusion:parquet 2004584744 1851075277 1.08
fineweb_q02/datafusion:parquet 1894664451 1951846220 0.97
fineweb_q03/datafusion:parquet 1979297251 1983224510 1.00
fineweb_q04/datafusion:parquet 1917454540 1995535497 0.96
fineweb_q05/datafusion:parquet 1967485386 1850462294 1.06
fineweb_q06/datafusion:parquet 1945776259 1819109974 1.07
fineweb_q07/datafusion:parquet 2187424064 1938650592 1.13
fineweb_q08/datafusion:parquet 2084291165 2127387620 0.98
duckdb / vortex-file-compressed (0.924x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 109011707 121271912 0.90
fineweb_q01/duckdb:vortex-file-compressed 621289526 663431024 0.94
fineweb_q02/duckdb:vortex-file-compressed 522370473 532872737 0.98
fineweb_q03/duckdb:vortex-file-compressed 1584169901 1986408903 0.80
fineweb_q04/duckdb:vortex-file-compressed 1647407809 1745596671 0.94
fineweb_q05/duckdb:vortex-file-compressed 1598963939 1556038138 1.03
fineweb_q06/duckdb:vortex-file-compressed 1725583344 1746192986 0.99
fineweb_q07/duckdb:vortex-file-compressed 1499232381 1641570609 0.91
fineweb_q08/duckdb:vortex-file-compressed 738460417 863986685 0.85
duckdb / vortex-compact (0.950x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 133620722 126282928 1.06
fineweb_q01/duckdb:vortex-compact 581812832 606663349 0.96
fineweb_q02/duckdb:vortex-compact 586816149 587204090 1.00
fineweb_q03/duckdb:vortex-compact 1711536313 1922743993 0.89
fineweb_q04/duckdb:vortex-compact 1758607360 2052117837 0.86
fineweb_q05/duckdb:vortex-compact 1533830958 1816809122 0.84
fineweb_q06/duckdb:vortex-compact 1491916276 1532589467 0.97
fineweb_q07/duckdb:vortex-compact 1340461918 1310065381 1.02
fineweb_q08/duckdb:vortex-compact 512265938 526357962 0.97
duckdb / parquet (1.002x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1176305208 1056692084 1.11
fineweb_q01/duckdb:parquet 1798593361 1783446421 1.01
fineweb_q02/duckdb:parquet 1696413587 1663208077 1.02
fineweb_q03/duckdb:parquet 4407919668 4260105177 1.03
fineweb_q04/duckdb:parquet 1911408169 1949826332 0.98
fineweb_q05/duckdb:parquet 2845584989 2972673189 0.96
fineweb_q06/duckdb:parquet 3506692627 3425925858 1.02
fineweb_q07/duckdb:parquet 4087770801 4203179360 0.97
fineweb_q08/duckdb:parquet 1104819963 1196739871 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -4.6% +19.8% -20.3% +94.9% ➖ noise
0 datafusion:vortex-file-compressed +5.2% +19.8% -12.1% +197.8% ➖ noise
0 duckdb:vortex-compact +5.8% +19.8% -11.7% +34.6% ➖ noise
0 duckdb:vortex-file-compressed -10.1% +19.8% -24.9% +43.4% ➖ noise
1 datafusion:vortex-compact -0.6% +4.5% -4.9% +32.8% ➖ noise
1 datafusion:vortex-file-compressed +60.0% +4.5% +53.1% +55.8% ➖ noise
1 duckdb:vortex-compact -4.1% +4.5% -8.2% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -6.4% +4.5% -10.4% +30.0% ➖ noise
2 datafusion:vortex-compact +22.0% -0.5% +22.6% +34.0% ➖ noise
2 datafusion:vortex-file-compressed +64.4% -0.5% +65.3% +31.7% 🚨 regression
2 duckdb:vortex-compact -0.1% -0.5% +0.4% +41.0% ➖ noise
2 duckdb:vortex-file-compressed -2.0% -0.5% -1.5% +30.0% ➖ noise
3 datafusion:vortex-compact -7.0% +1.6% -8.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +1.4% +1.6% -0.2% +30.0% ➖ noise
3 duckdb:vortex-compact -11.0% +1.6% -12.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -20.2% +1.6% -21.5% +30.0% ➖ noise
4 datafusion:vortex-compact -4.9% -2.9% -2.0% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +2.7% -2.9% +5.8% +30.0% ➖ noise
4 duckdb:vortex-compact -14.3% -2.9% -11.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -5.6% -2.9% -2.8% +30.0% ➖ noise
5 datafusion:vortex-compact -0.6% +0.9% -1.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +2.7% +0.9% +1.8% +30.0% ➖ noise
5 duckdb:vortex-compact -15.6% +0.9% -16.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +2.8% +0.9% +1.9% +30.0% ➖ noise
6 datafusion:vortex-compact -3.6% +4.6% -7.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +6.8% +4.6% +2.1% +30.0% ➖ noise
6 duckdb:vortex-compact -2.7% +4.6% -7.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -1.2% +4.6% -5.6% +30.0% ➖ noise
7 datafusion:vortex-compact +6.1% +4.8% +1.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.1% +4.8% -1.6% +30.0% ➖ noise
7 duckdb:vortex-compact +2.3% +4.8% -2.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -8.7% +4.8% -12.8% +30.2% ➖ noise
8 datafusion:vortex-compact +0.2% -4.9% +5.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +22.5% -4.9% +28.8% +30.0% ➖ noise
8 duckdb:vortex-compact -2.7% -4.9% +2.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -14.5% -4.9% -10.1% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 0.977x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -2.3%


datafusion / vortex-file-compressed (0.983x ➖, 0↑ 1↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 773242702 901923024 0.86
tpch_q02/datafusion:vortex-file-compressed 1049163192 809779701 1.30
tpch_q03/datafusion:vortex-file-compressed 990494026 959319997 1.03
tpch_q04/datafusion:vortex-file-compressed 694797939 621177741 1.12
tpch_q05/datafusion:vortex-file-compressed 1085874800 1279601117 0.85
tpch_q06/datafusion:vortex-file-compressed 801119419 958597036 0.84
tpch_q07/datafusion:vortex-file-compressed 1344915255 1544247901 0.87
tpch_q08/datafusion:vortex-file-compressed 1257878599 1182446294 1.06
tpch_q09/datafusion:vortex-file-compressed 1489985931 1478788618 1.01
tpch_q10/datafusion:vortex-file-compressed 1090764721 1046062486 1.04
tpch_q11/datafusion:vortex-file-compressed 557632299 582064058 0.96
tpch_q12/datafusion:vortex-file-compressed 990163850 1039314374 0.95
tpch_q13/datafusion:vortex-file-compressed 443277189 469939422 0.94
tpch_q14/datafusion:vortex-file-compressed 615402787 604793825 1.02
tpch_q15/datafusion:vortex-file-compressed 1144732396 1200312869 0.95
tpch_q16/datafusion:vortex-file-compressed 307554999 404751106 0.76
tpch_q17/datafusion:vortex-file-compressed 1187450398 1282771521 0.93
tpch_q18/datafusion:vortex-file-compressed 1360113732 1494329211 0.91
tpch_q19/datafusion:vortex-file-compressed 🚨 1027827438 772388811 1.33
tpch_q20/datafusion:vortex-file-compressed 1198859717 1000674879 1.20
tpch_q21/datafusion:vortex-file-compressed 1747448021 1978993782 0.88
tpch_q22/datafusion:vortex-file-compressed 421410872 412071006 1.02
datafusion / vortex-compact (0.953x ➖, 0↑ 1↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 743464968 733765621 1.01
tpch_q02/datafusion:vortex-compact 839745889 783990896 1.07
tpch_q03/datafusion:vortex-compact 748946771 857694315 0.87
tpch_q04/datafusion:vortex-compact 561673002 615540364 0.91
tpch_q05/datafusion:vortex-compact 960207944 1004148986 0.96
tpch_q06/datafusion:vortex-compact 631825419 636602641 0.99
tpch_q07/datafusion:vortex-compact 1132431530 1152084761 0.98
tpch_q08/datafusion:vortex-compact 1157137947 1187801878 0.97
tpch_q09/datafusion:vortex-compact 1311124530 1503492152 0.87
tpch_q10/datafusion:vortex-compact 1021384881 1159882802 0.88
tpch_q11/datafusion:vortex-compact 432392502 507415442 0.85
tpch_q12/datafusion:vortex-compact 795013888 1088035857 0.73
tpch_q13/datafusion:vortex-compact 411793097 448431563 0.92
tpch_q14/datafusion:vortex-compact 605250175 657514981 0.92
tpch_q15/datafusion:vortex-compact 1018198600 1213259104 0.84
tpch_q16/datafusion:vortex-compact 387362985 415191694 0.93
tpch_q17/datafusion:vortex-compact 1172212538 1234874045 0.95
tpch_q18/datafusion:vortex-compact 1241955416 1195182064 1.04
tpch_q19/datafusion:vortex-compact 672574057 691682615 0.97
tpch_q20/datafusion:vortex-compact 933676041 916415181 1.02
tpch_q21/datafusion:vortex-compact 1434289709 1409157741 1.02
tpch_q22/datafusion:vortex-compact 🚨 495416956 352430787 1.41
datafusion / parquet (0.991x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 933944428 962201590 0.97
tpch_q02/datafusion:parquet 991079535 859887822 1.15
tpch_q03/datafusion:parquet 1018098260 1073751924 0.95
tpch_q04/datafusion:parquet 506712648 481386539 1.05
tpch_q05/datafusion:parquet 1248946262 1337739570 0.93
tpch_q06/datafusion:parquet 547155000 563310328 0.97
tpch_q07/datafusion:parquet 1446135875 1515231181 0.95
tpch_q08/datafusion:parquet 1848215103 1783074044 1.04
tpch_q09/datafusion:parquet 1890803204 1976919252 0.96
tpch_q10/datafusion:parquet 2076761009 2748433133 0.76
tpch_q11/datafusion:parquet 786788847 749764544 1.05
tpch_q12/datafusion:parquet 770131896 804784172 0.96
tpch_q13/datafusion:parquet 834497067 878966348 0.95
tpch_q14/datafusion:parquet 988590062 870746822 1.14
tpch_q15/datafusion:parquet 1294425101 1252582860 1.03
tpch_q16/datafusion:parquet 515435045 452141181 1.14
tpch_q17/datafusion:parquet 1494146018 1600770226 0.93
tpch_q18/datafusion:parquet 1819556156 1788553143 1.02
tpch_q19/datafusion:parquet 1117875418 1057670079 1.06
tpch_q20/datafusion:parquet 1323997531 1233844104 1.07
tpch_q21/datafusion:parquet 1896527982 2008243755 0.94
tpch_q22/datafusion:parquet 653174892 756007371 0.86
duckdb / vortex-file-compressed (1.017x ➖, 0↑ 1↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 619206598 636306348 0.97
tpch_q02/duckdb:vortex-file-compressed 1301803480 1247751864 1.04
tpch_q03/duckdb:vortex-file-compressed 974987225 910791233 1.07
tpch_q04/duckdb:vortex-file-compressed 635330113 676912992 0.94
tpch_q05/duckdb:vortex-file-compressed 1084858141 1180968142 0.92
tpch_q06/duckdb:vortex-file-compressed 808997438 831202908 0.97
tpch_q07/duckdb:vortex-file-compressed 1178902181 1148802464 1.03
tpch_q08/duckdb:vortex-file-compressed 1450842658 1561457886 0.93
tpch_q09/duckdb:vortex-file-compressed 1532724287 1414966763 1.08
tpch_q10/duckdb:vortex-file-compressed 1111349243 1108863545 1.00
tpch_q11/duckdb:vortex-file-compressed 714975815 802792751 0.89
tpch_q12/duckdb:vortex-file-compressed 876988927 712195773 1.23
tpch_q13/duckdb:vortex-file-compressed 896813986 952712651 0.94
tpch_q14/duckdb:vortex-file-compressed 871507818 839262958 1.04
tpch_q15/duckdb:vortex-file-compressed 582779275 528741055 1.10
tpch_q16/duckdb:vortex-file-compressed 🚨 574217108 430606126 1.33
tpch_q17/duckdb:vortex-file-compressed 991552961 971699084 1.02
tpch_q18/duckdb:vortex-file-compressed 912414283 895349012 1.02
tpch_q19/duckdb:vortex-file-compressed 777144050 789746170 0.98
tpch_q20/duckdb:vortex-file-compressed 1240186627 1210571720 1.02
tpch_q21/duckdb:vortex-file-compressed 1944614221 1961664578 0.99
tpch_q22/duckdb:vortex-file-compressed 656163114 696123766 0.94
duckdb / vortex-compact (0.957x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 629925157 585516783 1.08
tpch_q02/duckdb:vortex-compact 972798236 1316533125 0.74
tpch_q03/duckdb:vortex-compact 771500043 901612400 0.86
tpch_q04/duckdb:vortex-compact 542946941 527788264 1.03
tpch_q05/duckdb:vortex-compact 1059232843 1097880976 0.96
tpch_q06/duckdb:vortex-compact 787962253 861626407 0.91
tpch_q07/duckdb:vortex-compact 1108557459 1234320753 0.90
tpch_q08/duckdb:vortex-compact 1450828969 1274113601 1.14
tpch_q09/duckdb:vortex-compact 1377875404 1368876764 1.01
tpch_q10/duckdb:vortex-compact 1147010503 1076147515 1.07
tpch_q11/duckdb:vortex-compact 665225913 822472085 0.81
tpch_q12/duckdb:vortex-compact 714569548 642180609 1.11
tpch_q13/duckdb:vortex-compact 894300775 857309159 1.04
tpch_q14/duckdb:vortex-compact 804940682 821143082 0.98
tpch_q15/duckdb:vortex-compact 556243082 564069718 0.99
tpch_q16/duckdb:vortex-compact 404297962 441268584 0.92
tpch_q17/duckdb:vortex-compact 846172248 942663243 0.90
tpch_q18/duckdb:vortex-compact 713747747 785137659 0.91
tpch_q19/duckdb:vortex-compact 767841838 768707259 1.00
tpch_q20/duckdb:vortex-compact 1221989335 1188359988 1.03
tpch_q21/duckdb:vortex-compact 1651479125 1636760548 1.01
tpch_q22/duckdb:vortex-compact 607117931 766459772 0.79
duckdb / parquet (0.954x ➖, 0↑ 0↓)
name PR 13ccccf (ns) base cbc8ad1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 892671637 1031044477 0.87
tpch_q02/duckdb:parquet 1555477862 1649916388 0.94
tpch_q03/duckdb:parquet 1589696166 1723910829 0.92
tpch_q04/duckdb:parquet 1046281712 1120537121 0.93
tpch_q05/duckdb:parquet 2274756642 2811540481 0.81
tpch_q06/duckdb:parquet 671090295 798619426 0.84
tpch_q07/duckdb:parquet 1747652879 1692565292 1.03
tpch_q08/duckdb:parquet 2446459613 2373739969 1.03
tpch_q09/duckdb:parquet 2309339633 2412369460 0.96
tpch_q10/duckdb:parquet 2948677913 3045665876 0.97
tpch_q11/duckdb:parquet 973754895 984489505 0.99
tpch_q12/duckdb:parquet 939528969 1164604598 0.81
tpch_q13/duckdb:parquet 1377761767 1184551863 1.16
tpch_q14/duckdb:parquet 1246142539 1308059826 0.95
tpch_q15/duckdb:parquet 915584985 921298771 0.99
tpch_q16/duckdb:parquet 801118523 875413597 0.92
tpch_q17/duckdb:parquet 1287091953 1356871432 0.95
tpch_q18/duckdb:parquet 1316993107 1346173522 0.98
tpch_q19/duckdb:parquet 1531409532 1641298892 0.93
tpch_q20/duckdb:parquet 1707218173 1742099396 0.98
tpch_q21/duckdb:parquet 1932135302 1700173146 1.14
tpch_q22/duckdb:parquet 954956110 982579704 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.3% -8.3% +10.5% +38.5% ➖ noise
1 datafusion:vortex-file-compressed -14.3% -8.3% -6.5% +37.3% ➖ noise
1 duckdb:vortex-compact +7.6% -8.3% +17.4% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -2.7% -8.3% +6.2% +30.0% ➖ noise
2 datafusion:vortex-compact +7.1% +4.2% +2.8% +40.4% ➖ noise
2 datafusion:vortex-file-compressed +29.6% +4.2% +24.3% +41.5% ➖ noise
2 duckdb:vortex-compact -26.1% +4.2% -29.1% +30.0% ✅ faster
2 duckdb:vortex-file-compressed +4.3% +4.2% +0.1% +30.0% ➖ noise
3 datafusion:vortex-compact -12.7% -6.5% -6.6% +56.3% ➖ noise
3 datafusion:vortex-file-compressed +3.2% -6.5% +10.4% +58.4% ➖ noise
3 duckdb:vortex-compact -14.4% -6.5% -8.5% +33.5% ➖ noise
3 duckdb:vortex-file-compressed +7.0% -6.5% +14.5% +38.1% ➖ noise
4 datafusion:vortex-compact -8.8% -0.9% -8.0% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +11.9% -0.9% +12.8% +30.0% ➖ noise
4 duckdb:vortex-compact +2.9% -0.9% +3.8% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -6.1% -0.9% -5.3% +30.0% ➖ noise
5 datafusion:vortex-compact -4.4% -13.1% +10.0% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -15.1% -13.1% -2.4% +30.0% ➖ noise
5 duckdb:vortex-compact -3.5% -13.1% +11.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -8.1% -13.1% +5.7% +30.0% ➖ noise
6 datafusion:vortex-compact -0.8% -9.7% +9.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -16.4% -9.7% -7.5% +49.6% ➖ noise
6 duckdb:vortex-compact -8.5% -9.7% +1.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -2.7% -9.7% +7.7% +30.0% ➖ noise
7 datafusion:vortex-compact -1.7% -0.7% -1.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -12.9% -0.7% -12.3% +30.0% ➖ noise
7 duckdb:vortex-compact -10.2% -0.7% -9.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +2.6% -0.7% +3.4% +30.0% ➖ noise
8 datafusion:vortex-compact -2.6% +3.4% -5.7% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +6.4% +3.4% +2.9% +30.0% ➖ noise
8 duckdb:vortex-compact +13.9% +3.4% +10.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -7.1% +3.4% -10.1% +30.0% ➖ noise
9 datafusion:vortex-compact -12.8% -4.3% -8.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +0.8% -4.3% +5.3% +30.0% ➖ noise
9 duckdb:vortex-compact +0.7% -4.3% +5.2% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +8.3% -4.3% +13.2% +30.0% ➖ noise
10 datafusion:vortex-compact -11.9% -14.5% +3.0% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +4.3% -14.5% +21.9% +30.0% ➖ noise
10 duckdb:vortex-compact +6.6% -14.5% +24.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +0.2% -14.5% +17.2% +30.0% ➖ noise
11 datafusion:vortex-compact -14.8% +1.9% -16.4% +34.2% ➖ noise
11 datafusion:vortex-file-compressed -4.2% +1.9% -6.0% +30.0% ➖ noise
11 duckdb:vortex-compact -19.1% +1.9% -20.6% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -10.9% +1.9% -12.6% +30.0% ➖ noise
12 datafusion:vortex-compact -26.9% -12.1% -16.8% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -4.7% -12.1% +8.4% +30.0% ➖ noise
12 duckdb:vortex-compact +11.3% -12.1% +26.6% +35.7% ➖ noise
12 duckdb:vortex-file-compressed +23.1% -12.1% +40.1% +30.0% 🚨 regression
13 datafusion:vortex-compact -8.2% +5.1% -12.6% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -5.7% +5.1% -10.2% +30.0% ➖ noise
13 duckdb:vortex-compact +4.3% +5.1% -0.7% +31.9% ➖ noise
13 duckdb:vortex-file-compressed -5.9% +5.1% -10.4% +34.6% ➖ noise
14 datafusion:vortex-compact -7.9% +4.0% -11.5% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +1.8% +4.0% -2.2% +30.0% ➖ noise
14 duckdb:vortex-compact -2.0% +4.0% -5.7% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +3.8% +4.0% -0.2% +30.0% ➖ noise
15 datafusion:vortex-compact -16.1% +1.3% -17.2% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -4.6% +1.3% -5.9% +30.0% ➖ noise
15 duckdb:vortex-compact -1.4% +1.3% -2.7% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +10.2% +1.3% +8.8% +30.0% ➖ noise
16 datafusion:vortex-compact -6.7% +2.1% -8.7% +41.8% ➖ noise
16 datafusion:vortex-file-compressed -24.0% +2.1% -25.6% +30.0% ✅ faster
16 duckdb:vortex-compact -8.4% +2.1% -10.3% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +33.4% +2.1% +30.6% +34.4% ➖ noise
17 datafusion:vortex-compact -5.1% -5.9% +0.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -7.4% -5.9% -1.6% +30.0% ➖ noise
17 duckdb:vortex-compact -10.2% -5.9% -4.6% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +2.0% -5.9% +8.4% +30.0% ➖ noise
18 datafusion:vortex-compact +3.9% -0.2% +4.2% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -9.0% -0.2% -8.8% +30.0% ➖ noise
18 duckdb:vortex-compact -9.1% -0.2% -8.9% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +1.9% -0.2% +2.1% +30.0% ➖ noise
19 datafusion:vortex-compact -2.8% -0.7% -2.1% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +33.1% -0.7% +34.0% +38.3% ➖ noise
19 duckdb:vortex-compact -0.1% -0.7% +0.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -1.6% -0.7% -0.9% +30.0% ➖ noise
20 datafusion:vortex-compact +1.9% +2.5% -0.6% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +19.8% +2.5% +16.8% +35.5% ➖ noise
20 duckdb:vortex-compact +2.8% +2.5% +0.3% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +2.4% +2.5% -0.1% +30.0% ➖ noise
21 datafusion:vortex-compact +1.8% +3.6% -1.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -11.7% +3.6% -14.8% +30.0% ➖ noise
21 duckdb:vortex-compact +0.9% +3.6% -2.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -0.9% +3.6% -4.3% +30.0% ➖ noise
22 datafusion:vortex-compact +40.6% -8.4% +53.4% +30.1% 🚨 regression
22 datafusion:vortex-file-compressed +2.3% -8.4% +11.6% +30.0% ➖ noise
22 duckdb:vortex-compact -20.8% -8.4% -13.6% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -5.7% -8.4% +2.9% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 30 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions bot added the stale This PR is stale and will be auto-closed soon label Apr 15, 2026
@AdamGS AdamGS closed this Apr 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement stale This PR is stale and will be auto-closed soon

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant