Skip to content

Make PolarSignals profiling data more visible - #9029

Merged
AdamGS merged 11 commits into
developfrom
adamg/polarsignals-preview-benchmark
Jul 28, 2026
Merged

Make PolarSignals profiling data more visible#9029
AdamGS merged 11 commits into
developfrom
adamg/polarsignals-preview-benchmark

Conversation

@AdamGS

@AdamGS AdamGS commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Rationale for this change

This PR makes a few changes to make polarsignals more visible and easier to use.

  1. Adds a job identifier, so you can see the status of each benchmark/job and go directly to the respective dashboard
  2. Adds some labels to make things more intuitive when exploring data
  3. Upload the binary's debug-info in a dedicated action, which is a lot more robust as the agent might not upload everything in time.
  4. Enable frame points which dropped at some point, not sure why.

Special thanks to @brancz for helping me debug parca ❤️

@AdamGS
ps profiles
78fe111 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7f3ef04 statpopgen 1 Explore Profiling Data
🟢 Done 7f3ef04 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 7f3ef04 clickbench-nvme 1 Explore Profiling Data
🟢 Done 7f3ef04 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 7f3ef04 fineweb 1 Explore Profiling Data
🟢 Done 7f3ef04 tpcds-nvme 1 Explore Profiling Data
🟢 Done 7f3ef04 tpch-s3 1 Explore Profiling Data
🟢 Done 7f3ef04 tpch-nvme 1 Explore Profiling Data
🟢 Done 7f3ef04 fineweb-s3 1 Explore Profiling Data
🟢 Done 7f3ef04 polarsignals 1 Explore Profiling Data
Previous Runs (71)
Status Commit Job Attempt Link
🟢 Done 1d6d710 fineweb 1 Explore Profiling Data
🟢 Done 1d6d710 tpch-nvme 1 Explore Profiling Data
🟢 Done 1d6d710 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 1d6d710 tpcds-nvme 1 Explore Profiling Data
🟢 Done cfe38fb clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done cfe38fb clickbench-nvme 1 Explore Profiling Data
🟢 Done cfe38fb polarsignals 1 Explore Profiling Data
🟢 Done cfe38fb statpopgen 1 Explore Profiling Data
🟢 Done cfe38fb tpch-nvme 1 Explore Profiling Data
🟢 Done cfe38fb tpcds-nvme 1 Explore Profiling Data
🟢 Done cfe38fb tpch-nvme-10 1 Explore Profiling Data
🟢 Done cfe38fb fineweb 1 Explore Profiling Data
🟢 Done cfe38fb tpch-s3 1 Explore Profiling Data
🟢 Done b7e1d27 statpopgen 1 Explore Profiling Data
🟡 In Progress b7e1d27 clickbench-nvme 1 Explore Profiling Data
🟢 Done b7e1d27 polarsignals 1 Explore Profiling Data
🟢 Done b7e1d27 fineweb 1 Explore Profiling Data
🟢 Done b7e1d27 tpch-s3 1 Explore Profiling Data
🟢 Done b7e1d27 fineweb-s3 1 Explore Profiling Data
🟢 Done b7e1d27 tpch-nvme-10 1 Explore Profiling Data
🟢 Done b7e1d27 tpcds-nvme 1 Explore Profiling Data
🟢 Done 86adaa5 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 86adaa5 statpopgen 1 Explore Profiling Data
🟢 Done 86adaa5 clickbench-nvme 1 Explore Profiling Data
🟢 Done 86adaa5 fineweb-s3 1 Explore Profiling Data
🟢 Done 86adaa5 fineweb 1 Explore Profiling Data
🟢 Done 86adaa5 tpcds-nvme 1 Explore Profiling Data
🟢 Done 86adaa5 polarsignals 1 Explore Profiling Data
🟢 Done 86adaa5 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 86adaa5 tpch-nvme 1 Explore Profiling Data
🟢 Done 86adaa5 tpch-s3 1 Explore Profiling Data
🟢 Done 2f12343 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 2f12343 statpopgen 1 Explore Profiling Data
🟢 Done 2f12343 clickbench-nvme 1 Explore Profiling Data
🟢 Done 2f12343 fineweb-s3 1 Explore Profiling Data
🟢 Done 2f12343 fineweb 1 Explore Profiling Data
🟢 Done 2f12343 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 2f12343 polarsignals 1 Explore Profiling Data
🟢 Done 2f12343 tpcds-nvme 1 Explore Profiling Data
🟢 Done 2f12343 tpch-s3 1 Explore Profiling Data
🟢 Done 2f12343 tpch-nvme 1 Explore Profiling Data
🟢 Done a89313c clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done a89313c statpopgen 1 Explore Profiling Data
🟢 Done a89313c clickbench-nvme 1 Explore Profiling Data
🟢 Done a89313c fineweb-s3 1 Explore Profiling Data
🟢 Done a89313c fineweb 1 Explore Profiling Data
🟢 Done a89313c polarsignals 1 Explore Profiling Data
🟢 Done a89313c tpcds-nvme 1 Explore Profiling Data
🟢 Done a89313c tpch-nvme-10 1 Explore Profiling Data
🟢 Done a89313c tpch-s3 1 Explore Profiling Data
🟢 Done a89313c tpch-nvme 1 Explore Profiling Data
🟢 Done 0270890 polarsignals 2 Explore Profiling Data
🟢 Done 0270890 statpopgen 1 Explore Profiling Data
🟢 Done 0270890 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 0270890 clickbench-nvme 1 Explore Profiling Data
🟢 Done 0270890 fineweb-s3 1 Explore Profiling Data
🟢 Done 0270890 fineweb 1 Explore Profiling Data
🟢 Done 0270890 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 0270890 tpcds-nvme 1 Explore Profiling Data
🟢 Done 0270890 tpch-s3 1 Explore Profiling Data
🟢 Done 0270890 tpch-nvme 1 Explore Profiling Data
🟢 Done 78fe111 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 78fe111 statpopgen 1 Explore Profiling Data
🟢 Done 78fe111 fineweb-s3 1 Explore Profiling Data
🟢 Done 78fe111 clickbench-nvme 1 Explore Profiling Data
🟢 Done 78fe111 fineweb 1 Explore Profiling Data
🟢 Done 78fe111 tpcds-nvme 1 Explore Profiling Data
🟢 Done 78fe111 polarsignals 1 Explore Profiling Data
🟢 Done 78fe111 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 78fe111 tpch-s3 1 Explore Profiling Data
🟢 Done 78fe111 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.139x ❌

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.139x ❌, 0↑ 8↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 123789247 105128220 1.18
polarsignals_q01/datafusion:vortex-file-compressed 🚨 315529772 264616150 1.19
polarsignals_q02/datafusion:vortex-file-compressed 🚨 26553863 23833711 1.11
polarsignals_q03/datafusion:vortex-file-compressed 🚨 316900768 272162858 1.16
polarsignals_q04/datafusion:vortex-file-compressed 🚨 11428559 9929758 1.15
polarsignals_q05/datafusion:vortex-file-compressed 🚨 16433388 14201288 1.16
polarsignals_q06/datafusion:vortex-file-compressed 🚨 21649506 19597572 1.10
polarsignals_q07/datafusion:vortex-file-compressed 14714734 13393919 1.10
polarsignals_q08/datafusion:vortex-file-compressed 🚨 470293074 403612321 1.17
polarsignals_q09/datafusion:vortex-file-compressed 10760311 10011513 1.07

No file size changes detected.

@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+1.4%, low confidence)
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52169587 50796098 1.03
tpch_q02/datafusion:vortex-file-compressed 21766172 21880792 0.99
tpch_q03/datafusion:vortex-file-compressed 29978199 31032661 0.97
tpch_q04/datafusion:vortex-file-compressed 19365453 18986003 1.02
tpch_q05/datafusion:vortex-file-compressed 45188986 45150015 1.00
tpch_q06/datafusion:vortex-file-compressed 9213008 9611016 0.96
tpch_q07/datafusion:vortex-file-compressed 51242576 52569741 0.97
tpch_q08/datafusion:vortex-file-compressed 38084602 37815154 1.01
tpch_q09/datafusion:vortex-file-compressed 48515676 49998001 0.97
tpch_q10/datafusion:vortex-file-compressed 34206882 32596798 1.05
tpch_q11/datafusion:vortex-file-compressed 15631162 16080081 0.97
tpch_q12/datafusion:vortex-file-compressed 23269907 24618546 0.95
tpch_q13/datafusion:vortex-file-compressed 24538187 24601871 1.00
tpch_q14/datafusion:vortex-file-compressed 14947732 15028110 0.99
tpch_q15/datafusion:vortex-file-compressed 22479343 22220266 1.01
tpch_q16/datafusion:vortex-file-compressed 18429156 18923567 0.97
tpch_q17/datafusion:vortex-file-compressed 63954236 62466952 1.02
tpch_q18/datafusion:vortex-file-compressed 73295383 74075752 0.99
tpch_q19/datafusion:vortex-file-compressed 19723781 19518249 1.01
tpch_q20/datafusion:vortex-file-compressed 29142993 29489853 0.99
tpch_q21/datafusion:vortex-file-compressed 66497957 68376491 0.97
tpch_q22/datafusion:vortex-file-compressed 11790506 12176689 0.97
datafusion / parquet (0.993x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 129486613 132290623 0.98
tpch_q02/datafusion:parquet 58948976 60754138 0.97
tpch_q03/datafusion:parquet 81679217 77420013 1.06
tpch_q04/datafusion:parquet 45979801 47025256 0.98
tpch_q05/datafusion:parquet 94348204 92328049 1.02
tpch_q06/datafusion:parquet 40403326 43593468 0.93
tpch_q07/datafusion:parquet 106828114 97609069 1.09
tpch_q08/datafusion:parquet 88830195 97927277 0.91
tpch_q09/datafusion:parquet 125454558 125855202 1.00
tpch_q10/datafusion:parquet 113884027 111611858 1.02
tpch_q11/datafusion:parquet 41174776 41581248 0.99
tpch_q12/datafusion:parquet 84110681 77790901 1.08
tpch_q13/datafusion:parquet 193030018 191569048 1.01
tpch_q14/datafusion:parquet 45321364 46400916 0.98
tpch_q15/datafusion:parquet 59873324 63391687 0.94
tpch_q16/datafusion:parquet 42257680 41236816 1.02
tpch_q17/datafusion:parquet 137127545 143270244 0.96
tpch_q18/datafusion:parquet 150679672 151721777 0.99
tpch_q19/datafusion:parquet 77119268 76876259 1.00
tpch_q20/datafusion:parquet 72907472 73562741 0.99
tpch_q21/datafusion:parquet 136493840 143074499 0.95
tpch_q22/datafusion:parquet 44354486 45092848 0.98
duckdb / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 27683591 27804589 1.00
tpch_q02/duckdb:vortex-file-compressed 25024770 24828159 1.01
tpch_q03/duckdb:vortex-file-compressed 31094061 31411779 0.99
tpch_q04/duckdb:vortex-file-compressed 27555819 27155313 1.01
tpch_q05/duckdb:vortex-file-compressed 34357958 34706139 0.99
tpch_q06/duckdb:vortex-file-compressed 8135555 8677466 0.94
tpch_q07/duckdb:vortex-file-compressed 33182497 32884056 1.01
tpch_q08/duckdb:vortex-file-compressed 38244062 38517376 0.99
tpch_q09/duckdb:vortex-file-compressed 54399404 54824707 0.99
tpch_q10/duckdb:vortex-file-compressed 40437129 40151622 1.01
tpch_q11/duckdb:vortex-file-compressed 13737460 12917443 1.06
tpch_q12/duckdb:vortex-file-compressed 22471306 22698426 0.99
tpch_q13/duckdb:vortex-file-compressed 39169943 39280614 1.00
tpch_q14/duckdb:vortex-file-compressed 20243647 19321371 1.05
tpch_q15/duckdb:vortex-file-compressed 15983315 16351075 0.98
tpch_q16/duckdb:vortex-file-compressed 27201701 27082888 1.00
tpch_q17/duckdb:vortex-file-compressed 22501650 22641362 0.99
tpch_q18/duckdb:vortex-file-compressed 50590756 51832188 0.98
tpch_q19/duckdb:vortex-file-compressed 25277568 24908504 1.01
tpch_q20/duckdb:vortex-file-compressed 30782779 30998627 0.99
tpch_q21/duckdb:vortex-file-compressed 99602756 97704320 1.02
tpch_q22/duckdb:vortex-file-compressed 17939125 16560913 1.08
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77390837 78068085 0.99
tpch_q02/duckdb:parquet 40425367 40088145 1.01
tpch_q03/duckdb:parquet 71148415 73402061 0.97
tpch_q04/duckdb:parquet 50346344 51862982 0.97
tpch_q05/duckdb:parquet 68945310 68916881 1.00
tpch_q06/duckdb:parquet 22371128 23162458 0.97
tpch_q07/duckdb:parquet 77940709 75490772 1.03
tpch_q08/duckdb:parquet 84207543 83192383 1.01
tpch_q09/duckdb:parquet 141386785 155948891 0.91
tpch_q10/duckdb:parquet 126043302 132661894 0.95
tpch_q11/duckdb:parquet 22926117 22912221 1.00
tpch_q12/duckdb:parquet 47909277 48553937 0.99
tpch_q13/duckdb:parquet 255174591 254156463 1.00
tpch_q14/duckdb:parquet 51641684 51390619 1.00
tpch_q15/duckdb:parquet 26477160 26755987 0.99
tpch_q16/duckdb:parquet 58472168 58461625 1.00
tpch_q17/duckdb:parquet 58185706 57412866 1.01
tpch_q18/duckdb:parquet 119382358 122613249 0.97
tpch_q19/duckdb:parquet 69837380 71203338 0.98
tpch_q20/duckdb:parquet 65850794 66201392 0.99
tpch_q21/duckdb:parquet 181549862 176130002 1.03
tpch_q22/duckdb:parquet 55705733 56045591 0.99
File Size Changes (10 files changed, -43.9% overall, 0↑ 10↓)
File Scale Format Base HEAD Change %
customer_0.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 0 B 63.00 MB -100.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 0 B 63.03 MB -100.0%
nation_0.vortex 1.0 vortex-compact 7.80 KB 0 B 7.80 KB -100.0%
orders_0.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part_0.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp_0.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region_0.vortex 1.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 1.0 vortex-compact 496.46 KB 0 B 496.46 KB -100.0%

Totals:

  • vortex-compact: 189.76 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.92 MB → 242.92 MB (0.0%)

@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): 0.965x ➖
Parquet (geomean): 0.968x ➖
Shifts: Parquet (control) -3.2% · Median polish -1.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4817283 4646456 1.04
fineweb_q01/datafusion:vortex-file-compressed 30398035 32223375 0.94
fineweb_q02/datafusion:vortex-file-compressed 34856995 35537170 0.98
fineweb_q03/datafusion:vortex-file-compressed 53134263 54032779 0.98
fineweb_q04/datafusion:vortex-file-compressed 239340028 241352352 0.99
fineweb_q05/datafusion:vortex-file-compressed 184714048 186909708 0.99
fineweb_q06/datafusion:vortex-file-compressed 47413048 47645102 1.00
fineweb_q07/datafusion:vortex-file-compressed 52449807 52322945 1.00
fineweb_q08/datafusion:vortex-file-compressed 18989835 19575360 0.97
datafusion / parquet (0.980x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7141825 7505997 0.95
fineweb_q01/datafusion:parquet 284046360 295930562 0.96
fineweb_q02/datafusion:parquet 288901727 305167719 0.95
fineweb_q03/datafusion:parquet 287678784 284399524 1.01
fineweb_q04/datafusion:parquet 313094525 307939832 1.02
fineweb_q05/datafusion:parquet 299616441 303138720 0.99
fineweb_q06/datafusion:parquet 289394939 302003865 0.96
fineweb_q07/datafusion:parquet 282295438 283212907 1.00
fineweb_q08/datafusion:parquet 281344932 284413998 0.99
duckdb / vortex-file-compressed (0.944x ➖, 1↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 2997359 3708786 0.81
fineweb_q01/duckdb:vortex-file-compressed 32485412 33542166 0.97
fineweb_q02/duckdb:vortex-file-compressed 37495901 36935243 1.02
fineweb_q03/duckdb:vortex-file-compressed 98334886 101363309 0.97
fineweb_q04/duckdb:vortex-file-compressed 240831841 256540462 0.94
fineweb_q05/duckdb:vortex-file-compressed 181541678 189757939 0.96
fineweb_q06/duckdb:vortex-file-compressed 52204319 54285799 0.96
fineweb_q07/duckdb:vortex-file-compressed 53603839 55771530 0.96
fineweb_q08/duckdb:vortex-file-compressed 20875585 22500665 0.93
duckdb / parquet (0.957x ➖, 1↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 33305079 35099574 0.95
fineweb_q01/duckdb:parquet 90565163 94509578 0.96
fineweb_q02/duckdb:parquet 88658166 91596784 0.97
fineweb_q03/duckdb:parquet 315536715 323044525 0.98
fineweb_q04/duckdb:parquet 444530733 452796756 0.98
fineweb_q05/duckdb:parquet 415690283 426350925 0.97
fineweb_q06/duckdb:parquet 204594051 211314242 0.97
fineweb_q07/duckdb:parquet 217633954 225881090 0.96
fineweb_q08/duckdb:parquet 🚀 36907440 42114795 0.88
File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 1.012x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.023x ➖, 0↑ 4↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 23158201 21847202 1.06
tpcds_q02/datafusion:vortex-file-compressed 41279496 41896515 0.99
tpcds_q03/datafusion:vortex-file-compressed 14570532 14448338 1.01
tpcds_q04/datafusion:vortex-file-compressed 228528070 216848691 1.05
tpcds_q05/datafusion:vortex-file-compressed 43923200 41954786 1.05
tpcds_q06/datafusion:vortex-file-compressed 22591973 22168703 1.02
tpcds_q07/datafusion:vortex-file-compressed 42398559 38830063 1.09
tpcds_q08/datafusion:vortex-file-compressed 29814521 29159377 1.02
tpcds_q09/datafusion:vortex-file-compressed 31011242 29910538 1.04
tpcds_q10/datafusion:vortex-file-compressed 36020781 34831024 1.03
tpcds_q11/datafusion:vortex-file-compressed 127679080 120301935 1.06
tpcds_q12/datafusion:vortex-file-compressed 17198280 16809322 1.02
tpcds_q13/datafusion:vortex-file-compressed 44205996 44993310 0.98
tpcds_q14/datafusion:vortex-file-compressed 156721763 152406431 1.03
tpcds_q15/datafusion:vortex-file-compressed 24941024 25846241 0.96
tpcds_q16/datafusion:vortex-file-compressed 23313631 22861789 1.02
tpcds_q17/datafusion:vortex-file-compressed 57689484 57847404 1.00
tpcds_q18/datafusion:vortex-file-compressed 59088050 56365366 1.05
tpcds_q19/datafusion:vortex-file-compressed 21448270 20976151 1.02
tpcds_q20/datafusion:vortex-file-compressed 19324326 20158933 0.96
tpcds_q21/datafusion:vortex-file-compressed 36395288 37095467 0.98
tpcds_q22/datafusion:vortex-file-compressed 🚨 140415508 117147013 1.20
tpcds_q23/datafusion:vortex-file-compressed 152818121 150703718 1.01
tpcds_q24/datafusion:vortex-file-compressed 81567436 80357153 1.02
tpcds_q25/datafusion:vortex-file-compressed 63493660 60269167 1.05
tpcds_q26/datafusion:vortex-file-compressed 29447062 28603271 1.03
tpcds_q27/datafusion:vortex-file-compressed 92835967 90412617 1.03
tpcds_q28/datafusion:vortex-file-compressed 31969208 32368496 0.99
tpcds_q29/datafusion:vortex-file-compressed 57075293 57800919 0.99
tpcds_q30/datafusion:vortex-file-compressed 🚨 25103583 22672614 1.11
tpcds_q31/datafusion:vortex-file-compressed 68553955 65824844 1.04
tpcds_q32/datafusion:vortex-file-compressed 17557389 17384546 1.01
tpcds_q33/datafusion:vortex-file-compressed 28401027 28100348 1.01
tpcds_q34/datafusion:vortex-file-compressed 24838971 23942736 1.04
tpcds_q35/datafusion:vortex-file-compressed 41948885 42623817 0.98
tpcds_q36/datafusion:vortex-file-compressed 57135303 55657258 1.03
tpcds_q37/datafusion:vortex-file-compressed 18547226 17702686 1.05
tpcds_q38/datafusion:vortex-file-compressed 37793122 40980483 0.92
tpcds_q39/datafusion:vortex-file-compressed 107349379 107666101 1.00
tpcds_q40/datafusion:vortex-file-compressed 29310281 28129862 1.04
tpcds_q41/datafusion:vortex-file-compressed 20152469 20647839 0.98
tpcds_q42/datafusion:vortex-file-compressed 12904037 12941258 1.00
tpcds_q43/datafusion:vortex-file-compressed 18318401 17419187 1.05
tpcds_q44/datafusion:vortex-file-compressed 30150112 29221842 1.03
tpcds_q45/datafusion:vortex-file-compressed 24989769 25273774 0.99
tpcds_q46/datafusion:vortex-file-compressed 34263978 33206105 1.03
tpcds_q47/datafusion:vortex-file-compressed 136037245 135646028 1.00
tpcds_q48/datafusion:vortex-file-compressed 36240339 36379322 1.00
tpcds_q49/datafusion:vortex-file-compressed 57990012 55726575 1.04
tpcds_q50/datafusion:vortex-file-compressed 38073398 37036178 1.03
tpcds_q51/datafusion:vortex-file-compressed 89791281 94763222 0.95
tpcds_q52/datafusion:vortex-file-compressed 13708193 13526867 1.01
tpcds_q53/datafusion:vortex-file-compressed 🚨 22604961 20437781 1.11
tpcds_q54/datafusion:vortex-file-compressed 32867776 32144700 1.02
tpcds_q55/datafusion:vortex-file-compressed 13132195 12895850 1.02
tpcds_q56/datafusion:vortex-file-compressed 30235195 29421406 1.03
tpcds_q57/datafusion:vortex-file-compressed 87814903 89087483 0.99
tpcds_q58/datafusion:vortex-file-compressed 52332278 51109980 1.02
tpcds_q59/datafusion:vortex-file-compressed 55899413 56488376 0.99
tpcds_q60/datafusion:vortex-file-compressed 29363534 29504144 1.00
tpcds_q61/datafusion:vortex-file-compressed 39163349 39060929 1.00
tpcds_q62/datafusion:vortex-file-compressed 21163569 20429278 1.04
tpcds_q63/datafusion:vortex-file-compressed 21696501 20847884 1.04
tpcds_q64/datafusion:vortex-file-compressed 401392990 382531381 1.05
tpcds_q65/datafusion:vortex-file-compressed 51024071 49027777 1.04
tpcds_q66/datafusion:vortex-file-compressed 69169804 69930358 0.99
tpcds_q67/datafusion:vortex-file-compressed 143128363 148552620 0.96
tpcds_q68/datafusion:vortex-file-compressed 31991043 31930410 1.00
tpcds_q69/datafusion:vortex-file-compressed 33885281 35015000 0.97
tpcds_q70/datafusion:vortex-file-compressed 98077266 92531707 1.06
tpcds_q71/datafusion:vortex-file-compressed 22546763 21654797 1.04
tpcds_q72/datafusion:vortex-file-compressed 2116059160 2034056337 1.04
tpcds_q73/datafusion:vortex-file-compressed 25206766 25670952 0.98
tpcds_q74/datafusion:vortex-file-compressed 78637829 74584052 1.05
tpcds_q75/datafusion:vortex-file-compressed 109391604 104984591 1.04
tpcds_q76/datafusion:vortex-file-compressed 28129386 27597457 1.02
tpcds_q77/datafusion:vortex-file-compressed 36516074 35556510 1.03
tpcds_q78/datafusion:vortex-file-compressed 107949600 108253282 1.00
tpcds_q79/datafusion:vortex-file-compressed 28346887 28716113 0.99
tpcds_q80/datafusion:vortex-file-compressed 88593060 85343344 1.04
tpcds_q81/datafusion:vortex-file-compressed 24882062 23557296 1.06
tpcds_q82/datafusion:vortex-file-compressed 19533797 19644511 0.99
tpcds_q83/datafusion:vortex-file-compressed 33758868 33592844 1.00
tpcds_q84/datafusion:vortex-file-compressed 12292444 11927736 1.03
tpcds_q85/datafusion:vortex-file-compressed 85041571 83587509 1.02
tpcds_q86/datafusion:vortex-file-compressed 15056472 13820655 1.09
tpcds_q87/datafusion:vortex-file-compressed 37347284 36622834 1.02
tpcds_q88/datafusion:vortex-file-compressed 56797503 52712864 1.08
tpcds_q89/datafusion:vortex-file-compressed 25323091 26011188 0.97
tpcds_q90/datafusion:vortex-file-compressed 13113065 13067626 1.00
tpcds_q91/datafusion:vortex-file-compressed 17948680 17622271 1.02
tpcds_q92/datafusion:vortex-file-compressed 14962903 14446814 1.04
tpcds_q93/datafusion:vortex-file-compressed 31486871 29459496 1.07
tpcds_q94/datafusion:vortex-file-compressed 19642092 19072300 1.03
tpcds_q95/datafusion:vortex-file-compressed 53623937 52778992 1.02
tpcds_q96/datafusion:vortex-file-compressed 🚨 13564315 11853218 1.14
tpcds_q97/datafusion:vortex-file-compressed 28500689 28434651 1.00
tpcds_q98/datafusion:vortex-file-compressed 24152753 23193815 1.04
tpcds_q99/datafusion:vortex-file-compressed 24577565 23743527 1.04
datafusion / parquet (1.024x ➖, 0↑ 6↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 23975464 24433574 0.98
tpcds_q02/datafusion:parquet 41917838 41438312 1.01
tpcds_q03/datafusion:parquet 13678888 14240713 0.96
tpcds_q04/datafusion:parquet 295772265 298170627 0.99
tpcds_q05/datafusion:parquet 47287280 45777006 1.03
tpcds_q06/datafusion:parquet 22799187 22118116 1.03
tpcds_q07/datafusion:parquet 77005153 76421534 1.01
tpcds_q08/datafusion:parquet 29952080 28138755 1.06
tpcds_q09/datafusion:parquet 38023155 38130362 1.00
tpcds_q10/datafusion:parquet 72507741 68880363 1.05
tpcds_q11/datafusion:parquet 156941135 146157218 1.07
tpcds_q12/datafusion:parquet 18539040 17328886 1.07
tpcds_q13/datafusion:parquet 75503922 75645899 1.00
tpcds_q14/datafusion:parquet 163742607 158808949 1.03
tpcds_q15/datafusion:parquet 20629777 20668591 1.00
tpcds_q16/datafusion:parquet 29587587 28139999 1.05
tpcds_q17/datafusion:parquet 60921010 59869799 1.02
tpcds_q18/datafusion:parquet 109026715 108183383 1.01
tpcds_q19/datafusion:parquet 🚨 24630686 22318287 1.10
tpcds_q20/datafusion:parquet 17512605 18322949 0.96
tpcds_q21/datafusion:parquet 18441900 18064487 1.02
tpcds_q22/datafusion:parquet 156796146 145462799 1.08
tpcds_q23/datafusion:parquet 156669163 149096218 1.05
tpcds_q24/datafusion:parquet 87321647 89278052 0.98
tpcds_q25/datafusion:parquet 65346053 63502766 1.03
tpcds_q26/datafusion:parquet 64319901 70120818 0.92
tpcds_q27/datafusion:parquet 144227746 139637361 1.03
tpcds_q28/datafusion:parquet 44503085 44263570 1.01
tpcds_q29/datafusion:parquet 65076670 63959520 1.02
tpcds_q30/datafusion:parquet 33588697 32738203 1.03
tpcds_q31/datafusion:parquet 69758746 64580568 1.08
tpcds_q32/datafusion:parquet 16455373 16611278 0.99
tpcds_q33/datafusion:parquet 27594865 26950263 1.02
tpcds_q34/datafusion:parquet 22518499 22606357 1.00
tpcds_q35/datafusion:parquet 70854963 69526252 1.02
tpcds_q36/datafusion:parquet 58488750 56155569 1.04
tpcds_q37/datafusion:parquet 19436675 19840493 0.98
tpcds_q38/datafusion:parquet 41571498 43135047 0.96
tpcds_q39/datafusion:parquet 77448008 72690058 1.07
tpcds_q40/datafusion:parquet 🚨 25548245 22428435 1.14
tpcds_q41/datafusion:parquet 14292148 14146917 1.01
tpcds_q42/datafusion:parquet 11847599 11497674 1.03
tpcds_q43/datafusion:parquet 🚨 18337947 16670291 1.10
tpcds_q44/datafusion:parquet 32142205 32740536 0.98
tpcds_q45/datafusion:parquet 28261827 28100717 1.01
tpcds_q46/datafusion:parquet 32849686 31694288 1.04
tpcds_q47/datafusion:parquet 132903402 125447242 1.06
tpcds_q48/datafusion:parquet 68424906 68888791 0.99
tpcds_q49/datafusion:parquet 57896079 55903778 1.04
tpcds_q50/datafusion:parquet 41918873 41245206 1.02
tpcds_q51/datafusion:parquet 88012186 87510550 1.01
tpcds_q52/datafusion:parquet 12143731 12500100 0.97
tpcds_q53/datafusion:parquet 🚨 19814877 17924423 1.11
tpcds_q54/datafusion:parquet 32626511 31821273 1.03
tpcds_q55/datafusion:parquet 11855926 11519277 1.03
tpcds_q56/datafusion:parquet 28441127 27763176 1.02
tpcds_q57/datafusion:parquet 🚨 107712976 94743366 1.14
tpcds_q58/datafusion:parquet 56214228 55741045 1.01
tpcds_q59/datafusion:parquet 60893729 60492705 1.01
tpcds_q60/datafusion:parquet 27823326 27738191 1.00
tpcds_q61/datafusion:parquet 44834988 42523394 1.05
tpcds_q62/datafusion:parquet 🚨 25561885 19159025 1.33
tpcds_q63/datafusion:parquet 17757224 17881182 0.99
tpcds_q64/datafusion:parquet 297988062 303148196 0.98
tpcds_q65/datafusion:parquet 37807484 36128300 1.05
tpcds_q66/datafusion:parquet 69405992 68442388 1.01
tpcds_q67/datafusion:parquet 143077285 146827624 0.97
tpcds_q68/datafusion:parquet 32511400 30892420 1.05
tpcds_q69/datafusion:parquet 65641641 65834082 1.00
tpcds_q70/datafusion:parquet 33442257 33072539 1.01
tpcds_q71/datafusion:parquet 23542671 21932075 1.07
tpcds_q72/datafusion:parquet 578980891 582044097 0.99
tpcds_q73/datafusion:parquet 21365731 20155689 1.06
tpcds_q74/datafusion:parquet 87039414 85273711 1.02
tpcds_q75/datafusion:parquet 105471479 111837327 0.94
tpcds_q76/datafusion:parquet 31918713 29269488 1.09
tpcds_q77/datafusion:parquet 38435721 38726805 0.99
tpcds_q78/datafusion:parquet 109975812 107060173 1.03
tpcds_q79/datafusion:parquet 28141701 26181533 1.07
tpcds_q80/datafusion:parquet 78287911 74760198 1.05
tpcds_q81/datafusion:parquet 29754559 30619519 0.97
tpcds_q82/datafusion:parquet 18676306 18655048 1.00
tpcds_q83/datafusion:parquet 41668123 41529509 1.00
tpcds_q84/datafusion:parquet 40655993 39347395 1.03
tpcds_q85/datafusion:parquet 144335946 144371115 1.00
tpcds_q86/datafusion:parquet 14441655 15982378 0.90
tpcds_q87/datafusion:parquet 44897227 43812849 1.02
tpcds_q88/datafusion:parquet 60724989 61056498 0.99
tpcds_q89/datafusion:parquet 22377154 21893500 1.02
tpcds_q90/datafusion:parquet 14301807 13675490 1.05
tpcds_q91/datafusion:parquet 58349957 56655094 1.03
tpcds_q92/datafusion:parquet 17822893 16905549 1.05
tpcds_q93/datafusion:parquet 30805702 29609934 1.04
tpcds_q94/datafusion:parquet 21163858 19554587 1.08
tpcds_q95/datafusion:parquet 60162466 60502609 0.99
tpcds_q96/datafusion:parquet 12551298 12806687 0.98
tpcds_q97/datafusion:parquet 29507321 29732572 0.99
tpcds_q98/datafusion:parquet 21454470 21256145 1.01
tpcds_q99/datafusion:parquet 26010073 24767923 1.05
duckdb / vortex-file-compressed (1.002x ➖, 2↑ 1↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23075764 22017303 1.05
tpcds_q02/duckdb:vortex-file-compressed 22966563 22514222 1.02
tpcds_q03/duckdb:vortex-file-compressed 19549935 18962900 1.03
tpcds_q04/duckdb:vortex-file-compressed 92169463 93642269 0.98
tpcds_q05/duckdb:vortex-file-compressed 34656421 34180621 1.01
tpcds_q06/duckdb:vortex-file-compressed 34570053 33555186 1.03
tpcds_q07/duckdb:vortex-file-compressed 29020397 29059666 1.00
tpcds_q08/duckdb:vortex-file-compressed 27112643 26414926 1.03
tpcds_q09/duckdb:vortex-file-compressed 15559979 15630986 1.00
tpcds_q10/duckdb:vortex-file-compressed 38649079 39749896 0.97
tpcds_q11/duckdb:vortex-file-compressed 72568057 72225439 1.00
tpcds_q12/duckdb:vortex-file-compressed 14088813 14184707 0.99
tpcds_q13/duckdb:vortex-file-compressed 34178927 34899858 0.98
tpcds_q14/duckdb:vortex-file-compressed 103000212 103185242 1.00
tpcds_q15/duckdb:vortex-file-compressed 27648504 26923430 1.03
tpcds_q16/duckdb:vortex-file-compressed 22887975 22931206 1.00
tpcds_q17/duckdb:vortex-file-compressed 47548220 47482682 1.00
tpcds_q18/duckdb:vortex-file-compressed 39291364 39134671 1.00
tpcds_q19/duckdb:vortex-file-compressed 35953416 35247005 1.02
tpcds_q20/duckdb:vortex-file-compressed 14002954 14041733 1.00
tpcds_q21/duckdb:vortex-file-compressed 15746824 15525403 1.01
tpcds_q22/duckdb:vortex-file-compressed 71071301 70551827 1.01
tpcds_q23/duckdb:vortex-file-compressed 90026645 87156505 1.03
tpcds_q24/duckdb:vortex-file-compressed 43831634 44195211 0.99
tpcds_q25/duckdb:vortex-file-compressed 36110122 36110179 1.00
tpcds_q26/duckdb:vortex-file-compressed 18502800 18826546 0.98
tpcds_q27/duckdb:vortex-file-compressed 28452904 28495382 1.00
tpcds_q28/duckdb:vortex-file-compressed 11284413 11654388 0.97
tpcds_q29/duckdb:vortex-file-compressed 46689423 45451806 1.03
tpcds_q30/duckdb:vortex-file-compressed 26064076 25871034 1.01
tpcds_q31/duckdb:vortex-file-compressed 31424834 31309251 1.00
tpcds_q32/duckdb:vortex-file-compressed 12906104 12701815 1.02
tpcds_q33/duckdb:vortex-file-compressed 25151629 25938505 0.97
tpcds_q34/duckdb:vortex-file-compressed 27218827 26896140 1.01
tpcds_q35/duckdb:vortex-file-compressed 68428839 66609388 1.03
tpcds_q36/duckdb:vortex-file-compressed 25712820 25038141 1.03
tpcds_q37/duckdb:vortex-file-compressed 19294644 19083540 1.01
tpcds_q38/duckdb:vortex-file-compressed 🚀 35389358 40121145 0.88
tpcds_q39/duckdb:vortex-file-compressed 30341060 28349955 1.07
tpcds_q40/duckdb:vortex-file-compressed 18017773 18057095 1.00
tpcds_q41/duckdb:vortex-file-compressed 12213786 11956757 1.02
tpcds_q42/duckdb:vortex-file-compressed 15961307 15879881 1.01
tpcds_q43/duckdb:vortex-file-compressed 17813008 17466893 1.02
tpcds_q44/duckdb:vortex-file-compressed 21080529 20667267 1.02
tpcds_q45/duckdb:vortex-file-compressed 30234685 30843420 0.98
tpcds_q46/duckdb:vortex-file-compressed 36842563 36476300 1.01
tpcds_q47/duckdb:vortex-file-compressed 52517663 52386986 1.00
tpcds_q48/duckdb:vortex-file-compressed 33790337 31915306 1.06
tpcds_q49/duckdb:vortex-file-compressed 38306848 36801466 1.04
tpcds_q50/duckdb:vortex-file-compressed 26688356 26880777 0.99
tpcds_q51/duckdb:vortex-file-compressed 105974967 105891371 1.00
tpcds_q52/duckdb:vortex-file-compressed 15372629 15736407 0.98
tpcds_q53/duckdb:vortex-file-compressed 23841980 24216245 0.98
tpcds_q54/duckdb:vortex-file-compressed 28933163 28578846 1.01
tpcds_q55/duckdb:vortex-file-compressed 14467173 14468625 1.00
tpcds_q56/duckdb:vortex-file-compressed 28645475 27650560 1.04
tpcds_q57/duckdb:vortex-file-compressed 36789074 37959047 0.97
tpcds_q58/duckdb:vortex-file-compressed 30213799 29747285 1.02
tpcds_q59/duckdb:vortex-file-compressed 35924123 38439405 0.93
tpcds_q60/duckdb:vortex-file-compressed 27810482 27989720 0.99
tpcds_q61/duckdb:vortex-file-compressed 31537057 31999537 0.99
tpcds_q62/duckdb:vortex-file-compressed 14674132 15118585 0.97
tpcds_q63/duckdb:vortex-file-compressed 21633524 21561197 1.00
tpcds_q64/duckdb:vortex-file-compressed 98011672 97817066 1.00
tpcds_q65/duckdb:vortex-file-compressed 22486843 23098113 0.97
tpcds_q66/duckdb:vortex-file-compressed 28899634 28973568 1.00
tpcds_q67/duckdb:vortex-file-compressed 145589875 136886207 1.06
tpcds_q68/duckdb:vortex-file-compressed 🚀 32661614 38742773 0.84
tpcds_q69/duckdb:vortex-file-compressed 43398806 41428033 1.05
tpcds_q70/duckdb:vortex-file-compressed 34391079 31822067 1.08
tpcds_q71/duckdb:vortex-file-compressed 22642013 23642212 0.96
tpcds_q72/duckdb:vortex-file-compressed 148854825 150164084 0.99
tpcds_q73/duckdb:vortex-file-compressed 28080879 26974933 1.04
tpcds_q74/duckdb:vortex-file-compressed 47637932 45172577 1.05
tpcds_q75/duckdb:vortex-file-compressed 50798812 48564665 1.05
tpcds_q76/duckdb:vortex-file-compressed 22351987 21638313 1.03
tpcds_q77/duckdb:vortex-file-compressed 23728225 24122791 0.98
tpcds_q78/duckdb:vortex-file-compressed 64533330 64646208 1.00
tpcds_q79/duckdb:vortex-file-compressed 26506991 27184939 0.98
tpcds_q80/duckdb:vortex-file-compressed 47918804 47178936 1.02
tpcds_q81/duckdb:vortex-file-compressed 29144377 28710333 1.02
tpcds_q82/duckdb:vortex-file-compressed 45730874 46037198 0.99
tpcds_q83/duckdb:vortex-file-compressed 27213897 28183082 0.97
tpcds_q84/duckdb:vortex-file-compressed 16112607 16331277 0.99
tpcds_q85/duckdb:vortex-file-compressed 43924051 42370761 1.04
tpcds_q86/duckdb:vortex-file-compressed 16604550 17445291 0.95
tpcds_q87/duckdb:vortex-file-compressed 🚨 42950974 37740128 1.14
tpcds_q88/duckdb:vortex-file-compressed 57269297 58202835 0.98
tpcds_q89/duckdb:vortex-file-compressed 23856864 21973694 1.09
tpcds_q90/duckdb:vortex-file-compressed 10637169 11105180 0.96
tpcds_q91/duckdb:vortex-file-compressed 22207642 23823866 0.93
tpcds_q92/duckdb:vortex-file-compressed 17561879 17940437 0.98
tpcds_q93/duckdb:vortex-file-compressed 27412863 28978975 0.95
tpcds_q94/duckdb:vortex-file-compressed 21445408 21797001 0.98
tpcds_q95/duckdb:vortex-file-compressed 123154403 121368118 1.01
tpcds_q96/duckdb:vortex-file-compressed 12976090 13508090 0.96
tpcds_q97/duckdb:vortex-file-compressed 39110929 37593116 1.04
tpcds_q98/duckdb:vortex-file-compressed 19498253 19379464 1.01
tpcds_q99/duckdb:vortex-file-compressed 18057115 19576475 0.92
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 30223864 30817270 0.98
tpcds_q02/duckdb:parquet 23735666 24446767 0.97
tpcds_q03/duckdb:parquet 12895213 13130022 0.98
tpcds_q04/duckdb:parquet 169169227 165100660 1.02
tpcds_q05/duckdb:parquet 32622667 32300339 1.01
tpcds_q06/duckdb:parquet 33536304 33224384 1.01
tpcds_q07/duckdb:parquet 24514611 24646658 0.99
tpcds_q08/duckdb:parquet 29939420 29754941 1.01
tpcds_q09/duckdb:parquet 44332876 45565316 0.97
tpcds_q10/duckdb:parquet 38180477 37559319 1.02
tpcds_q11/duckdb:parquet 89570296 92999255 0.96
tpcds_q12/duckdb:parquet 16195657 16030060 1.01
tpcds_q13/duckdb:parquet 35778862 35571233 1.01
tpcds_q14/duckdb:parquet 107707851 102941565 1.05
tpcds_q15/duckdb:parquet 31154927 30430978 1.02
tpcds_q16/duckdb:parquet 22689236 22631278 1.00
tpcds_q17/duckdb:parquet 40084549 39154048 1.02
tpcds_q18/duckdb:parquet 48260782 48561184 0.99
tpcds_q19/duckdb:parquet 31915844 32339779 0.99
tpcds_q20/duckdb:parquet 17098608 17047210 1.00
tpcds_q21/duckdb:parquet 11984140 11699329 1.02
tpcds_q22/duckdb:parquet 70294606 71565783 0.98
tpcds_q23/duckdb:parquet 82814110 83017023 1.00
tpcds_q24/duckdb:parquet 47488730 46355813 1.02
tpcds_q25/duckdb:parquet 36041655 36077218 1.00
tpcds_q26/duckdb:parquet 40114138 40049483 1.00
tpcds_q27/duckdb:parquet 53127120 52996320 1.00
tpcds_q28/duckdb:parquet 43530271 43344134 1.00
tpcds_q29/duckdb:parquet 37252606 37232676 1.00
tpcds_q30/duckdb:parquet 38055367 37773977 1.01
tpcds_q31/duckdb:parquet 28752959 28915433 0.99
tpcds_q32/duckdb:parquet 12706166 12100695 1.05
tpcds_q33/duckdb:parquet 24141412 24719994 0.98
tpcds_q34/duckdb:parquet 22915350 22828545 1.00
tpcds_q35/duckdb:parquet 62005915 61955862 1.00
tpcds_q36/duckdb:parquet 22893593 22943821 1.00
tpcds_q37/duckdb:parquet 14600416 14065515 1.04
tpcds_q38/duckdb:parquet 36866141 37139476 0.99
tpcds_q39/duckdb:parquet 32742202 32688251 1.00
tpcds_q40/duckdb:parquet 19385728 19514616 0.99
tpcds_q41/duckdb:parquet 9007558 8920573 1.01
tpcds_q42/duckdb:parquet 12729801 12902802 0.99
tpcds_q43/duckdb:parquet 18631499 17889243 1.04
tpcds_q44/duckdb:parquet 26075358 26702016 0.98
tpcds_q45/duckdb:parquet 29631715 29336703 1.01
tpcds_q46/duckdb:parquet 47937452 48151570 1.00
tpcds_q47/duckdb:parquet 50204846 50781109 0.99
tpcds_q48/duckdb:parquet 32613602 32704108 1.00
tpcds_q49/duckdb:parquet 28703800 28864045 0.99
tpcds_q50/duckdb:parquet 26750482 26789751 1.00
tpcds_q51/duckdb:parquet 105888937 103855873 1.02
tpcds_q52/duckdb:parquet 12780246 13221176 0.97
tpcds_q53/duckdb:parquet 17160795 17333814 0.99
tpcds_q54/duckdb:parquet 29437429 28549388 1.03
tpcds_q55/duckdb:parquet 12845643 12703872 1.01
tpcds_q56/duckdb:parquet 24097257 23610457 1.02
tpcds_q57/duckdb:parquet 38063217 38199654 1.00
tpcds_q58/duckdb:parquet 25791458 26760608 0.96
tpcds_q59/duckdb:parquet 36553488 36869321 0.99
tpcds_q60/duckdb:parquet 26033689 25565854 1.02
tpcds_q61/duckdb:parquet 33688426 34316019 0.98
tpcds_q62/duckdb:parquet 12579275 12699334 0.99
tpcds_q63/duckdb:parquet 16099475 15824549 1.02
tpcds_q64/duckdb:parquet 78995422 76032640 1.04
tpcds_q65/duckdb:parquet 23258150 23365769 1.00
tpcds_q66/duckdb:parquet 33098013 32677560 1.01
tpcds_q67/duckdb:parquet 137639081 137373957 1.00
tpcds_q68/duckdb:parquet 39719297 38967365 1.02
tpcds_q69/duckdb:parquet 39011964 39233600 0.99
tpcds_q70/duckdb:parquet 23645279 22501797 1.05
tpcds_q71/duckdb:parquet 23779943 23970787 0.99
tpcds_q72/duckdb:parquet 167180098 167637678 1.00
tpcds_q73/duckdb:parquet 20496821 21396160 0.96
tpcds_q74/duckdb:parquet 128250982 126533680 1.01
tpcds_q75/duckdb:parquet 58190841 58852910 0.99
tpcds_q76/duckdb:parquet 22348359 22312643 1.00
tpcds_q77/duckdb:parquet 25788577 26601734 0.97
tpcds_q78/duckdb:parquet 78407220 77643922 1.01
tpcds_q79/duckdb:parquet 30351793 30139581 1.01
tpcds_q80/duckdb:parquet 43571358 43854556 0.99
tpcds_q81/duckdb:parquet 35298694 35552676 0.99
tpcds_q82/duckdb:parquet 16287053 17774478 0.92
tpcds_q83/duckdb:parquet 18424805 18575015 0.99
tpcds_q84/duckdb:parquet 20725899 20319410 1.02
tpcds_q85/duckdb:parquet 42697011 40886392 1.04
tpcds_q86/duckdb:parquet 13820005 13728475 1.01
tpcds_q87/duckdb:parquet 39307550 39378241 1.00
tpcds_q88/duckdb:parquet 54080531 54325854 1.00
tpcds_q89/duckdb:parquet 19725619 18773085 1.05
tpcds_q90/duckdb:parquet 8661476 8900080 0.97
tpcds_q91/duckdb:parquet 26281123 25742060 1.02
tpcds_q92/duckdb:parquet 13113127 13285782 0.99
tpcds_q93/duckdb:parquet 32137722 32236920 1.00
tpcds_q94/duckdb:parquet 18509320 18080368 1.02
tpcds_q95/duckdb:parquet 133324405 121876833 1.09
tpcds_q96/duckdb:parquet 11027420 10650250 1.04
tpcds_q97/duckdb:parquet 37767396 38062369 0.99
tpcds_q98/duckdb:parquet 22798464 22128190 1.03
tpcds_q99/duckdb:parquet 20474914 20667518 0.99
File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.43 KB 0 B 47.43 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.44 KB 0 B 362.44 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 638.84 KB 0 B 638.84 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.18 KB 0 B 424.18 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.28 KB 0 B 140.28 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.29 KB 0 B 10.29 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.56 KB 0 B 5.56 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.32 KB 0 B 1000.32 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.31 KB 0 B 50.31 KB -100.0%
reason.vortex 1.0 vortex-compact 5.96 KB 0 B 5.96 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.73 KB 0 B 10.73 KB -100.0%
store.vortex 1.0 vortex-compact 43.22 KB 0 B 43.22 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.59 KB 0 B 96.59 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.14 KB 0 B 22.14 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.01 KB 0 B 25.01 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.19 KB 0 B 42.19 KB -100.0%

Totals:

  • vortex-compact: 207.94 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.3%
Engines: DataFusion No clear signal (+2.7%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 1.027x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.035x ➖, 0↑ 2↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 436512255 426711085 1.02
tpch_q02/datafusion:vortex-file-compressed 98222300 100586506 0.98
tpch_q03/datafusion:vortex-file-compressed 191209498 195033230 0.98
tpch_q04/datafusion:vortex-file-compressed 93387937 90059558 1.04
tpch_q05/datafusion:vortex-file-compressed 🚨 364354768 329579560 1.11
tpch_q06/datafusion:vortex-file-compressed 41947421 38232479 1.10
tpch_q07/datafusion:vortex-file-compressed 449086367 440755436 1.02
tpch_q08/datafusion:vortex-file-compressed 349667490 330718673 1.06
tpch_q09/datafusion:vortex-file-compressed 597840059 587559624 1.02
tpch_q10/datafusion:vortex-file-compressed 218288794 211194624 1.03
tpch_q11/datafusion:vortex-file-compressed 73925122 77258180 0.96
tpch_q12/datafusion:vortex-file-compressed 109793230 108337208 1.01
tpch_q13/datafusion:vortex-file-compressed 195251453 190964969 1.02
tpch_q14/datafusion:vortex-file-compressed 49024943 50059761 0.98
tpch_q15/datafusion:vortex-file-compressed 101181973 101012820 1.00
tpch_q16/datafusion:vortex-file-compressed 74964629 71926442 1.04
tpch_q17/datafusion:vortex-file-compressed 582735614 573911027 1.02
tpch_q18/datafusion:vortex-file-compressed 830303239 803622653 1.03
tpch_q19/datafusion:vortex-file-compressed 🚨 89334156 76624124 1.17
tpch_q20/datafusion:vortex-file-compressed 161593319 153588880 1.05
tpch_q21/datafusion:vortex-file-compressed 623965919 574147336 1.09
tpch_q22/datafusion:vortex-file-compressed 55892583 52213738 1.07
datafusion / parquet (1.008x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 465501893 472485455 0.99
tpch_q02/datafusion:parquet 166540691 165280413 1.01
tpch_q03/datafusion:parquet 252850909 254427203 0.99
tpch_q04/datafusion:parquet 113656033 115520006 0.98
tpch_q05/datafusion:parquet 388114150 389779688 1.00
tpch_q06/datafusion:parquet 129760406 128940660 1.01
tpch_q07/datafusion:parquet 553879391 546186484 1.01
tpch_q08/datafusion:parquet 455319380 441694650 1.03
tpch_q09/datafusion:parquet 712909417 716238264 1.00
tpch_q10/datafusion:parquet 529323756 521496114 1.02
tpch_q11/datafusion:parquet 116458699 115823708 1.01
tpch_q12/datafusion:parquet 209687474 208674237 1.00
tpch_q13/datafusion:parquet 348753733 342747988 1.02
tpch_q14/datafusion:parquet 154829753 152094275 1.02
tpch_q15/datafusion:parquet 266888801 269719019 0.99
tpch_q16/datafusion:parquet 120941221 118954842 1.02
tpch_q17/datafusion:parquet 670961018 663107159 1.01
tpch_q18/datafusion:parquet 867047776 853822345 1.02
tpch_q19/datafusion:parquet 277256355 279817846 0.99
tpch_q20/datafusion:parquet 306835326 302479399 1.01
tpch_q21/datafusion:parquet 677188013 653392888 1.04
tpch_q22/datafusion:parquet 208679044 203182362 1.03
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170999684 168131494 1.02
tpch_q02/duckdb:vortex-file-compressed 52983251 52827257 1.00
tpch_q03/duckdb:vortex-file-compressed 118959912 118576186 1.00
tpch_q04/duckdb:vortex-file-compressed 151895395 151681002 1.00
tpch_q05/duckdb:vortex-file-compressed 147236557 133926374 1.10
tpch_q06/duckdb:vortex-file-compressed 34580644 34245155 1.01
tpch_q07/duckdb:vortex-file-compressed 130599927 127920718 1.02
tpch_q08/duckdb:vortex-file-compressed 172738026 168873926 1.02
tpch_q09/duckdb:vortex-file-compressed 393384575 388687785 1.01
tpch_q10/duckdb:vortex-file-compressed 192720688 190995871 1.01
tpch_q11/duckdb:vortex-file-compressed 31469365 30340720 1.04
tpch_q12/duckdb:vortex-file-compressed 106606401 104084199 1.02
tpch_q13/duckdb:vortex-file-compressed 273121568 270105859 1.01
tpch_q14/duckdb:vortex-file-compressed 53728286 53064236 1.01
tpch_q15/duckdb:vortex-file-compressed 88464787 87874109 1.01
tpch_q16/duckdb:vortex-file-compressed 75044532 76661640 0.98
tpch_q17/duckdb:vortex-file-compressed 87961711 86188691 1.02
tpch_q18/duckdb:vortex-file-compressed 285656528 286619860 1.00
tpch_q19/duckdb:vortex-file-compressed 74194757 75417766 0.98
tpch_q20/duckdb:vortex-file-compressed 137759646 137407093 1.00
tpch_q21/duckdb:vortex-file-compressed 🚨 547105423 464980156 1.18
tpch_q22/duckdb:vortex-file-compressed 62568818 63367138 0.99
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 266998686 263757672 1.01
tpch_q02/duckdb:parquet 97880364 102251037 0.96
tpch_q03/duckdb:parquet 216083006 212500535 1.02
tpch_q04/duckdb:parquet 139335487 139566778 1.00
tpch_q05/duckdb:parquet 228521948 228949330 1.00
tpch_q06/duckdb:parquet 75265969 75144836 1.00
tpch_q07/duckdb:parquet 192103970 186409858 1.03
tpch_q08/duckdb:parquet 267817158 269050626 1.00
tpch_q09/duckdb:parquet 517430722 506114196 1.02
tpch_q10/duckdb:parquet 626585164 626426329 1.00
tpch_q11/duckdb:parquet 67017487 70649467 0.95
tpch_q12/duckdb:parquet 136253008 133261633 1.02
tpch_q13/duckdb:parquet 447342777 453730689 0.99
tpch_q14/duckdb:parquet 180521221 177674078 1.02
tpch_q15/duckdb:parquet 103985399 104067125 1.00
tpch_q16/duckdb:parquet 166003619 166841741 0.99
tpch_q17/duckdb:parquet 184353495 187677416 0.98
tpch_q18/duckdb:parquet 370047454 362338319 1.02
tpch_q19/duckdb:parquet 286562767 290056913 0.99
tpch_q20/duckdb:parquet 234298129 232417820 1.01
tpch_q21/duckdb:parquet 570490582 569291927 1.00
tpch_q22/duckdb:parquet 305503809 301726401 1.01
File Size Changes (25 files changed, -44.0% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
customer_0.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 0 B 100.64 MB -100.0%
lineitem_10.vortex 10.0 vortex-compact 100.83 MB 0 B 100.83 MB -100.0%
lineitem_11.vortex 10.0 vortex-compact 100.75 MB 0 B 100.75 MB -100.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_2.vortex 10.0 vortex-compact 100.79 MB 0 B 100.79 MB -100.0%
lineitem_3.vortex 10.0 vortex-compact 100.85 MB 0 B 100.85 MB -100.0%
lineitem_4.vortex 10.0 vortex-compact 100.55 MB 0 B 100.55 MB -100.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 0 B 100.70 MB -100.0%
lineitem_6.vortex 10.0 vortex-compact 100.88 MB 0 B 100.88 MB -100.0%
lineitem_7.vortex 10.0 vortex-compact 100.79 MB 0 B 100.79 MB -100.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 0 B 100.46 MB -100.0%
nation_0.vortex 10.0 vortex-compact 7.80 KB 0 B 7.80 KB -100.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 0 B 114.79 MB -100.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 0 B 114.76 MB -100.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 0 B 114.78 MB -100.0%
part_0.vortex 10.0 vortex-compact 17.92 MB 0 B 17.92 MB -100.0%
part_1.vortex 10.0 vortex-compact 17.98 MB 0 B 17.98 MB -100.0%
partsupp_0.vortex 10.0 vortex-compact 101.84 MB 0 B 101.84 MB -100.0%
partsupp_1.vortex 10.0 vortex-compact 102.09 MB 0 B 102.09 MB -100.0%
region_0.vortex 10.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.9%
Engines: DataFusion No clear signal (-2.9%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 0.960x ➖
Parquet (geomean): 0.979x ➖
Shifts: Parquet (control) -2.1% · Median polish -2.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.937x ➖, 3↑ 1↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 428691170 416231321 1.03
clickbench-sorted_q24/datafusion:vortex-file-compressed 🚀 20914895 24417966 0.86
clickbench-sorted_q26/datafusion:vortex-file-compressed 🚨 21814211 19207694 1.14
clickbench-sorted_q36/datafusion:vortex-file-compressed 🚀 63686639 77185897 0.83
clickbench-sorted_q37/datafusion:vortex-file-compressed 43122734 47597391 0.91
clickbench-sorted_q38/datafusion:vortex-file-compressed 🚀 40522008 46131889 0.88
clickbench-sorted_q39/datafusion:vortex-file-compressed 114627789 114237277 1.00
clickbench-sorted_q40/datafusion:vortex-file-compressed 20243594 22163521 0.91
clickbench-sorted_q41/datafusion:vortex-file-compressed 19653250 20988079 0.94
clickbench-sorted_q42/datafusion:vortex-file-compressed 14166446 15309481 0.93
datafusion / parquet (0.965x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 4742011943 5221377913 0.91
clickbench-sorted_q24/datafusion:parquet 27997566 28667163 0.98
clickbench-sorted_q26/datafusion:parquet 27976139 29298268 0.95
clickbench-sorted_q36/datafusion:parquet 181028893 189118063 0.96
clickbench-sorted_q37/datafusion:parquet 114381704 114319122 1.00
clickbench-sorted_q38/datafusion:parquet 163195668 172188324 0.95
clickbench-sorted_q39/datafusion:parquet 296828720 309252873 0.96
clickbench-sorted_q40/datafusion:parquet 71195577 68766011 1.04
clickbench-sorted_q41/datafusion:parquet 64199291 64723723 0.99
clickbench-sorted_q42/datafusion:parquet 31199672 33858638 0.92
duckdb / vortex-file-compressed (0.984x ➖, 1↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 🚀 149412038 170478943 0.88
clickbench-sorted_q24/duckdb:vortex-file-compressed 27379728 28047326 0.98
clickbench-sorted_q26/duckdb:vortex-file-compressed 48172057 49380789 0.98
clickbench-sorted_q36/duckdb:vortex-file-compressed 56142732 57903820 0.97
clickbench-sorted_q37/duckdb:vortex-file-compressed 44726764 44929157 1.00
clickbench-sorted_q38/duckdb:vortex-file-compressed 52888634 50860872 1.04
clickbench-sorted_q39/duckdb:vortex-file-compressed 109892937 108579493 1.01
clickbench-sorted_q40/duckdb:vortex-file-compressed 30056057 29848794 1.01
clickbench-sorted_q41/duckdb:vortex-file-compressed 28475844 28357521 1.00
clickbench-sorted_q42/duckdb:vortex-file-compressed 25018512 25251728 0.99
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 196235545 197422715 0.99
clickbench-sorted_q24/duckdb:parquet 29350903 28574476 1.03
clickbench-sorted_q26/duckdb:parquet 24339606 25229616 0.96
clickbench-sorted_q36/duckdb:parquet 108457220 107871324 1.01
clickbench-sorted_q37/duckdb:parquet 93908852 93519772 1.00
clickbench-sorted_q38/duckdb:parquet 96967024 96102112 1.01
clickbench-sorted_q39/duckdb:parquet 179424751 181699360 0.99
clickbench-sorted_q40/duckdb:parquet 42063028 42742184 0.98
clickbench-sorted_q41/duckdb:parquet 41373140 41687132 0.99
clickbench-sorted_q42/duckdb:parquet 30080380 31085275 0.97
File Size Changes (201 files changed, -42.8% overall, 45↑ 156↓)
File Scale Format Base HEAD Change %
hits_038.vortex 1.0 vortex-file-compressed 190.01 MB 192.49 MB +2.48 MB +1.3%
hits_010.vortex 1.0 vortex-file-compressed 169.07 MB 170.33 MB +1.26 MB +0.7%
hits_007.vortex 1.0 vortex-file-compressed 198.79 MB 200.19 MB +1.40 MB +0.7%
hits_017.vortex 1.0 vortex-file-compressed 146.84 MB 147.35 MB +527.42 KB +0.4%
hits_000.vortex 1.0 vortex-file-compressed 131.63 MB 131.96 MB +338.14 KB +0.3%
hits_031.vortex 1.0 vortex-file-compressed 159.54 MB 159.93 MB +391.48 KB +0.2%
hits_035.vortex 1.0 vortex-file-compressed 102.58 MB 102.81 MB +230.36 KB +0.2%
hits_071.vortex 1.0 vortex-file-compressed 140.12 MB 140.43 MB +313.28 KB +0.2%
hits_072.vortex 1.0 vortex-file-compressed 102.42 MB 102.64 MB +224.34 KB +0.2%
hits_067.vortex 1.0 vortex-file-compressed 131.81 MB 132.08 MB +274.59 KB +0.2%
hits_026.vortex 1.0 vortex-file-compressed 131.47 MB 131.68 MB +214.86 KB +0.2%
hits_092.vortex 1.0 vortex-file-compressed 199.40 MB 199.69 MB +303.87 KB +0.1%
hits_091.vortex 1.0 vortex-file-compressed 146.90 MB 147.12 MB +219.79 KB +0.1%
hits_093.vortex 1.0 vortex-file-compressed 131.68 MB 131.85 MB +175.36 KB +0.1%
hits_042.vortex 1.0 vortex-file-compressed 201.72 MB 201.97 MB +251.52 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 199.07 MB 199.31 MB +243.24 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 198.89 MB 199.09 MB +206.46 KB +0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.64 MB 160.79 MB +156.41 KB +0.1%
hits_095.vortex 1.0 vortex-file-compressed 154.40 MB 154.54 MB +145.27 KB +0.1%
hits_015.vortex 1.0 vortex-file-compressed 131.22 MB 131.34 MB +117.63 KB +0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.93 MB 131.04 MB +117.13 KB +0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.98 MB 172.13 MB +147.42 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 192.88 MB 193.04 MB +159.93 KB +0.1%
hits_016.vortex 1.0 vortex-file-compressed 180.41 MB 180.55 MB +148.27 KB +0.1%
hits_056.vortex 1.0 vortex-file-compressed 135.76 MB 135.86 MB +106.24 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 154.28 MB 154.40 MB +120.67 KB +0.1%
hits_048.vortex 1.0 vortex-file-compressed 199.31 MB 199.46 MB +151.76 KB +0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.04 MB 161.15 MB +112.77 KB +0.1%
hits_079.vortex 1.0 vortex-file-compressed 181.27 MB 181.38 MB +120.80 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.35 MB 101.41 MB +64.79 KB +0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.03 MB 161.12 MB +83.70 KB +0.1%
hits_076.vortex 1.0 vortex-file-compressed 161.02 MB 161.10 MB +75.47 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.46 MB 171.54 MB +77.37 KB +0.0%
hits_058.vortex 1.0 vortex-file-compressed 155.15 MB 155.21 MB +65.14 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.25 MB 171.32 MB +68.56 KB +0.0%
hits_020.vortex 1.0 vortex-file-compressed 160.15 MB 160.21 MB +62.48 KB +0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.00 MB 172.06 MB +65.46 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.26 MB 142.30 MB +45.86 KB +0.0%
hits_033.vortex 1.0 vortex-file-compressed 200.22 MB 200.27 MB +60.38 KB +0.0%
hits_045.vortex 1.0 vortex-file-compressed 140.61 MB 140.65 MB +38.73 KB +0.0%
hits_041.vortex 1.0 vortex-file-compressed 131.28 MB 131.31 MB +36.02 KB +0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.96 MB 130.98 MB +27.69 KB +0.0%
hits_074.vortex 1.0 vortex-file-compressed 199.77 MB 199.80 MB +21.86 KB +0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.27 MB 161.27 MB +3.16 KB +0.0%
hits_029.vortex 1.0 vortex-file-compressed 199.74 MB 199.75 MB +1.55 KB +0.0%
hits_087.vortex 1.0 vortex-file-compressed 160.98 MB 160.98 MB 112 B -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.87 MB 126.86 MB 1.86 KB -0.0%
hits_070.vortex 1.0 vortex-file-compressed 199.84 MB 199.83 MB 5.26 KB -0.0%
hits_082.vortex 1.0 vortex-file-compressed 139.96 MB 139.95 MB 4.20 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 195.38 MB 195.35 MB 27.82 KB -0.0%
hits_085.vortex 1.0 vortex-file-compressed 199.72 MB 199.68 MB 32.87 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.51 MB 126.49 MB 21.47 KB -0.0%
hits_008.vortex 1.0 vortex-file-compressed 140.34 MB 140.32 MB 25.66 KB -0.0%
hits_037.vortex 1.0 vortex-file-compressed 177.32 MB 177.29 MB 32.82 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.36 MB 126.33 MB 27.20 KB -0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.60 MB 137.57 MB 30.06 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 157.26 MB 157.23 MB 37.48 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 131.52 MB 131.48 MB 35.49 KB -0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.85 MB 154.79 MB 62.84 KB -0.0%
hits_027.vortex 1.0 vortex-file-compressed 190.05 MB 189.97 MB 79.30 KB -0.0%
hits_018.vortex 1.0 vortex-file-compressed 199.61 MB 199.52 MB 95.19 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 154.71 MB 154.62 MB 94.34 KB -0.1%
hits_061.vortex 1.0 vortex-file-compressed 160.88 MB 160.78 MB 100.12 KB -0.1%
hits_084.vortex 1.0 vortex-file-compressed 154.67 MB 154.57 MB 104.54 KB -0.1%
hits_086.vortex 1.0 vortex-file-compressed 192.32 MB 192.18 MB 143.27 KB -0.1%
hits_060.vortex 1.0 vortex-file-compressed 193.34 MB 193.20 MB 145.01 KB -0.1%
hits_081.vortex 1.0 vortex-file-compressed 199.86 MB 199.69 MB 177.15 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 101.39 MB 101.30 MB 91.19 KB -0.1%
hits_057.vortex 1.0 vortex-file-compressed 160.08 MB 159.91 MB 168.77 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.95 MB 131.80 MB 145.06 KB -0.1%
hits_062.vortex 1.0 vortex-file-compressed 170.88 MB 170.69 MB 193.59 KB -0.1%
hits_090.vortex 1.0 vortex-file-compressed 192.73 MB 192.51 MB 232.22 KB -0.1%
hits_075.vortex 1.0 vortex-file-compressed 189.89 MB 189.64 MB 262.34 KB -0.1%
hits_012.vortex 1.0 vortex-file-compressed 191.07 MB 190.81 MB 264.95 KB -0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.76 MB 167.50 MB 260.60 KB -0.2%
hits_049.vortex 1.0 vortex-file-compressed 191.64 MB 191.35 MB 301.12 KB -0.2%
hits_019.vortex 1.0 vortex-file-compressed 141.03 MB 140.79 MB 243.15 KB -0.2%
hits_053.vortex 1.0 vortex-file-compressed 190.30 MB 189.94 MB 370.79 KB -0.2%
hits_063.vortex 1.0 vortex-file-compressed 131.91 MB 131.64 MB 267.92 KB -0.2%
hits_044.vortex 1.0 vortex-file-compressed 200.56 MB 200.15 MB 410.34 KB -0.2%
hits_077.vortex 1.0 vortex-file-compressed 172.88 MB 172.50 MB 380.45 KB -0.2%
hits_073.vortex 1.0 vortex-file-compressed 173.18 MB 172.81 MB 383.66 KB -0.2%
hits_096.vortex 1.0 vortex-file-compressed 199.81 MB 199.36 MB 456.28 KB -0.2%
hits_051.vortex 1.0 vortex-file-compressed 172.97 MB 172.53 MB 449.81 KB -0.3%
hits_055.vortex 1.0 vortex-file-compressed 199.51 MB 198.92 MB 602.07 KB -0.3%
hits_004.vortex 1.0 vortex-file-compressed 131.92 MB 131.52 MB 408.60 KB -0.3%
hits_028.vortex 1.0 vortex-file-compressed 152.89 MB 152.38 MB 530.59 KB -0.3%
hits_054.vortex 1.0 vortex-file-compressed 147.56 MB 147.01 MB 566.80 KB -0.4%
hits_065.vortex 1.0 vortex-file-compressed 162.01 MB 161.39 MB 627.52 KB -0.4%
hits_022.vortex 1.0 vortex-file-compressed 199.25 MB 198.49 MB 773.42 KB -0.4%
hits_040.vortex 1.0 vortex-file-compressed 144.27 MB 143.69 MB 591.23 KB -0.4%
hits_014.vortex 1.0 vortex-file-compressed 172.76 MB 172.04 MB 735.27 KB -0.4%
hits_003.vortex 1.0 vortex-file-compressed 137.09 MB 136.50 MB 605.31 KB -0.4%
hits_050.vortex 1.0 vortex-file-compressed 160.84 MB 160.07 MB 791.35 KB -0.5%
hits_094.vortex 1.0 vortex-file-compressed 159.34 MB 158.35 MB 1006.91 KB -0.6%
hits_066.vortex 1.0 vortex-file-compressed 164.14 MB 163.10 MB 1.04 MB -0.6%
hits_034.vortex 1.0 vortex-file-compressed 183.33 MB 181.93 MB 1.40 MB -0.8%
hits_024.vortex 1.0 vortex-file-compressed 160.57 MB 159.09 MB 1.47 MB -0.9%
hits_064.vortex 1.0 vortex-file-compressed 194.32 MB 190.91 MB 3.41 MB -1.8%
hits_001.vortex 1.0 vortex-file-compressed 193.35 MB 189.35 MB 4.00 MB -2.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 98.47 MB 0 B 98.47 MB -100.0%
hits_001.vortex 1.0 vortex-compact 140.51 MB 0 B 140.51 MB -100.0%
hits_002.vortex 1.0 vortex-compact 125.55 MB 0 B 125.55 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.53 MB 0 B 104.53 MB -100.0%
hits_004.vortex 1.0 vortex-compact 97.53 MB 0 B 97.53 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.88 MB 0 B 115.88 MB -100.0%
hits_006.vortex 1.0 vortex-compact 94.07 MB 0 B 94.07 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.45 MB 0 B 153.45 MB -100.0%
hits_008.vortex 1.0 vortex-compact 105.69 MB 0 B 105.69 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.24 MB 0 B 75.24 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.40 MB 0 B 123.40 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.86 MB 0 B 152.86 MB -100.0%
hits_012.vortex 1.0 vortex-compact 140.07 MB 0 B 140.07 MB -100.0%
hits_013.vortex 1.0 vortex-compact 124.37 MB 0 B 124.37 MB -100.0%
hits_014.vortex 1.0 vortex-compact 133.92 MB 0 B 133.92 MB -100.0%
hits_015.vortex 1.0 vortex-compact 97.70 MB 0 B 97.70 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.54 MB 0 B 127.54 MB -100.0%
hits_017.vortex 1.0 vortex-compact 111.69 MB 0 B 111.69 MB -100.0%
hits_018.vortex 1.0 vortex-compact 153.60 MB 0 B 153.60 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.64 MB 0 B 106.64 MB -100.0%
hits_020.vortex 1.0 vortex-compact 111.64 MB 0 B 111.64 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.72 MB 0 B 110.72 MB -100.0%
hits_022.vortex 1.0 vortex-compact 152.25 MB 0 B 152.25 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.74 MB 0 B 142.74 MB -100.0%
hits_024.vortex 1.0 vortex-compact 124.52 MB 0 B 124.52 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.50 MB 0 B 133.50 MB -100.0%
hits_026.vortex 1.0 vortex-compact 98.72 MB 0 B 98.72 MB -100.0%
hits_027.vortex 1.0 vortex-compact 139.21 MB 0 B 139.21 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.74 MB 0 B 115.74 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.60 MB 0 B 153.60 MB -100.0%
hits_030.vortex 1.0 vortex-compact 98.31 MB 0 B 98.31 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.53 MB 0 B 111.53 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.65 MB 0 B 110.65 MB -100.0%
hits_033.vortex 1.0 vortex-compact 152.85 MB 0 B 152.85 MB -100.0%
hits_034.vortex 1.0 vortex-compact 132.35 MB 0 B 132.35 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.97 MB 0 B 75.97 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.37 MB 0 B 133.37 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.93 MB 0 B 132.93 MB -100.0%
hits_038.vortex 1.0 vortex-compact 138.31 MB 0 B 138.31 MB -100.0%
hits_039.vortex 1.0 vortex-compact 123.95 MB 0 B 123.95 MB -100.0%
hits_040.vortex 1.0 vortex-compact 109.93 MB 0 B 109.93 MB -100.0%
hits_041.vortex 1.0 vortex-compact 97.14 MB 0 B 97.14 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.35 MB 0 B 136.35 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.23 MB 0 B 94.23 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.75 MB 0 B 153.75 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.20 MB 0 B 106.20 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.97 MB 0 B 74.97 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.49 MB 0 B 110.49 MB -100.0%
hits_048.vortex 1.0 vortex-compact 152.47 MB 0 B 152.47 MB -100.0%
hits_049.vortex 1.0 vortex-compact 139.31 MB 0 B 139.31 MB -100.0%
hits_050.vortex 1.0 vortex-compact 125.48 MB 0 B 125.48 MB -100.0%
hits_051.vortex 1.0 vortex-compact 134.10 MB 0 B 134.10 MB -100.0%
hits_052.vortex 1.0 vortex-compact 97.67 MB 0 B 97.67 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.98 MB 0 B 138.98 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.07 MB 0 B 112.07 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.29 MB 0 B 153.29 MB -100.0%
hits_056.vortex 1.0 vortex-compact 101.41 MB 0 B 101.41 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.97 MB 0 B 111.97 MB -100.0%
hits_058.vortex 1.0 vortex-compact 111.07 MB 0 B 111.07 MB -100.0%
hits_059.vortex 1.0 vortex-compact 152.61 MB 0 B 152.61 MB -100.0%
hits_060.vortex 1.0 vortex-compact 141.20 MB 0 B 141.20 MB -100.0%
hits_061.vortex 1.0 vortex-compact 124.42 MB 0 B 124.42 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.86 MB 0 B 132.86 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.78 MB 0 B 98.78 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.01 MB 0 B 140.01 MB -100.0%
hits_065.vortex 1.0 vortex-compact 125.82 MB 0 B 125.82 MB -100.0%
hits_066.vortex 1.0 vortex-compact 116.83 MB 0 B 116.83 MB -100.0%
hits_067.vortex 1.0 vortex-compact 98.88 MB 0 B 98.88 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.64 MB 0 B 112.64 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.74 MB 0 B 99.74 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.77 MB 0 B 153.77 MB -100.0%
hits_071.vortex 1.0 vortex-compact 106.14 MB 0 B 106.14 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.57 MB 0 B 75.57 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.13 MB 0 B 134.13 MB -100.0%
hits_074.vortex 1.0 vortex-compact 153.17 MB 0 B 153.17 MB -100.0%
hits_075.vortex 1.0 vortex-compact 137.84 MB 0 B 137.84 MB -100.0%
hits_076.vortex 1.0 vortex-compact 125.84 MB 0 B 125.84 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.57 MB 0 B 134.57 MB -100.0%
hits_078.vortex 1.0 vortex-compact 97.20 MB 0 B 97.20 MB -100.0%
hits_079.vortex 1.0 vortex-compact 128.09 MB 0 B 128.09 MB -100.0%
hits_080.vortex 1.0 vortex-compact 96.87 MB 0 B 96.87 MB -100.0%
hits_081.vortex 1.0 vortex-compact 152.83 MB 0 B 152.83 MB -100.0%
hits_082.vortex 1.0 vortex-compact 105.81 MB 0 B 105.81 MB -100.0%
hits_083.vortex 1.0 vortex-compact 110.09 MB 0 B 110.09 MB -100.0%
hits_084.vortex 1.0 vortex-compact 110.44 MB 0 B 110.44 MB -100.0%
hits_085.vortex 1.0 vortex-compact 152.53 MB 0 B 152.53 MB -100.0%
hits_086.vortex 1.0 vortex-compact 140.82 MB 0 B 140.82 MB -100.0%
hits_087.vortex 1.0 vortex-compact 125.66 MB 0 B 125.66 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.36 MB 0 B 134.36 MB -100.0%
hits_089.vortex 1.0 vortex-compact 99.47 MB 0 B 99.47 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.31 MB 0 B 141.31 MB -100.0%
hits_091.vortex 1.0 vortex-compact 112.31 MB 0 B 112.31 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.32 MB 0 B 153.32 MB -100.0%
hits_093.vortex 1.0 vortex-compact 99.09 MB 0 B 99.09 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.70 MB 0 B 110.70 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.62 MB 0 B 110.62 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.27 MB 0 B 153.27 MB -100.0%
hits_097.vortex 1.0 vortex-compact 141.26 MB 0 B 141.26 MB -100.0%
hits_098.vortex 1.0 vortex-compact 104.33 MB 0 B 104.33 MB -100.0%
hits_099.vortex 1.0 vortex-compact 133.05 MB 0 B 133.05 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.98 GB → 15.96 GB (-0.1%)

@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.9%
Engines: DuckDB No clear signal (-1.9%, low confidence)
Vortex (geomean): 0.946x ➖
Parquet (geomean): 0.964x ➖
Shifts: Parquet (control) -3.6% · Median polish -4.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.946x ➖, 1↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11572778 12812465 0.90
statpopgen_q01/duckdb:vortex-file-compressed 🚀 12690322 15173674 0.84
statpopgen_q02/duckdb:vortex-file-compressed 525753084 554137049 0.95
statpopgen_q03/duckdb:vortex-file-compressed 1026713940 1079330777 0.95
statpopgen_q04/duckdb:vortex-file-compressed 1037248026 1103231308 0.94
statpopgen_q05/duckdb:vortex-file-compressed 463676157 475516558 0.98
statpopgen_q06/duckdb:vortex-file-compressed 1504630362 1560351074 0.96
statpopgen_q07/duckdb:vortex-file-compressed 197356838 197914221 1.00
statpopgen_q08/duckdb:vortex-file-compressed 222886024 226493008 0.98
statpopgen_q09/duckdb:vortex-file-compressed 813882197 834533946 0.98
statpopgen_q10/duckdb:vortex-file-compressed 2519349020 2665082687 0.95
duckdb / parquet (0.964x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 327562815 341383418 0.96
statpopgen_q01/duckdb:parquet 411306209 420927614 0.98
statpopgen_q02/duckdb:parquet 781240057 834788471 0.94
statpopgen_q03/duckdb:parquet 1204694538 1322006391 0.91
statpopgen_q04/duckdb:parquet 1218116775 1242854128 0.98
statpopgen_q05/duckdb:parquet 836034070 869308927 0.96
statpopgen_q06/duckdb:parquet 1445472647 1515060662 0.95
statpopgen_q07/duckdb:parquet 885123405 893007694 0.99
statpopgen_q08/duckdb:parquet 886908085 894726039 0.99
statpopgen_q09/duckdb:parquet 1027434447 1057651477 0.97
statpopgen_q10/duckdb:parquet 2210488790 2264267612 0.98
File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.2%
Engines: DataFusion No clear signal (+2.8%, environment too noisy confidence) · DuckDB No clear signal (+1.6%, low confidence)
Vortex (geomean): 0.966x ➖
Parquet (geomean): 0.945x ➖
Shifts: Parquet (control) -5.5% · Median polish -3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.976x ➖, 1↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 35040429 51012106 0.69
fineweb_q01/datafusion:vortex-file-compressed 515666682 564853625 0.91
fineweb_q02/datafusion:vortex-file-compressed 548042071 435496075 1.26
fineweb_q03/datafusion:vortex-file-compressed 1117597075 1132055419 0.99
fineweb_q04/datafusion:vortex-file-compressed 1179466759 1169388940 1.01
fineweb_q05/datafusion:vortex-file-compressed 1119298606 1118375875 1.00
fineweb_q06/datafusion:vortex-file-compressed 1266849387 1231520366 1.03
fineweb_q07/datafusion:vortex-file-compressed 1095006003 1106914859 0.99
fineweb_q08/datafusion:vortex-file-compressed 505659418 502966502 1.01
datafusion / parquet (0.949x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1173305029 1211372795 0.97
fineweb_q01/datafusion:parquet 1687019645 1858332145 0.91
fineweb_q02/datafusion:parquet 1816865734 1847214711 0.98
fineweb_q03/datafusion:parquet 1870616521 1755198983 1.07
fineweb_q04/datafusion:parquet 1749583452 1930858959 0.91
fineweb_q05/datafusion:parquet 1776301265 1781668345 1.00
fineweb_q06/datafusion:parquet 1755921304 1866245039 0.94
fineweb_q07/datafusion:parquet 1798651033 2047774262 0.88
fineweb_q08/datafusion:parquet 1772198051 1945837061 0.91
duckdb / vortex-file-compressed (0.956x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 82558525 88608409 0.93
fineweb_q01/duckdb:vortex-file-compressed 607249691 612703443 0.99
fineweb_q02/duckdb:vortex-file-compressed 503644813 572204633 0.88
fineweb_q03/duckdb:vortex-file-compressed 1247713768 1366243613 0.91
fineweb_q04/duckdb:vortex-file-compressed 1263559706 1369829227 0.92
fineweb_q05/duckdb:vortex-file-compressed 1271350596 1228387245 1.03
fineweb_q06/duckdb:vortex-file-compressed 1414217121 1440459323 0.98
fineweb_q07/duckdb:vortex-file-compressed 1267082369 1301145080 0.97
fineweb_q08/duckdb:vortex-file-compressed 619217712 628320504 0.99
duckdb / parquet (0.941x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1084832135 1140814322 0.95
fineweb_q01/duckdb:parquet 1324218571 1482075071 0.89
fineweb_q02/duckdb:parquet 1394476494 1432800372 0.97
fineweb_q03/duckdb:parquet 3783078038 3765429652 1.00
fineweb_q04/duckdb:parquet 1882363787 2083039210 0.90
fineweb_q05/duckdb:parquet 2042714440 2142588378 0.95
fineweb_q06/duckdb:parquet 4166434737 4650110948 0.90
fineweb_q07/duckdb:parquet 2545763010 2665795939 0.95
fineweb_q08/duckdb:parquet 1066194156 1123918973 0.95

@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.9%
Engines: DataFusion No clear signal (+1.9%, low confidence) · DuckDB No clear signal (+1.8%, low confidence)
Vortex (geomean): 1.036x ➖
Parquet (geomean): 1.017x ➖
Shifts: Parquet (control) +1.7% · Median polish +2.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.062x ➖, 0↑ 4↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1637642 1622546 1.01
clickbench_q01/datafusion:vortex-file-compressed 18319150 16782614 1.09
clickbench_q02/datafusion:vortex-file-compressed 34491097 34640422 1.00
clickbench_q03/datafusion:vortex-file-compressed 37372646 35978022 1.04
clickbench_q04/datafusion:vortex-file-compressed 🚨 255206319 227363850 1.12
clickbench_q05/datafusion:vortex-file-compressed 317466963 294419123 1.08
clickbench_q06/datafusion:vortex-file-compressed 1674242 1663194 1.01
clickbench_q07/datafusion:vortex-file-compressed 22910554 21380525 1.07
clickbench_q08/datafusion:vortex-file-compressed 345979355 327440906 1.06
clickbench_q09/datafusion:vortex-file-compressed 465378497 450503486 1.03
clickbench_q10/datafusion:vortex-file-compressed 73966293 71196227 1.04
clickbench_q11/datafusion:vortex-file-compressed 85431720 82648252 1.03
clickbench_q12/datafusion:vortex-file-compressed 264716480 250532175 1.06
clickbench_q13/datafusion:vortex-file-compressed 441392305 408386359 1.08
clickbench_q14/datafusion:vortex-file-compressed 270376678 248998940 1.09
clickbench_q15/datafusion:vortex-file-compressed 286490039 272544379 1.05
clickbench_q16/datafusion:vortex-file-compressed 680908682 632894440 1.08
clickbench_q17/datafusion:vortex-file-compressed 683370958 647984389 1.05
clickbench_q18/datafusion:vortex-file-compressed 1431813092 1344571688 1.06
clickbench_q19/datafusion:vortex-file-compressed 26357623 25086969 1.05
clickbench_q20/datafusion:vortex-file-compressed 275939540 258052432 1.07
clickbench_q21/datafusion:vortex-file-compressed 360933508 341036175 1.06
clickbench_q22/datafusion:vortex-file-compressed 454802864 433437549 1.05
clickbench_q23/datafusion:vortex-file-compressed 588822644 555558150 1.06
clickbench_q24/datafusion:vortex-file-compressed 44481992 44284376 1.00
clickbench_q25/datafusion:vortex-file-compressed 75968941 74083428 1.03
clickbench_q26/datafusion:vortex-file-compressed 🚨 44600225 40135040 1.11
clickbench_q27/datafusion:vortex-file-compressed 385628561 368196689 1.05
clickbench_q28/datafusion:vortex-file-compressed 2368898224 2294522975 1.03
clickbench_q29/datafusion:vortex-file-compressed 57817945 52648180 1.10
clickbench_q30/datafusion:vortex-file-compressed 234583801 221306615 1.06
clickbench_q31/datafusion:vortex-file-compressed 254737981 235034693 1.08
clickbench_q32/datafusion:vortex-file-compressed 1076295253 1015272495 1.06
clickbench_q33/datafusion:vortex-file-compressed 1414056408 1344010185 1.05
clickbench_q34/datafusion:vortex-file-compressed 1415205869 1348371246 1.05
clickbench_q35/datafusion:vortex-file-compressed 250002386 234339401 1.07
clickbench_q36/datafusion:vortex-file-compressed 63678706 58449353 1.09
clickbench_q37/datafusion:vortex-file-compressed 25564435 24197238 1.06
clickbench_q38/datafusion:vortex-file-compressed 16853878 15330405 1.10
clickbench_q39/datafusion:vortex-file-compressed 🚨 127671072 115050672 1.11
clickbench_q40/datafusion:vortex-file-compressed 12556035 11444592 1.10
clickbench_q41/datafusion:vortex-file-compressed 🚨 12438121 10882430 1.14
clickbench_q42/datafusion:vortex-file-compressed 11738821 10971803 1.07
datafusion / parquet (1.042x ➖, 0↑ 3↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1596671 1536596 1.04
clickbench_q01/datafusion:parquet 20131106 18954719 1.06
clickbench_q02/datafusion:parquet 44972923 44639669 1.01
clickbench_q03/datafusion:parquet 35253778 34174260 1.03
clickbench_q04/datafusion:parquet 267461935 268434406 1.00
clickbench_q05/datafusion:parquet 325330563 317376482 1.03
clickbench_q06/datafusion:parquet 1586534 1557262 1.02
clickbench_q07/datafusion:parquet 21256060 20262001 1.05
clickbench_q08/datafusion:parquet 349476875 326634849 1.07
clickbench_q09/datafusion:parquet 479889165 476842919 1.01
clickbench_q10/datafusion:parquet 94742261 89572025 1.06
clickbench_q11/datafusion:parquet 🚨 126584171 113723279 1.11
clickbench_q12/datafusion:parquet 311652013 300386255 1.04
clickbench_q13/datafusion:parquet 491510032 460123651 1.07
clickbench_q14/datafusion:parquet 326916002 312301155 1.05
clickbench_q15/datafusion:parquet 286548157 276691083 1.04
clickbench_q16/datafusion:parquet 704776082 643942922 1.09
clickbench_q17/datafusion:parquet 662411799 635213385 1.04
clickbench_q18/datafusion:parquet 1405447971 1369093650 1.03
clickbench_q19/datafusion:parquet 28064336 28816878 0.97
clickbench_q20/datafusion:parquet 570441055 567538273 1.01
clickbench_q21/datafusion:parquet 629529878 611680743 1.03
clickbench_q22/datafusion:parquet 930399185 903843755 1.03
clickbench_q23/datafusion:parquet 4146014391 3994835038 1.04
clickbench_q24/datafusion:parquet 56248382 54470553 1.03
clickbench_q25/datafusion:parquet 130903529 126407043 1.04
clickbench_q26/datafusion:parquet 52775439 52565025 1.00
clickbench_q27/datafusion:parquet 664648127 642158465 1.04
clickbench_q28/datafusion:parquet 2499593711 2410151659 1.04
clickbench_q29/datafusion:parquet 57631262 54471345 1.06
clickbench_q30/datafusion:parquet 325447523 311470910 1.04
clickbench_q31/datafusion:parquet 352505845 336533040 1.05
clickbench_q32/datafusion:parquet 1126086481 1122443061 1.00
clickbench_q33/datafusion:parquet 1535267298 1461923538 1.05
clickbench_q34/datafusion:parquet 1532481679 1479426146 1.04
clickbench_q35/datafusion:parquet 254459699 240850292 1.06
clickbench_q36/datafusion:parquet 113286574 105567657 1.07
clickbench_q37/datafusion:parquet 🚨 44958470 40565293 1.11
clickbench_q38/datafusion:parquet 64507720 61773833 1.04
clickbench_q39/datafusion:parquet 223844922 207177183 1.08
clickbench_q40/datafusion:parquet 🚨 24645298 22306419 1.10
clickbench_q41/datafusion:parquet 22942230 22864546 1.00
clickbench_q42/datafusion:parquet 22747313 21452990 1.06
duckdb / vortex-file-compressed (1.010x ➖, 1↑ 1↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 9188556 9740092 0.94
clickbench_q01/duckdb:vortex-file-compressed 15803717 15792901 1.00
clickbench_q02/duckdb:vortex-file-compressed 21235761 21669057 0.98
clickbench_q03/duckdb:vortex-file-compressed 26769173 28005539 0.96
clickbench_q04/duckdb:vortex-file-compressed 201897405 198978812 1.01
clickbench_q05/duckdb:vortex-file-compressed 185009451 185029325 1.00
clickbench_q06/duckdb:vortex-file-compressed 20230089 19911351 1.02
clickbench_q07/duckdb:vortex-file-compressed 20640000 19661335 1.05
clickbench_q08/duckdb:vortex-file-compressed 272225698 270952541 1.00
clickbench_q09/duckdb:vortex-file-compressed 358230403 348160207 1.03
clickbench_q10/duckdb:vortex-file-compressed 74617320 72804575 1.02
clickbench_q11/duckdb:vortex-file-compressed 85719290 84726517 1.01
clickbench_q12/duckdb:vortex-file-compressed 208903169 207716341 1.01
clickbench_q13/duckdb:vortex-file-compressed 427673588 421767833 1.01
clickbench_q14/duckdb:vortex-file-compressed 246313846 242219765 1.02
clickbench_q15/duckdb:vortex-file-compressed 267465376 254576331 1.05
clickbench_q16/duckdb:vortex-file-compressed 553467296 543033914 1.02
clickbench_q17/duckdb:vortex-file-compressed 450556201 441785271 1.02
clickbench_q18/duckdb:vortex-file-compressed 968732171 958496134 1.01
clickbench_q19/duckdb:vortex-file-compressed 20550215 20485635 1.00
clickbench_q20/duckdb:vortex-file-compressed 261356413 251661925 1.04
clickbench_q21/duckdb:vortex-file-compressed 358034130 340645763 1.05
clickbench_q22/duckdb:vortex-file-compressed 521738004 525347279 0.99
clickbench_q23/duckdb:vortex-file-compressed 155052434 167664507 0.92
clickbench_q24/duckdb:vortex-file-compressed 🚀 34476277 39871636 0.86
clickbench_q25/duckdb:vortex-file-compressed 80649275 81769411 0.99
clickbench_q26/duckdb:vortex-file-compressed 45549635 45587613 1.00
clickbench_q27/duckdb:vortex-file-compressed 223182481 226254183 0.99
clickbench_q28/duckdb:vortex-file-compressed 3038275105 3022960610 1.01
clickbench_q29/duckdb:vortex-file-compressed 27267559 26566255 1.03
clickbench_q30/duckdb:vortex-file-compressed 206580188 202396111 1.02
clickbench_q31/duckdb:vortex-file-compressed 306116081 293495396 1.04
clickbench_q32/duckdb:vortex-file-compressed 1138008944 1124873697 1.01
clickbench_q33/duckdb:vortex-file-compressed 1128756874 1135767964 0.99
clickbench_q34/duckdb:vortex-file-compressed 1206519889 1210499437 1.00
clickbench_q35/duckdb:vortex-file-compressed 372192255 372684511 1.00
clickbench_q36/duckdb:vortex-file-compressed 30548152 28789442 1.06
clickbench_q37/duckdb:vortex-file-compressed 20376457 21129202 0.96
clickbench_q38/duckdb:vortex-file-compressed 24774351 22868627 1.08
clickbench_q39/duckdb:vortex-file-compressed 46661623 44377060 1.05
clickbench_q40/duckdb:vortex-file-compressed 21872514 21188371 1.03
clickbench_q41/duckdb:vortex-file-compressed 🚨 21358285 18554888 1.15
clickbench_q42/duckdb:vortex-file-compressed 21438964 20998246 1.02
duckdb / parquet (0.992x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23032510 23898849 0.96
clickbench_q01/duckdb:parquet 29493946 30341830 0.97
clickbench_q02/duckdb:parquet 51261571 53241954 0.96
clickbench_q03/duckdb:parquet 40578495 42845598 0.95
clickbench_q04/duckdb:parquet 208669181 213610264 0.98
clickbench_q05/duckdb:parquet 264730218 267057951 0.99
clickbench_q06/duckdb:parquet 48957090 48806373 1.00
clickbench_q07/duckdb:parquet 32903323 32829997 1.00
clickbench_q08/duckdb:parquet 271232827 281440717 0.96
clickbench_q09/duckdb:parquet 408878648 424123844 0.96
clickbench_q10/duckdb:parquet 84016932 86360354 0.97
clickbench_q11/duckdb:parquet 102122665 103936907 0.98
clickbench_q12/duckdb:parquet 286840286 286619626 1.00
clickbench_q13/duckdb:parquet 489386860 485383944 1.01
clickbench_q14/duckdb:parquet 325477386 319580950 1.02
clickbench_q15/duckdb:parquet 260268149 259687683 1.00
clickbench_q16/duckdb:parquet 612429586 613708296 1.00
clickbench_q17/duckdb:parquet 514905606 513568530 1.00
clickbench_q18/duckdb:parquet 1042724251 1048535237 0.99
clickbench_q19/duckdb:parquet 30018426 30028544 1.00
clickbench_q20/duckdb:parquet 413502611 424364798 0.97
clickbench_q21/duckdb:parquet 540045654 544161082 0.99
clickbench_q22/duckdb:parquet 925579536 932318629 0.99
clickbench_q23/duckdb:parquet 274220345 277349564 0.99
clickbench_q24/duckdb:parquet 72723326 74276210 0.98
clickbench_q25/duckdb:parquet 167744817 164163430 1.02
clickbench_q26/duckdb:parquet 56166873 56153907 1.00
clickbench_q27/duckdb:parquet 477567290 482429903 0.99
clickbench_q28/duckdb:parquet 4792551591 4780936107 1.00
clickbench_q29/duckdb:parquet 44142534 44140932 1.00
clickbench_q30/duckdb:parquet 318548163 315452937 1.01
clickbench_q31/duckdb:parquet 379784830 376511185 1.01
clickbench_q32/duckdb:parquet 1130992571 1127377309 1.00
clickbench_q33/duckdb:parquet 1130424205 1144835235 0.99
clickbench_q34/duckdb:parquet 1182806335 1183513683 1.00
clickbench_q35/duckdb:parquet 374039643 371782242 1.01
clickbench_q36/duckdb:parquet 48337997 46903873 1.03
clickbench_q37/duckdb:parquet 35040719 36045938 0.97
clickbench_q38/duckdb:parquet 36895577 36658938 1.01
clickbench_q39/duckdb:parquet 79972802 78001236 1.03
clickbench_q40/duckdb:parquet 21547540 21367617 1.01
clickbench_q41/duckdb:parquet 22015535 22180487 0.99
clickbench_q42/duckdb:parquet 23535289 24545528 0.96
File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.57 MB 0 B 58.57 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.58 MB 0 B 73.58 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.73 MB 0 B 91.73 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@AdamGS
Simplify
494222a 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@github-actions

github-actions Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.5%
Engines: DataFusion No clear signal (-8.8%, environment too noisy confidence) · DuckDB No clear signal (+4.3%, environment too noisy confidence)
Vortex (geomean): 0.952x ➖
Parquet (geomean): 0.976x ➖
Shifts: Parquet (control) -2.4% · Median polish -2.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.902x ➖, 1↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 257027635 286064349 0.90
tpch_q02/datafusion:vortex-file-compressed 407179979 553920190 0.74
tpch_q03/datafusion:vortex-file-compressed 🚀 405745108 648244988 0.63
tpch_q04/datafusion:vortex-file-compressed 210400898 258148546 0.82
tpch_q05/datafusion:vortex-file-compressed 356078769 445926887 0.80
tpch_q06/datafusion:vortex-file-compressed 291152387 323509333 0.90
tpch_q07/datafusion:vortex-file-compressed 395265481 466155059 0.85
tpch_q08/datafusion:vortex-file-compressed 486066691 511081307 0.95
tpch_q09/datafusion:vortex-file-compressed 324265619 349039126 0.93
tpch_q10/datafusion:vortex-file-compressed 407716482 408250907 1.00
tpch_q11/datafusion:vortex-file-compressed 266732426 274001561 0.97
tpch_q12/datafusion:vortex-file-compressed 359368708 380391718 0.94
tpch_q13/datafusion:vortex-file-compressed 181204787 206976799 0.88
tpch_q14/datafusion:vortex-file-compressed 235112193 245827764 0.96
tpch_q15/datafusion:vortex-file-compressed 422656661 437742235 0.97
tpch_q16/datafusion:vortex-file-compressed 186240002 200690196 0.93
tpch_q17/datafusion:vortex-file-compressed 310261825 358487534 0.87
tpch_q18/datafusion:vortex-file-compressed 268811506 269028551 1.00
tpch_q19/datafusion:vortex-file-compressed 468673540 453700682 1.03
tpch_q20/datafusion:vortex-file-compressed 377725371 379150195 1.00
tpch_q21/datafusion:vortex-file-compressed 508190250 495836939 1.02
tpch_q22/datafusion:vortex-file-compressed 146177477 159662180 0.92
datafusion / parquet (0.990x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 216697936 252252495 0.86
tpch_q02/datafusion:parquet 454207708 418794021 1.08
tpch_q03/datafusion:parquet 325791840 328363063 0.99
tpch_q04/datafusion:parquet 190282409 179351216 1.06
tpch_q05/datafusion:parquet 432820604 480207663 0.90
tpch_q06/datafusion:parquet 146428647 150808118 0.97
tpch_q07/datafusion:parquet 442252198 446467618 0.99
tpch_q08/datafusion:parquet 525222899 544394243 0.96
tpch_q09/datafusion:parquet 478093925 470762190 1.02
tpch_q10/datafusion:parquet 460316139 472332482 0.97
tpch_q11/datafusion:parquet 373379447 372285311 1.00
tpch_q12/datafusion:parquet 226070778 217097492 1.04
tpch_q13/datafusion:parquet 423597618 422956182 1.00
tpch_q14/datafusion:parquet 169244624 171790556 0.99
tpch_q15/datafusion:parquet 299516283 286885849 1.04
tpch_q16/datafusion:parquet 167097747 189967659 0.88
tpch_q17/datafusion:parquet 355737988 380777278 0.93
tpch_q18/datafusion:parquet 430678704 437037392 0.99
tpch_q19/datafusion:parquet 319073034 314586240 1.01
tpch_q20/datafusion:parquet 303797411 319347870 0.95
tpch_q21/datafusion:parquet 493541948 497450849 0.99
tpch_q22/datafusion:parquet 190105929 161198939 1.18
duckdb / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 284698151 277408851 1.03
tpch_q02/duckdb:vortex-file-compressed 952971859 897152089 1.06
tpch_q03/duckdb:vortex-file-compressed 623276941 609731204 1.02
tpch_q04/duckdb:vortex-file-compressed 352222903 404131847 0.87
tpch_q05/duckdb:vortex-file-compressed 815085224 843905926 0.97
tpch_q06/duckdb:vortex-file-compressed 341461475 361464931 0.94
tpch_q07/duckdb:vortex-file-compressed 909989356 853954015 1.07
tpch_q08/duckdb:vortex-file-compressed 1025748928 1070140533 0.96
tpch_q09/duckdb:vortex-file-compressed 890842388 860041324 1.04
tpch_q10/duckdb:vortex-file-compressed 691834204 690584048 1.00
tpch_q11/duckdb:vortex-file-compressed 459434704 462849544 0.99
tpch_q12/duckdb:vortex-file-compressed 556477059 604131238 0.92
tpch_q13/duckdb:vortex-file-compressed 386819466 378278838 1.02
tpch_q14/duckdb:vortex-file-compressed 360220632 364439747 0.99
tpch_q15/duckdb:vortex-file-compressed 268872671 263931050 1.02
tpch_q16/duckdb:vortex-file-compressed 339526642 360324077 0.94
tpch_q17/duckdb:vortex-file-compressed 662277162 692230276 0.96
tpch_q18/duckdb:vortex-file-compressed 571821162 565478755 1.01
tpch_q19/duckdb:vortex-file-compressed 539208466 451134781 1.20
tpch_q20/duckdb:vortex-file-compressed 768658708 733201235 1.05
tpch_q21/duckdb:vortex-file-compressed 1029698178 1021362060 1.01
tpch_q22/duckdb:vortex-file-compressed 292069817 274289192 1.06
duckdb / parquet (0.963x ➖, 0↑ 0↓)
name PR 7f3ef04 (ns) base 28d327c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 398910882 409302161 0.97
tpch_q02/duckdb:parquet 1031333177 1072560554 0.96
tpch_q03/duckdb:parquet 911026908 998187168 0.91
tpch_q04/duckdb:parquet 588097635 602486579 0.98
tpch_q05/duckdb:parquet 1171476456 1165909735 1.00
tpch_q06/duckdb:parquet 399991661 396480054 1.01
tpch_q07/duckdb:parquet 1125435385 1147929156 0.98
tpch_q08/duckdb:parquet 1337797931 1426029390 0.94
tpch_q09/duckdb:parquet 1225396006 1300209769 0.94
tpch_q10/duckdb:parquet 1216738242 1200663768 1.01
tpch_q11/duckdb:parquet 673654427 759703511 0.89
tpch_q12/duckdb:parquet 605257810 709971787 0.85
tpch_q13/duckdb:parquet 874359433 916120684 0.95
tpch_q14/duckdb:parquet 590873701 646529796 0.91
tpch_q15/duckdb:parquet 499709657 539311254 0.93
tpch_q16/duckdb:parquet 586713997 651154652 0.90
tpch_q17/duckdb:parquet 721877597 695517008 1.04
tpch_q18/duckdb:parquet 847919740 818219946 1.04
tpch_q19/duckdb:parquet 742306869 692782907 1.07
tpch_q20/duckdb:parquet 1009916270 1092752051 0.92
tpch_q21/duckdb:parquet 1027792660 1030142052 1.00
tpch_q22/duckdb:parquet 532923085 537057879 0.99

@AdamGS
Force frame points in benchmarks
0270890 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added changelog/ci action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
AdamGS added 2 commits July 28, 2026 14:26
@AdamGS
Use newer parca version
3439eb0 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
Rename binary
2f12343 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
AdamGS force-pushed the adamg/polarsignals-preview-benchmark branch from a89313c to 2f12343 Compare July 28, 2026 13:45
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@AdamGS
print parca logs
86adaa5 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@AdamGS
Upload debug info explicitly
b7e1d27 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@AdamGS
Update parca config
63bc6be 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@AdamGS
fix
cfe38fb 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@codspeed-hq

codspeed-hq Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

✅ 1892 untouched benchmarks
⏩ 3 skipped benchmarks1

Comparing adamg/polarsignals-preview-benchmark (7f3ef04) with develop (28d327c)

Open in CodSpeed

Footnotes

  1. 3 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@AdamGS
AdamGS force-pushed the adamg/polarsignals-preview-benchmark branch from 2f0a02f to d6649fb Compare July 28, 2026 15:36
@AdamGS
rename fix
1d6d710 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
AdamGS force-pushed the adamg/polarsignals-preview-benchmark branch from d6649fb to 1d6d710 Compare July 28, 2026 15:37
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@AdamGS
more error cases
7f3ef04 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@AdamGS
AdamGS requested review from 0ax1 and robert3005 July 28, 2026 15:54
@AdamGS AdamGS changed the title [WIP] Make PolarSignals profiling data more visible Make PolarSignals profiling data more visible Jul 28, 2026
@AdamGS
AdamGS marked this pull request as ready for review July 28, 2026 15:54
@AdamGS
AdamGS requested a review from brancz July 28, 2026 15:57
0ax1
0ax1 reviewed Jul 28, 2026
View reviewed changes
Comment thread .github/actions/upload-parca-debuginfo/action.yml
printf "%s" "$POLARSIGNALS_CLOUD_TOKEN" > "$token_file"

uploaded=0
while IFS= read -r binary; do

@0ax1 0ax1 Jul 28, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you're going to hell

@AdamGS AdamGS Jul 28, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that was true yesterday, might as well double down

@AdamGS
AdamGS merged commit 6609288 into develop Jul 28, 2026
109 of 110 checks passed
@AdamGS
AdamGS deleted the adamg/polarsignals-preview-benchmark branch July 28, 2026 16:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@0ax1 0ax1 0ax1 approved these changes
@robert3005 robert3005 Awaiting requested review from robert3005
@brancz brancz Awaiting requested review from brancz

Assignees

No one assigned

Labels

changelog/ci

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@AdamGS @0ax1