Skip to content

feat(vortex-geo): per-row bounding-box scalar function (vortex.geo.envelope)#8831

Open
HarukiMoriarty wants to merge 2 commits into
developfrom
nemo/geo-bounding-rect
Open

feat(vortex-geo): per-row bounding-box scalar function (vortex.geo.envelope)#8831
HarukiMoriarty wants to merge 2 commits into
developfrom
nemo/geo-bounding-rect

Conversation

@HarukiMoriarty

@HarukiMoriarty HarukiMoriarty commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

What

Adds GeoEnvelope (vortex.geo.envelope): the per-row 2-D axis-aligned bounding box of a native geometry column, returned as a native geoarrow.box (Rect) column.

The consumer is a row-oriented spatial-join operator that bulk-loads an in-memory R-tree (rstar::RTree::bulk_load takes individual objects), so it needs one box per geometry, read back row by row.

How

  • Walk the nested ListView storage down to the leaf coordinate Struct, tracking which top-level row owns each coordinate, then min/max x/y per row over the raw f64 buffers.
  • A Rect input is the identity (the bounding box of a box is itself).
  • 2-D only: only the x/y leaf ordinates are read; any z/m are ignored — matching the GeometryAabb aggregate.
  • A null row, or a valid-but-empty geometry, yields a null box, so the output is always nullable. validity() returns None, since the output null mask is not derivable from the operand's validity (empty geometries introduce nulls even over a non-nullable operand).

@codspeed-hq

codspeed-hq Bot commented Jul 17, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

✅ 1788 untouched benchmarks
⏩ 54 skipped benchmarks1


Comparing nemo/geo-bounding-rect (1db4760) with develop (94e593e)

Open in CodSpeed

Footnotes

  1. 54 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions

github-actions Bot commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 1db4760 1 Explore Profiling Data
Previous Runs (5)
Status Commit Job Attempt Link
🟢 Done 72aa947 1 Explore Profiling Data
🟢 Done b269fa9 1 Explore Profiling Data
🟢 Done 0c8823f 1 Explore Profiling Data
🟢 Done 488a97c 1 Explore Profiling Data
🟢 Done 5dbbc22 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.2%
Engines: DataFusion No clear signal (+6.8%, medium confidence) · DuckDB No clear signal (+3.7%, low confidence)
Vortex (geomean): 1.028x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.059x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 10245212 9541200 1.07
vortex_q01/datafusion:vortex-file-compressed 6236656 5974462 1.04
datafusion / parquet (0.991x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 20592328 21214230 0.97
vortex_q01/datafusion:parquet 4795681 4736768 1.01
duckdb / vortex-file-compressed (1.051x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 10550354 9885437 1.07
vortex_q01/duckdb:vortex-file-compressed 6245234 6028973 1.04
duckdb / parquet (1.014x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 23567967 23250798 1.01
vortex_q01/duckdb:parquet 9505118 9373387 1.01

No file size changes detected.

@HarukiMoriarty HarukiMoriarty added the changelog/feature A new feature label Jul 17, 2026
@HarukiMoriarty
HarukiMoriarty force-pushed the nemo/geo-bounding-rect branch from 488a97c to 0c8823f Compare July 17, 2026 20:26
@HarukiMoriarty
HarukiMoriarty changed the base branch from develop to nemo/geo-null-propagation July 17, 2026 20:26
Base automatically changed from nemo/geo-null-propagation to develop July 20, 2026 19:28
@HarukiMoriarty
HarukiMoriarty force-pushed the nemo/geo-bounding-rect branch from 0c8823f to b269fa9 Compare July 20, 2026 20:05
Comment thread vortex-geo/src/bounds.rs Outdated

@connortsui20 connortsui20 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this should be a scalar function?

…velope)

`GeoEnvelope` computes the per-row 2-D axis-aligned bounding box of a native
geometry column, returned as a native geoarrow.box (`Rect`) column — the
per-row counterpart of the `GeometryAabb` aggregate (whole-column). Intended
for row-oriented consumers such as bulk-loading an in-memory R-tree in a
spatial-join operator, which read the resulting box column back row by row.

Computed directly over the native coordinate storage — no `geo_types` decode
and no Arrow round-trip: walk the nested `ListView` storage down to the leaf
x/y buffers, tracking which top-level row owns each coordinate, then min/max
per row. A `Rect` input is the identity; a null row or an empty geometry
yields a null box, so the output is always nullable.

Hoist the shared `f64_field` coordinate-column accessor into
`extension::coordinate`, used by both this function and the aggregate.

Signed-off-by: Nemo Yu <zyu379@wisc.edu>
@HarukiMoriarty
HarukiMoriarty force-pushed the nemo/geo-bounding-rect branch from b269fa9 to 72aa947 Compare July 21, 2026 14:13
@HarukiMoriarty HarukiMoriarty changed the title feat(vortex-geo): per-row 2-D AABB compute primitive feat(vortex-geo): per-row bounding-box scalar function (vortex.geo.envelope) Jul 21, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark-sql-full Run SQL benchmarks with vortex-compact and SF=10 label Jul 21, 2026
@github-actions github-actions Bot removed the action/benchmark-sql-full Run SQL benchmarks with vortex-compact and SF=10 label Jul 21, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.016x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.016x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 117443727 117918727 1.00
polarsignals_q01/datafusion:vortex-file-compressed 260137706 263723799 0.99
polarsignals_q02/datafusion:vortex-file-compressed 23710651 25184055 0.94
polarsignals_q03/datafusion:vortex-file-compressed 268037663 264770950 1.01
polarsignals_q04/datafusion:vortex-file-compressed 9960414 9820018 1.01
polarsignals_q05/datafusion:vortex-file-compressed 15077347 14503870 1.04
polarsignals_q06/datafusion:vortex-file-compressed 21076980 19795297 1.06
polarsignals_q07/datafusion:vortex-file-compressed 14744219 13673463 1.08
polarsignals_q08/datafusion:vortex-file-compressed 389999933 394883858 0.99
polarsignals_q09/datafusion:vortex-file-compressed 12359600 11783011 1.05

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-DS SF=1 on NVME (full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-2.4%, environment too noisy confidence) · DuckDB No clear signal (+0.9%, environment too noisy confidence)
Vortex (geomean): 0.999x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.998x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 53722603 52758288 1.02
tpch_q02/datafusion:vortex-file-compressed 22571377 22115188 1.02
tpch_q03/datafusion:vortex-file-compressed 30063654 30182969 1.00
tpch_q04/datafusion:vortex-file-compressed 19111007 19623958 0.97
tpch_q05/datafusion:vortex-file-compressed 46504754 45310789 1.03
tpch_q06/datafusion:vortex-file-compressed 9561260 9797234 0.98
tpch_q07/datafusion:vortex-file-compressed 51984184 52196798 1.00
tpch_q08/datafusion:vortex-file-compressed 37718370 38225340 0.99
tpch_q09/datafusion:vortex-file-compressed 51780348 51251964 1.01
tpch_q10/datafusion:vortex-file-compressed 32046940 32821865 0.98
tpch_q11/datafusion:vortex-file-compressed 16176594 16705597 0.97
tpch_q12/datafusion:vortex-file-compressed 23228520 24022508 0.97
tpch_q13/datafusion:vortex-file-compressed 26192345 25996578 1.01
tpch_q14/datafusion:vortex-file-compressed 14708004 14617760 1.01
tpch_q15/datafusion:vortex-file-compressed 22250885 22112485 1.01
tpch_q16/datafusion:vortex-file-compressed 19335888 19457487 0.99
tpch_q17/datafusion:vortex-file-compressed 65819755 65177296 1.01
tpch_q18/datafusion:vortex-file-compressed 75138325 73958762 1.02
tpch_q19/datafusion:vortex-file-compressed 17716345 18854589 0.94
tpch_q20/datafusion:vortex-file-compressed 30318353 29340378 1.03
tpch_q21/datafusion:vortex-file-compressed 67634503 67074070 1.01
tpch_q22/datafusion:vortex-file-compressed 11643432 11474271 1.01
datafusion / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58911344 60218630 0.98
tpch_q02/datafusion:vortex-compact 25467750 25401494 1.00
tpch_q03/datafusion:vortex-compact 33432918 33160683 1.01
tpch_q04/datafusion:vortex-compact 22736485 22372869 1.02
tpch_q05/datafusion:vortex-compact 48010952 47247746 1.02
tpch_q06/datafusion:vortex-compact 12215728 12354942 0.99
tpch_q07/datafusion:vortex-compact 55399449 55510165 1.00
tpch_q08/datafusion:vortex-compact 42372400 42787417 0.99
tpch_q09/datafusion:vortex-compact 54756603 55684226 0.98
tpch_q10/datafusion:vortex-compact 37526456 37734428 0.99
tpch_q11/datafusion:vortex-compact 16965642 17869244 0.95
tpch_q12/datafusion:vortex-compact 31098459 31065463 1.00
tpch_q13/datafusion:vortex-compact 31597522 31116710 1.02
tpch_q14/datafusion:vortex-compact 17998292 18310940 0.98
tpch_q15/datafusion:vortex-compact 29689936 30526436 0.97
tpch_q16/datafusion:vortex-compact 22783597 23060845 0.99
tpch_q17/datafusion:vortex-compact 66977545 69340338 0.97
tpch_q18/datafusion:vortex-compact 80536934 78230347 1.03
tpch_q19/datafusion:vortex-compact 38126912 37035120 1.03
tpch_q20/datafusion:vortex-compact 33739466 34820994 0.97
tpch_q21/datafusion:vortex-compact 77921482 77944140 1.00
tpch_q22/datafusion:vortex-compact 13271934 13163417 1.01
datafusion / parquet (1.016x ➖, 1↑ 4↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 140276200 109375154 1.28
tpch_q02/datafusion:parquet 59468282 60274112 0.99
tpch_q03/datafusion:parquet 79324835 81275288 0.98
tpch_q04/datafusion:parquet 🚨 46489259 41529291 1.12
tpch_q05/datafusion:parquet 90103150 94066302 0.96
tpch_q06/datafusion:parquet 🚀 36674393 43246781 0.85
tpch_q07/datafusion:parquet 106442089 107119699 0.99
tpch_q08/datafusion:parquet 95424080 94863721 1.01
tpch_q09/datafusion:parquet 123363163 121154807 1.02
tpch_q10/datafusion:parquet 🚨 117375182 105450661 1.11
tpch_q11/datafusion:parquet 41106874 40752324 1.01
tpch_q12/datafusion:parquet 85030826 84541147 1.01
tpch_q13/datafusion:parquet 191162464 190868723 1.00
tpch_q14/datafusion:parquet 44976971 45420062 0.99
tpch_q15/datafusion:parquet 58572242 58405455 1.00
tpch_q16/datafusion:parquet 43761780 43340177 1.01
tpch_q17/datafusion:parquet 134344606 141782424 0.95
tpch_q18/datafusion:parquet 153784341 154328465 1.00
tpch_q19/datafusion:parquet 74018654 73852886 1.00
tpch_q20/datafusion:parquet 🚨 72850230 64839069 1.12
tpch_q21/datafusion:parquet 144589572 140915703 1.03
tpch_q22/datafusion:parquet 43705557 43488562 1.00
datafusion / arrow (0.983x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 55702889 58601345 0.95
tpch_q02/datafusion:arrow 16466523 16974857 0.97
tpch_q03/datafusion:arrow 32078664 32851256 0.98
tpch_q04/datafusion:arrow 26189004 26886771 0.97
tpch_q05/datafusion:arrow 55676714 54793576 1.02
tpch_q06/datafusion:arrow 22599902 21422164 1.05
tpch_q07/datafusion:arrow 104556424 103687081 1.01
tpch_q08/datafusion:arrow 41062658 42373210 0.97
tpch_q09/datafusion:arrow 62185194 68376024 0.91
tpch_q10/datafusion:arrow 48139643 51738733 0.93
tpch_q11/datafusion:arrow 8921849 9186091 0.97
tpch_q12/datafusion:arrow 48364059 50701284 0.95
tpch_q13/datafusion:arrow 44959755 45527199 0.99
tpch_q14/datafusion:arrow 23253077 23333663 1.00
tpch_q15/datafusion:arrow 46298178 46249634 1.00
tpch_q16/datafusion:arrow 16253921 16384366 0.99
tpch_q17/datafusion:arrow 65537338 65908813 0.99
tpch_q18/datafusion:arrow 105297219 106705803 0.99
tpch_q19/datafusion:arrow 37886410 37359343 1.01
tpch_q20/datafusion:arrow 34611542 35037679 0.99
tpch_q21/datafusion:arrow 148508525 153874558 0.97
tpch_q22/datafusion:arrow 12269186 11856785 1.03
duckdb / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 27444056 27768165 0.99
tpch_q02/duckdb:vortex-file-compressed 25049153 25085173 1.00
tpch_q03/duckdb:vortex-file-compressed 31018361 30809567 1.01
tpch_q04/duckdb:vortex-file-compressed 27263828 27189813 1.00
tpch_q05/duckdb:vortex-file-compressed 34446481 34166690 1.01
tpch_q06/duckdb:vortex-file-compressed 8204726 8165876 1.00
tpch_q07/duckdb:vortex-file-compressed 33229589 33162618 1.00
tpch_q08/duckdb:vortex-file-compressed 38700523 38531788 1.00
tpch_q09/duckdb:vortex-file-compressed 55272803 55888574 0.99
tpch_q10/duckdb:vortex-file-compressed 40463546 39991199 1.01
tpch_q11/duckdb:vortex-file-compressed 13505583 13623120 0.99
tpch_q12/duckdb:vortex-file-compressed 22818169 23055400 0.99
tpch_q13/duckdb:vortex-file-compressed 39298558 39224860 1.00
tpch_q14/duckdb:vortex-file-compressed 18930717 19685210 0.96
tpch_q15/duckdb:vortex-file-compressed 16003915 15719387 1.02
tpch_q16/duckdb:vortex-file-compressed 26973161 27087876 1.00
tpch_q17/duckdb:vortex-file-compressed 22862162 22676956 1.01
tpch_q18/duckdb:vortex-file-compressed 49602625 50318640 0.99
tpch_q19/duckdb:vortex-file-compressed 26396398 26045649 1.01
tpch_q20/duckdb:vortex-file-compressed 30792840 30390509 1.01
tpch_q21/duckdb:vortex-file-compressed 96895852 97050158 1.00
tpch_q22/duckdb:vortex-file-compressed 16381447 16652192 0.98
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38224655 37930498 1.01
tpch_q02/duckdb:vortex-compact 30681667 31601142 0.97
tpch_q03/duckdb:vortex-compact 34231660 34209684 1.00
tpch_q04/duckdb:vortex-compact 33928056 33612807 1.01
tpch_q05/duckdb:vortex-compact 38752909 38856723 1.00
tpch_q06/duckdb:vortex-compact 10464918 10147189 1.03
tpch_q07/duckdb:vortex-compact 41613701 41860272 0.99
tpch_q08/duckdb:vortex-compact 45669219 46637984 0.98
tpch_q09/duckdb:vortex-compact 65309758 64725136 1.01
tpch_q10/duckdb:vortex-compact 47583052 46541160 1.02
tpch_q11/duckdb:vortex-compact 15555690 15636753 0.99
tpch_q12/duckdb:vortex-compact 31858233 31486377 1.01
tpch_q13/duckdb:vortex-compact 44978245 44304617 1.02
tpch_q14/duckdb:vortex-compact 23423137 23721429 0.99
tpch_q15/duckdb:vortex-compact 19382092 19520127 0.99
tpch_q16/duckdb:vortex-compact 29281628 29133091 1.01
tpch_q17/duckdb:vortex-compact 27770596 26914146 1.03
tpch_q18/duckdb:vortex-compact 57656530 57165901 1.01
tpch_q19/duckdb:vortex-compact 29856851 28095425 1.06
tpch_q20/duckdb:vortex-compact 37160288 36877232 1.01
tpch_q21/duckdb:vortex-compact 110686098 112943320 0.98
tpch_q22/duckdb:vortex-compact 16736064 17158009 0.98
duckdb / parquet (0.994x ➖, 1↑ 1↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77982062 77477472 1.01
tpch_q02/duckdb:parquet 39645885 39341489 1.01
tpch_q03/duckdb:parquet 71282723 71228801 1.00
tpch_q04/duckdb:parquet 50052493 51442430 0.97
tpch_q05/duckdb:parquet 68880526 69709054 0.99
tpch_q06/duckdb:parquet 22426837 22653795 0.99
tpch_q07/duckdb:parquet 71869035 72052771 1.00
tpch_q08/duckdb:parquet 🚀 82521245 93675181 0.88
tpch_q09/duckdb:parquet 141329302 147706659 0.96
tpch_q10/duckdb:parquet 128486546 126038543 1.02
tpch_q11/duckdb:parquet 22284583 22636716 0.98
tpch_q12/duckdb:parquet 🚨 55415178 47038579 1.18
tpch_q13/duckdb:parquet 250340583 251402902 1.00
tpch_q14/duckdb:parquet 50839399 51141178 0.99
tpch_q15/duckdb:parquet 26301078 26340120 1.00
tpch_q16/duckdb:parquet 57842661 58392397 0.99
tpch_q17/duckdb:parquet 60459426 61086145 0.99
tpch_q18/duckdb:parquet 119434937 113526128 1.05
tpch_q19/duckdb:parquet 68951479 72551339 0.95
tpch_q20/duckdb:parquet 66053562 65883479 1.00
tpch_q21/duckdb:parquet 167135284 177158504 0.94
tpch_q22/duckdb:parquet 55259833 55575998 0.99
duckdb / duckdb (1.006x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17749700 17699808 1.00
tpch_q02/duckdb:duckdb 14578037 14132919 1.03
tpch_q03/duckdb:duckdb 22649057 22171091 1.02
tpch_q04/duckdb:duckdb 22335755 21741411 1.03
tpch_q05/duckdb:duckdb 23867104 23335546 1.02
tpch_q06/duckdb:duckdb 7072530 7043014 1.00
tpch_q07/duckdb:duckdb 24831339 25231045 0.98
tpch_q08/duckdb:duckdb 24496770 23792001 1.03
tpch_q09/duckdb:duckdb 57170973 57473056 0.99
tpch_q10/duckdb:duckdb 49479431 50775805 0.97
tpch_q11/duckdb:duckdb 7171512 7130351 1.01
tpch_q12/duckdb:duckdb 18047638 17693465 1.02
tpch_q13/duckdb:duckdb 39884658 39547677 1.01
tpch_q14/duckdb:duckdb 21537596 21214282 1.02
tpch_q15/duckdb:duckdb 13561204 13657889 0.99
tpch_q16/duckdb:duckdb 26000498 25956164 1.00
tpch_q17/duckdb:duckdb 16329195 16470417 0.99
tpch_q18/duckdb:duckdb 40602374 40541021 1.00
tpch_q19/duckdb:duckdb 30666430 30878558 0.99
tpch_q20/duckdb:duckdb 25091820 25294896 0.99
tpch_q21/duckdb:duckdb 60951045 61163772 1.00
tpch_q22/duckdb:duckdb 26092056 25549517 1.02

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+1.4%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): 1.033x ➖
Parquet (geomean): 1.031x ➖
Shifts: Parquet (control) +3.1% · Median polish +3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.033x ➖, 0↑ 2↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5986466 5310033 1.13
fineweb_q01/datafusion:vortex-file-compressed 33059960 33599033 0.98
fineweb_q02/datafusion:vortex-file-compressed 35846167 37142584 0.97
fineweb_q03/datafusion:vortex-file-compressed 🚨 60953859 53416837 1.14
fineweb_q04/datafusion:vortex-file-compressed 257741467 252378527 1.02
fineweb_q05/datafusion:vortex-file-compressed 197949320 189101453 1.05
fineweb_q06/datafusion:vortex-file-compressed 50594703 50607245 1.00
fineweb_q07/datafusion:vortex-file-compressed 56509407 53943930 1.05
fineweb_q08/datafusion:vortex-file-compressed 22514767 22907345 0.98
datafusion / vortex-compact (1.042x ➖, 0↑ 1↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6540795 5822768 1.12
fineweb_q01/datafusion:vortex-compact 98609547 98816201 1.00
fineweb_q02/datafusion:vortex-compact 111467754 105147927 1.06
fineweb_q03/datafusion:vortex-compact 870565037 856827980 1.02
fineweb_q04/datafusion:vortex-compact 927383204 913657020 1.02
fineweb_q05/datafusion:vortex-compact 826527456 804509497 1.03
fineweb_q06/datafusion:vortex-compact 471945579 453592246 1.04
fineweb_q07/datafusion:vortex-compact 491156421 472360982 1.04
fineweb_q08/datafusion:vortex-compact 22090021 20784844 1.06
datafusion / parquet (1.024x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7056785 6980863 1.01
fineweb_q01/datafusion:parquet 300545679 295512137 1.02
fineweb_q02/datafusion:parquet 300349464 295460045 1.02
fineweb_q03/datafusion:parquet 304311573 284371410 1.07
fineweb_q04/datafusion:parquet 313351539 302860953 1.03
fineweb_q05/datafusion:parquet 308139958 304738922 1.01
fineweb_q06/datafusion:parquet 295018601 295576033 1.00
fineweb_q07/datafusion:parquet 287212829 279688187 1.03
fineweb_q08/datafusion:parquet 286744148 278656699 1.03
duckdb / vortex-file-compressed (1.041x ➖, 0↑ 1↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 2946799 2979230 0.99
fineweb_q01/duckdb:vortex-file-compressed 34372450 32598126 1.05
fineweb_q02/duckdb:vortex-file-compressed 39419002 38896196 1.01
fineweb_q03/duckdb:vortex-file-compressed 104676389 98898249 1.06
fineweb_q04/duckdb:vortex-file-compressed 248396698 241790826 1.03
fineweb_q05/duckdb:vortex-file-compressed 193833568 186161079 1.04
fineweb_q06/duckdb:vortex-file-compressed 54734962 51832449 1.06
fineweb_q07/duckdb:vortex-file-compressed 55490671 56059371 0.99
fineweb_q08/duckdb:vortex-file-compressed 🚨 23583176 20635159 1.14
duckdb / vortex-compact (1.016x ➖, 0↑ 1↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 3399872 3067748 1.11
fineweb_q01/duckdb:vortex-compact 107235001 108757408 0.99
fineweb_q02/duckdb:vortex-compact 112971975 113780472 0.99
fineweb_q03/duckdb:vortex-compact 864401615 843805780 1.02
fineweb_q04/duckdb:vortex-compact 921157579 895494343 1.03
fineweb_q05/duckdb:vortex-compact 821755992 800139949 1.03
fineweb_q06/duckdb:vortex-compact 470283516 465776351 1.01
fineweb_q07/duckdb:vortex-compact 490768160 477676494 1.03
fineweb_q08/duckdb:vortex-compact 19937344 21065201 0.95
duckdb / parquet (1.038x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 34141231 31406340 1.09
fineweb_q01/duckdb:parquet 95976658 90619672 1.06
fineweb_q02/duckdb:parquet 93090550 89338631 1.04
fineweb_q03/duckdb:parquet 326805976 319664181 1.02
fineweb_q04/duckdb:parquet 451454901 449567219 1.00
fineweb_q05/duckdb:parquet 426227098 420775611 1.01
fineweb_q06/duckdb:parquet 209946255 205165639 1.02
fineweb_q07/duckdb:parquet 224882969 219444820 1.02
fineweb_q08/duckdb:parquet 40109286 37661094 1.07

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.9%
Engines: DataFusion No clear signal (-5.6%, environment too noisy confidence) · DuckDB No clear signal (-4.2%, low confidence)
Vortex (geomean): 0.978x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +1.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.870x ➖, 1↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 33730489 85906105 0.39
fineweb_q01/datafusion:vortex-file-compressed 556719355 570151273 0.98
fineweb_q02/datafusion:vortex-file-compressed 544941310 590856355 0.92
fineweb_q03/datafusion:vortex-file-compressed 1086208495 1104412287 0.98
fineweb_q04/datafusion:vortex-file-compressed 1156660580 1143257088 1.01
fineweb_q05/datafusion:vortex-file-compressed 1079601588 1085562631 0.99
fineweb_q06/datafusion:vortex-file-compressed 1256961722 1304810866 0.96
fineweb_q07/datafusion:vortex-file-compressed 1078877845 1163479164 0.93
fineweb_q08/datafusion:vortex-file-compressed 467625428 510507211 0.92
datafusion / vortex-compact (1.090x ➖, 0↑ 1↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 37083109 33630329 1.10
fineweb_q01/datafusion:vortex-compact 524653422 537978662 0.98
fineweb_q02/datafusion:vortex-compact 731970380 575449745 1.27
fineweb_q03/datafusion:vortex-compact 1304163522 1367722369 0.95
fineweb_q04/datafusion:vortex-compact 1620645270 1645644424 0.98
fineweb_q05/datafusion:vortex-compact 1357926984 1363226490 1.00
fineweb_q06/datafusion:vortex-compact 1289906750 1240835757 1.04
fineweb_q07/datafusion:vortex-compact 1222002029 1142704602 1.07
fineweb_q08/datafusion:vortex-compact 🚨 646358638 424624667 1.52
datafusion / parquet (1.031x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1099512198 1064161566 1.03
fineweb_q01/datafusion:parquet 1887720000 1682961568 1.12
fineweb_q02/datafusion:parquet 1827833598 1741397243 1.05
fineweb_q03/datafusion:parquet 1821607706 1710823355 1.06
fineweb_q04/datafusion:parquet 1723914727 1813250238 0.95
fineweb_q05/datafusion:parquet 1785888460 1717576158 1.04
fineweb_q06/datafusion:parquet 1899449231 1718845464 1.11
fineweb_q07/datafusion:parquet 1806063773 1873644416 0.96
fineweb_q08/datafusion:parquet 1734235379 1796921391 0.97
duckdb / vortex-file-compressed (0.969x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 87159846 96736939 0.90
fineweb_q01/duckdb:vortex-file-compressed 580302997 567084130 1.02
fineweb_q02/duckdb:vortex-file-compressed 531244504 491475281 1.08
fineweb_q03/duckdb:vortex-file-compressed 1225596189 1241476860 0.99
fineweb_q04/duckdb:vortex-file-compressed 1277515248 1437094030 0.89
fineweb_q05/duckdb:vortex-file-compressed 1246928765 1265251465 0.99
fineweb_q06/duckdb:vortex-file-compressed 1420472917 1419903871 1.00
fineweb_q07/duckdb:vortex-file-compressed 1239113876 1318886479 0.94
fineweb_q08/duckdb:vortex-file-compressed 533191417 574086422 0.93
duckdb / vortex-compact (0.996x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 85360167 74789490 1.14
fineweb_q01/duckdb:vortex-compact 565661705 532268086 1.06
fineweb_q02/duckdb:vortex-compact 645776970 603218233 1.07
fineweb_q03/duckdb:vortex-compact 1663056153 1700442543 0.98
fineweb_q04/duckdb:vortex-compact 1712020283 1891223033 0.91
fineweb_q05/duckdb:vortex-compact 1588656104 1708268092 0.93
fineweb_q06/duckdb:vortex-compact 1671571564 1629867063 1.03
fineweb_q07/duckdb:vortex-compact 1311974737 1451526743 0.90
fineweb_q08/duckdb:vortex-compact 450082755 462538708 0.97
duckdb / parquet (1.026x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1118813045 1085479526 1.03
fineweb_q01/duckdb:parquet 1445863567 1360563768 1.06
fineweb_q02/duckdb:parquet 1389700993 1405332913 0.99
fineweb_q03/duckdb:parquet 3667487276 3520425626 1.04
fineweb_q04/duckdb:parquet 1912340722 1853063488 1.03
fineweb_q05/duckdb:parquet 2106595058 2043985616 1.03
fineweb_q06/duckdb:parquet 4406285610 4230205435 1.04
fineweb_q07/duckdb:parquet 2652409204 2703890568 0.98
fineweb_q08/duckdb:parquet 1119753205 1093874738 1.02

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Statistical and Population Genetics (full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+2.8%, low confidence)
Vortex (geomean): 1.060x ➖
Parquet (geomean): 1.039x ➖
Shifts: Parquet (control) +3.9% · Median polish +4.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.062x ➖, 0↑ 3↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 447250514 425660290 1.05
clickbench-sorted_q24/datafusion:vortex-file-compressed 🚨 24268131 20322277 1.19
clickbench-sorted_q26/datafusion:vortex-file-compressed 20857858 21944712 0.95
clickbench-sorted_q36/datafusion:vortex-file-compressed 70610756 69901719 1.01
clickbench-sorted_q37/datafusion:vortex-file-compressed 45697501 43163723 1.06
clickbench-sorted_q38/datafusion:vortex-file-compressed 🚨 48438561 40667354 1.19
clickbench-sorted_q39/datafusion:vortex-file-compressed 🚨 124904221 111302748 1.12
clickbench-sorted_q40/datafusion:vortex-file-compressed 22125829 21790495 1.02
clickbench-sorted_q41/datafusion:vortex-file-compressed 20570330 20704857 0.99
clickbench-sorted_q42/datafusion:vortex-file-compressed 15571812 14661454 1.06
datafusion / parquet (1.061x ➖, 0↑ 3↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 🚨 5236866748 4718615139 1.11
clickbench-sorted_q24/datafusion:parquet 🚨 33049270 29790744 1.11
clickbench-sorted_q26/datafusion:parquet 29319379 28447541 1.03
clickbench-sorted_q36/datafusion:parquet 188568897 185915662 1.01
clickbench-sorted_q37/datafusion:parquet 🚨 124301642 111271245 1.12
clickbench-sorted_q38/datafusion:parquet 169431990 158243708 1.07
clickbench-sorted_q39/datafusion:parquet 300926610 282583337 1.06
clickbench-sorted_q40/datafusion:parquet 68250803 64134437 1.06
clickbench-sorted_q41/datafusion:parquet 66030703 63865123 1.03
clickbench-sorted_q42/datafusion:parquet 31604029 31548409 1.00
duckdb / vortex-file-compressed (1.057x ➖, 0↑ 3↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 🚨 188339899 168432323 1.12
clickbench-sorted_q24/duckdb:vortex-file-compressed 24782349 23699100 1.05
clickbench-sorted_q26/duckdb:vortex-file-compressed 40576891 40851002 0.99
clickbench-sorted_q36/duckdb:vortex-file-compressed 🚨 62482278 55329803 1.13
clickbench-sorted_q37/duckdb:vortex-file-compressed 46081808 46052570 1.00
clickbench-sorted_q38/duckdb:vortex-file-compressed 51095131 49097139 1.04
clickbench-sorted_q39/duckdb:vortex-file-compressed 117164031 114891298 1.02
clickbench-sorted_q40/duckdb:vortex-file-compressed 29213332 28586238 1.02
clickbench-sorted_q41/duckdb:vortex-file-compressed 🚨 30886500 27748549 1.11
clickbench-sorted_q42/duckdb:vortex-file-compressed 26921326 24492014 1.10
duckdb / parquet (1.018x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 207747153 214547883 0.97
clickbench-sorted_q24/duckdb:parquet 29910469 29085851 1.03
clickbench-sorted_q26/duckdb:parquet 26483250 26316359 1.01
clickbench-sorted_q36/duckdb:parquet 115286395 110128369 1.05
clickbench-sorted_q37/duckdb:parquet 96629927 92863948 1.04
clickbench-sorted_q38/duckdb:parquet 97524754 96910258 1.01
clickbench-sorted_q39/duckdb:parquet 189399386 178595414 1.06
clickbench-sorted_q40/duckdb:parquet 43810661 42138173 1.04
clickbench-sorted_q41/duckdb:parquet 42733520 41835203 1.02
clickbench-sorted_q42/duckdb:parquet 29487658 30584929 0.96
duckdb / duckdb (1.035x ➖, 0↑ 1↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:duckdb 294134704 281849113 1.04
clickbench-sorted_q24/duckdb:duckdb 45931012 44377115 1.04
clickbench-sorted_q26/duckdb:duckdb 42629621 42183167 1.01
clickbench-sorted_q36/duckdb:duckdb 93590295 93532092 1.00
clickbench-sorted_q37/duckdb:duckdb 82791565 80727892 1.03
clickbench-sorted_q38/duckdb:duckdb 67548684 64321702 1.05
clickbench-sorted_q39/duckdb:duckdb 🚨 133718549 120915311 1.11
clickbench-sorted_q40/duckdb:duckdb 46002101 44123945 1.04
clickbench-sorted_q41/duckdb:duckdb 44354268 43015072 1.03
clickbench-sorted_q42/duckdb:duckdb 36712999 36269346 1.01

File Size Changes (201 files changed, +0.0% overall, 102↑ 99↓)
File Scale Format Base HEAD Change %
hits_061.vortex 1.0 vortex-compact 123.49 MB 125.70 MB +2.21 MB +1.8%
hits_065.vortex 1.0 vortex-compact 123.98 MB 125.31 MB +1.33 MB +1.1%
hits_093.vortex 1.0 vortex-compact 97.96 MB 98.91 MB +966.99 KB +1.0%
hits_024.vortex 1.0 vortex-compact 124.32 MB 125.48 MB +1.17 MB +0.9%
hits_086.vortex 1.0 vortex-compact 139.57 MB 140.83 MB +1.26 MB +0.9%
hits_023.vortex 1.0 vortex-compact 141.69 MB 142.79 MB +1.10 MB +0.8%
hits_085.vortex 1.0 vortex-file-compressed 198.40 MB 199.78 MB +1.38 MB +0.7%
hits_033.vortex 1.0 vortex-file-compressed 198.80 MB 200.17 MB +1.37 MB +0.7%
hits_053.vortex 1.0 vortex-file-compressed 190.42 MB 191.59 MB +1.17 MB +0.6%
hits_004.vortex 1.0 vortex-file-compressed 130.99 MB 131.74 MB +771.59 KB +0.6%
hits_043.vortex 1.0 vortex-compact 94.07 MB 94.61 MB +553.97 KB +0.6%
hits_052.vortex 1.0 vortex-compact 98.63 MB 99.19 MB +578.30 KB +0.6%
hits_048.vortex 1.0 vortex-file-compressed 198.54 MB 199.59 MB +1.05 MB +0.5%
hits_017.vortex 1.0 vortex-compact 111.61 MB 112.19 MB +599.05 KB +0.5%
hits_045.vortex 1.0 vortex-compact 105.63 MB 106.16 MB +536.66 KB +0.5%
hits_040.vortex 1.0 vortex-compact 110.03 MB 110.56 MB +539.67 KB +0.5%
hits_022.vortex 1.0 vortex-compact 152.41 MB 153.12 MB +727.74 KB +0.5%
hits_000.vortex 1.0 vortex-file-compressed 131.47 MB 132.08 MB +625.51 KB +0.5%
hits_056.vortex 1.0 vortex-compact 100.89 MB 101.35 MB +476.98 KB +0.5%
hits_071.vortex 1.0 vortex-compact 105.76 MB 106.22 MB +471.65 KB +0.4%
hits_030.vortex 1.0 vortex-compact 98.25 MB 98.68 MB +438.04 KB +0.4%
hits_015.vortex 1.0 vortex-compact 97.86 MB 98.27 MB +422.92 KB +0.4%
hits_098.vortex 1.0 vortex-compact 103.64 MB 104.08 MB +446.01 KB +0.4%
hits_066.vortex 1.0 vortex-file-compressed 163.03 MB 163.58 MB +567.77 KB +0.3%
hits_099.vortex 1.0 vortex-file-compressed 171.20 MB 171.78 MB +595.54 KB +0.3%
hits_066.vortex 1.0 vortex-compact 117.58 MB 117.95 MB +376.18 KB +0.3%
hits_073.vortex 1.0 vortex-compact 134.23 MB 134.59 MB +370.51 KB +0.3%
hits_019.vortex 1.0 vortex-file-compressed 140.97 MB 141.32 MB +359.30 KB +0.2%
hits_064.vortex 1.0 vortex-file-compressed 191.01 MB 191.45 MB +456.14 KB +0.2%
hits_089.vortex 1.0 vortex-file-compressed 131.45 MB 131.74 MB +302.58 KB +0.2%
hits_098.vortex 1.0 vortex-file-compressed 137.46 MB 137.75 MB +297.95 KB +0.2%
hits_086.vortex 1.0 vortex-file-compressed 192.17 MB 192.57 MB +404.57 KB +0.2%
hits_011.vortex 1.0 vortex-file-compressed 199.26 MB 199.66 MB +410.23 KB +0.2%
hits_003.vortex 1.0 vortex-file-compressed 136.64 MB 136.91 MB +271.92 KB +0.2%
hits_027.vortex 1.0 vortex-file-compressed 189.99 MB 190.34 MB +356.30 KB +0.2%
hits_060.vortex 1.0 vortex-file-compressed 193.15 MB 193.49 MB +348.87 KB +0.2%
hits_089.vortex 1.0 vortex-compact 99.18 MB 99.34 MB +167.33 KB +0.2%
hits_014.vortex 1.0 vortex-compact 133.70 MB 133.92 MB +218.91 KB +0.2%
hits_015.vortex 1.0 vortex-file-compressed 131.22 MB 131.42 MB +212.07 KB +0.2%
hits_055.vortex 1.0 vortex-file-compressed 199.36 MB 199.67 MB +310.32 KB +0.2%
hits_026.vortex 1.0 vortex-file-compressed 131.26 MB 131.46 MB +200.97 KB +0.1%
hits_045.vortex 1.0 vortex-file-compressed 140.63 MB 140.82 MB +198.68 KB +0.1%
hits_072.vortex 1.0 vortex-compact 75.56 MB 75.66 MB +104.05 KB +0.1%
hits_074.vortex 1.0 vortex-compact 152.95 MB 153.15 MB +209.09 KB +0.1%
hits_029.vortex 1.0 vortex-compact 153.23 MB 153.43 MB +208.28 KB +0.1%
hits_078.vortex 1.0 vortex-compact 97.88 MB 98.00 MB +120.64 KB +0.1%
hits_070.vortex 1.0 vortex-file-compressed 200.22 MB 200.46 MB +245.84 KB +0.1%
hits_016.vortex 1.0 vortex-compact 127.38 MB 127.52 MB +148.77 KB +0.1%
hits_006.vortex 1.0 vortex-compact 95.89 MB 96.00 MB +107.22 KB +0.1%
hits_053.vortex 1.0 vortex-compact 138.91 MB 139.06 MB +152.76 KB +0.1%
hits_050.vortex 1.0 vortex-file-compressed 160.84 MB 161.00 MB +165.10 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.31 MB 101.40 MB +93.53 KB +0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.91 MB 181.07 MB +164.75 KB +0.1%
hits_073.vortex 1.0 vortex-file-compressed 172.63 MB 172.79 MB +156.99 KB +0.1%
hits_049.vortex 1.0 vortex-compact 140.49 MB 140.61 MB +125.48 KB +0.1%
hits_013.vortex 1.0 vortex-compact 125.53 MB 125.63 MB +107.31 KB +0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.92 MB 140.04 MB +118.14 KB +0.1%
hits_032.vortex 1.0 vortex-compact 110.54 MB 110.62 MB +86.23 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.87 MB 200.01 MB +148.73 KB +0.1%
hits_085.vortex 1.0 vortex-compact 153.23 MB 153.34 MB +111.04 KB +0.1%
hits_017.vortex 1.0 vortex-file-compressed 146.83 MB 146.93 MB +104.06 KB +0.1%
hits_051.vortex 1.0 vortex-compact 133.87 MB 133.96 MB +87.73 KB +0.1%
hits_058.vortex 1.0 vortex-compact 111.08 MB 111.15 MB +66.04 KB +0.1%
hits_095.vortex 1.0 vortex-file-compressed 154.32 MB 154.41 MB +90.47 KB +0.1%
hits_040.vortex 1.0 vortex-file-compressed 143.35 MB 143.43 MB +78.23 KB +0.1%
hits_087.vortex 1.0 vortex-file-compressed 161.00 MB 161.08 MB +86.29 KB +0.1%
hits_005.vortex 1.0 vortex-compact 115.87 MB 115.93 MB +58.02 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.03 MB 147.11 MB +72.82 KB +0.0%
hits_016.vortex 1.0 vortex-file-compressed 180.19 MB 180.27 MB +82.94 KB +0.0%
hits_074.vortex 1.0 vortex-file-compressed 199.23 MB 199.31 MB +86.70 KB +0.0%
hits_097.vortex 1.0 vortex-compact 141.33 MB 141.39 MB +60.77 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 131.79 MB 131.84 MB +53.67 KB +0.0%
hits_021.vortex 1.0 vortex-file-compressed 154.46 MB 154.52 MB +56.53 KB +0.0%
hits_027.vortex 1.0 vortex-compact 139.24 MB 139.29 MB +47.34 KB +0.0%
hits_057.vortex 1.0 vortex-compact 111.86 MB 111.89 MB +37.82 KB +0.0%
hits_007.vortex 1.0 vortex-compact 153.45 MB 153.50 MB +47.33 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.55 MB 189.61 MB +58.02 KB +0.0%
hits_018.vortex 1.0 vortex-compact 153.74 MB 153.78 MB +39.49 KB +0.0%
hits_022.vortex 1.0 vortex-file-compressed 199.07 MB 199.11 MB +45.39 KB +0.0%
hits_090.vortex 1.0 vortex-compact 141.25 MB 141.28 MB +30.96 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 171.92 MB 171.95 MB +32.55 KB +0.0%
hits_024.vortex 1.0 vortex-file-compressed 160.47 MB 160.49 MB +28.84 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.68 MB 110.70 MB +17.56 KB +0.0%
hits_055.vortex 1.0 vortex-compact 153.39 MB 153.42 MB +23.00 KB +0.0%
hits_078.vortex 1.0 vortex-file-compressed 131.02 MB 131.04 MB +17.80 KB +0.0%
hits_011.vortex 1.0 vortex-compact 152.88 MB 152.90 MB +20.65 KB +0.0%
hits_009.vortex 1.0 vortex-compact 75.22 MB 75.23 MB +10.07 KB +0.0%
hits_028.vortex 1.0 vortex-compact 115.65 MB 115.67 MB +12.70 KB +0.0%
hits_003.vortex 1.0 vortex-compact 104.52 MB 104.54 MB +11.20 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.93 MB 75.93 MB +7.19 KB +0.0%
hits_099.vortex 1.0 vortex-compact 133.43 MB 133.44 MB +11.73 KB +0.0%
hits_095.vortex 1.0 vortex-compact 110.63 MB 110.64 MB +8.38 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 160.84 MB 160.85 MB +11.24 KB +0.0%
hits_071.vortex 1.0 vortex-file-compressed 140.04 MB 140.05 MB +9.37 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.49 MB 110.50 MB +6.98 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.03 MB 161.04 MB +7.76 KB +0.0%
hits_029.vortex 1.0 vortex-file-compressed 198.61 MB 198.62 MB +9.47 KB +0.0%
hits_083.vortex 1.0 vortex-compact 110.06 MB 110.06 MB +4.69 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 154.48 MB 154.49 MB +5.91 KB +0.0%
hits_054.vortex 1.0 vortex-file-compressed 146.99 MB 147.00 MB +3.55 KB +0.0%
hits_020.vortex 1.0 vortex-compact 111.68 MB 111.68 MB +304 B +0.0%
hits_092.vortex 1.0 vortex-compact 153.56 MB 153.56 MB +8 B +0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.01 MB 161.01 MB 4.10 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.23 MB 142.22 MB 5.76 KB -0.0%
hits_082.vortex 1.0 vortex-file-compressed 140.02 MB 140.01 MB 8.07 KB -0.0%
hits_079.vortex 1.0 vortex-compact 127.97 MB 127.96 MB 7.73 KB -0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.53 MB 171.51 MB 14.77 KB -0.0%
hits_091.vortex 1.0 vortex-compact 112.23 MB 112.22 MB 11.64 KB -0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.61 MB 160.59 MB 18.57 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.95 MB 159.93 MB 21.09 KB -0.0%
hits_054.vortex 1.0 vortex-compact 112.02 MB 112.00 MB 16.74 KB -0.0%
hits_001.vortex 1.0 vortex-file-compressed 189.04 MB 189.02 MB 28.28 KB -0.0%
hits_034.vortex 1.0 vortex-compact 133.37 MB 133.35 MB 25.02 KB -0.0%
hits_010.vortex 1.0 vortex-compact 123.09 MB 123.07 MB 23.20 KB -0.0%
hits_034.vortex 1.0 vortex-file-compressed 182.09 MB 182.05 MB 41.06 KB -0.0%
hits_070.vortex 1.0 vortex-compact 153.75 MB 153.71 MB 37.07 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.87 MB 131.83 MB 32.91 KB -0.0%
hits_048.vortex 1.0 vortex-compact 153.36 MB 153.32 MB 38.35 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.53 MB 126.49 MB 32.68 KB -0.0%
hits_028.vortex 1.0 vortex-file-compressed 151.90 MB 151.86 MB 40.88 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.73 MB 135.70 MB 36.76 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 157.26 MB 157.22 MB 48.84 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.58 MB 191.52 MB 59.59 KB -0.0%
hits_096.vortex 1.0 vortex-compact 153.29 MB 153.23 MB 55.32 KB -0.0%
hits_001.vortex 1.0 vortex-compact 139.03 MB 138.98 MB 51.00 KB -0.0%
hits_014.vortex 1.0 vortex-file-compressed 172.18 MB 172.11 MB 65.61 KB -0.0%
hits_037.vortex 1.0 vortex-file-compressed 177.14 MB 177.07 MB 69.66 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.40 MB 161.34 MB 65.83 KB -0.0%
hits_037.vortex 1.0 vortex-compact 132.22 MB 132.17 MB 57.18 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 169.05 MB 168.97 MB 74.19 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.40 MB 172.32 MB 75.70 KB -0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.91 MB 190.83 MB 86.17 KB -0.0%
hits_042.vortex 1.0 vortex-compact 136.35 MB 136.29 MB 64.29 KB -0.0%
hits_025.vortex 1.0 vortex-compact 133.48 MB 133.42 MB 67.27 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.92 MB 126.85 MB 66.02 KB -0.1%
hits_087.vortex 1.0 vortex-compact 125.61 MB 125.55 MB 65.48 KB -0.1%
hits_041.vortex 1.0 vortex-file-compressed 131.36 MB 131.29 MB 74.66 KB -0.1%
hits_059.vortex 1.0 vortex-file-compressed 199.11 MB 199.00 MB 116.91 KB -0.1%
hits_038.vortex 1.0 vortex-compact 139.64 MB 139.55 MB 86.49 KB -0.1%
hits_094.vortex 1.0 vortex-compact 110.84 MB 110.77 MB 69.56 KB -0.1%
hits_019.vortex 1.0 vortex-compact 106.65 MB 106.58 MB 66.94 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.14 MB 172.03 MB 109.20 KB -0.1%
hits_050.vortex 1.0 vortex-compact 125.39 MB 125.31 MB 81.54 KB -0.1%
hits_059.vortex 1.0 vortex-compact 152.92 MB 152.81 MB 105.52 KB -0.1%
hits_092.vortex 1.0 vortex-file-compressed 199.76 MB 199.62 MB 143.62 KB -0.1%
hits_046.vortex 1.0 vortex-compact 74.96 MB 74.91 MB 54.41 KB -0.1%
hits_031.vortex 1.0 vortex-compact 111.65 MB 111.57 MB 81.60 KB -0.1%
hits_068.vortex 1.0 vortex-compact 112.48 MB 112.39 MB 89.75 KB -0.1%
hits_021.vortex 1.0 vortex-compact 110.64 MB 110.55 MB 90.70 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.32 MB 161.18 MB 135.27 KB -0.1%
hits_088.vortex 1.0 vortex-compact 134.14 MB 134.02 MB 116.29 KB -0.1%
hits_047.vortex 1.0 vortex-file-compressed 154.51 MB 154.37 MB 142.91 KB -0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.28 MB 161.13 MB 151.99 KB -0.1%
hits_044.vortex 1.0 vortex-compact 153.73 MB 153.58 MB 148.88 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.90 MB 154.75 MB 158.93 KB -0.1%
hits_060.vortex 1.0 vortex-compact 141.33 MB 141.19 MB 145.70 KB -0.1%
hits_077.vortex 1.0 vortex-compact 134.47 MB 134.34 MB 141.30 KB -0.1%
hits_064.vortex 1.0 vortex-compact 140.19 MB 140.03 MB 161.77 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 101.43 MB 101.32 MB 117.24 KB -0.1%
hits_062.vortex 1.0 vortex-compact 132.92 MB 132.76 MB 166.49 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.75 MB 131.59 MB 166.66 KB -0.1%
hits_058.vortex 1.0 vortex-file-compressed 155.26 MB 155.07 MB 198.13 KB -0.1%
hits_096.vortex 1.0 vortex-file-compressed 199.49 MB 199.24 MB 255.20 KB -0.1%
hits_069.vortex 1.0 vortex-compact 99.88 MB 99.75 MB 133.29 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 102.50 MB 102.34 MB 158.63 KB -0.2%
hits_036.vortex 1.0 vortex-compact 133.49 MB 133.27 MB 218.75 KB -0.2%
hits_023.vortex 1.0 vortex-file-compressed 197.14 MB 196.82 MB 324.74 KB -0.2%
hits_005.vortex 1.0 vortex-file-compressed 167.81 MB 167.53 MB 285.46 KB -0.2%
hits_080.vortex 1.0 vortex-compact 96.60 MB 96.44 MB 165.55 KB -0.2%
hits_052.vortex 1.0 vortex-file-compressed 131.24 MB 131.02 MB 226.30 KB -0.2%
hits_020.vortex 1.0 vortex-file-compressed 160.51 MB 160.24 MB 277.41 KB -0.2%
hits_026.vortex 1.0 vortex-compact 98.40 MB 98.24 MB 170.17 KB -0.2%
hits_042.vortex 1.0 vortex-file-compressed 201.99 MB 201.63 MB 377.45 KB -0.2%
hits_067.vortex 1.0 vortex-file-compressed 132.06 MB 131.82 MB 249.88 KB -0.2%
hits_057.vortex 1.0 vortex-file-compressed 160.38 MB 160.07 MB 316.43 KB -0.2%
hits_004.vortex 1.0 vortex-compact 97.84 MB 97.64 MB 206.88 KB -0.2%
hits_090.vortex 1.0 vortex-file-compressed 193.05 MB 192.65 MB 414.36 KB -0.2%
hits_067.vortex 1.0 vortex-compact 99.26 MB 99.05 MB 219.52 KB -0.2%
hits_081.vortex 1.0 vortex-compact 153.92 MB 153.58 MB 349.06 KB -0.2%
hits_007.vortex 1.0 vortex-file-compressed 200.09 MB 199.61 MB 492.12 KB -0.2%
hits_033.vortex 1.0 vortex-compact 152.77 MB 152.40 MB 379.78 KB -0.2%
hits_035.vortex 1.0 vortex-file-compressed 103.16 MB 102.90 MB 266.20 KB -0.3%
hits_094.vortex 1.0 vortex-file-compressed 159.30 MB 158.89 MB 417.97 KB -0.3%
hits_008.vortex 1.0 vortex-compact 106.12 MB 105.81 MB 313.59 KB -0.3%
hits_081.vortex 1.0 vortex-file-compressed 200.56 MB 199.97 MB 594.87 KB -0.3%
hits_006.vortex 1.0 vortex-file-compressed 126.77 MB 126.38 MB 394.66 KB -0.3%
hits_039.vortex 1.0 vortex-compact 124.79 MB 124.32 MB 477.22 KB -0.4%
hits_051.vortex 1.0 vortex-file-compressed 173.02 MB 172.34 MB 693.99 KB -0.4%
hits_082.vortex 1.0 vortex-compact 106.26 MB 105.83 MB 432.65 KB -0.4%
hits_041.vortex 1.0 vortex-compact 98.17 MB 97.77 MB 414.81 KB -0.4%
hits_075.vortex 1.0 vortex-compact 139.62 MB 139.03 MB 596.36 KB -0.4%
hits_018.vortex 1.0 vortex-file-compressed 199.61 MB 198.67 MB 964.80 KB -0.5%
hits_062.vortex 1.0 vortex-file-compressed 171.88 MB 170.72 MB 1.16 MB -0.7%
hits_063.vortex 1.0 vortex-compact 98.83 MB 97.98 MB 864.84 KB -0.9%
hits_012.vortex 1.0 vortex-compact 139.96 MB 138.71 MB 1.25 MB -0.9%
hits_097.vortex 1.0 vortex-file-compressed 195.25 MB 192.99 MB 2.26 MB -1.2%
hits_076.vortex 1.0 vortex-compact 126.27 MB 124.72 MB 1.55 MB -1.2%
hits_002.vortex 1.0 vortex-compact 125.59 MB 123.98 MB 1.61 MB -1.3%
hits_038.vortex 1.0 vortex-file-compressed 193.23 MB 190.23 MB 3.00 MB -1.6%
hits_000.vortex 1.0 vortex-compact 100.51 MB 98.71 MB 1.80 MB -1.8%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 11.94 GB → 11.94 GB (+0.0%)
  • vortex-file-compressed: 15.97 GB → 15.96 GB (-0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+1.5%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): 1.004x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.008x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 455804788 443277204 1.03
tpch_q02/datafusion:vortex-file-compressed 106010918 105285208 1.01
tpch_q03/datafusion:vortex-file-compressed 201539948 202508909 1.00
tpch_q04/datafusion:vortex-file-compressed 100872657 97592327 1.03
tpch_q05/datafusion:vortex-file-compressed 349280049 341391766 1.02
tpch_q06/datafusion:vortex-file-compressed 39712413 40226693 0.99
tpch_q07/datafusion:vortex-file-compressed 469911458 462447870 1.02
tpch_q08/datafusion:vortex-file-compressed 360236175 356377256 1.01
tpch_q09/datafusion:vortex-file-compressed 617707864 601987444 1.03
tpch_q10/datafusion:vortex-file-compressed 233510343 226675838 1.03
tpch_q11/datafusion:vortex-file-compressed 79886231 78982977 1.01
tpch_q12/datafusion:vortex-file-compressed 115560012 113889160 1.01
tpch_q13/datafusion:vortex-file-compressed 197597905 201677040 0.98
tpch_q14/datafusion:vortex-file-compressed 52247375 52574255 0.99
tpch_q15/datafusion:vortex-file-compressed 102748870 101906510 1.01
tpch_q16/datafusion:vortex-file-compressed 76781243 79410652 0.97
tpch_q17/datafusion:vortex-file-compressed 604822498 587477646 1.03
tpch_q18/datafusion:vortex-file-compressed 861125272 858921570 1.00
tpch_q19/datafusion:vortex-file-compressed 77213817 77549740 1.00
tpch_q20/datafusion:vortex-file-compressed 160929125 159929694 1.01
tpch_q21/datafusion:vortex-file-compressed 605473530 603528870 1.00
tpch_q22/datafusion:vortex-file-compressed 59397906 58245954 1.02
datafusion / vortex-compact (1.002x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 511572183 506563589 1.01
tpch_q02/datafusion:vortex-compact 111102693 110767471 1.00
tpch_q03/datafusion:vortex-compact 217222543 215832566 1.01
tpch_q04/datafusion:vortex-compact 131145281 133483440 0.98
tpch_q05/datafusion:vortex-compact 361764969 361731981 1.00
tpch_q06/datafusion:vortex-compact 62485787 61699714 1.01
tpch_q07/datafusion:vortex-compact 496639880 484494570 1.03
tpch_q08/datafusion:vortex-compact 378111236 367087348 1.03
tpch_q09/datafusion:vortex-compact 632509385 616226290 1.03
tpch_q10/datafusion:vortex-compact 278713108 275309624 1.01
tpch_q11/datafusion:vortex-compact 82519864 80675469 1.02
tpch_q12/datafusion:vortex-compact 177598187 180418947 0.98
tpch_q13/datafusion:vortex-compact 247510799 251981159 0.98
tpch_q14/datafusion:vortex-compact 69876591 70337211 0.99
tpch_q15/datafusion:vortex-compact 157603863 156979771 1.00
tpch_q16/datafusion:vortex-compact 83217490 85785284 0.97
tpch_q17/datafusion:vortex-compact 598284858 599304206 1.00
tpch_q18/datafusion:vortex-compact 890914464 884000462 1.01
tpch_q19/datafusion:vortex-compact 207467705 212180068 0.98
tpch_q20/datafusion:vortex-compact 185142468 182423642 1.01
tpch_q21/datafusion:vortex-compact 692296585 686290616 1.01
tpch_q22/datafusion:vortex-compact 62304025 63952670 0.97
datafusion / parquet (0.992x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 486643086 483978180 1.01
tpch_q02/datafusion:parquet 182230080 178911993 1.02
tpch_q03/datafusion:parquet 263940003 266830385 0.99
tpch_q04/datafusion:parquet 123054289 123500548 1.00
tpch_q05/datafusion:parquet 408543884 417910499 0.98
tpch_q06/datafusion:parquet 132589186 136199218 0.97
tpch_q07/datafusion:parquet 589066408 587824682 1.00
tpch_q08/datafusion:parquet 466561590 474305661 0.98
tpch_q09/datafusion:parquet 744894451 766740503 0.97
tpch_q10/datafusion:parquet 577455048 593457403 0.97
tpch_q11/datafusion:parquet 125990943 126434390 1.00
tpch_q12/datafusion:parquet 214653848 218149738 0.98
tpch_q13/datafusion:parquet 357360137 353622609 1.01
tpch_q14/datafusion:parquet 158990275 162449701 0.98
tpch_q15/datafusion:parquet 270112997 269236067 1.00
tpch_q16/datafusion:parquet 127080962 127886728 0.99
tpch_q17/datafusion:parquet 689649945 694100256 0.99
tpch_q18/datafusion:parquet 887807938 904779722 0.98
tpch_q19/datafusion:parquet 285098954 287433163 0.99
tpch_q20/datafusion:parquet 309712038 307398138 1.01
tpch_q21/datafusion:parquet 666938008 672769139 0.99
tpch_q22/datafusion:parquet 210302801 209932509 1.00
datafusion / arrow (1.009x ➖, 0↑ 1↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 714812075 722292238 0.99
tpch_q02/datafusion:arrow 113479715 117166244 0.97
tpch_q03/datafusion:arrow 531740159 528253212 1.01
tpch_q04/datafusion:arrow 384373444 388244962 0.99
tpch_q05/datafusion:arrow 776478544 780935809 0.99
tpch_q06/datafusion:arrow 344637094 340465161 1.01
tpch_q07/datafusion:arrow 1213404759 1185051658 1.02
tpch_q08/datafusion:arrow 1005606974 985927165 1.02
tpch_q09/datafusion:arrow 1133516962 1139066882 1.00
tpch_q10/datafusion:arrow 692318534 657855203 1.05
tpch_q11/datafusion:arrow 94035174 92885552 1.01
tpch_q12/datafusion:arrow 🚨 1496805991 1336034204 1.12
tpch_q13/datafusion:arrow 477377668 495724405 0.96
tpch_q14/datafusion:arrow 390235256 389464358 1.00
tpch_q15/datafusion:arrow 790846218 796619415 0.99
tpch_q16/datafusion:arrow 83032937 81922585 1.01
tpch_q17/datafusion:arrow 1011385673 1003449601 1.01
tpch_q18/datafusion:arrow 1941260707 1905952990 1.02
tpch_q19/datafusion:arrow 585510688 566514606 1.03
tpch_q20/datafusion:arrow 549684137 524308555 1.05
tpch_q21/datafusion:arrow 3231656471 3210851896 1.01
tpch_q22/datafusion:arrow 85594133 91371681 0.94
duckdb / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169759644 172179623 0.99
tpch_q02/duckdb:vortex-file-compressed 54482914 55105019 0.99
tpch_q03/duckdb:vortex-file-compressed 122975809 120921225 1.02
tpch_q04/duckdb:vortex-file-compressed 156175692 156532640 1.00
tpch_q05/duckdb:vortex-file-compressed 137776519 137629338 1.00
tpch_q06/duckdb:vortex-file-compressed 34809774 34720912 1.00
tpch_q07/duckdb:vortex-file-compressed 132381367 130817973 1.01
tpch_q08/duckdb:vortex-file-compressed 174081969 171221366 1.02
tpch_q09/duckdb:vortex-file-compressed 397574144 402251959 0.99
tpch_q10/duckdb:vortex-file-compressed 193463072 195099969 0.99
tpch_q11/duckdb:vortex-file-compressed 31550442 31128254 1.01
tpch_q12/duckdb:vortex-file-compressed 106892344 107173708 1.00
tpch_q13/duckdb:vortex-file-compressed 273998963 275020151 1.00
tpch_q14/duckdb:vortex-file-compressed 55297709 55100999 1.00
tpch_q15/duckdb:vortex-file-compressed 89633223 89382119 1.00
tpch_q16/duckdb:vortex-file-compressed 78863447 77338458 1.02
tpch_q17/duckdb:vortex-file-compressed 89040023 88704919 1.00
tpch_q18/duckdb:vortex-file-compressed 289870505 290823579 1.00
tpch_q19/duckdb:vortex-file-compressed 74650187 75728952 0.99
tpch_q20/duckdb:vortex-file-compressed 141477261 139727353 1.01
tpch_q21/duckdb:vortex-file-compressed 486398456 483602847 1.01
tpch_q22/duckdb:vortex-file-compressed 63593769 64904594 0.98
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 275077713 274543755 1.00
tpch_q02/duckdb:vortex-compact 62094011 61078275 1.02
tpch_q03/duckdb:vortex-compact 158080516 157712161 1.00
tpch_q04/duckdb:vortex-compact 217627202 216946339 1.00
tpch_q05/duckdb:vortex-compact 185396444 184159165 1.01
tpch_q06/duckdb:vortex-compact 58665209 57952243 1.01
tpch_q07/duckdb:vortex-compact 216628499 216480902 1.00
tpch_q08/duckdb:vortex-compact 220161099 219094849 1.00
tpch_q09/duckdb:vortex-compact 469885182 467204032 1.01
tpch_q10/duckdb:vortex-compact 261270165 262035877 1.00
tpch_q11/duckdb:vortex-compact 39460654 39526079 1.00
tpch_q12/duckdb:vortex-compact 193476783 194144238 1.00
tpch_q13/duckdb:vortex-compact 327338806 327551512 1.00
tpch_q14/duckdb:vortex-compact 74193063 74983252 0.99
tpch_q15/duckdb:vortex-compact 119603640 118706157 1.01
tpch_q16/duckdb:vortex-compact 82606278 79582531 1.04
tpch_q17/duckdb:vortex-compact 104882842 105160652 1.00
tpch_q18/duckdb:vortex-compact 353597850 352341595 1.00
tpch_q19/duckdb:vortex-compact 92769392 93228231 1.00
tpch_q20/duckdb:vortex-compact 181733623 180696920 1.01
tpch_q21/duckdb:vortex-compact 639022605 634778080 1.01
tpch_q22/duckdb:vortex-compact 73151041 72596504 1.01
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 263537002 264769594 1.00
tpch_q02/duckdb:parquet 107386311 106313062 1.01
tpch_q03/duckdb:parquet 212558461 215528241 0.99
tpch_q04/duckdb:parquet 140127869 138991864 1.01
tpch_q05/duckdb:parquet 229167801 225938066 1.01
tpch_q06/duckdb:parquet 75556967 75609996 1.00
tpch_q07/duckdb:parquet 191539657 195043693 0.98
tpch_q08/duckdb:parquet 271336969 286010873 0.95
tpch_q09/duckdb:parquet 518812849 533498031 0.97
tpch_q10/duckdb:parquet 630811840 652371515 0.97
tpch_q11/duckdb:parquet 67271027 71192413 0.94
tpch_q12/duckdb:parquet 132820494 136432156 0.97
tpch_q13/duckdb:parquet 456980232 461739085 0.99
tpch_q14/duckdb:parquet 182461970 180327174 1.01
tpch_q15/duckdb:parquet 105607107 107059092 0.99
tpch_q16/duckdb:parquet 170381381 164856501 1.03
tpch_q17/duckdb:parquet 183753044 187865816 0.98
tpch_q18/duckdb:parquet 369171497 370526527 1.00
tpch_q19/duckdb:parquet 289397178 290737170 1.00
tpch_q20/duckdb:parquet 237164809 236158974 1.00
tpch_q21/duckdb:parquet 570626990 579321273 0.98
tpch_q22/duckdb:parquet 307422276 304652591 1.01
duckdb / duckdb (0.990x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 121058624 121117426 1.00
tpch_q02/duckdb:duckdb 49107377 49995115 0.98
tpch_q03/duckdb:duckdb 104860595 108354087 0.97
tpch_q04/duckdb:duckdb 141033174 146038803 0.97
tpch_q05/duckdb:duckdb 120720830 120465864 1.00
tpch_q06/duckdb:duckdb 44796334 45565220 0.98
tpch_q07/duckdb:duckdb 92348950 91736986 1.01
tpch_q08/duckdb:duckdb 120020078 119343107 1.01
tpch_q09/duckdb:duckdb 285910517 287385623 0.99
tpch_q10/duckdb:duckdb 215357939 218517396 0.99
tpch_q11/duckdb:duckdb 19374922 19637514 0.99
tpch_q12/duckdb:duckdb 91196288 90839154 1.00
tpch_q13/duckdb:duckdb 231517970 240843168 0.96
tpch_q14/duckdb:duckdb 78334687 79599123 0.98
tpch_q15/duckdb:duckdb 82448432 84051818 0.98
tpch_q16/duckdb:duckdb 77590246 76324752 1.02
tpch_q17/duckdb:duckdb 89019397 88584591 1.00
tpch_q18/duckdb:duckdb 236049154 232587624 1.01
tpch_q19/duckdb:duckdb 124462241 125215046 0.99
tpch_q20/duckdb:duckdb 118556533 118288673 1.00
tpch_q21/duckdb:duckdb 305491904 307488776 0.99
tpch_q22/duckdb:duckdb 68974580 73383884 0.94

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Engines: DataFusion No clear signal (-3.0%, environment too noisy confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): 0.940x ➖
Parquet (geomean): 0.963x ➖
Shifts: Parquet (control) -3.7% · Median polish -1.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.929x ➖, 19↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚀 1618420 1803988 0.90
clickbench_q01/datafusion:vortex-file-compressed 🚀 18791932 21413495 0.88
clickbench_q02/datafusion:vortex-file-compressed 🚀 34945880 39651331 0.88
clickbench_q03/datafusion:vortex-file-compressed 🚀 38232890 47189778 0.81
clickbench_q04/datafusion:vortex-file-compressed 🚀 239374189 281624936 0.85
clickbench_q05/datafusion:vortex-file-compressed 🚀 298918731 351391385 0.85
clickbench_q06/datafusion:vortex-file-compressed 🚀 1564826 1816901 0.86
clickbench_q07/datafusion:vortex-file-compressed 🚀 22197803 24823945 0.89
clickbench_q08/datafusion:vortex-file-compressed 🚀 333976114 376136385 0.89
clickbench_q09/datafusion:vortex-file-compressed 455773058 441340980 1.03
clickbench_q10/datafusion:vortex-file-compressed 74889192 72216412 1.04
clickbench_q11/datafusion:vortex-file-compressed 86211394 85050548 1.01
clickbench_q12/datafusion:vortex-file-compressed 253769022 257669925 0.98
clickbench_q13/datafusion:vortex-file-compressed 420542438 410665339 1.02
clickbench_q14/datafusion:vortex-file-compressed 255493690 259266751 0.99
clickbench_q15/datafusion:vortex-file-compressed 278017563 278383227 1.00
clickbench_q16/datafusion:vortex-file-compressed 641398724 649080504 0.99
clickbench_q17/datafusion:vortex-file-compressed 639264373 638967227 1.00
clickbench_q18/datafusion:vortex-file-compressed 1354623166 1346558532 1.01
clickbench_q19/datafusion:vortex-file-compressed 25970601 26686260 0.97
clickbench_q20/datafusion:vortex-file-compressed 257548581 270122305 0.95
clickbench_q21/datafusion:vortex-file-compressed 🚀 343616046 394098160 0.87
clickbench_q22/datafusion:vortex-file-compressed 🚀 440832954 525000025 0.84
clickbench_q23/datafusion:vortex-file-compressed 🚀 569548777 638037045 0.89
clickbench_q24/datafusion:vortex-file-compressed 41180110 40565242 1.02
clickbench_q25/datafusion:vortex-file-compressed 72948304 75659798 0.96
clickbench_q26/datafusion:vortex-file-compressed 44584518 45044416 0.99
clickbench_q27/datafusion:vortex-file-compressed 373427225 368812354 1.01
clickbench_q28/datafusion:vortex-file-compressed 2296762981 2344541307 0.98
clickbench_q29/datafusion:vortex-file-compressed 🚀 46638874 56804441 0.82
clickbench_q30/datafusion:vortex-file-compressed 🚀 223413909 255975626 0.87
clickbench_q31/datafusion:vortex-file-compressed 240527364 242681987 0.99
clickbench_q32/datafusion:vortex-file-compressed 1019979408 1057332650 0.96
clickbench_q33/datafusion:vortex-file-compressed 1384849863 1377139533 1.01
clickbench_q34/datafusion:vortex-file-compressed 🚀 1344730070 1701144932 0.79
clickbench_q35/datafusion:vortex-file-compressed 🚀 239370025 294255861 0.81
clickbench_q36/datafusion:vortex-file-compressed 🚀 56717100 66280409 0.86
clickbench_q37/datafusion:vortex-file-compressed 🚀 24094081 27109599 0.89
clickbench_q38/datafusion:vortex-file-compressed 🚀 15550937 17794368 0.87
clickbench_q39/datafusion:vortex-file-compressed 121876302 128710476 0.95
clickbench_q40/datafusion:vortex-file-compressed 12098740 12765587 0.95
clickbench_q41/datafusion:vortex-file-compressed 11796886 12520155 0.94
clickbench_q42/datafusion:vortex-file-compressed 11293001 11696855 0.97
datafusion / parquet (0.958x ➖, 7↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1523798 1598536 0.95
clickbench_q01/datafusion:parquet 19183054 20006328 0.96
clickbench_q02/datafusion:parquet 43128163 44311878 0.97
clickbench_q03/datafusion:parquet 33536681 36100019 0.93
clickbench_q04/datafusion:parquet 263899230 261718596 1.01
clickbench_q05/datafusion:parquet 332939500 313318077 1.06
clickbench_q06/datafusion:parquet 1479110 1495746 0.99
clickbench_q07/datafusion:parquet 21061637 20846922 1.01
clickbench_q08/datafusion:parquet 332091765 330809557 1.00
clickbench_q09/datafusion:parquet 466789744 486359607 0.96
clickbench_q10/datafusion:parquet 91275780 91333671 1.00
clickbench_q11/datafusion:parquet 115621346 115141862 1.00
clickbench_q12/datafusion:parquet 292363764 296921207 0.98
clickbench_q13/datafusion:parquet 456209928 482181357 0.95
clickbench_q14/datafusion:parquet 🚀 316022161 369362384 0.86
clickbench_q15/datafusion:parquet 🚀 278908522 345472437 0.81
clickbench_q16/datafusion:parquet 🚀 661292778 748942222 0.88
clickbench_q17/datafusion:parquet 646782246 685314466 0.94
clickbench_q18/datafusion:parquet 1354939445 1422561461 0.95
clickbench_q19/datafusion:parquet 27272591 26857783 1.02
clickbench_q20/datafusion:parquet 550276528 561426140 0.98
clickbench_q21/datafusion:parquet 623585153 689773992 0.90
clickbench_q22/datafusion:parquet 🚀 907010247 1031015234 0.88
clickbench_q23/datafusion:parquet 4016108185 4230451488 0.95
clickbench_q24/datafusion:parquet 52126080 51948839 1.00
clickbench_q25/datafusion:parquet 127440352 127465040 1.00
clickbench_q26/datafusion:parquet 52450463 53301489 0.98
clickbench_q27/datafusion:parquet 646649915 664528499 0.97
clickbench_q28/datafusion:parquet 2434761770 2434394983 1.00
clickbench_q29/datafusion:parquet 🚀 45497492 51472892 0.88
clickbench_q30/datafusion:parquet 309980966 320227383 0.97
clickbench_q31/datafusion:parquet 342297536 346829776 0.99
clickbench_q32/datafusion:parquet 🚀 1105961932 1433057334 0.77
clickbench_q33/datafusion:parquet 1478132436 1510273483 0.98
clickbench_q34/datafusion:parquet 1489954982 1490669526 1.00
clickbench_q35/datafusion:parquet 240808151 247564775 0.97
clickbench_q36/datafusion:parquet 102934540 108298464 0.95
clickbench_q37/datafusion:parquet 42100890 41251771 1.02
clickbench_q38/datafusion:parquet 59219762 61528564 0.96
clickbench_q39/datafusion:parquet 208647065 219292492 0.95
clickbench_q40/datafusion:parquet 23025526 23550754 0.98
clickbench_q41/datafusion:parquet 🚀 21185416 23734753 0.89
clickbench_q42/datafusion:parquet 23513388 22803940 1.03
duckdb / vortex-file-compressed (0.951x ➖, 9↑ 1↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 10138193 9454631 1.07
clickbench_q01/duckdb:vortex-file-compressed 15573632 15815557 0.98
clickbench_q02/duckdb:vortex-file-compressed 20016539 21341798 0.94
clickbench_q03/duckdb:vortex-file-compressed 🚀 26077988 30520491 0.85
clickbench_q04/duckdb:vortex-file-compressed 197951343 209040290 0.95
clickbench_q05/duckdb:vortex-file-compressed 184052935 186140885 0.99
clickbench_q06/duckdb:vortex-file-compressed 18317164 18166146 1.01
clickbench_q07/duckdb:vortex-file-compressed 19769345 20240014 0.98
clickbench_q08/duckdb:vortex-file-compressed 265844911 281760170 0.94
clickbench_q09/duckdb:vortex-file-compressed 350405765 357279215 0.98
clickbench_q10/duckdb:vortex-file-compressed 73887619 73435713 1.01
clickbench_q11/duckdb:vortex-file-compressed 85148870 88418497 0.96
clickbench_q12/duckdb:vortex-file-compressed 207259876 214879504 0.96
clickbench_q13/duckdb:vortex-file-compressed 418674245 426558052 0.98
clickbench_q14/duckdb:vortex-file-compressed 243638005 247121054 0.99
clickbench_q15/duckdb:vortex-file-compressed 255523154 260731935 0.98
clickbench_q16/duckdb:vortex-file-compressed 535566170 558438910 0.96
clickbench_q17/duckdb:vortex-file-compressed 433371906 444048758 0.98
clickbench_q18/duckdb:vortex-file-compressed 🚀 947827701 1106498886 0.86
clickbench_q19/duckdb:vortex-file-compressed 🚀 21217793 24404265 0.87
clickbench_q20/duckdb:vortex-file-compressed 🚀 249304425 328696415 0.76
clickbench_q21/duckdb:vortex-file-compressed 🚀 320625157 441520458 0.73
clickbench_q22/duckdb:vortex-file-compressed 🚀 485407866 647629524 0.75
clickbench_q23/duckdb:vortex-file-compressed 🚀 135564440 179468711 0.76
clickbench_q24/duckdb:vortex-file-compressed 🚨 50741550 36705870 1.38
clickbench_q25/duckdb:vortex-file-compressed 82729808 86388101 0.96
clickbench_q26/duckdb:vortex-file-compressed 🚀 46927833 54557693 0.86
clickbench_q27/duckdb:vortex-file-compressed 🚀 211734416 255025904 0.83
clickbench_q28/duckdb:vortex-file-compressed 3015295627 3141668367 0.96
clickbench_q29/duckdb:vortex-file-compressed 26602516 27074265 0.98
clickbench_q30/duckdb:vortex-file-compressed 203107508 205876340 0.99
clickbench_q31/duckdb:vortex-file-compressed 297477298 299061094 0.99
clickbench_q32/duckdb:vortex-file-compressed 1126172135 1141503624 0.99
clickbench_q33/duckdb:vortex-file-compressed 1077598791 1190295006 0.91
clickbench_q34/duckdb:vortex-file-compressed 1173191807 1194805481 0.98
clickbench_q35/duckdb:vortex-file-compressed 372140309 373162207 1.00
clickbench_q36/duckdb:vortex-file-compressed 30027320 29350887 1.02
clickbench_q37/duckdb:vortex-file-compressed 20677941 19282083 1.07
clickbench_q38/duckdb:vortex-file-compressed 23886956 23245792 1.03
clickbench_q39/duckdb:vortex-file-compressed 46535522 45015969 1.03
clickbench_q40/duckdb:vortex-file-compressed 19319213 19703685 0.98
clickbench_q41/duckdb:vortex-file-compressed 18271917 18875362 0.97
clickbench_q42/duckdb:vortex-file-compressed 20479138 20854096 0.98
duckdb / parquet (0.969x ➖, 4↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24210615 24712293 0.98
clickbench_q01/duckdb:parquet 32458069 32644333 0.99
clickbench_q02/duckdb:parquet 50251487 54312524 0.93
clickbench_q03/duckdb:parquet 40404541 44850732 0.90
clickbench_q04/duckdb:parquet 🚀 207704629 230837554 0.90
clickbench_q05/duckdb:parquet 262271832 282858500 0.93
clickbench_q06/duckdb:parquet 48230224 50543847 0.95
clickbench_q07/duckdb:parquet 33515621 33344929 1.01
clickbench_q08/duckdb:parquet 273606886 290007166 0.94
clickbench_q09/duckdb:parquet 400147121 411933053 0.97
clickbench_q10/duckdb:parquet 85466936 81887650 1.04
clickbench_q11/duckdb:parquet 101820509 102910962 0.99
clickbench_q12/duckdb:parquet 282090799 285021239 0.99
clickbench_q13/duckdb:parquet 474649082 476276240 1.00
clickbench_q14/duckdb:parquet 316332289 318825742 0.99
clickbench_q15/duckdb:parquet 258218901 260266719 0.99
clickbench_q16/duckdb:parquet 598236081 600515494 1.00
clickbench_q17/duckdb:parquet 506736606 510343940 0.99
clickbench_q18/duckdb:parquet 🚀 1038356674 1229710102 0.84
clickbench_q19/duckdb:parquet 28626968 31498771 0.91
clickbench_q20/duckdb:parquet 🚀 411620165 473834194 0.87
clickbench_q21/duckdb:parquet 535429556 532779873 1.00
clickbench_q22/duckdb:parquet 920855651 926269606 0.99
clickbench_q23/duckdb:parquet 270847354 267704626 1.01
clickbench_q24/duckdb:parquet 70196361 71281042 0.98
clickbench_q25/duckdb:parquet 163999442 165622656 0.99
clickbench_q26/duckdb:parquet 54166374 58472851 0.93
clickbench_q27/duckdb:parquet 472274146 477871602 0.99
clickbench_q28/duckdb:parquet 4794625209 4809116781 1.00
clickbench_q29/duckdb:parquet 43406118 43218943 1.00
clickbench_q30/duckdb:parquet 310785763 315902053 0.98
clickbench_q31/duckdb:parquet 375480225 379564447 0.99
clickbench_q32/duckdb:parquet 🚀 1122927407 1262314916 0.89
clickbench_q33/duckdb:parquet 1116800564 1124930766 0.99
clickbench_q34/duckdb:parquet 1157589810 1155212533 1.00
clickbench_q35/duckdb:parquet 373980641 377565995 0.99
clickbench_q36/duckdb:parquet 51724189 48747063 1.06
clickbench_q37/duckdb:parquet 34901475 35244758 0.99
clickbench_q38/duckdb:parquet 35876332 39753393 0.90
clickbench_q39/duckdb:parquet 82099723 85328149 0.96
clickbench_q40/duckdb:parquet 21565369 21701682 0.99
clickbench_q41/duckdb:parquet 21528080 22206590 0.97
clickbench_q42/duckdb:parquet 22439125 23538065 0.95
duckdb / duckdb (0.959x ➖, 6↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18570644 18094809 1.03
clickbench_q01/duckdb:duckdb 35869206 36450066 0.98
clickbench_q02/duckdb:duckdb 52519003 53955150 0.97
clickbench_q03/duckdb:duckdb 58173872 57870210 1.01
clickbench_q04/duckdb:duckdb 211910696 218681843 0.97
clickbench_q05/duckdb:duckdb 289341617 294653801 0.98
clickbench_q06/duckdb:duckdb 35651737 37388560 0.95
clickbench_q07/duckdb:duckdb 36460350 37683716 0.97
clickbench_q08/duckdb:duckdb 275911047 304371385 0.91
clickbench_q09/duckdb:duckdb 399007043 436727545 0.91
clickbench_q10/duckdb:duckdb 117162311 125908179 0.93
clickbench_q11/duckdb:duckdb 127336619 137102611 0.93
clickbench_q12/duckdb:duckdb 🚀 259395337 298522678 0.87
clickbench_q13/duckdb:duckdb 🚀 455989493 522859950 0.87
clickbench_q14/duckdb:duckdb 286456058 286089758 1.00
clickbench_q15/duckdb:duckdb 244310986 244830508 1.00
clickbench_q16/duckdb:duckdb 567543892 568512474 1.00
clickbench_q17/duckdb:duckdb 🚀 470964259 528050160 0.89
clickbench_q18/duckdb:duckdb 🚀 1034803460 1187863924 0.87
clickbench_q19/duckdb:duckdb 36911004 37250348 0.99
clickbench_q20/duckdb:duckdb 472932809 474130715 1.00
clickbench_q21/duckdb:duckdb 474584013 467953987 1.01
clickbench_q22/duckdb:duckdb 548648923 531397942 1.03
clickbench_q23/duckdb:duckdb 252971926 263506772 0.96
clickbench_q24/duckdb:duckdb 63272324 64498536 0.98
clickbench_q25/duckdb:duckdb 150223072 150809508 1.00
clickbench_q26/duckdb:duckdb 63635021 64577686 0.99
clickbench_q27/duckdb:duckdb 422503538 412898228 1.02
clickbench_q28/duckdb:duckdb 4418984821 4382475784 1.01
clickbench_q29/duckdb:duckdb 52723421 52024254 1.01
clickbench_q30/duckdb:duckdb 279198457 281182064 0.99
clickbench_q31/duckdb:duckdb 366621705 359134635 1.02
clickbench_q32/duckdb:duckdb 1123078268 1109049521 1.01
clickbench_q33/duckdb:duckdb 1131670392 1120085244 1.01
clickbench_q34/duckdb:duckdb 1212947018 1281761217 0.95
clickbench_q35/duckdb:duckdb 🚀 302766342 340944077 0.89
clickbench_q36/duckdb:duckdb 56820204 60674686 0.94
clickbench_q37/duckdb:duckdb 30134257 31837511 0.95
clickbench_q38/duckdb:duckdb 35075010 37176038 0.94
clickbench_q39/duckdb:duckdb 🚀 81139859 107928679 0.75
clickbench_q40/duckdb:duckdb 29293150 31359545 0.93
clickbench_q41/duckdb:duckdb 28588231 30262753 0.94
clickbench_q42/duckdb:duckdb 31681463 33235872 0.95

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 7.11 GB (-0.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.3%
Engines: DataFusion No clear signal (+2.9%, environment too noisy confidence) · DuckDB No clear signal (+1.6%, low confidence)
Vortex (geomean): 1.085x ➖
Parquet (geomean): 1.061x ➖
Shifts: Parquet (control) +6.1% · Median polish +6.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.108x ➖, 0↑ 2↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 336634472 268453087 1.25
tpch_q02/datafusion:vortex-file-compressed 563199076 435461120 1.29
tpch_q03/datafusion:vortex-file-compressed 🚨 552851016 410625442 1.35
tpch_q04/datafusion:vortex-file-compressed 230422502 208075728 1.11
tpch_q05/datafusion:vortex-file-compressed 435331195 340325789 1.28
tpch_q06/datafusion:vortex-file-compressed 324918027 297044870 1.09
tpch_q07/datafusion:vortex-file-compressed 391410497 388994021 1.01
tpch_q08/datafusion:vortex-file-compressed 474447087 496470350 0.96
tpch_q09/datafusion:vortex-file-compressed 352775375 352121132 1.00
tpch_q10/datafusion:vortex-file-compressed 444568283 422017133 1.05
tpch_q11/datafusion:vortex-file-compressed 301993838 269048081 1.12
tpch_q12/datafusion:vortex-file-compressed 479997883 383682680 1.25
tpch_q13/datafusion:vortex-file-compressed 🚨 242598956 184794010 1.31
tpch_q14/datafusion:vortex-file-compressed 272508518 249332018 1.09
tpch_q15/datafusion:vortex-file-compressed 484267208 444962853 1.09
tpch_q16/datafusion:vortex-file-compressed 210564014 202555338 1.04
tpch_q17/datafusion:vortex-file-compressed 357018311 318752039 1.12
tpch_q18/datafusion:vortex-file-compressed 276190461 245997487 1.12
tpch_q19/datafusion:vortex-file-compressed 454813130 402875586 1.13
tpch_q20/datafusion:vortex-file-compressed 404226070 394477938 1.02
tpch_q21/datafusion:vortex-file-compressed 525213308 519137413 1.01
tpch_q22/datafusion:vortex-file-compressed 143845451 174337716 0.83
datafusion / vortex-compact (1.125x ➖, 0↑ 4↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 285437646 247725326 1.15
tpch_q02/datafusion:vortex-compact 447938696 424340495 1.06
tpch_q03/datafusion:vortex-compact 470426296 386840234 1.22
tpch_q04/datafusion:vortex-compact 211015940 222287564 0.95
tpch_q05/datafusion:vortex-compact 354057140 390975368 0.91
tpch_q06/datafusion:vortex-compact 301142411 401823304 0.75
tpch_q07/datafusion:vortex-compact 398835715 424519668 0.94
tpch_q08/datafusion:vortex-compact 536438261 467524734 1.15
tpch_q09/datafusion:vortex-compact 🚨 480736501 362841889 1.32
tpch_q10/datafusion:vortex-compact 🚨 596099889 385452000 1.55
tpch_q11/datafusion:vortex-compact 310946809 256245152 1.21
tpch_q12/datafusion:vortex-compact 389891239 367146355 1.06
tpch_q13/datafusion:vortex-compact 222165323 200120650 1.11
tpch_q14/datafusion:vortex-compact 243828481 238734570 1.02
tpch_q15/datafusion:vortex-compact 497829664 436386758 1.14
tpch_q16/datafusion:vortex-compact 195539946 187677633 1.04
tpch_q17/datafusion:vortex-compact 🚨 492963720 344584271 1.43
tpch_q18/datafusion:vortex-compact 🚨 488048234 242411959 2.01
tpch_q19/datafusion:vortex-compact 658404179 520526872 1.26
tpch_q20/datafusion:vortex-compact 485338601 441823351 1.10
tpch_q21/datafusion:vortex-compact 519329778 514364999 1.01
tpch_q22/datafusion:vortex-compact 163377617 180360658 0.91
datafusion / parquet (1.084x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 237738102 216976785 1.10
tpch_q02/datafusion:parquet 412899068 414020266 1.00
tpch_q03/datafusion:parquet 303217163 304832236 0.99
tpch_q04/datafusion:parquet 141732891 141006438 1.01
tpch_q05/datafusion:parquet 528827462 408600069 1.29
tpch_q06/datafusion:parquet 144941297 133974949 1.08
tpch_q07/datafusion:parquet 469491036 437218090 1.07
tpch_q08/datafusion:parquet 597078215 539916387 1.11
tpch_q09/datafusion:parquet 517543454 447853676 1.16
tpch_q10/datafusion:parquet 502805463 463895228 1.08
tpch_q11/datafusion:parquet 486498715 383348520 1.27
tpch_q12/datafusion:parquet 245285210 223534367 1.10
tpch_q13/datafusion:parquet 451638977 430122031 1.05
tpch_q14/datafusion:parquet 208942168 164734388 1.27
tpch_q15/datafusion:parquet 378319090 291745289 1.30
tpch_q16/datafusion:parquet 196772690 187468603 1.05
tpch_q17/datafusion:parquet 406562691 374103517 1.09
tpch_q18/datafusion:parquet 437782319 435585758 1.01
tpch_q19/datafusion:parquet 336056815 322117134 1.04
tpch_q20/datafusion:parquet 320484143 310411990 1.03
tpch_q21/datafusion:parquet 535210465 544287949 0.98
tpch_q22/datafusion:parquet 167852531 187342175 0.90
duckdb / vortex-file-compressed (1.052x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 274981548 257777102 1.07
tpch_q02/duckdb:vortex-file-compressed 926085899 917653500 1.01
tpch_q03/duckdb:vortex-file-compressed 660727503 663240190 1.00
tpch_q04/duckdb:vortex-file-compressed 419199414 375305819 1.12
tpch_q05/duckdb:vortex-file-compressed 788298076 767641146 1.03
tpch_q06/duckdb:vortex-file-compressed 364341506 371191416 0.98
tpch_q07/duckdb:vortex-file-compressed 904459670 878972079 1.03
tpch_q08/duckdb:vortex-file-compressed 1073897901 997796162 1.08
tpch_q09/duckdb:vortex-file-compressed 946139815 877366842 1.08
tpch_q10/duckdb:vortex-file-compressed 768785129 695828227 1.10
tpch_q11/duckdb:vortex-file-compressed 507667055 472412388 1.07
tpch_q12/duckdb:vortex-file-compressed 578524327 581246072 1.00
tpch_q13/duckdb:vortex-file-compressed 395843733 379997355 1.04
tpch_q14/duckdb:vortex-file-compressed 430363176 412814660 1.04
tpch_q15/duckdb:vortex-file-compressed 301190337 301206202 1.00
tpch_q16/duckdb:vortex-file-compressed 374757713 344177258 1.09
tpch_q17/duckdb:vortex-file-compressed 705726310 642584853 1.10
tpch_q18/duckdb:vortex-file-compressed 589835775 582696352 1.01
tpch_q19/duckdb:vortex-file-compressed 482662402 439154277 1.10
tpch_q20/duckdb:vortex-file-compressed 771305860 741914821 1.04
tpch_q21/duckdb:vortex-file-compressed 1088390257 1006270583 1.08
tpch_q22/duckdb:vortex-file-compressed 286619890 258371957 1.11
duckdb / vortex-compact (1.059x ➖, 0↑ 1↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 293476638 288576079 1.02
tpch_q02/duckdb:vortex-compact 931333907 909467510 1.02
tpch_q03/duckdb:vortex-compact 663807163 586384099 1.13
tpch_q04/duckdb:vortex-compact 418813035 373737924 1.12
tpch_q05/duckdb:vortex-compact 790867920 811326314 0.97
tpch_q06/duckdb:vortex-compact 322854211 319081162 1.01
tpch_q07/duckdb:vortex-compact 888389873 838631345 1.06
tpch_q08/duckdb:vortex-compact 1071263958 1017231706 1.05
tpch_q09/duckdb:vortex-compact 995045117 917502955 1.08
tpch_q10/duckdb:vortex-compact 680969354 636451795 1.07
tpch_q11/duckdb:vortex-compact 476249872 440333697 1.08
tpch_q12/duckdb:vortex-compact 634987016 582629581 1.09
tpch_q13/duckdb:vortex-compact 387168886 329253178 1.18
tpch_q14/duckdb:vortex-compact 🚨 468502924 344340978 1.36
tpch_q15/duckdb:vortex-compact 306221958 285906314 1.07
tpch_q16/duckdb:vortex-compact 340623125 308023354 1.11
tpch_q17/duckdb:vortex-compact 651673423 601696043 1.08
tpch_q18/duckdb:vortex-compact 522440185 541573854 0.96
tpch_q19/duckdb:vortex-compact 447959200 457251254 0.98
tpch_q20/duckdb:vortex-compact 711386696 712587958 1.00
tpch_q21/duckdb:vortex-compact 976359913 1050486269 0.93
tpch_q22/duckdb:vortex-compact 277893096 284542484 0.98
duckdb / parquet (1.039x ➖, 0↑ 0↓)
name PR 1db4760 (ns) base ae9ecec (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 429939340 439602309 0.98
tpch_q02/duckdb:parquet 1041939167 1021092866 1.02
tpch_q03/duckdb:parquet 1029510793 927836756 1.11
tpch_q04/duckdb:parquet 701395008 616512057 1.14
tpch_q05/duckdb:parquet 1243025603 1206039011 1.03
tpch_q06/duckdb:parquet 430360698 407338661 1.06
tpch_q07/duckdb:parquet 1174846984 1150088233 1.02
tpch_q08/duckdb:parquet 1408969120 1407095000 1.00
tpch_q09/duckdb:parquet 1322453224 1278469443 1.03
tpch_q10/duckdb:parquet 1227222196 1182554428 1.04
tpch_q11/duckdb:parquet 675549842 657712185 1.03
tpch_q12/duckdb:parquet 653737448 654251219 1.00
tpch_q13/duckdb:parquet 920052291 849452113 1.08
tpch_q14/duckdb:parquet 652867200 633471774 1.03
tpch_q15/duckdb:parquet 477172835 445976614 1.07
tpch_q16/duckdb:parquet 645587730 597056499 1.08
tpch_q17/duckdb:parquet 709781158 726026642 0.98
tpch_q18/duckdb:parquet 845882789 810550584 1.04
tpch_q19/duckdb:parquet 797307127 713382189 1.12
tpch_q20/duckdb:parquet 1131313816 1077466795 1.05
tpch_q21/duckdb:parquet 1045112076 1049626998 1.00
tpch_q22/duckdb:parquet 515482358 530526533 0.97

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants