Skip to content

perf[array]: outline the array parts data from the DynArray#7750

Open
joseph-isaacs wants to merge 12 commits intodevelopfrom
ji/vtable-array-outer
Open

perf[array]: outline the array parts data from the DynArray#7750
joseph-isaacs wants to merge 12 commits intodevelopfrom
ji/vtable-array-outer

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented May 1, 2026 •
edited
Loading

Change the internals of ArrayRef to allow access to common fields without dyn dispatch.

+ pub struct ArrayRef(Arc<ArrayInner<dyn DynArrayData>>);
- pub struct ArrayRef(Arc<dyn DynArray>);
pub(crate) struct ArrayInner<D: ?Sized> {
    pub(crate) len: usize,
    pub(crate) encoding_id: ArrayId,
    pub(crate) dtype: DType,
    pub(crate) slots: Vec<Option<ArrayRef>>,
    pub(crate) stats: ArrayStats,
    pub(crate) data: D, // must be last for unsized coercion
}

Applied the following renames:

  • ArrayInner -> ArrayData
  • <V as VTable>::ArrayData -> <V as VTable>::TypedArrayData
  • DynArray -> DynArrayData

@joseph-isaacs
wip
c50a3d5 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
Merge remote-tracking branch 'origin/develop' into ji/vtable-array-outer
12d7ed7 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-array/src/array/erased.rs
@joseph-isaacs joseph-isaacs changed the title wip do not merge: try out a new array memory layout May 1, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 1, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 1, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: Random Access

Vortex (geomean): 0.977x ➖
Parquet (geomean): 1.018x ➖

unknown / unknown (1.006x ➖, 2↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2138874 2201627 0.97
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1510180 1471153 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8368293370 8366468950 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8320122859 8338957244 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7454264 7839563 0.95
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7082807 7252897 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk 5884021 5737865 1.03
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 6681698 6522869 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8350732629 8246749502 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8300445044 8197881469 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12834210 13194765 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12688483 13158730 0.96
random-access/lance-tokio-local-disk 781925 780190 1.00
random-access/lance-tokio-local-disk-footer 1364876 1361448 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 254218 246293 1.03
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 653806 622221 1.05
random-access/nested-lists/correlated/parquet-tokio-local-disk 130364299 127602942 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 131010926 127333250 1.03
random-access/nested-lists/correlated/vortex-tokio-local-disk 586027 576617 1.02
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 629558 596028 1.06
random-access/nested-lists/uniform/lance-tokio-local-disk 1134570 1108734 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1551945 1477262 1.05
random-access/nested-lists/uniform/parquet-tokio-local-disk 131474018 127477057 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130941250 127386280 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk 2146727 2093679 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2134388 2094718 1.02
random-access/nested-structs/correlated/lance-tokio-local-disk 413894 394616 1.05
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 620211 593847 1.04
random-access/nested-structs/correlated/parquet-tokio-local-disk 21675852 21322043 1.02
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 21918566 21343909 1.03
random-access/nested-structs/correlated/vortex-tokio-local-disk 778470 776476 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 709706 734252 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk 2812073 2741746 1.03
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3001462 2950674 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk 22434597 21269327 1.05
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22127060 21203565 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk 1660816 1592397 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1665616 1554565 1.07
random-access/parquet-tokio-local-disk 169100436 164794018 1.03
random-access/parquet-tokio-local-disk-footer 167926260 165707096 1.01
random-access/taxi/correlated/lance-tokio-local-disk 974100 963992 1.01
random-access/taxi/correlated/lance-tokio-local-disk-footer 1649373 1590756 1.04
random-access/taxi/correlated/parquet-tokio-local-disk 252054067 252781862 1.00
random-access/taxi/correlated/parquet-tokio-local-disk-footer 251423488 251590793 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1586671 1852357 0.86
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1732625 1841305 0.94
random-access/taxi/uniform/lance-tokio-local-disk 9659797 9415402 1.03
random-access/taxi/uniform/lance-tokio-local-disk-footer 10260506 10151258 1.01
random-access/taxi/uniform/parquet-tokio-local-disk 265880392 263571240 1.01
random-access/taxi/uniform/parquet-tokio-local-disk-footer 265907806 264154231 1.01
random-access/taxi/uniform/vortex-tokio-local-disk 4511029 4624864 0.98
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4473800 4606158 0.97
random-access/vortex-tokio-local-disk 1171208 1290872 0.91
random-access/vortex-tokio-local-disk-footer 🚀 1191689 1326956 0.90

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: Compression

Vortex (geomean): 1.017x ➖
Parquet (geomean): 1.029x ➖

unknown / unknown (1.039x ➖, 2↑ 21↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
compress time/Arade 1204412549 1142528953 1.05
compress time/Bimbo 7166645324 6821495731 1.05
compress time/CMSprovider 3005206976 2837659527 1.06
compress time/Euro2016 461779903 430323086 1.07
compress time/Food 402802479 384890746 1.05
compress time/HashTags 841985046 832645156 1.01
compress time/TPC-H l_comment canonical 1368765135 1274610453 1.07
compress time/TPC-H l_comment chunked 1385611730 1279809568 1.08
compress time/taxi 741781144 705231305 1.05
compress time/wide table cols=100 chunks=1 rows=1000 11876466 12076417 0.98
compress time/wide table cols=100 chunks=50 rows=1000 12114111 11755154 1.03
compress time/wide table cols=1000 chunks=1 rows=1000 130173681 125266851 1.04
compress time/wide table cols=1000 chunks=50 rows=1000 130432588 130422207 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1505164431 1436245715 1.05
compress time/wide table cols=10000 chunks=50 rows=1000 1497933431 1419196284 1.06
decompress time/Arade 🚨 29133598 25474156 1.14
decompress time/Bimbo 🚨 89170992 77020915 1.16
decompress time/CMSprovider 🚨 96816492 72217628 1.34
decompress time/Euro2016 19543806 18582833 1.05
decompress time/Food 🚨 9068475 7598072 1.19
decompress time/HashTags 73395332 68440717 1.07
decompress time/TPC-H l_comment canonical 🚨 43536301 39418029 1.10
decompress time/TPC-H l_comment chunked 🚨 44225988 39522092 1.12
decompress time/taxi 🚨 16748404 14649360 1.14
decompress time/wide table cols=100 chunks=1 rows=1000 2616574 2436589 1.07
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2807005 2478227 1.13
decompress time/wide table cols=1000 chunks=1 rows=1000 24974605 22775027 1.10
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 25846953 22847832 1.13
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 289949516 244929126 1.18
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 291020964 246418627 1.18
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2683762969 2567810601 1.05
parquet_rs-zstd compress time/Bimbo 12771856092 12352703876 1.03
parquet_rs-zstd compress time/CMSprovider 7189159830 6791354737 1.06
parquet_rs-zstd compress time/Euro2016 1363057270 1304986698 1.04
parquet_rs-zstd compress time/Food 811762019 781615947 1.04
parquet_rs-zstd compress time/HashTags 2306606992 2103455012 1.10
parquet_rs-zstd compress time/TPC-H l_comment canonical 3255053875 3124671994 1.04
parquet_rs-zstd compress time/TPC-H l_comment chunked 3256728453 3125208807 1.04
parquet_rs-zstd compress time/taxi 1253098423 1192069755 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 7029923 6093841 1.15
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7198867 6030200 1.19
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 80228760 73161754 1.10
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 80025649 74078278 1.08
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 828637886 798370854 1.04
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 809343115 814924826 0.99
parquet_rs-zstd decompress time/Arade 626404666 613187942 1.02
parquet_rs-zstd decompress time/Bimbo 1698299468 1695816283 1.00
parquet_rs-zstd decompress time/CMSprovider 1764934590 1682181383 1.05
parquet_rs-zstd decompress time/Euro2016 382517081 375036132 1.02
parquet_rs-zstd decompress time/Food 202565626 195836766 1.03
parquet_rs-zstd decompress time/HashTags 🚨 683344243 614732477 1.11
parquet_rs-zstd decompress time/TPC-H l_comment canonical 594441783 584551328 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked 595589231 585303407 1.02
parquet_rs-zstd decompress time/taxi 246915900 245777316 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2970064 2799348 1.06
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2996870 2780684 1.08
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34485582 31901518 1.08
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 35164001 33130462 1.06
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 359516416 344577984 1.04
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 355507674 344143494 1.03
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163394324 163395292 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio compress time/Food 0 0 1.01
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.92
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.85
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 1 0.86
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.93
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/Bimbo 🚨 0 0 1.16
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.28
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.15
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.09
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.10
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.14
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.0%
Vortex (geomean): 0.994x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -0.6%

datafusion / vortex-file-compressed (1.002x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 725606790 870351985 0.83
tpch_q02/datafusion:vortex-file-compressed 1047726244 1137695987 0.92
tpch_q03/datafusion:vortex-file-compressed 856887863 1111018849 0.77
tpch_q04/datafusion:vortex-file-compressed 675515230 767753349 0.88
tpch_q05/datafusion:vortex-file-compressed 1141301362 1044050114 1.09
tpch_q06/datafusion:vortex-file-compressed 723974142 681812032 1.06
tpch_q07/datafusion:vortex-file-compressed 1142964604 1334880536 0.86
tpch_q08/datafusion:vortex-file-compressed 1486096062 1193823669 1.24
tpch_q09/datafusion:vortex-file-compressed 1329846108 1305372609 1.02
tpch_q10/datafusion:vortex-file-compressed 1024884592 1132811669 0.90
tpch_q11/datafusion:vortex-file-compressed 634586292 510971744 1.24
tpch_q12/datafusion:vortex-file-compressed 1074691457 1125347018 0.95
tpch_q13/datafusion:vortex-file-compressed 465269742 458612711 1.01
tpch_q14/datafusion:vortex-file-compressed 735389312 682120962 1.08
tpch_q15/datafusion:vortex-file-compressed 1262840797 1200098983 1.05
tpch_q16/datafusion:vortex-file-compressed 369837481 405095183 0.91
tpch_q17/datafusion:vortex-file-compressed 1196683799 1166586089 1.03
tpch_q18/datafusion:vortex-file-compressed 1278424210 1173545843 1.09
tpch_q19/datafusion:vortex-file-compressed 802448284 925836333 0.87
tpch_q20/datafusion:vortex-file-compressed 1020053694 1161917525 0.88
tpch_q21/datafusion:vortex-file-compressed 1818769069 1625857825 1.12
tpch_q22/datafusion:vortex-file-compressed 🚨 592228361 397897781 1.49
datafusion / vortex-compact (1.044x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 674722535 681272619 0.99
tpch_q02/datafusion:vortex-compact 830281954 705289468 1.18
tpch_q03/datafusion:vortex-compact 829467892 976064333 0.85
tpch_q04/datafusion:vortex-compact 649514280 602699106 1.08
tpch_q05/datafusion:vortex-compact 1120820346 948523777 1.18
tpch_q06/datafusion:vortex-compact 688176713 627218383 1.10
tpch_q07/datafusion:vortex-compact 993568513 945091946 1.05
tpch_q08/datafusion:vortex-compact 1096369154 1032216601 1.06
tpch_q09/datafusion:vortex-compact 1213399797 1117787754 1.09
tpch_q10/datafusion:vortex-compact 920761585 895125337 1.03
tpch_q11/datafusion:vortex-compact 512511632 405208551 1.26
tpch_q12/datafusion:vortex-compact 922993794 775059493 1.19
tpch_q13/datafusion:vortex-compact 429178249 423262363 1.01
tpch_q14/datafusion:vortex-compact 852210775 668350456 1.28
tpch_q15/datafusion:vortex-compact 1278032681 1478543143 0.86
tpch_q16/datafusion:vortex-compact 354934250 346998754 1.02
tpch_q17/datafusion:vortex-compact 1342545794 1150584165 1.17
tpch_q18/datafusion:vortex-compact 1096062940 1115401920 0.98
tpch_q19/datafusion:vortex-compact 861417595 893876250 0.96
tpch_q20/datafusion:vortex-compact 1146897955 1130252659 1.01
tpch_q21/datafusion:vortex-compact 1834861739 1761871484 1.04
tpch_q22/datafusion:vortex-compact 428135219 575399588 0.74
datafusion / parquet (0.984x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 1016606590 920645865 1.10
tpch_q02/datafusion:parquet 1513095027 1204575297 1.26
tpch_q03/datafusion:parquet 1034739083 1121521694 0.92
tpch_q04/datafusion:parquet 498930593 515202184 0.97
tpch_q05/datafusion:parquet 1381789527 1210751180 1.14
tpch_q06/datafusion:parquet 639258212 561225199 1.14
tpch_q07/datafusion:parquet 1575698298 1463527526 1.08
tpch_q08/datafusion:parquet 1887515803 1628022334 1.16
tpch_q09/datafusion:parquet 2328851359 1813227305 1.28
tpch_q10/datafusion:parquet 2135856450 2202224452 0.97
tpch_q11/datafusion:parquet 609931894 572700551 1.07
tpch_q12/datafusion:parquet 710205531 879622662 0.81
tpch_q13/datafusion:parquet 717012684 1003402089 0.71
tpch_q14/datafusion:parquet 806758686 903289571 0.89
tpch_q15/datafusion:parquet 1258485776 1441802953 0.87
tpch_q16/datafusion:parquet 504052490 593591176 0.85
tpch_q17/datafusion:parquet 1386744368 1340143277 1.03
tpch_q18/datafusion:parquet 1730848285 1662230218 1.04
tpch_q19/datafusion:parquet 887318050 1124104951 0.79
tpch_q20/datafusion:parquet 1086940025 1182587927 0.92
tpch_q21/datafusion:parquet 1804641689 1748685699 1.03
tpch_q22/datafusion:parquet 811777715 948172232 0.86
duckdb / vortex-file-compressed (0.954x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 623922673 676021506 0.92
tpch_q02/duckdb:vortex-file-compressed 1287467008 1191394235 1.08
tpch_q03/duckdb:vortex-file-compressed 937712124 1053123735 0.89
tpch_q04/duckdb:vortex-file-compressed 692662990 601662889 1.15
tpch_q05/duckdb:vortex-file-compressed 1191500152 1145678043 1.04
tpch_q06/duckdb:vortex-file-compressed 773082925 821923419 0.94
tpch_q07/duckdb:vortex-file-compressed 1219989685 1300031640 0.94
tpch_q08/duckdb:vortex-file-compressed 1393778128 1649917217 0.84
tpch_q09/duckdb:vortex-file-compressed 1387052870 1590733646 0.87
tpch_q10/duckdb:vortex-file-compressed 1057665764 1241697439 0.85
tpch_q11/duckdb:vortex-file-compressed 653545008 698388008 0.94
tpch_q12/duckdb:vortex-file-compressed 710443017 826649354 0.86
tpch_q13/duckdb:vortex-file-compressed 984066976 970153355 1.01
tpch_q14/duckdb:vortex-file-compressed 842763647 880644291 0.96
tpch_q15/duckdb:vortex-file-compressed 537600966 541304830 0.99
tpch_q16/duckdb:vortex-file-compressed 569115101 506822550 1.12
tpch_q17/duckdb:vortex-file-compressed 937420184 946926836 0.99
tpch_q18/duckdb:vortex-file-compressed 908029470 936772509 0.97
tpch_q19/duckdb:vortex-file-compressed 741653365 965481407 0.77
tpch_q20/duckdb:vortex-file-compressed 1153569066 1390846464 0.83
tpch_q21/duckdb:vortex-file-compressed 2010546050 2055517147 0.98
tpch_q22/duckdb:vortex-file-compressed 737933369 637279995 1.16
duckdb / vortex-compact (0.979x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 593283950 612902705 0.97
tpch_q02/duckdb:vortex-compact 1089213845 1055762440 1.03
tpch_q03/duckdb:vortex-compact 878003097 848086598 1.04
tpch_q04/duckdb:vortex-compact 554034110 567039242 0.98
tpch_q05/duckdb:vortex-compact 1037648354 1013814641 1.02
tpch_q06/duckdb:vortex-compact 701792190 757310998 0.93
tpch_q07/duckdb:vortex-compact 1033957015 1088049529 0.95
tpch_q08/duckdb:vortex-compact 1320795293 1375631690 0.96
tpch_q09/duckdb:vortex-compact 1357846034 1331364855 1.02
tpch_q10/duckdb:vortex-compact 1077706273 1039198139 1.04
tpch_q11/duckdb:vortex-compact 610676188 721795121 0.85
tpch_q12/duckdb:vortex-compact 708741361 676353224 1.05
tpch_q13/duckdb:vortex-compact 879545028 860474908 1.02
tpch_q14/duckdb:vortex-compact 829927616 838655869 0.99
tpch_q15/duckdb:vortex-compact 512075010 537266097 0.95
tpch_q16/duckdb:vortex-compact 430352605 503988770 0.85
tpch_q17/duckdb:vortex-compact 891003029 849540073 1.05
tpch_q18/duckdb:vortex-compact 747569911 692148491 1.08
tpch_q19/duckdb:vortex-compact 705079120 745937297 0.95
tpch_q20/duckdb:vortex-compact 1202427025 1165411000 1.03
tpch_q21/duckdb:vortex-compact 1705334532 1791238225 0.95
tpch_q22/duckdb:vortex-compact 643885722 726798949 0.89
duckdb / parquet (0.966x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 969177060 921439942 1.05
tpch_q02/duckdb:parquet 1296490463 1689699549 0.77
tpch_q03/duckdb:parquet 1790413495 1723028650 1.04
tpch_q04/duckdb:parquet 1063239450 1051408299 1.01
tpch_q05/duckdb:parquet 1948284581 2027280066 0.96
tpch_q06/duckdb:parquet 917809620 852186882 1.08
tpch_q07/duckdb:parquet 1884340672 1818974937 1.04
tpch_q08/duckdb:parquet 2452782676 2557063658 0.96
tpch_q09/duckdb:parquet 2542254412 2613755266 0.97
tpch_q10/duckdb:parquet 3117441908 3286108919 0.95
tpch_q11/duckdb:parquet 916579794 1093496926 0.84
tpch_q12/duckdb:parquet 1197911595 1152563760 1.04
tpch_q13/duckdb:parquet 1394243780 1286173232 1.08
tpch_q14/duckdb:parquet 1367498559 1337312397 1.02
tpch_q15/duckdb:parquet 911700188 980785733 0.93
tpch_q16/duckdb:parquet 814785506 906751521 0.90
tpch_q17/duckdb:parquet 1287371448 1294527465 0.99
tpch_q18/duckdb:parquet 1404980056 1523931439 0.92
tpch_q19/duckdb:parquet 1472258329 1496612037 0.98
tpch_q20/duckdb:parquet 1872393914 2078653816 0.90
tpch_q21/duckdb:parquet 2040020856 1883981093 1.08
tpch_q22/duckdb:parquet 958982266 1172443443 0.82
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.0% +7.8% -8.1% +38.7% ➖ noise
1 datafusion:vortex-file-compressed -16.6% +7.8% -22.6% +52.1% ➖ noise
1 duckdb:vortex-compact -3.2% +7.8% -10.2% +109.1% ➖ noise
1 duckdb:vortex-file-compressed -7.7% +7.8% -14.4% +39.5% ➖ noise
2 datafusion:vortex-compact +17.7% -1.8% +19.9% +42.3% ➖ noise
2 datafusion:vortex-file-compressed -7.9% -1.8% -6.2% +45.6% ➖ noise
2 duckdb:vortex-compact +3.2% -1.8% +5.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +8.1% -1.8% +10.1% +30.9% ➖ noise
3 datafusion:vortex-compact -15.0% -2.1% -13.2% +42.4% ➖ noise
3 datafusion:vortex-file-compressed -22.9% -2.1% -21.2% +51.6% ➖ noise
3 duckdb:vortex-compact +3.5% -2.1% +5.7% +36.9% ➖ noise
3 duckdb:vortex-file-compressed -11.0% -2.1% -9.1% +39.8% ➖ noise
4 datafusion:vortex-compact +7.8% -1.0% +8.9% +31.5% ➖ noise
4 datafusion:vortex-file-compressed -12.0% -1.0% -11.1% +30.0% ➖ noise
4 duckdb:vortex-compact -2.3% -1.0% -1.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +15.1% -1.0% +16.3% +30.0% ➖ noise
5 datafusion:vortex-compact +18.2% +4.7% +12.8% +41.8% ➖ noise
5 datafusion:vortex-file-compressed +9.3% +4.7% +4.4% +34.3% ➖ noise
5 duckdb:vortex-compact +2.4% +4.7% -2.3% +33.7% ➖ noise
5 duckdb:vortex-file-compressed +4.0% +4.7% -0.7% +34.3% ➖ noise
6 datafusion:vortex-compact +9.7% +10.8% -0.9% +49.5% ➖ noise
6 datafusion:vortex-file-compressed +6.2% +10.8% -4.1% +40.1% ➖ noise
6 duckdb:vortex-compact -7.3% +10.8% -16.3% +39.3% ➖ noise
6 duckdb:vortex-file-compressed -5.9% +10.8% -15.1% +37.5% ➖ noise
7 datafusion:vortex-compact +5.1% +5.6% -0.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -14.4% +5.6% -18.9% +30.0% ➖ noise
7 duckdb:vortex-compact -5.0% +5.6% -10.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -6.2% +5.6% -11.1% +30.0% ➖ noise
8 datafusion:vortex-compact +6.2% +5.5% +0.7% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +24.5% +5.5% +18.0% +30.0% ➖ noise
8 duckdb:vortex-compact -4.0% +5.5% -9.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -15.5% +5.5% -19.9% +30.0% ➖ noise
9 datafusion:vortex-compact +8.6% +11.8% -2.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +1.9% +11.8% -8.9% +30.0% ➖ noise
9 duckdb:vortex-compact +2.0% +11.8% -8.8% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -12.8% +11.8% -22.0% +30.0% ➖ noise
10 datafusion:vortex-compact +2.9% -4.1% +7.2% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -9.5% -4.1% -5.7% +41.3% ➖ noise
10 duckdb:vortex-compact +3.7% -4.1% +8.1% +73.2% ➖ noise
10 duckdb:vortex-file-compressed -14.8% -4.1% -11.2% +31.0% ➖ noise
11 datafusion:vortex-compact +26.5% -5.5% +33.9% +30.0% 🚨 regression
11 datafusion:vortex-file-compressed +24.2% -5.5% +31.4% +30.0% 🚨 regression
11 duckdb:vortex-compact -15.4% -5.5% -10.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -6.4% -5.5% -1.0% +30.0% ➖ noise
12 datafusion:vortex-compact +19.1% -8.4% +30.0% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -4.5% -8.4% +4.2% +30.0% ➖ noise
12 duckdb:vortex-compact +4.8% -8.4% +14.4% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -14.1% -8.4% -6.2% +30.0% ➖ noise
13 datafusion:vortex-compact +1.4% -12.0% +15.2% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +1.5% -12.0% +15.3% +30.0% ➖ noise
13 duckdb:vortex-compact +2.2% -12.0% +16.1% +38.8% ➖ noise
13 duckdb:vortex-file-compressed +1.4% -12.0% +15.2% +41.9% ➖ noise
14 datafusion:vortex-compact +27.5% -4.4% +33.4% +33.8% ➖ noise
14 datafusion:vortex-file-compressed +7.8% -4.4% +12.8% +30.0% ➖ noise
14 duckdb:vortex-compact -1.0% -4.4% +3.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -4.3% -4.4% +0.1% +30.0% ➖ noise
15 datafusion:vortex-compact -13.6% -9.9% -4.0% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +5.2% -9.9% +16.8% +30.0% ➖ noise
15 duckdb:vortex-compact -4.7% -9.9% +5.8% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -0.7% -9.9% +10.3% +30.0% ➖ noise
16 datafusion:vortex-compact +2.3% -12.6% +17.1% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -8.7% -12.6% +4.5% +32.8% ➖ noise
16 duckdb:vortex-compact -14.6% -12.6% -2.2% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +12.3% -12.6% +28.6% +30.0% ➖ noise
17 datafusion:vortex-compact +16.7% +1.4% +15.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +2.6% +1.4% +1.1% +30.0% ➖ noise
17 duckdb:vortex-compact +4.9% +1.4% +3.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -1.0% +1.4% -2.4% +30.0% ➖ noise
18 datafusion:vortex-compact -1.7% -2.0% +0.3% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +8.9% -2.0% +11.2% +30.0% ➖ noise
18 duckdb:vortex-compact +8.0% -2.0% +10.2% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -3.1% -2.0% -1.1% +30.0% ➖ noise
19 datafusion:vortex-compact -3.6% -11.9% +9.4% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -13.3% -11.9% -1.6% +30.0% ➖ noise
19 duckdb:vortex-compact -5.5% -11.9% +7.3% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -23.2% -11.9% -12.8% +30.0% ➖ noise
20 datafusion:vortex-compact +1.5% -9.0% +11.5% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -12.2% -9.0% -3.5% +30.0% ➖ noise
20 duckdb:vortex-compact +3.2% -9.0% +13.4% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -17.1% -9.0% -8.8% +30.0% ➖ noise
21 datafusion:vortex-compact +4.1% +5.7% -1.5% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +11.9% +5.7% +5.8% +30.0% ➖ noise
21 duckdb:vortex-compact -4.8% +5.7% -9.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.2% +5.7% -7.5% +30.0% ➖ noise
22 datafusion:vortex-compact -25.6% -16.3% -11.1% +51.6% ➖ noise
22 datafusion:vortex-file-compressed +48.8% -16.3% +77.9% +48.3% 🚨 regression
22 duckdb:vortex-compact -11.4% -16.3% +5.9% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +15.8% -16.3% +38.4% +35.2% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.3%
Vortex (geomean): 0.983x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +1.6%

datafusion / vortex-file-compressed (0.884x ➖, 2↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 322296747 320831650 1.00
tpch_q02/datafusion:vortex-file-compressed 454595199 588343073 0.77
tpch_q03/datafusion:vortex-file-compressed 418023216 543349651 0.77
tpch_q04/datafusion:vortex-file-compressed 259204912 354830404 0.73
tpch_q05/datafusion:vortex-file-compressed 🚀 457985978 714820926 0.64
tpch_q06/datafusion:vortex-file-compressed 352862962 409999275 0.86
tpch_q07/datafusion:vortex-file-compressed 470026463 539826397 0.87
tpch_q08/datafusion:vortex-file-compressed 600994891 809323471 0.74
tpch_q09/datafusion:vortex-file-compressed 🚀 452820245 831520212 0.54
tpch_q10/datafusion:vortex-file-compressed 548056502 747429412 0.73
tpch_q11/datafusion:vortex-file-compressed 407542517 410496229 0.99
tpch_q12/datafusion:vortex-file-compressed 557008539 614161366 0.91
tpch_q13/datafusion:vortex-file-compressed 214752380 168202417 1.28
tpch_q14/datafusion:vortex-file-compressed 338532014 337456325 1.00
tpch_q15/datafusion:vortex-file-compressed 592638035 672987979 0.88
tpch_q16/datafusion:vortex-file-compressed 213957888 217086200 0.99
tpch_q17/datafusion:vortex-file-compressed 397316252 463839737 0.86
tpch_q18/datafusion:vortex-file-compressed 328819620 335457516 0.98
tpch_q19/datafusion:vortex-file-compressed 512742357 452187470 1.13
tpch_q20/datafusion:vortex-file-compressed 495947534 666750200 0.74
tpch_q21/datafusion:vortex-file-compressed 724116139 658706968 1.10
tpch_q22/datafusion:vortex-file-compressed 🚨 156523099 113774337 1.38
datafusion / vortex-compact (1.013x ➖, 1↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 345149273 371463516 0.93
tpch_q02/datafusion:vortex-compact 459318546 470090461 0.98
tpch_q03/datafusion:vortex-compact 387848487 491184087 0.79
tpch_q04/datafusion:vortex-compact 261107666 236417701 1.10
tpch_q05/datafusion:vortex-compact 414346708 483719279 0.86
tpch_q06/datafusion:vortex-compact 🚀 361451254 517774914 0.70
tpch_q07/datafusion:vortex-compact 518362808 454862020 1.14
tpch_q08/datafusion:vortex-compact 605486497 569292432 1.06
tpch_q09/datafusion:vortex-compact 493616491 434999806 1.13
tpch_q10/datafusion:vortex-compact 589992712 510948146 1.15
tpch_q11/datafusion:vortex-compact 375974442 307273291 1.22
tpch_q12/datafusion:vortex-compact 530140993 497263727 1.07
tpch_q13/datafusion:vortex-compact 156074702 131059106 1.19
tpch_q14/datafusion:vortex-compact 318951112 272331906 1.17
tpch_q15/datafusion:vortex-compact 459864294 475515355 0.97
tpch_q16/datafusion:vortex-compact 180637295 216974631 0.83
tpch_q17/datafusion:vortex-compact 376591531 371056328 1.01
tpch_q18/datafusion:vortex-compact 🚨 469293811 322995748 1.45
tpch_q19/datafusion:vortex-compact 542063610 509808349 1.06
tpch_q20/datafusion:vortex-compact 580219465 498305483 1.16
tpch_q21/datafusion:vortex-compact 601633297 730012679 0.82
tpch_q22/datafusion:vortex-compact 119095798 147443013 0.81
datafusion / parquet (1.014x ➖, 0↑ 3↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 272869508 257469592 1.06
tpch_q02/datafusion:parquet 515018214 418918802 1.23
tpch_q03/datafusion:parquet 🚨 458216545 303512328 1.51
tpch_q04/datafusion:parquet 191180530 179229865 1.07
tpch_q05/datafusion:parquet 503578157 532854640 0.95
tpch_q06/datafusion:parquet 155452439 159634765 0.97
tpch_q07/datafusion:parquet 507467690 525519502 0.97
tpch_q08/datafusion:parquet 597898127 611735393 0.98
tpch_q09/datafusion:parquet 459284022 548390727 0.84
tpch_q10/datafusion:parquet 513726372 568177276 0.90
tpch_q11/datafusion:parquet 355004315 410040308 0.87
tpch_q12/datafusion:parquet 228059284 298652819 0.76
tpch_q13/datafusion:parquet 443559669 427492287 1.04
tpch_q14/datafusion:parquet 181320782 183975253 0.99
tpch_q15/datafusion:parquet 298278701 328956906 0.91
tpch_q16/datafusion:parquet 172996550 172471800 1.00
tpch_q17/datafusion:parquet 497385396 456768941 1.09
tpch_q18/datafusion:parquet 615652859 689129401 0.89
tpch_q19/datafusion:parquet 545508426 549222772 0.99
tpch_q20/datafusion:parquet 🚨 720242294 453192063 1.59
tpch_q21/datafusion:parquet 🚨 896213967 683053248 1.31
tpch_q22/datafusion:parquet 199617428 251390177 0.79
duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 333468071 279571621 1.19
tpch_q02/duckdb:vortex-file-compressed 1008485466 960868692 1.05
tpch_q03/duckdb:vortex-file-compressed 662075807 737228854 0.90
tpch_q04/duckdb:vortex-file-compressed 424274798 401359617 1.06
tpch_q05/duckdb:vortex-file-compressed 1047287303 917525477 1.14
tpch_q06/duckdb:vortex-file-compressed 453863248 522582683 0.87
tpch_q07/duckdb:vortex-file-compressed 924342656 887989096 1.04
tpch_q08/duckdb:vortex-file-compressed 1081623794 1039591942 1.04
tpch_q09/duckdb:vortex-file-compressed 871538758 892685248 0.98
tpch_q10/duckdb:vortex-file-compressed 797164928 840443013 0.95
tpch_q11/duckdb:vortex-file-compressed 543461349 545763130 1.00
tpch_q12/duckdb:vortex-file-compressed 523188739 517430478 1.01
tpch_q13/duckdb:vortex-file-compressed 571503810 513817085 1.11
tpch_q14/duckdb:vortex-file-compressed 520515976 530004110 0.98
tpch_q15/duckdb:vortex-file-compressed 275148238 288611908 0.95
tpch_q16/duckdb:vortex-file-compressed 405889032 395231564 1.03
tpch_q17/duckdb:vortex-file-compressed 762718262 787748721 0.97
tpch_q18/duckdb:vortex-file-compressed 605938347 651653817 0.93
tpch_q19/duckdb:vortex-file-compressed 533699124 477606688 1.12
tpch_q20/duckdb:vortex-file-compressed 833797927 866046510 0.96
tpch_q21/duckdb:vortex-file-compressed 1141991541 1205025267 0.95
tpch_q22/duckdb:vortex-file-compressed 400371884 411146097 0.97
duckdb / vortex-compact (1.036x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 327358304 309834728 1.06
tpch_q02/duckdb:vortex-compact 967975312 931773154 1.04
tpch_q03/duckdb:vortex-compact 705598668 685426943 1.03
tpch_q04/duckdb:vortex-compact 412012320 338059877 1.22
tpch_q05/duckdb:vortex-compact 957621587 985431508 0.97
tpch_q06/duckdb:vortex-compact 486596784 501619857 0.97
tpch_q07/duckdb:vortex-compact 1030416064 900514592 1.14
tpch_q08/duckdb:vortex-compact 1032841772 922463763 1.12
tpch_q09/duckdb:vortex-compact 1057192611 924143829 1.14
tpch_q10/duckdb:vortex-compact 761246904 917174421 0.83
tpch_q11/duckdb:vortex-compact 487570163 479395109 1.02
tpch_q12/duckdb:vortex-compact 485491716 492403581 0.99
tpch_q13/duckdb:vortex-compact 492582308 502309707 0.98
tpch_q14/duckdb:vortex-compact 535029347 500662726 1.07
tpch_q15/duckdb:vortex-compact 311672101 300433464 1.04
tpch_q16/duckdb:vortex-compact 416870516 401614014 1.04
tpch_q17/duckdb:vortex-compact 680124317 722999560 0.94
tpch_q18/duckdb:vortex-compact 495511817 507959386 0.98
tpch_q19/duckdb:vortex-compact 473001861 434914876 1.09
tpch_q20/duckdb:vortex-compact 801721972 748330043 1.07
tpch_q21/duckdb:vortex-compact 1145819347 1073480453 1.07
tpch_q22/duckdb:vortex-compact 397326502 373620530 1.06
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 429622717 544612067 0.79
tpch_q02/duckdb:parquet 1257284105 1216130575 1.03
tpch_q03/duckdb:parquet 1178209792 1148515045 1.03
tpch_q04/duckdb:parquet 628061139 652025111 0.96
tpch_q05/duckdb:parquet 1425684549 1320991954 1.08
tpch_q06/duckdb:parquet 411538157 478382159 0.86
tpch_q07/duckdb:parquet 1209769737 1209623503 1.00
tpch_q08/duckdb:parquet 1637199870 1591635532 1.03
tpch_q09/duckdb:parquet 1466636235 1401590535 1.05
tpch_q10/duckdb:parquet 1440937437 1294968329 1.11
tpch_q11/duckdb:parquet 760630891 778452319 0.98
tpch_q12/duckdb:parquet 908883339 748012622 1.22
tpch_q13/duckdb:parquet 961715732 909368446 1.06
tpch_q14/duckdb:parquet 751974460 811334151 0.93
tpch_q15/duckdb:parquet 550757451 618969967 0.89
tpch_q16/duckdb:parquet 642914944 631718168 1.02
tpch_q17/duckdb:parquet 867370243 871529767 1.00
tpch_q18/duckdb:parquet 934909778 906412456 1.03
tpch_q19/duckdb:parquet 801713119 744560964 1.08
tpch_q20/duckdb:parquet 1164264697 1161404969 1.00
tpch_q21/duckdb:parquet 1173132782 1166707944 1.01
tpch_q22/duckdb:parquet 569604301 620080635 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.1% -8.6% +1.6% +72.0% ➖ noise
1 datafusion:vortex-file-compressed +0.5% -8.6% +9.9% +66.3% ➖ noise
1 duckdb:vortex-compact +5.7% -8.6% +15.6% +48.2% ➖ noise
1 duckdb:vortex-file-compressed +19.3% -8.6% +30.5% +45.2% ➖ noise
2 datafusion:vortex-compact -2.3% +12.7% -13.3% +38.0% ➖ noise
2 datafusion:vortex-file-compressed -22.7% +12.7% -31.5% +39.6% ✅ faster
2 duckdb:vortex-compact +3.9% +12.7% -7.9% +31.2% ➖ noise
2 duckdb:vortex-file-compressed +5.0% +12.7% -6.9% +32.2% ➖ noise
3 datafusion:vortex-compact -21.0% +24.4% -36.6% +54.4% ✅ faster
3 datafusion:vortex-file-compressed -23.1% +24.4% -38.2% +57.4% ✅ faster
3 duckdb:vortex-compact +2.9% +24.4% -17.3% +32.7% ➖ noise
3 duckdb:vortex-file-compressed -10.2% +24.4% -27.8% +47.9% ➖ noise
4 datafusion:vortex-compact +10.4% +1.4% +9.0% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -26.9% +1.4% -27.9% +37.8% ✅ faster
4 duckdb:vortex-compact +21.9% +1.4% +20.2% +33.0% ➖ noise
4 duckdb:vortex-file-compressed +5.7% +1.4% +4.3% +30.0% ➖ noise
5 datafusion:vortex-compact -14.3% +1.0% -15.2% +33.3% ➖ noise
5 datafusion:vortex-file-compressed -35.9% +1.0% -36.6% +30.0% ✅ faster
5 duckdb:vortex-compact -2.8% +1.0% -3.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +14.1% +1.0% +13.0% +30.0% ➖ noise
6 datafusion:vortex-compact -30.2% -8.5% -23.7% +32.7% ➖ noise
6 datafusion:vortex-file-compressed -13.9% -8.5% -6.0% +30.0% ➖ noise
6 duckdb:vortex-compact -3.0% -8.5% +6.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -13.1% -8.5% -5.1% +30.0% ➖ noise
7 datafusion:vortex-compact +14.0% -1.7% +16.0% +34.6% ➖ noise
7 datafusion:vortex-file-compressed -12.9% -1.7% -11.4% +30.0% ➖ noise
7 duckdb:vortex-compact +14.4% -1.7% +16.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +4.1% -1.7% +5.9% +30.0% ➖ noise
8 datafusion:vortex-compact +6.4% +0.3% +6.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -25.7% +0.3% -25.9% +30.0% ✅ faster
8 duckdb:vortex-compact +12.0% +0.3% +11.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +4.0% +0.3% +3.8% +30.0% ➖ noise
9 datafusion:vortex-compact +13.5% -6.4% +21.2% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -45.5% -6.4% -41.8% +37.3% ✅ faster
9 duckdb:vortex-compact +14.4% -6.4% +22.2% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -2.4% -6.4% +4.3% +30.0% ➖ noise
10 datafusion:vortex-compact +15.5% +0.3% +15.1% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -26.7% +0.3% -26.9% +32.2% ✅ faster
10 duckdb:vortex-compact -17.0% +0.3% -17.3% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -5.1% +0.3% -5.4% +30.0% ➖ noise
11 datafusion:vortex-compact +22.4% -8.0% +33.0% +30.0% 🚨 regression
11 datafusion:vortex-file-compressed -0.7% -8.0% +7.9% +39.6% ➖ noise
11 duckdb:vortex-compact +1.7% -8.0% +10.6% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -0.4% -8.0% +8.3% +30.0% ➖ noise
12 datafusion:vortex-compact +6.6% -3.7% +10.7% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -9.3% -3.7% -5.8% +30.0% ➖ noise
12 duckdb:vortex-compact -1.4% -3.7% +2.4% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +1.1% -3.7% +5.0% +30.0% ➖ noise
13 datafusion:vortex-compact +19.1% +4.8% +13.7% +59.8% ➖ noise
13 datafusion:vortex-file-compressed +27.7% +4.8% +21.9% +41.2% ➖ noise
13 duckdb:vortex-compact -1.9% +4.8% -6.4% +33.6% ➖ noise
13 duckdb:vortex-file-compressed +11.2% +4.8% +6.2% +35.7% ➖ noise
14 datafusion:vortex-compact +17.1% -4.4% +22.5% +35.8% ➖ noise
14 datafusion:vortex-file-compressed +0.3% -4.4% +5.0% +31.1% ➖ noise
14 duckdb:vortex-compact +6.9% -4.4% +11.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -1.8% -4.4% +2.8% +30.0% ➖ noise
15 datafusion:vortex-compact -3.3% -10.2% +7.7% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -11.9% -10.2% -2.0% +30.0% ➖ noise
15 duckdb:vortex-compact +3.7% -10.2% +15.5% +46.0% ➖ noise
15 duckdb:vortex-file-compressed -4.7% -10.2% +6.1% +30.0% ➖ noise
16 datafusion:vortex-compact -16.7% +1.0% -17.6% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -1.4% +1.0% -2.5% +30.0% ➖ noise
16 duckdb:vortex-compact +3.8% +1.0% +2.7% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +2.7% +1.0% +1.6% +30.0% ➖ noise
17 datafusion:vortex-compact +1.5% +4.1% -2.5% +30.8% ➖ noise
17 datafusion:vortex-file-compressed -14.3% +4.1% -17.7% +36.1% ➖ noise
17 duckdb:vortex-compact -5.9% +4.1% -9.6% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -3.2% +4.1% -7.0% +30.0% ➖ noise
18 datafusion:vortex-compact +45.3% -4.0% +51.4% +30.3% 🚨 regression
18 datafusion:vortex-file-compressed -2.0% -4.0% +2.1% +30.0% ➖ noise
18 duckdb:vortex-compact -2.5% -4.0% +1.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -7.0% -4.0% -3.1% +33.0% ➖ noise
19 datafusion:vortex-compact +6.3% +3.4% +2.8% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +13.4% +3.4% +9.6% +30.0% ➖ noise
19 duckdb:vortex-compact +8.8% +3.4% +5.2% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +11.7% +3.4% +8.1% +30.0% ➖ noise
20 datafusion:vortex-compact +16.4% +26.2% -7.8% +38.6% ➖ noise
20 datafusion:vortex-file-compressed -25.6% +26.2% -41.1% +37.6% ✅ faster
20 duckdb:vortex-compact +7.1% +26.2% -15.1% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -3.7% +26.2% -23.7% +30.0% ✅ faster
21 datafusion:vortex-compact -17.6% +14.9% -28.2% +30.9% ✅ faster
21 datafusion:vortex-file-compressed +9.9% +14.9% -4.3% +30.0% ➖ noise
21 duckdb:vortex-compact +6.7% +14.9% -7.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -5.2% +14.9% -17.5% +30.0% ➖ noise
22 datafusion:vortex-compact -19.2% -14.6% -5.4% +63.0% ➖ noise
22 datafusion:vortex-file-compressed +37.6% -14.6% +61.1% +35.0% 🚨 regression
22 duckdb:vortex-compact +6.3% -14.6% +24.5% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -2.6% -14.6% +14.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.8%

datafusion / vortex-file-compressed (0.987x ➖, 1↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 23861765 25553524 0.93
tpcds_q02/datafusion:vortex-file-compressed 46592089 46600987 1.00
tpcds_q03/datafusion:vortex-file-compressed 14903680 15098181 0.99
tpcds_q04/datafusion:vortex-file-compressed 247949093 256543650 0.97
tpcds_q05/datafusion:vortex-file-compressed 43102478 43040357 1.00
tpcds_q06/datafusion:vortex-file-compressed 62530956 58172077 1.07
tpcds_q07/datafusion:vortex-file-compressed 40835871 41057132 0.99
tpcds_q08/datafusion:vortex-file-compressed 28381498 28538400 0.99
tpcds_q09/datafusion:vortex-file-compressed 43693772 44376170 0.98
tpcds_q10/datafusion:vortex-file-compressed 🚨 43879998 38725105 1.13
tpcds_q11/datafusion:vortex-file-compressed 128643752 127366688 1.01
tpcds_q12/datafusion:vortex-file-compressed 19040232 19203150 0.99
tpcds_q13/datafusion:vortex-file-compressed 43171933 45782381 0.94
tpcds_q14/datafusion:vortex-file-compressed 170506331 168818048 1.01
tpcds_q15/datafusion:vortex-file-compressed 28681896 28854672 0.99
tpcds_q16/datafusion:vortex-file-compressed 29110246 29519175 0.99
tpcds_q17/datafusion:vortex-file-compressed 61528428 61711380 1.00
tpcds_q18/datafusion:vortex-file-compressed 67874014 68354912 0.99
tpcds_q19/datafusion:vortex-file-compressed 21219323 22400258 0.95
tpcds_q20/datafusion:vortex-file-compressed 21898459 21170058 1.03
tpcds_q21/datafusion:vortex-file-compressed 36717168 35962208 1.02
tpcds_q22/datafusion:vortex-file-compressed 🚀 111495363 144876703 0.77
tpcds_q23/datafusion:vortex-file-compressed 145356294 146293805 0.99
tpcds_q24/datafusion:vortex-file-compressed 81701844 84039213 0.97
tpcds_q25/datafusion:vortex-file-compressed 66037010 66058789 1.00
tpcds_q26/datafusion:vortex-file-compressed 33040167 33739083 0.98
tpcds_q27/datafusion:vortex-file-compressed 104811609 103944442 1.01
tpcds_q28/datafusion:vortex-file-compressed 40936002 43157725 0.95
tpcds_q29/datafusion:vortex-file-compressed 60654589 63591657 0.95
tpcds_q30/datafusion:vortex-file-compressed 23240212 23085442 1.01
tpcds_q31/datafusion:vortex-file-compressed 73431750 74814233 0.98
tpcds_q32/datafusion:vortex-file-compressed 20244301 20046695 1.01
tpcds_q33/datafusion:vortex-file-compressed 29344949 29210062 1.00
tpcds_q34/datafusion:vortex-file-compressed 23692560 24217061 0.98
tpcds_q35/datafusion:vortex-file-compressed 43966804 44460100 0.99
tpcds_q36/datafusion:vortex-file-compressed 56242243 56255579 1.00
tpcds_q37/datafusion:vortex-file-compressed 25157075 25034844 1.00
tpcds_q38/datafusion:vortex-file-compressed 43174759 42948221 1.01
tpcds_q39/datafusion:vortex-file-compressed 102251537 103833628 0.98
tpcds_q40/datafusion:vortex-file-compressed 33091545 32855786 1.01
tpcds_q41/datafusion:vortex-file-compressed 15536419 15164235 1.02
tpcds_q42/datafusion:vortex-file-compressed 14095758 13930621 1.01
tpcds_q43/datafusion:vortex-file-compressed 18654912 18479463 1.01
tpcds_q44/datafusion:vortex-file-compressed 30705309 32368546 0.95
tpcds_q45/datafusion:vortex-file-compressed 27110151 26503841 1.02
tpcds_q46/datafusion:vortex-file-compressed 33885567 34829133 0.97
tpcds_q47/datafusion:vortex-file-compressed 130605139 128992315 1.01
tpcds_q48/datafusion:vortex-file-compressed 37967898 40930737 0.93
tpcds_q49/datafusion:vortex-file-compressed 57347279 58452491 0.98
tpcds_q50/datafusion:vortex-file-compressed 38338496 38443409 1.00
tpcds_q51/datafusion:vortex-file-compressed 87089302 86888199 1.00
tpcds_q52/datafusion:vortex-file-compressed 14258259 13814055 1.03
tpcds_q53/datafusion:vortex-file-compressed 21011910 20808271 1.01
tpcds_q54/datafusion:vortex-file-compressed 34502183 34616837 1.00
tpcds_q55/datafusion:vortex-file-compressed 13574999 13767886 0.99
tpcds_q56/datafusion:vortex-file-compressed 29857845 29329048 1.02
tpcds_q57/datafusion:vortex-file-compressed 105750270 112126318 0.94
tpcds_q58/datafusion:vortex-file-compressed 50833040 53020880 0.96
tpcds_q59/datafusion:vortex-file-compressed 56477568 56189660 1.01
tpcds_q60/datafusion:vortex-file-compressed 28738100 29338159 0.98
tpcds_q61/datafusion:vortex-file-compressed 39584628 40324184 0.98
tpcds_q62/datafusion:vortex-file-compressed 22501183 21930120 1.03
tpcds_q63/datafusion:vortex-file-compressed 20650575 21236531 0.97
tpcds_q64/datafusion:vortex-file-compressed 407650975 410650743 0.99
tpcds_q65/datafusion:vortex-file-compressed 39717422 40143927 0.99
tpcds_q66/datafusion:vortex-file-compressed 69434741 71190402 0.98
tpcds_q67/datafusion:vortex-file-compressed 143917332 138453503 1.04
tpcds_q68/datafusion:vortex-file-compressed 31924630 32791820 0.97
tpcds_q69/datafusion:vortex-file-compressed 35612321 35628078 1.00
tpcds_q70/datafusion:vortex-file-compressed 84151090 88739581 0.95
tpcds_q71/datafusion:vortex-file-compressed 22075088 22653179 0.97
tpcds_q72/datafusion:vortex-file-compressed 2093340950 2107817350 0.99
tpcds_q73/datafusion:vortex-file-compressed 22247641 22834931 0.97
tpcds_q74/datafusion:vortex-file-compressed 76468274 79091389 0.97
tpcds_q75/datafusion:vortex-file-compressed 104810789 110320532 0.95
tpcds_q76/datafusion:vortex-file-compressed 22747893 23470418 0.97
tpcds_q77/datafusion:vortex-file-compressed 38227347 39225048 0.97
tpcds_q78/datafusion:vortex-file-compressed 121720177 124020712 0.98
tpcds_q79/datafusion:vortex-file-compressed 27658189 28762131 0.96
tpcds_q80/datafusion:vortex-file-compressed 92568646 90966721 1.02
tpcds_q81/datafusion:vortex-file-compressed 23394547 23943267 0.98
tpcds_q82/datafusion:vortex-file-compressed 25513655 26371278 0.97
tpcds_q83/datafusion:vortex-file-compressed 32183613 33607323 0.96
tpcds_q84/datafusion:vortex-file-compressed 12378370 12565169 0.99
tpcds_q85/datafusion:vortex-file-compressed 93968517 97218897 0.97
tpcds_q86/datafusion:vortex-file-compressed 15411048 15810893 0.97
tpcds_q87/datafusion:vortex-file-compressed 42962715 43416309 0.99
tpcds_q88/datafusion:vortex-file-compressed 53929826 55474677 0.97
tpcds_q89/datafusion:vortex-file-compressed 24311176 24592110 0.99
tpcds_q90/datafusion:vortex-file-compressed 15314290 14759885 1.04
tpcds_q91/datafusion:vortex-file-compressed 17986285 17713271 1.02
tpcds_q92/datafusion:vortex-file-compressed 18527834 19275472 0.96
tpcds_q93/datafusion:vortex-file-compressed 32624148 33256286 0.98
tpcds_q94/datafusion:vortex-file-compressed 23025830 25497324 0.90
tpcds_q95/datafusion:vortex-file-compressed 61832518 61294339 1.01
tpcds_q96/datafusion:vortex-file-compressed 13360539 13168891 1.01
tpcds_q97/datafusion:vortex-file-compressed 31880541 31675899 1.01
tpcds_q98/datafusion:vortex-file-compressed 24189147 24791085 0.98
tpcds_q99/datafusion:vortex-file-compressed 33070201 32293969 1.02
datafusion / vortex-compact (0.986x ➖, 2↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 24838127 24617517 1.01
tpcds_q02/datafusion:vortex-compact 52233272 52756900 0.99
tpcds_q03/datafusion:vortex-compact 19498868 20088039 0.97
tpcds_q04/datafusion:vortex-compact 296708608 294854733 1.01
tpcds_q05/datafusion:vortex-compact 46315292 47451742 0.98
tpcds_q06/datafusion:vortex-compact 63788375 61286325 1.04
tpcds_q07/datafusion:vortex-compact 55179075 54156505 1.02
tpcds_q08/datafusion:vortex-compact 35015349 35188192 1.00
tpcds_q09/datafusion:vortex-compact 61987596 63475844 0.98
tpcds_q10/datafusion:vortex-compact 49823527 49726561 1.00
tpcds_q11/datafusion:vortex-compact 146557854 147654790 0.99
tpcds_q12/datafusion:vortex-compact 🚀 22406358 25454426 0.88
tpcds_q13/datafusion:vortex-compact 93562305 94140223 0.99
tpcds_q14/datafusion:vortex-compact 194282866 193782889 1.00
tpcds_q15/datafusion:vortex-compact 29715150 30911500 0.96
tpcds_q16/datafusion:vortex-compact 32259458 32504671 0.99
tpcds_q17/datafusion:vortex-compact 71803260 75530888 0.95
tpcds_q18/datafusion:vortex-compact 76585418 76296920 1.00
tpcds_q19/datafusion:vortex-compact 28617618 29528266 0.97
tpcds_q20/datafusion:vortex-compact 25524398 25402786 1.00
tpcds_q21/datafusion:vortex-compact 39681075 41614124 0.95
tpcds_q22/datafusion:vortex-compact 116436537 125930363 0.92
tpcds_q23/datafusion:vortex-compact 167873799 165613757 1.01
tpcds_q24/datafusion:vortex-compact 95091402 95496577 1.00
tpcds_q25/datafusion:vortex-compact 77801562 78718900 0.99
tpcds_q26/datafusion:vortex-compact 43750317 46954740 0.93
tpcds_q27/datafusion:vortex-compact 122486756 127271987 0.96
tpcds_q28/datafusion:vortex-compact 79572902 81919973 0.97
tpcds_q29/datafusion:vortex-compact 72204322 71613684 1.01
tpcds_q30/datafusion:vortex-compact 28633367 27657857 1.04
tpcds_q31/datafusion:vortex-compact 95821059 98039591 0.98
tpcds_q32/datafusion:vortex-compact 24764044 25345564 0.98
tpcds_q33/datafusion:vortex-compact 35304279 35861731 0.98
tpcds_q34/datafusion:vortex-compact 31751653 31923017 0.99
tpcds_q35/datafusion:vortex-compact 51191640 52025517 0.98
tpcds_q36/datafusion:vortex-compact 73153431 75779902 0.97
tpcds_q37/datafusion:vortex-compact 41385132 39562550 1.05
tpcds_q38/datafusion:vortex-compact 52894586 51632876 1.02
tpcds_q39/datafusion:vortex-compact 105517321 110573320 0.95
tpcds_q40/datafusion:vortex-compact 36730083 36193682 1.01
tpcds_q41/datafusion:vortex-compact 17361739 17444810 1.00
tpcds_q42/datafusion:vortex-compact 18144500 18333391 0.99
tpcds_q43/datafusion:vortex-compact 24183485 24583738 0.98
tpcds_q44/datafusion:vortex-compact 44859183 48242162 0.93
tpcds_q45/datafusion:vortex-compact 30161152 30888681 0.98
tpcds_q46/datafusion:vortex-compact 43469580 44077248 0.99
tpcds_q47/datafusion:vortex-compact 150742838 148744574 1.01
tpcds_q48/datafusion:vortex-compact 69236108 72038506 0.96
tpcds_q49/datafusion:vortex-compact 68319802 74250774 0.92
tpcds_q50/datafusion:vortex-compact 46983228 47967502 0.98
tpcds_q51/datafusion:vortex-compact 95890449 95781950 1.00
tpcds_q52/datafusion:vortex-compact 18391154 19796338 0.93
tpcds_q53/datafusion:vortex-compact 28693288 28810647 1.00
tpcds_q54/datafusion:vortex-compact 40908364 40991387 1.00
tpcds_q55/datafusion:vortex-compact 17774612 18178216 0.98
tpcds_q56/datafusion:vortex-compact 34520444 35727159 0.97
tpcds_q57/datafusion:vortex-compact 116311591 116447334 1.00
tpcds_q58/datafusion:vortex-compact 62913036 63416697 0.99
tpcds_q59/datafusion:vortex-compact 69174356 69306033 1.00
tpcds_q60/datafusion:vortex-compact 36302380 34778743 1.04
tpcds_q61/datafusion:vortex-compact 54519155 53285098 1.02
tpcds_q62/datafusion:vortex-compact 🚀 24249198 27933480 0.87
tpcds_q63/datafusion:vortex-compact 27637680 27746589 1.00
tpcds_q64/datafusion:vortex-compact 446512350 446151733 1.00
tpcds_q65/datafusion:vortex-compact 56488487 55498316 1.02
tpcds_q66/datafusion:vortex-compact 77040223 74234554 1.04
tpcds_q67/datafusion:vortex-compact 148139604 157625929 0.94
tpcds_q68/datafusion:vortex-compact 44036176 44414196 0.99
tpcds_q69/datafusion:vortex-compact 47156467 47778574 0.99
tpcds_q70/datafusion:vortex-compact 97404848 96986285 1.00
tpcds_q71/datafusion:vortex-compact 29862452 29649266 1.01
tpcds_q72/datafusion:vortex-compact 2101393237 2111007024 1.00
tpcds_q73/datafusion:vortex-compact 30641697 31078268 0.99
tpcds_q74/datafusion:vortex-compact 89797329 89086764 1.01
tpcds_q75/datafusion:vortex-compact 126488553 131002620 0.97
tpcds_q76/datafusion:vortex-compact 31790302 31350187 1.01
tpcds_q77/datafusion:vortex-compact 48304640 50579682 0.96
tpcds_q78/datafusion:vortex-compact 135844664 137402297 0.99
tpcds_q79/datafusion:vortex-compact 37941195 38430336 0.99
tpcds_q80/datafusion:vortex-compact 101975527 103667157 0.98
tpcds_q81/datafusion:vortex-compact 28984636 27259471 1.06
tpcds_q82/datafusion:vortex-compact 39958060 40526170 0.99
tpcds_q83/datafusion:vortex-compact 32445600 32787118 0.99
tpcds_q84/datafusion:vortex-compact 14132700 14963127 0.94
tpcds_q85/datafusion:vortex-compact 129055232 132824821 0.97
tpcds_q86/datafusion:vortex-compact 20561807 21880470 0.94
tpcds_q87/datafusion:vortex-compact 49774392 52704260 0.94
tpcds_q88/datafusion:vortex-compact 75375597 75888725 0.99
tpcds_q89/datafusion:vortex-compact 30211212 30349145 1.00
tpcds_q90/datafusion:vortex-compact 15266565 14945522 1.02
tpcds_q91/datafusion:vortex-compact 31540024 32491854 0.97
tpcds_q92/datafusion:vortex-compact 23683665 24650360 0.96
tpcds_q93/datafusion:vortex-compact 36828079 38043275 0.97
tpcds_q94/datafusion:vortex-compact 🚨 28834052 25946573 1.11
tpcds_q95/datafusion:vortex-compact 66660547 65476947 1.02
tpcds_q96/datafusion:vortex-compact 17047126 17261178 0.99
tpcds_q97/datafusion:vortex-compact 36727245 36809535 1.00
tpcds_q98/datafusion:vortex-compact 29316904 29728168 0.99
tpcds_q99/datafusion:vortex-compact 30488459 30583701 1.00
datafusion / parquet (0.995x ➖, 2↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30868742 29664760 1.04
tpcds_q02/datafusion:parquet 40813139 40801370 1.00
tpcds_q03/datafusion:parquet 12868347 12624283 1.02
tpcds_q04/datafusion:parquet 269841137 262383323 1.03
tpcds_q05/datafusion:parquet 39495830 40602464 0.97
tpcds_q06/datafusion:parquet 57854121 59076288 0.98
tpcds_q07/datafusion:parquet 75555643 77395453 0.98
tpcds_q08/datafusion:parquet 25891960 25059004 1.03
tpcds_q09/datafusion:parquet 45346400 42687645 1.06
tpcds_q10/datafusion:parquet 70157676 65865088 1.07
tpcds_q11/datafusion:parquet 146482628 146979768 1.00
tpcds_q12/datafusion:parquet 17673553 16666666 1.06
tpcds_q13/datafusion:parquet 73591359 73526440 1.00
tpcds_q14/datafusion:parquet 157229474 156852677 1.00
tpcds_q15/datafusion:parquet 20404761 20832040 0.98
tpcds_q16/datafusion:parquet 22956181 22577519 1.02
tpcds_q17/datafusion:parquet 60202085 62736423 0.96
tpcds_q18/datafusion:parquet 110679220 119666221 0.92
tpcds_q19/datafusion:parquet 22200936 21862137 1.02
tpcds_q20/datafusion:parquet 16060495 16064674 1.00
tpcds_q21/datafusion:parquet 17931371 18078370 0.99
tpcds_q22/datafusion:parquet 152055529 146261081 1.04
tpcds_q23/datafusion:parquet 144179043 141752365 1.02
tpcds_q24/datafusion:parquet 87823112 87519160 1.00
tpcds_q25/datafusion:parquet 62753709 64355794 0.98
tpcds_q26/datafusion:parquet 64191955 65048381 0.99
tpcds_q27/datafusion:parquet 140753745 140299162 1.00
tpcds_q28/datafusion:parquet 44230026 43991267 1.01
tpcds_q29/datafusion:parquet 64112676 64120289 1.00
tpcds_q30/datafusion:parquet 32988355 33345675 0.99
tpcds_q31/datafusion:parquet 63085321 63642117 0.99
tpcds_q32/datafusion:parquet 17319587 17298107 1.00
tpcds_q33/datafusion:parquet 25701576 26630838 0.97
tpcds_q34/datafusion:parquet 19458556 21160632 0.92
tpcds_q35/datafusion:parquet 65267529 67733494 0.96
tpcds_q36/datafusion:parquet 55377798 54860516 1.01
tpcds_q37/datafusion:parquet 18776617 18334362 1.02
tpcds_q38/datafusion:parquet 38765004 39890215 0.97
tpcds_q39/datafusion:parquet 71030402 71617035 0.99
tpcds_q40/datafusion:parquet 23618024 23013108 1.03
tpcds_q41/datafusion:parquet 13157903 13035145 1.01
tpcds_q42/datafusion:parquet 11085796 11198664 0.99
tpcds_q43/datafusion:parquet 16418192 16710489 0.98
tpcds_q44/datafusion:parquet 32211352 34006717 0.95
tpcds_q45/datafusion:parquet 28044271 27705547 1.01
tpcds_q46/datafusion:parquet 30933160 31438184 0.98
tpcds_q47/datafusion:parquet 122286907 122230147 1.00
tpcds_q48/datafusion:parquet 67014248 68869798 0.97
tpcds_q49/datafusion:parquet 53855465 54447510 0.99
tpcds_q50/datafusion:parquet 44041416 42508307 1.04
tpcds_q51/datafusion:parquet 83058813 83957944 0.99
tpcds_q52/datafusion:parquet 🚀 11435779 12725089 0.90
tpcds_q53/datafusion:parquet 17385303 16970454 1.02
tpcds_q54/datafusion:parquet 32810733 33139089 0.99
tpcds_q55/datafusion:parquet 11328540 10665659 1.06
tpcds_q56/datafusion:parquet 25952645 26614563 0.98
tpcds_q57/datafusion:parquet 95805099 99977947 0.96
tpcds_q58/datafusion:parquet 49232366 47936190 1.03
tpcds_q59/datafusion:parquet 56802637 56183867 1.01
tpcds_q60/datafusion:parquet 26171398 27291777 0.96
tpcds_q61/datafusion:parquet 41989639 41572395 1.01
tpcds_q62/datafusion:parquet 25644716 24336643 1.05
tpcds_q63/datafusion:parquet 17302753 17351029 1.00
tpcds_q64/datafusion:parquet 510422820 507358694 1.01
tpcds_q65/datafusion:parquet 37189824 36774956 1.01
tpcds_q66/datafusion:parquet 71346541 69234398 1.03
tpcds_q67/datafusion:parquet 141569220 139534486 1.01
tpcds_q68/datafusion:parquet 31268924 31717234 0.99
tpcds_q69/datafusion:parquet 64508972 64046541 1.01
tpcds_q70/datafusion:parquet 83483799 87092455 0.96
tpcds_q71/datafusion:parquet 21889495 21897720 1.00
tpcds_q72/datafusion:parquet 592428106 594528446 1.00
tpcds_q73/datafusion:parquet 19950976 20458592 0.98
tpcds_q74/datafusion:parquet 78904252 79255582 1.00
tpcds_q75/datafusion:parquet 96692267 95555057 1.01
tpcds_q76/datafusion:parquet 28472657 28872767 0.99
tpcds_q77/datafusion:parquet 37986663 37744103 1.01
tpcds_q78/datafusion:parquet 113397523 110291437 1.03
tpcds_q79/datafusion:parquet 25526040 26159955 0.98
tpcds_q80/datafusion:parquet 77480795 76878595 1.01
tpcds_q81/datafusion:parquet 30297123 30938838 0.98
tpcds_q82/datafusion:parquet 18803119 18607048 1.01
tpcds_q83/datafusion:parquet 35071796 35980858 0.97
tpcds_q84/datafusion:parquet 37499571 38592559 0.97
tpcds_q85/datafusion:parquet 146101819 147751256 0.99
tpcds_q86/datafusion:parquet 13499627 14524869 0.93
tpcds_q87/datafusion:parquet 39420896 39878138 0.99
tpcds_q88/datafusion:parquet 59407050 57877981 1.03
tpcds_q89/datafusion:parquet 21129955 20345963 1.04
tpcds_q90/datafusion:parquet 13792406 14048467 0.98
tpcds_q91/datafusion:parquet 55396352 57106724 0.97
tpcds_q92/datafusion:parquet 17774860 17295389 1.03
tpcds_q93/datafusion:parquet 30529369 30939423 0.99
tpcds_q94/datafusion:parquet 20195287 19251692 1.05
tpcds_q95/datafusion:parquet 58301856 58453288 1.00
tpcds_q96/datafusion:parquet 11284674 11488075 0.98
tpcds_q97/datafusion:parquet 29111358 29828805 0.98
tpcds_q98/datafusion:parquet 20523086 21171319 0.97
tpcds_q99/datafusion:parquet 🚀 28636272 33268520 0.86
duckdb / vortex-file-compressed (0.990x ➖, 0↑ 2↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21249308 21716720 0.98
tpcds_q02/duckdb:vortex-file-compressed 33792438 36758783 0.92
tpcds_q03/duckdb:vortex-file-compressed 32406365 30682555 1.06
tpcds_q04/duckdb:vortex-file-compressed 101788083 108500750 0.94
tpcds_q05/duckdb:vortex-file-compressed 36711711 35550650 1.03
tpcds_q06/duckdb:vortex-file-compressed 30974149 31521727 0.98
tpcds_q07/duckdb:vortex-file-compressed 18742591 19787470 0.95
tpcds_q08/duckdb:vortex-file-compressed 27783038 28122810 0.99
tpcds_q09/duckdb:vortex-file-compressed 36601569 37833242 0.97
tpcds_q10/duckdb:vortex-file-compressed 39749146 40563220 0.98
tpcds_q11/duckdb:vortex-file-compressed 60144712 61736894 0.97
tpcds_q12/duckdb:vortex-file-compressed 13797324 14175403 0.97
tpcds_q13/duckdb:vortex-file-compressed 32585805 33452972 0.97
tpcds_q14/duckdb:vortex-file-compressed 104239230 106017881 0.98
tpcds_q15/duckdb:vortex-file-compressed 25870476 26816388 0.96
tpcds_q16/duckdb:vortex-file-compressed 26323829 26645152 0.99
tpcds_q17/duckdb:vortex-file-compressed 42653635 42742010 1.00
tpcds_q18/duckdb:vortex-file-compressed 44934596 47679069 0.94
tpcds_q19/duckdb:vortex-file-compressed 32776293 32763546 1.00
tpcds_q20/duckdb:vortex-file-compressed 15329264 15063541 1.02
tpcds_q21/duckdb:vortex-file-compressed 16219999 17053140 0.95
tpcds_q22/duckdb:vortex-file-compressed 71315503 71831529 0.99
tpcds_q23/duckdb:vortex-file-compressed 108150902 108946467 0.99
tpcds_q24/duckdb:vortex-file-compressed 51145051 50935365 1.00
tpcds_q25/duckdb:vortex-file-compressed 49501940 48116172 1.03
tpcds_q26/duckdb:vortex-file-compressed 37959126 40191824 0.94
tpcds_q27/duckdb:vortex-file-compressed 46108052 50300558 0.92
tpcds_q28/duckdb:vortex-file-compressed 34110984 34249878 1.00
tpcds_q29/duckdb:vortex-file-compressed 41526906 41300366 1.01
tpcds_q30/duckdb:vortex-file-compressed 23405071 23587249 0.99
tpcds_q31/duckdb:vortex-file-compressed 35297646 36163830 0.98
tpcds_q32/duckdb:vortex-file-compressed 13598590 14543250 0.94
tpcds_q33/duckdb:vortex-file-compressed 23373196 23822384 0.98
tpcds_q34/duckdb:vortex-file-compressed 23189538 22663459 1.02
tpcds_q35/duckdb:vortex-file-compressed 64449219 63853315 1.01
tpcds_q36/duckdb:vortex-file-compressed 24631085 24508268 1.01
tpcds_q37/duckdb:vortex-file-compressed 14703852 15740929 0.93
tpcds_q38/duckdb:vortex-file-compressed 37505053 36378515 1.03
tpcds_q39/duckdb:vortex-file-compressed 34715331 35048222 0.99
tpcds_q40/duckdb:vortex-file-compressed 20099327 19602130 1.03
tpcds_q41/duckdb:vortex-file-compressed 12789076 12876846 0.99
tpcds_q42/duckdb:vortex-file-compressed 12747868 13024560 0.98
tpcds_q43/duckdb:vortex-file-compressed 22796994 23245782 0.98
tpcds_q44/duckdb:vortex-file-compressed 20896006 20738325 1.01
tpcds_q45/duckdb:vortex-file-compressed 28679240 29293481 0.98
tpcds_q46/duckdb:vortex-file-compressed 50824903 51199383 0.99
tpcds_q47/duckdb:vortex-file-compressed 44776249 46932490 0.95
tpcds_q48/duckdb:vortex-file-compressed 29701013 29885878 0.99
tpcds_q49/duckdb:vortex-file-compressed 🚨 37417686 32998191 1.13
tpcds_q50/duckdb:vortex-file-compressed 33532867 33012126 1.02
tpcds_q51/duckdb:vortex-file-compressed 94923112 97604979 0.97
tpcds_q52/duckdb:vortex-file-compressed 12951637 12450905 1.04
tpcds_q53/duckdb:vortex-file-compressed 22507531 21951614 1.03
tpcds_q54/duckdb:vortex-file-compressed 27462159 28304218 0.97
tpcds_q55/duckdb:vortex-file-compressed 13105281 13091663 1.00
tpcds_q56/duckdb:vortex-file-compressed 23399962 23812380 0.98
tpcds_q57/duckdb:vortex-file-compressed 39150925 39534732 0.99
tpcds_q58/duckdb:vortex-file-compressed 31373381 30715897 1.02
tpcds_q59/duckdb:vortex-file-compressed 67843840 66783555 1.02
tpcds_q60/duckdb:vortex-file-compressed 25503530 25487588 1.00
tpcds_q61/duckdb:vortex-file-compressed 🚨 34363487 29885194 1.15
tpcds_q62/duckdb:vortex-file-compressed 17628028 16898514 1.04
tpcds_q63/duckdb:vortex-file-compressed 21236789 21133824 1.00
tpcds_q64/duckdb:vortex-file-compressed 79188273 84069216 0.94
tpcds_q65/duckdb:vortex-file-compressed 21501360 20997290 1.02
tpcds_q66/duckdb:vortex-file-compressed 28841040 28771748 1.00
tpcds_q67/duckdb:vortex-file-compressed 135145940 137442440 0.98
tpcds_q68/duckdb:vortex-file-compressed 39738178 41563526 0.96
tpcds_q69/duckdb:vortex-file-compressed 41754790 40771019 1.02
tpcds_q70/duckdb:vortex-file-compressed 24726384 26157865 0.95
tpcds_q71/duckdb:vortex-file-compressed 21551140 20277906 1.06
tpcds_q72/duckdb:vortex-file-compressed 173294104 173054815 1.00
tpcds_q73/duckdb:vortex-file-compressed 23484979 22634253 1.04
tpcds_q74/duckdb:vortex-file-compressed 71265139 78546799 0.91
tpcds_q75/duckdb:vortex-file-compressed 59053179 57791067 1.02
tpcds_q76/duckdb:vortex-file-compressed 18385997 20262721 0.91
tpcds_q77/duckdb:vortex-file-compressed 24960768 24710411 1.01
tpcds_q78/duckdb:vortex-file-compressed 75688651 77047865 0.98
tpcds_q79/duckdb:vortex-file-compressed 32114222 32377764 0.99
tpcds_q80/duckdb:vortex-file-compressed 43908702 48383066 0.91
tpcds_q81/duckdb:vortex-file-compressed 27199495 28123689 0.97
tpcds_q82/duckdb:vortex-file-compressed 16430670 16556155 0.99
tpcds_q83/duckdb:vortex-file-compressed 22642437 23257215 0.97
tpcds_q84/duckdb:vortex-file-compressed 18436503 19587100 0.94
tpcds_q85/duckdb:vortex-file-compressed 45118793 43035728 1.05
tpcds_q86/duckdb:vortex-file-compressed 16188449 16281290 0.99
tpcds_q87/duckdb:vortex-file-compressed 39481524 41858364 0.94
tpcds_q88/duckdb:vortex-file-compressed 32671036 33556285 0.97
tpcds_q89/duckdb:vortex-file-compressed 21861196 22209368 0.98
tpcds_q90/duckdb:vortex-file-compressed 12139817 12623414 0.96
tpcds_q91/duckdb:vortex-file-compressed 30586827 30097350 1.02
tpcds_q92/duckdb:vortex-file-compressed 21505842 20127423 1.07
tpcds_q93/duckdb:vortex-file-compressed 26939495 27408864 0.98
tpcds_q94/duckdb:vortex-file-compressed 23842752 23568010 1.01
tpcds_q95/duckdb:vortex-file-compressed 143019266 142875533 1.00
tpcds_q96/duckdb:vortex-file-compressed 12963976 13901181 0.93
tpcds_q97/duckdb:vortex-file-compressed 38173197 36997119 1.03
tpcds_q98/duckdb:vortex-file-compressed 17823224 17319547 1.03
tpcds_q99/duckdb:vortex-file-compressed 26849846 27159491 0.99
duckdb / vortex-compact (0.995x ➖, 2↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 23435099 23925045 0.98
tpcds_q02/duckdb:vortex-compact 42508620 42217207 1.01
tpcds_q03/duckdb:vortex-compact 56624474 56771634 1.00
tpcds_q04/duckdb:vortex-compact 118621230 112405601 1.06
tpcds_q05/duckdb:vortex-compact 51462446 53440732 0.96
tpcds_q06/duckdb:vortex-compact 39545704 41974426 0.94
tpcds_q07/duckdb:vortex-compact 34703303 34235803 1.01
tpcds_q08/duckdb:vortex-compact 45473603 44102466 1.03
tpcds_q09/duckdb:vortex-compact 56813310 58578818 0.97
tpcds_q10/duckdb:vortex-compact 62810206 59979592 1.05
tpcds_q11/duckdb:vortex-compact 71082057 69912702 1.02
tpcds_q12/duckdb:vortex-compact 21697325 22131370 0.98
tpcds_q13/duckdb:vortex-compact 60316934 57730021 1.04
tpcds_q14/duckdb:vortex-compact 128359225 127899852 1.00
tpcds_q15/duckdb:vortex-compact 30781900 30954457 0.99
tpcds_q16/duckdb:vortex-compact 30313191 30434785 1.00
tpcds_q17/duckdb:vortex-compact 51968293 54703078 0.95
tpcds_q18/duckdb:vortex-compact 57623908 56180924 1.03
tpcds_q19/duckdb:vortex-compact 50726140 50311694 1.01
tpcds_q20/duckdb:vortex-compact 19127485 20331499 0.94
tpcds_q21/duckdb:vortex-compact 19516302 18758068 1.04
tpcds_q22/duckdb:vortex-compact 73089969 78412566 0.93
tpcds_q23/duckdb:vortex-compact 119418008 119762629 1.00
tpcds_q24/duckdb:vortex-compact 61301771 62653485 0.98
tpcds_q25/duckdb:vortex-compact 81740300 80942482 1.01
tpcds_q26/duckdb:vortex-compact 50783699 51080577 0.99
tpcds_q27/duckdb:vortex-compact 67768964 69570120 0.97
tpcds_q28/duckdb:vortex-compact 83492061 83958051 0.99
tpcds_q29/duckdb:vortex-compact 53394095 54378143 0.98
tpcds_q30/duckdb:vortex-compact 28363715 27828704 1.02
tpcds_q31/duckdb:vortex-compact 44798070 43800033 1.02
tpcds_q32/duckdb:vortex-compact 22013615 22740733 0.97
tpcds_q33/duckdb:vortex-compact 34643820 35243028 0.98
tpcds_q34/duckdb:vortex-compact 37321154 36318120 1.03
tpcds_q35/duckdb:vortex-compact 81803093 81827018 1.00
tpcds_q36/duckdb:vortex-compact 40575836 40226710 1.01
tpcds_q37/duckdb:vortex-compact 23197030 23092254 1.00
tpcds_q38/duckdb:vortex-compact 47814012 46480620 1.03
tpcds_q39/duckdb:vortex-compact 36379644 36512112 1.00
tpcds_q40/duckdb:vortex-compact 25607328 24664415 1.04
tpcds_q41/duckdb:vortex-compact 15165800 15348923 0.99
tpcds_q42/duckdb:vortex-compact 21763348 21824973 1.00
tpcds_q43/duckdb:vortex-compact 35460784 35623690 1.00
tpcds_q44/duckdb:vortex-compact 29272561 28831248 1.02
tpcds_q45/duckdb:vortex-compact 37133779 37605991 0.99
tpcds_q46/duckdb:vortex-compact 72548505 69064115 1.05
tpcds_q47/duckdb:vortex-compact 62044713 62025892 1.00
tpcds_q48/duckdb:vortex-compact 50306009 52840265 0.95
tpcds_q49/duckdb:vortex-compact 53949757 57861751 0.93
tpcds_q50/duckdb:vortex-compact 47381704 46887883 1.01
tpcds_q51/duckdb:vortex-compact 104059444 106811968 0.97
tpcds_q52/duckdb:vortex-compact 21457717 21789208 0.98
tpcds_q53/duckdb:vortex-compact 38147573 37260504 1.02
tpcds_q54/duckdb:vortex-compact 36944821 39866386 0.93
tpcds_q55/duckdb:vortex-compact 21617139 23410594 0.92
tpcds_q56/duckdb:vortex-compact 34876057 35478154 0.98
tpcds_q57/duckdb:vortex-compact 43322799 42568432 1.02
tpcds_q58/duckdb:vortex-compact 43035024 43037724 1.00
tpcds_q59/duckdb:vortex-compact 86679149 85987451 1.01
tpcds_q60/duckdb:vortex-compact 37649472 36619209 1.03
tpcds_q61/duckdb:vortex-compact 65396173 64132115 1.02
tpcds_q62/duckdb:vortex-compact 27208989 25785517 1.06
tpcds_q63/duckdb:vortex-compact 37148227 35914596 1.03
tpcds_q64/duckdb:vortex-compact 112154220 116314029 0.96
tpcds_q65/duckdb:vortex-compact 32623194 33026036 0.99
tpcds_q66/duckdb:vortex-compact 🚀 37484863 42469891 0.88
tpcds_q67/duckdb:vortex-compact 152530685 153345982 0.99
tpcds_q68/duckdb:vortex-compact 59537989 60626569 0.98
tpcds_q69/duckdb:vortex-compact 60327790 61195449 0.99
tpcds_q70/duckdb:vortex-compact 35086237 35915380 0.98
tpcds_q71/duckdb:vortex-compact 34052664 33918146 1.00
tpcds_q72/duckdb:vortex-compact 190175552 192596668 0.99
tpcds_q73/duckdb:vortex-compact 37365457 36530174 1.02
tpcds_q74/duckdb:vortex-compact 82147095 81942058 1.00
tpcds_q75/duckdb:vortex-compact 72101445 69732374 1.03
tpcds_q76/duckdb:vortex-compact 34035166 35756020 0.95
tpcds_q77/duckdb:vortex-compact 42980218 40113789 1.07
tpcds_q78/duckdb:vortex-compact 87525799 89303644 0.98
tpcds_q79/duckdb:vortex-compact 52800743 53413189 0.99
tpcds_q80/duckdb:vortex-compact 79639319 81272183 0.98
tpcds_q81/duckdb:vortex-compact 31990152 34352555 0.93
tpcds_q82/duckdb:vortex-compact 🚀 23772938 26629475 0.89
tpcds_q83/duckdb:vortex-compact 33228919 33366488 1.00
tpcds_q84/duckdb:vortex-compact 26626625 26371370 1.01
tpcds_q85/duckdb:vortex-compact 55809025 60970462 0.92
tpcds_q86/duckdb:vortex-compact 22621162 23394651 0.97
tpcds_q87/duckdb:vortex-compact 52840689 50476248 1.05
tpcds_q88/duckdb:vortex-compact 38794571 40124130 0.97
tpcds_q89/duckdb:vortex-compact 36247015 36823654 0.98
tpcds_q90/duckdb:vortex-compact 14826214 15163218 0.98
tpcds_q91/duckdb:vortex-compact 50782018 49308513 1.03
tpcds_q92/duckdb:vortex-compact 48912524 53066642 0.92
tpcds_q93/duckdb:vortex-compact 30993391 31126547 1.00
tpcds_q94/duckdb:vortex-compact 31456969 29539497 1.06
tpcds_q95/duckdb:vortex-compact 150020682 145195248 1.03
tpcds_q96/duckdb:vortex-compact 18520904 18121949 1.02
tpcds_q97/duckdb:vortex-compact 45818703 44552305 1.03
tpcds_q98/duckdb:vortex-compact 28334706 28064987 1.01
tpcds_q99/duckdb:vortex-compact 33413127 30647000 1.09
duckdb / parquet (1.002x ➖, 1↑ 3↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚨 31327584 27746890 1.13
tpcds_q02/duckdb:parquet 23861270 23652637 1.01
tpcds_q03/duckdb:parquet 10932550 11021228 0.99
tpcds_q04/duckdb:parquet 163232472 168623319 0.97
tpcds_q05/duckdb:parquet 29946100 28414288 1.05
tpcds_q06/duckdb:parquet 26955855 28439660 0.95
tpcds_q07/duckdb:parquet 20803103 20465716 1.02
tpcds_q08/duckdb:parquet 26212280 26148991 1.00
tpcds_q09/duckdb:parquet 38801189 39187605 0.99
tpcds_q10/duckdb:parquet 33277500 32730492 1.02
tpcds_q11/duckdb:parquet 83773302 86735498 0.97
tpcds_q12/duckdb:parquet 14497038 14149603 1.02
tpcds_q13/duckdb:parquet 33004864 32565745 1.01
tpcds_q14/duckdb:parquet 98355015 97211948 1.01
tpcds_q15/duckdb:parquet 29439294 30094539 0.98
tpcds_q16/duckdb:parquet 20933286 21678339 0.97
tpcds_q17/duckdb:parquet 37646403 38544658 0.98
tpcds_q18/duckdb:parquet 45094356 45944055 0.98
tpcds_q19/duckdb:parquet 27901343 28854661 0.97
tpcds_q20/duckdb:parquet 15222025 15419179 0.99
tpcds_q21/duckdb:parquet 10074267 10110578 1.00
tpcds_q22/duckdb:parquet 69284892 66245209 1.05
tpcds_q23/duckdb:parquet 82579246 80037232 1.03
tpcds_q24/duckdb:parquet 44398139 44174280 1.01
tpcds_q25/duckdb:parquet 32481192 32031761 1.01
tpcds_q26/duckdb:parquet 35885502 35035275 1.02
tpcds_q27/duckdb:parquet 47493633 48179166 0.99
tpcds_q28/duckdb:parquet 37101659 37733152 0.98
tpcds_q29/duckdb:parquet 35793247 35280466 1.01
tpcds_q30/duckdb:parquet 33469028 33834952 0.99
tpcds_q31/duckdb:parquet 22483736 22841711 0.98
tpcds_q32/duckdb:parquet 11116467 10790365 1.03
tpcds_q33/duckdb:parquet 20604630 20792489 0.99
tpcds_q34/duckdb:parquet 19908307 19933137 1.00
tpcds_q35/duckdb:parquet 56300543 57672933 0.98
tpcds_q36/duckdb:parquet 19328186 19360139 1.00
tpcds_q37/duckdb:parquet 12177313 11896450 1.02
tpcds_q38/duckdb:parquet 34122300 33434779 1.02
tpcds_q39/duckdb:parquet 28859366 28899169 1.00
tpcds_q40/duckdb:parquet 17287541 17755925 0.97
tpcds_q41/duckdb:parquet 7617098 7658013 0.99
tpcds_q42/duckdb:parquet 9375605 8984586 1.04
tpcds_q43/duckdb:parquet 14998227 15093120 0.99
tpcds_q44/duckdb:parquet 21730370 22047770 0.99
tpcds_q45/duckdb:parquet 25198494 26150985 0.96
tpcds_q46/duckdb:parquet 43037517 43572405 0.99
tpcds_q47/duckdb:parquet 43517383 44842899 0.97
tpcds_q48/duckdb:parquet 28768161 29046519 0.99
tpcds_q49/duckdb:parquet 24997813 24393344 1.02
tpcds_q50/duckdb:parquet 23723455 23846463 0.99
tpcds_q51/duckdb:parquet 92925561 94259570 0.99
tpcds_q52/duckdb:parquet 10157402 11045738 0.92
tpcds_q53/duckdb:parquet 14760431 14948541 0.99
tpcds_q54/duckdb:parquet 23719733 25562553 0.93
tpcds_q55/duckdb:parquet 9612461 9899184 0.97
tpcds_q56/duckdb:parquet 20911189 20664865 1.01
tpcds_q57/duckdb:parquet 34278417 35624022 0.96
tpcds_q58/duckdb:parquet 21324486 22289001 0.96
tpcds_q59/duckdb:parquet 35230383 35059690 1.00
tpcds_q60/duckdb:parquet 22238939 21234450 1.05
tpcds_q61/duckdb:parquet 29765340 31303338 0.95
tpcds_q62/duckdb:parquet 🚨 12671655 11281742 1.12
tpcds_q63/duckdb:parquet 13676304 13854369 0.99
tpcds_q64/duckdb:parquet 73328764 73888911 0.99
tpcds_q65/duckdb:parquet 19276353 19212929 1.00
tpcds_q66/duckdb:parquet 32052687 30176655 1.06
tpcds_q67/duckdb:parquet 134177334 131921125 1.02
tpcds_q68/duckdb:parquet 35068724 36484601 0.96
tpcds_q69/duckdb:parquet 35184534 35795183 0.98
tpcds_q70/duckdb:parquet 18837096 18906478 1.00
tpcds_q71/duckdb:parquet 19231033 18838860 1.02
tpcds_q72/duckdb:parquet 163590027 164086072 1.00
tpcds_q73/duckdb:parquet 17442366 17169024 1.02
tpcds_q74/duckdb:parquet 125252633 124439349 1.01
tpcds_q75/duckdb:parquet 53020070 51877237 1.02
tpcds_q76/duckdb:parquet 19750226 19243838 1.03
tpcds_q77/duckdb:parquet 21471266 21285778 1.01
tpcds_q78/duckdb:parquet 72582692 71953988 1.01
tpcds_q79/duckdb:parquet 27076878 25850001 1.05
tpcds_q80/duckdb:parquet 39387392 39491453 1.00
tpcds_q81/duckdb:parquet 31334832 31837019 0.98
tpcds_q82/duckdb:parquet 13842410 12772507 1.08
tpcds_q83/duckdb:parquet 16235554 16254817 1.00
tpcds_q84/duckdb:parquet 18394633 18654247 0.99
tpcds_q85/duckdb:parquet 37471609 36867600 1.02
tpcds_q86/duckdb:parquet 12060618 11770960 1.02
tpcds_q87/duckdb:parquet 37500051 35394551 1.06
tpcds_q88/duckdb:parquet 48348049 47562689 1.02
tpcds_q89/duckdb:parquet 16141908 15795663 1.02
tpcds_q90/duckdb:parquet 7040219 7173702 0.98
tpcds_q91/duckdb:parquet 23441264 22235271 1.05
tpcds_q92/duckdb:parquet 10937169 10683104 1.02
tpcds_q93/duckdb:parquet 28612658 29236215 0.98
tpcds_q94/duckdb:parquet 16260056 16114054 1.01
tpcds_q95/duckdb:parquet 🚨 138477660 116806171 1.19
tpcds_q96/duckdb:parquet 🚀 8214169 9152447 0.90
tpcds_q97/duckdb:parquet 32837160 33601516 0.98
tpcds_q98/duckdb:parquet 17212171 17665439 0.97
tpcds_q99/duckdb:parquet 19757040 20225414 0.98
duckdb / duckdb (0.999x ➖, 1↑ 3↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20312869 20213803 1.00
tpcds_q02/duckdb:duckdb 18628884 18800873 0.99
tpcds_q03/duckdb:duckdb 8500450 8600394 0.99
tpcds_q04/duckdb:duckdb 169688593 177989449 0.95
tpcds_q05/duckdb:duckdb 19038885 19504902 0.98
tpcds_q06/duckdb:duckdb 21990554 22889233 0.96
tpcds_q07/duckdb:duckdb 37055924 37761487 0.98
tpcds_q08/duckdb:duckdb 119648689 120430823 0.99
tpcds_q09/duckdb:duckdb 19753310 19704089 1.00
tpcds_q10/duckdb:duckdb 23222275 23225238 1.00
tpcds_q11/duckdb:duckdb 86229163 91731906 0.94
tpcds_q12/duckdb:duckdb 10804042 11124914 0.97
tpcds_q13/duckdb:duckdb 23912395 24334797 0.98
tpcds_q14/duckdb:duckdb 89467379 93726153 0.95
tpcds_q15/duckdb:duckdb 23621845 24702038 0.96
tpcds_q16/duckdb:duckdb 17359602 18136081 0.96
tpcds_q17/duckdb:duckdb 22000665 22834574 0.96
tpcds_q18/duckdb:duckdb 44880690 44412387 1.01
tpcds_q19/duckdb:duckdb 16482128 16604742 0.99
tpcds_q20/duckdb:duckdb 11103517 12008467 0.92
tpcds_q21/duckdb:duckdb 🚀 6293758 7063719 0.89
tpcds_q22/duckdb:duckdb 59345978 61249419 0.97
tpcds_q23/duckdb:duckdb 79842928 74538724 1.07
tpcds_q24/duckdb:duckdb 23845152 23955885 1.00
tpcds_q25/duckdb:duckdb 16473487 16666923 0.99
tpcds_q26/duckdb:duckdb 27570740 26517871 1.04
tpcds_q27/duckdb:duckdb 35941354 36774256 0.98
tpcds_q28/duckdb:duckdb 22217476 22319399 1.00
tpcds_q29/duckdb:duckdb 21136038 20363219 1.04
tpcds_q30/duckdb:duckdb 28633327 29808416 0.96
tpcds_q31/duckdb:duckdb 49307729 47699338 1.03
tpcds_q32/duckdb:duckdb 7967070 7302721 1.09
tpcds_q33/duckdb:duckdb 12714109 12894436 0.99
tpcds_q34/duckdb:duckdb 14759152 14795461 1.00
tpcds_q35/duckdb:duckdb 31653713 32395272 0.98
tpcds_q36/duckdb:duckdb 69251632 69223391 1.00
tpcds_q37/duckdb:duckdb 7379591 7757386 0.95
tpcds_q38/duckdb:duckdb 30319197 29758082 1.02
tpcds_q39/duckdb:duckdb 🚨 32545727 25884070 1.26
tpcds_q40/duckdb:duckdb 14005172 13015964 1.08
tpcds_q41/duckdb:duckdb 8328384 8588669 0.97
tpcds_q42/duckdb:duckdb 6444129 6402473 1.01
tpcds_q43/duckdb:duckdb 11313027 12122245 0.93
tpcds_q44/duckdb:duckdb 13347853 14712929 0.91
tpcds_q45/duckdb:duckdb 17648062 16943238 1.04
tpcds_q46/duckdb:duckdb 39685139 37337525 1.06
tpcds_q47/duckdb:duckdb 39301849 39158653 1.00
tpcds_q48/duckdb:duckdb 23321470 23002986 1.01
tpcds_q49/duckdb:duckdb 17112656 16950891 1.01
tpcds_q50/duckdb:duckdb 14059981 14001301 1.00
tpcds_q51/duckdb:duckdb 90105107 90866084 0.99
tpcds_q52/duckdb:duckdb 7119703 7153148 1.00
tpcds_q53/duckdb:duckdb 12910738 13330618 0.97
tpcds_q54/duckdb:duckdb 16479892 16260597 1.01
tpcds_q55/duckdb:duckdb 7656167 7364569 1.04
tpcds_q56/duckdb:duckdb 13428020 13186859 1.02
tpcds_q57/duckdb:duckdb 32608971 32563546 1.00
tpcds_q58/duckdb:duckdb 12230354 13180434 0.93
tpcds_q59/duckdb:duckdb 35423526 34603137 1.02
tpcds_q60/duckdb:duckdb 14831075 15221154 0.97
tpcds_q61/duckdb:duckdb 14713955 15196731 0.97
tpcds_q62/duckdb:duckdb 9602516 9356503 1.03
tpcds_q63/duckdb:duckdb 12439592 12149430 1.02
tpcds_q64/duckdb:duckdb 55008714 54635029 1.01
tpcds_q65/duckdb:duckdb 34276773 34655902 0.99
tpcds_q66/duckdb:duckdb 25471304 25277139 1.01
tpcds_q67/duckdb:duckdb 128059502 127169374 1.01
tpcds_q68/duckdb:duckdb 26382250 25075441 1.05
tpcds_q69/duckdb:duckdb 23401386 25126584 0.93
tpcds_q70/duckdb:duckdb 14499720 14740872 0.98
tpcds_q71/duckdb:duckdb 12069767 12127866 1.00
tpcds_q72/duckdb:duckdb 43515294 43311682 1.00
tpcds_q73/duckdb:duckdb 10533629 10946502 0.96
tpcds_q74/duckdb:duckdb 144804811 144415289 1.00
tpcds_q75/duckdb:duckdb 42172439 41117608 1.03
tpcds_q76/duckdb:duckdb 11819516 12189022 0.97
tpcds_q77/duckdb:duckdb 12193559 12284776 0.99
tpcds_q78/duckdb:duckdb 62849460 60806344 1.03
tpcds_q79/duckdb:duckdb 19052150 18689010 1.02
tpcds_q80/duckdb:duckdb 26346395 25729745 1.02
tpcds_q81/duckdb:duckdb 37862750 35419594 1.07
tpcds_q82/duckdb:duckdb 8168500 8762631 0.93
tpcds_q83/duckdb:duckdb 8934213 9229905 0.97
tpcds_q84/duckdb:duckdb 🚨 15587912 13938098 1.12
tpcds_q85/duckdb:duckdb 23991942 25030142 0.96
tpcds_q86/duckdb:duckdb 11363686 10660492 1.07
tpcds_q87/duckdb:duckdb 35024460 33634234 1.04
tpcds_q88/duckdb:duckdb 25613219 25779391 0.99
tpcds_q89/duckdb:duckdb 14969581 14789366 1.01
tpcds_q90/duckdb:duckdb 5461767 5557345 0.98
tpcds_q91/duckdb:duckdb 12773682 12275072 1.04
tpcds_q92/duckdb:duckdb 9199929 8996864 1.02
tpcds_q93/duckdb:duckdb 22281349 20643875 1.08
tpcds_q94/duckdb:duckdb 12243035 12808673 0.96
tpcds_q95/duckdb:duckdb 🚨 124239563 110071749 1.13
tpcds_q96/duckdb:duckdb 4620213 4769551 0.97
tpcds_q97/duckdb:duckdb 28803379 30068169 0.96
tpcds_q98/duckdb:duckdb 13318310 13606777 0.98
tpcds_q99/duckdb:duckdb 15919867 16257620 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.9% +8.4% -6.9% +23.4% ➖ noise
1 datafusion:vortex-file-compressed -6.6% +8.4% -13.8% +18.6% ➖ noise
1 duckdb:duckdb +0.5% +8.4% -7.3% +22.3% ➖ noise
1 duckdb:vortex-compact -2.0% +8.4% -9.6% +20.4% ➖ noise
1 duckdb:vortex-file-compressed -2.2% +8.4% -9.7% +32.6% ➖ noise
2 datafusion:vortex-compact -1.0% +0.5% -1.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.0% +0.5% -0.5% +10.0% ➖ noise
2 duckdb:duckdb -0.9% +0.5% -1.4% +14.4% ➖ noise
2 duckdb:vortex-compact +0.7% +0.5% +0.2% +26.3% ➖ noise
2 duckdb:vortex-file-compressed -8.1% +0.5% -8.5% +10.0% ➖ noise
3 datafusion:vortex-compact -2.9% +0.6% -3.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.3% +0.6% -1.8% +25.8% ➖ noise
3 duckdb:duckdb -1.2% +0.6% -1.7% +16.0% ➖ noise
3 duckdb:vortex-compact -0.3% +0.6% -0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.6% +0.6% +5.0% +10.0% ➖ noise
4 datafusion:vortex-compact +0.6% -0.2% +0.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.4% -0.2% -3.1% +10.0% ➖ noise
4 duckdb:duckdb -4.7% -0.2% -4.5% +10.0% ➖ noise
4 duckdb:vortex-compact +5.5% -0.2% +5.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -6.2% -0.2% -6.0% +11.4% ➖ noise
5 datafusion:vortex-compact -2.4% +1.3% -3.6% +10.5% ➖ noise
5 datafusion:vortex-file-compressed +0.1% +1.3% -1.1% +10.0% ➖ noise
5 duckdb:duckdb -2.4% +1.3% -3.6% +10.0% ➖ noise
5 duckdb:vortex-compact -3.7% +1.3% -4.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.3% +1.3% +2.0% +10.0% ➖ noise
6 datafusion:vortex-compact +4.1% -3.7% +8.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +7.5% -3.7% +11.6% +10.0% 🚨 regression
6 duckdb:duckdb -3.9% -3.7% -0.3% +12.8% ➖ noise
6 duckdb:vortex-compact -5.8% -3.7% -2.2% +11.8% ➖ noise
6 duckdb:vortex-file-compressed -1.7% -3.7% +2.0% +10.0% ➖ noise
7 datafusion:vortex-compact +1.9% -0.4% +2.3% +16.0% ➖ noise
7 datafusion:vortex-file-compressed -0.5% -0.4% -0.2% +10.0% ➖ noise
7 duckdb:duckdb -1.9% -0.4% -1.5% +23.6% ➖ noise
7 duckdb:vortex-compact +1.4% -0.4% +1.8% +10.9% ➖ noise
7 duckdb:vortex-file-compressed -5.3% -0.4% -4.9% +20.7% ➖ noise
8 datafusion:vortex-compact -0.5% +1.8% -2.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.5% +1.8% -2.3% +10.0% ➖ noise
8 duckdb:duckdb -0.6% +1.8% -2.4% +10.0% ➖ noise
8 duckdb:vortex-compact +3.1% +1.8% +1.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.2% +1.8% -2.9% +17.9% ➖ noise
9 datafusion:vortex-compact -2.3% +2.6% -4.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.5% +2.6% -4.0% +10.0% ➖ noise
9 duckdb:duckdb +0.2% +2.6% -2.3% +10.0% ➖ noise
9 duckdb:vortex-compact -3.0% +2.6% -5.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.3% +2.6% -5.7% +12.0% ➖ noise
10 datafusion:vortex-compact +0.2% +4.1% -3.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +13.3% +4.1% +8.9% +13.2% ➖ noise
10 duckdb:duckdb -0.0% +4.1% -3.9% +10.0% ➖ noise
10 duckdb:vortex-compact +4.7% +4.1% +0.6% +11.3% ➖ noise
10 duckdb:vortex-file-compressed -2.0% +4.1% -5.8% +10.0% ➖ noise
11 datafusion:vortex-compact -0.7% -1.9% +1.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.0% -1.9% +2.9% +10.0% ➖ noise
11 duckdb:duckdb -6.0% -1.9% -4.2% +10.0% ➖ noise
11 duckdb:vortex-compact +1.7% -1.9% +3.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.6% -1.9% -0.7% +10.1% ➖ noise
12 datafusion:vortex-compact -12.0% +4.2% -15.5% +16.1% ✅ faster
12 datafusion:vortex-file-compressed -0.8% +4.2% -4.9% +10.7% ➖ noise
12 duckdb:duckdb -2.9% +4.2% -6.8% +17.2% ➖ noise
12 duckdb:vortex-compact -2.0% +4.2% -5.9% +13.1% ➖ noise
12 duckdb:vortex-file-compressed -2.7% +4.2% -6.6% +12.5% ➖ noise
13 datafusion:vortex-compact -0.6% +0.7% -1.3% +18.0% ➖ noise
13 datafusion:vortex-file-compressed -5.7% +0.7% -6.4% +10.0% ➖ noise
13 duckdb:duckdb -1.7% +0.7% -2.4% +10.0% ➖ noise
13 duckdb:vortex-compact +4.5% +0.7% +3.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.6% +0.7% -3.3% +10.0% ➖ noise
14 datafusion:vortex-compact +0.3% +0.7% -0.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.0% +0.7% +0.3% +10.0% ➖ noise
14 duckdb:duckdb -4.5% +0.7% -5.2% +10.0% ➖ noise
14 duckdb:vortex-compact +0.4% +0.7% -0.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.7% +0.7% -2.4% +10.0% ➖ noise
15 datafusion:vortex-compact -3.9% -2.1% -1.8% +14.1% ➖ noise
15 datafusion:vortex-file-compressed -0.6% -2.1% +1.5% +15.1% ➖ noise
15 duckdb:duckdb -4.4% -2.1% -2.3% +12.3% ➖ noise
15 duckdb:vortex-compact -0.6% -2.1% +1.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -3.5% -2.1% -1.4% +10.0% ➖ noise
16 datafusion:vortex-compact -0.8% -0.9% +0.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -1.4% -0.9% -0.5% +10.0% ➖ noise
16 duckdb:duckdb -4.3% -0.9% -3.4% +14.1% ➖ noise
16 duckdb:vortex-compact -0.4% -0.9% +0.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.2% -0.9% -0.3% +10.0% ➖ noise
17 datafusion:vortex-compact -4.9% -3.2% -1.8% +10.1% ➖ noise
17 datafusion:vortex-file-compressed -0.3% -3.2% +3.0% +10.0% ➖ noise
17 duckdb:duckdb -3.7% -3.2% -0.5% +14.2% ➖ noise
17 duckdb:vortex-compact -5.0% -3.2% -1.9% +14.5% ➖ noise
17 duckdb:vortex-file-compressed -0.2% -3.2% +3.1% +10.0% ➖ noise
18 datafusion:vortex-compact +0.4% -4.7% +5.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.7% -4.7% +4.2% +10.4% ➖ noise
18 duckdb:duckdb +1.1% -4.7% +6.1% +11.0% ➖ noise
18 duckdb:vortex-compact +2.6% -4.7% +7.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -5.8% -4.7% -1.1% +10.0% ➖ noise
19 datafusion:vortex-compact -3.1% -0.9% -2.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.3% -0.9% -4.4% +22.9% ➖ noise
19 duckdb:duckdb -0.7% -0.9% +0.2% +12.0% ➖ noise
19 duckdb:vortex-compact +0.8% -0.9% +1.7% +11.1% ➖ noise
19 duckdb:vortex-file-compressed +0.0% -0.9% +1.0% +11.4% ➖ noise
20 datafusion:vortex-compact +0.5% -0.7% +1.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.4% -0.7% +4.1% +10.0% ➖ noise
20 duckdb:duckdb -7.5% -0.7% -6.9% +11.2% ➖ noise
20 duckdb:vortex-compact -5.9% -0.7% -5.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.8% -0.7% +2.4% +10.9% ➖ noise
21 datafusion:vortex-compact -4.6% -0.6% -4.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +2.1% -0.6% +2.7% +10.0% ➖ noise
21 duckdb:duckdb -10.9% -0.6% -10.4% +18.6% ➖ noise
21 duckdb:vortex-compact +4.0% -0.6% +4.7% +14.1% ➖ noise
21 duckdb:vortex-file-compressed -4.9% -0.6% -4.3% +14.2% ➖ noise
22 datafusion:vortex-compact -7.5% +4.3% -11.3% +29.0% ➖ noise
22 datafusion:vortex-file-compressed -23.0% +4.3% -26.2% +32.7% ✅ faster
22 duckdb:duckdb -3.1% +4.3% -7.1% +15.2% ➖ noise
22 duckdb:vortex-compact -6.8% +4.3% -10.6% +15.2% ➖ noise
22 duckdb:vortex-file-compressed -0.7% +4.3% -4.8% +14.5% ➖ noise
23 datafusion:vortex-compact +1.4% +2.4% -1.1% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -0.6% +2.4% -3.0% +11.1% ➖ noise
23 duckdb:duckdb +7.1% +2.4% +4.6% +16.3% ➖ noise
23 duckdb:vortex-compact -0.3% +2.4% -2.7% +11.8% ➖ noise
23 duckdb:vortex-file-compressed -0.7% +2.4% -3.1% +14.2% ➖ noise
24 datafusion:vortex-compact -0.4% +0.4% -0.8% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -2.8% +0.4% -3.2% +11.1% ➖ noise
24 duckdb:duckdb -0.5% +0.4% -0.9% +10.1% ➖ noise
24 duckdb:vortex-compact -2.2% +0.4% -2.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +0.4% +0.4% -0.0% +12.9% ➖ noise
25 datafusion:vortex-compact -1.2% -0.6% -0.6% +10.3% ➖ noise
25 datafusion:vortex-file-compressed -0.0% -0.6% +0.5% +10.0% ➖ noise
25 duckdb:duckdb -1.2% -0.6% -0.6% +10.6% ➖ noise
25 duckdb:vortex-compact +1.0% -0.6% +1.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.9% -0.6% +3.5% +10.9% ➖ noise
26 datafusion:vortex-compact -6.8% +0.5% -7.3% +11.0% ➖ noise
26 datafusion:vortex-file-compressed -2.1% +0.5% -2.6% +10.0% ➖ noise
26 duckdb:duckdb +4.0% +0.5% +3.4% +11.4% ➖ noise
26 duckdb:vortex-compact -0.6% +0.5% -1.1% +12.6% ➖ noise
26 duckdb:vortex-file-compressed -5.6% +0.5% -6.1% +10.0% ➖ noise
27 datafusion:vortex-compact -3.8% -0.6% -3.2% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +0.8% -0.6% +1.4% +10.0% ➖ noise
27 duckdb:duckdb -2.3% -0.6% -1.7% +17.8% ➖ noise
27 duckdb:vortex-compact -2.6% -0.6% -2.0% +14.4% ➖ noise
27 duckdb:vortex-file-compressed -8.3% -0.6% -7.8% +16.4% ➖ noise
28 datafusion:vortex-compact -2.9% -0.6% -2.3% +14.2% ➖ noise
28 datafusion:vortex-file-compressed -5.1% -0.6% -4.6% +10.0% ➖ noise
28 duckdb:duckdb -0.5% -0.6% +0.1% +10.0% ➖ noise
28 duckdb:vortex-compact -0.6% -0.6% +0.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.4% -0.6% +0.2% +10.0% ➖ noise
29 datafusion:vortex-compact +0.8% +0.7% +0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.6% +0.7% -5.3% +10.0% ➖ noise
29 duckdb:duckdb +3.8% +0.7% +3.1% +12.1% ➖ noise
29 duckdb:vortex-compact -1.8% +0.7% -2.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +0.5% +0.7% -0.2% +10.0% ➖ noise
30 datafusion:vortex-compact +3.5% -1.1% +4.7% +10.9% ➖ noise
30 datafusion:vortex-file-compressed +0.7% -1.1% +1.8% +13.3% ➖ noise
30 duckdb:duckdb -3.9% -1.1% -2.9% +10.0% ➖ noise
30 duckdb:vortex-compact +1.9% -1.1% +3.0% +12.0% ➖ noise
30 duckdb:vortex-file-compressed -0.8% -1.1% +0.3% +10.0% ➖ noise
31 datafusion:vortex-compact -2.3% -1.2% -1.1% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -1.8% -1.2% -0.6% +10.3% ➖ noise
31 duckdb:duckdb +3.4% -1.2% +4.7% +12.3% ➖ noise
31 duckdb:vortex-compact +2.3% -1.2% +3.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -2.4% -1.2% -1.2% +10.1% ➖ noise
32 datafusion:vortex-compact -2.3% +1.6% -3.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.0% +1.6% -0.6% +10.0% ➖ noise
32 duckdb:duckdb +9.1% +1.6% +7.4% +15.1% ➖ noise
32 duckdb:vortex-compact -3.2% +1.6% -4.7% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -6.5% +1.6% -7.9% +10.1% ➖ noise
33 datafusion:vortex-compact -1.6% -2.2% +0.7% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.5% -2.2% +2.7% +10.0% ➖ noise
33 duckdb:duckdb -1.4% -2.2% +0.8% +10.8% ➖ noise
33 duckdb:vortex-compact -1.7% -2.2% +0.5% +14.6% ➖ noise
33 duckdb:vortex-file-compressed -1.9% -2.2% +0.3% +10.0% ➖ noise
34 datafusion:vortex-compact -0.5% -4.2% +3.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -2.2% -4.2% +2.1% +10.0% ➖ noise
34 duckdb:duckdb -0.2% -4.2% +4.1% +10.0% ➖ noise
34 duckdb:vortex-compact +2.8% -4.2% +7.2% +15.7% ➖ noise
34 duckdb:vortex-file-compressed +2.3% -4.2% +6.8% +10.0% ➖ noise
35 datafusion:vortex-compact -1.6% -3.0% +1.5% +11.2% ➖ noise
35 datafusion:vortex-file-compressed -1.1% -3.0% +2.0% +10.0% ➖ noise
35 duckdb:duckdb -2.3% -3.0% +0.7% +14.5% ➖ noise
35 duckdb:vortex-compact -0.0% -3.0% +3.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.9% -3.0% +4.1% +10.0% ➖ noise
36 datafusion:vortex-compact -3.5% +0.4% -3.8% +10.5% ➖ noise
36 datafusion:vortex-file-compressed -0.0% +0.4% -0.4% +12.5% ➖ noise
36 duckdb:duckdb +0.0% +0.4% -0.3% +10.0% ➖ noise
36 duckdb:vortex-compact +0.9% +0.4% +0.5% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +0.5% +0.4% +0.1% +17.6% ➖ noise
37 datafusion:vortex-compact +4.6% +2.4% +2.2% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +0.5% +2.4% -1.9% +12.3% ➖ noise
37 duckdb:duckdb -4.9% +2.4% -7.1% +14.1% ➖ noise
37 duckdb:vortex-compact +0.5% +2.4% -1.9% +11.1% ➖ noise
37 duckdb:vortex-file-compressed -6.6% +2.4% -8.8% +10.4% ➖ noise
38 datafusion:vortex-compact +2.4% -0.4% +2.9% +10.9% ➖ noise
38 datafusion:vortex-file-compressed +0.5% -0.4% +0.9% +10.0% ➖ noise
38 duckdb:duckdb +1.9% -0.4% +2.3% +10.8% ➖ noise
38 duckdb:vortex-compact +2.9% -0.4% +3.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +3.1% -0.4% +3.5% +11.1% ➖ noise
39 datafusion:vortex-compact -4.6% -0.5% -4.1% +12.1% ➖ noise
39 datafusion:vortex-file-compressed -1.5% -0.5% -1.0% +10.0% ➖ noise
39 duckdb:duckdb +25.7% -0.5% +26.3% +29.0% ➖ noise
39 duckdb:vortex-compact -0.4% -0.5% +0.1% +20.8% ➖ noise
39 duckdb:vortex-file-compressed -0.9% -0.5% -0.5% +11.9% ➖ noise
40 datafusion:vortex-compact +1.5% -0.0% +1.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +0.7% -0.0% +0.8% +10.9% ➖ noise
40 duckdb:duckdb +7.6% -0.0% +7.6% +10.0% ➖ noise
40 duckdb:vortex-compact +3.8% -0.0% +3.9% +12.2% ➖ noise
40 duckdb:vortex-file-compressed +2.5% -0.0% +2.6% +14.8% ➖ noise
41 datafusion:vortex-compact -0.5% +0.2% -0.7% +11.6% ➖ noise
41 datafusion:vortex-file-compressed +2.5% +0.2% +2.2% +10.0% ➖ noise
41 duckdb:duckdb -3.0% +0.2% -3.2% +10.0% ➖ noise
41 duckdb:vortex-compact -1.2% +0.2% -1.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -0.7% +0.2% -0.9% +10.0% ➖ noise
42 datafusion:vortex-compact -1.0% +1.6% -2.6% +11.1% ➖ noise
42 datafusion:vortex-file-compressed +1.2% +1.6% -0.4% +10.0% ➖ noise
42 duckdb:duckdb +0.7% +1.6% -1.0% +16.0% ➖ noise
42 duckdb:vortex-compact -0.3% +1.6% -1.9% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -2.1% +1.6% -3.7% +13.7% ➖ noise
43 datafusion:vortex-compact -1.6% -1.2% -0.4% +12.2% ➖ noise
43 datafusion:vortex-file-compressed +0.9% -1.2% +2.2% +10.2% ➖ noise
43 duckdb:duckdb -6.7% -1.2% -5.6% +12.3% ➖ noise
43 duckdb:vortex-compact -0.5% -1.2% +0.7% +23.2% ➖ noise
43 duckdb:vortex-file-compressed -1.9% -1.2% -0.7% +12.9% ➖ noise
44 datafusion:vortex-compact -7.0% -3.4% -3.8% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -5.1% -3.4% -1.8% +10.6% ➖ noise
44 duckdb:duckdb -9.3% -3.4% -6.1% +13.8% ➖ noise
44 duckdb:vortex-compact +1.5% -3.4% +5.1% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +0.8% -3.4% +4.3% +10.0% ➖ noise
45 datafusion:vortex-compact -2.4% -1.2% -1.1% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +2.3% -1.2% +3.6% +10.0% ➖ noise
45 duckdb:duckdb +4.2% -1.2% +5.5% +10.2% ➖ noise
45 duckdb:vortex-compact -1.3% -1.2% -0.0% +11.7% ➖ noise
45 duckdb:vortex-file-compressed -2.1% -1.2% -0.9% +10.0% ➖ noise
46 datafusion:vortex-compact -1.4% -1.4% +0.0% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -2.7% -1.4% -1.3% +14.7% ➖ noise
46 duckdb:duckdb +6.3% -1.4% +7.8% +10.0% ➖ noise
46 duckdb:vortex-compact +5.0% -1.4% +6.6% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -0.7% -1.4% +0.7% +10.0% ➖ noise
47 datafusion:vortex-compact +1.3% -1.5% +2.9% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +1.3% -1.5% +2.8% +10.0% ➖ noise
47 duckdb:duckdb +0.4% -1.5% +1.9% +10.7% ➖ noise
47 duckdb:vortex-compact +0.0% -1.5% +1.5% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -4.6% -1.5% -3.2% +10.0% ➖ noise
48 datafusion:vortex-compact -3.9% -1.8% -2.1% +10.3% ➖ noise
48 datafusion:vortex-file-compressed -7.2% -1.8% -5.5% +10.0% ➖ noise
48 duckdb:duckdb +1.4% -1.8% +3.3% +10.0% ➖ noise
48 duckdb:vortex-compact -4.8% -1.8% -3.0% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -0.6% -1.8% +1.2% +11.3% ➖ noise
49 datafusion:vortex-compact -8.0% +0.7% -8.6% +11.3% ➖ noise
49 datafusion:vortex-file-compressed -1.9% +0.7% -2.6% +11.7% ➖ noise
49 duckdb:duckdb +1.0% +0.7% +0.3% +15.6% ➖ noise
49 duckdb:vortex-compact -6.8% +0.7% -7.4% +11.5% ➖ noise
49 duckdb:vortex-file-compressed +13.4% +0.7% +12.6% +25.4% ➖ noise
50 datafusion:vortex-compact -2.1% +1.5% -3.5% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -0.3% +1.5% -1.8% +10.0% ➖ noise
50 duckdb:duckdb +0.4% +1.5% -1.1% +10.7% ➖ noise
50 duckdb:vortex-compact +1.1% +1.5% -0.5% +12.2% ➖ noise
50 duckdb:vortex-file-compressed +1.6% +1.5% +0.1% +10.0% ➖ noise
51 datafusion:vortex-compact +0.1% -1.2% +1.4% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +0.2% -1.2% +1.5% +10.0% ➖ noise
51 duckdb:duckdb -0.8% -1.2% +0.4% +10.0% ➖ noise
51 duckdb:vortex-compact -2.6% -1.2% -1.4% +10.0% ➖ noise
51 duckdb:vortex-file-compressed -2.7% -1.2% -1.5% +10.0% ➖ noise
52 datafusion:vortex-compact -7.1% -9.1% +2.2% +13.0% ➖ noise
52 datafusion:vortex-file-compressed +3.2% -9.1% +13.5% +10.0% 🚨 regression
52 duckdb:duckdb -0.5% -9.1% +9.5% +17.6% ➖ noise
52 duckdb:vortex-compact -1.5% -9.1% +8.3% +10.9% ➖ noise
52 duckdb:vortex-file-compressed +4.0% -9.1% +14.4% +29.8% ➖ noise
53 datafusion:vortex-compact -0.4% +0.6% -1.0% +13.5% ➖ noise
53 datafusion:vortex-file-compressed +1.0% +0.6% +0.4% +17.4% ➖ noise
53 duckdb:duckdb -3.1% +0.6% -3.7% +10.0% ➖ noise
53 duckdb:vortex-compact +2.4% +0.6% +1.8% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +2.5% +0.6% +1.9% +10.0% ➖ noise
54 datafusion:vortex-compact -0.2% -4.2% +4.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -0.3% -4.2% +4.0% +15.9% ➖ noise
54 duckdb:duckdb +1.3% -4.2% +5.7% +11.1% ➖ noise
54 duckdb:vortex-compact -7.3% -4.2% -3.3% +13.0% ➖ noise
54 duckdb:vortex-file-compressed -3.0% -4.2% +1.2% +10.0% ➖ noise
55 datafusion:vortex-compact -2.2% +1.6% -3.7% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -1.4% +1.6% -2.9% +10.0% ➖ noise
55 duckdb:duckdb +4.0% +1.6% +2.4% +16.7% ➖ noise
55 duckdb:vortex-compact -7.7% +1.6% -9.1% +16.2% ➖ noise
55 duckdb:vortex-file-compressed +0.1% +1.6% -1.4% +10.5% ➖ noise
56 datafusion:vortex-compact -3.4% -0.7% -2.7% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +1.8% -0.7% +2.5% +10.0% ➖ noise
56 duckdb:duckdb +1.8% -0.7% +2.5% +10.0% ➖ noise
56 duckdb:vortex-compact -1.7% -0.7% -1.0% +10.7% ➖ noise
56 duckdb:vortex-file-compressed -1.7% -0.7% -1.1% +23.5% ➖ noise
57 datafusion:vortex-compact -0.1% -4.0% +4.0% +10.2% ➖ noise
57 datafusion:vortex-file-compressed -5.7% -4.0% -1.8% +10.0% ➖ noise
57 duckdb:duckdb +0.1% -4.0% +4.3% +17.8% ➖ noise
57 duckdb:vortex-compact +1.8% -4.0% +6.0% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -1.0% -4.0% +3.1% +10.0% ➖ noise
58 datafusion:vortex-compact -0.8% -0.9% +0.1% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -4.1% -0.9% -3.3% +10.0% ➖ noise
58 duckdb:duckdb -7.2% -0.9% -6.4% +12.2% ➖ noise
58 duckdb:vortex-compact -0.0% -0.9% +0.9% +10.0% ➖ noise
58 duckdb:vortex-file-compressed +2.1% -0.9% +3.0% +10.0% ➖ noise
59 datafusion:vortex-compact -0.2% +0.8% -1.0% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +0.5% +0.8% -0.3% +10.0% ➖ noise
59 duckdb:duckdb +2.4% +0.8% +1.6% +10.0% ➖ noise
59 duckdb:vortex-compact +0.8% +0.8% +0.0% +10.4% ➖ noise
59 duckdb:vortex-file-compressed +1.6% +0.8% +0.8% +10.0% ➖ noise
60 datafusion:vortex-compact +4.4% +0.2% +4.2% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -2.0% +0.2% -2.3% +10.0% ➖ noise
60 duckdb:duckdb -2.6% +0.2% -2.8% +11.9% ➖ noise
60 duckdb:vortex-compact +2.8% +0.2% +2.6% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +0.1% +0.2% -0.2% +15.5% ➖ noise
61 datafusion:vortex-compact +2.3% -2.0% +4.4% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -1.8% -2.0% +0.2% +10.0% ➖ noise
61 duckdb:duckdb -3.2% -2.0% -1.2% +10.0% ➖ noise
61 duckdb:vortex-compact +2.0% -2.0% +4.1% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +15.0% -2.0% +17.3% +17.0% 🚨 regression
62 datafusion:vortex-compact -13.2% +8.8% -20.2% +26.7% ➖ noise
62 datafusion:vortex-file-compressed +2.6% +8.8% -5.7% +22.5% ➖ noise
62 duckdb:duckdb +2.6% +8.8% -5.7% +24.9% ➖ noise
62 duckdb:vortex-compact +5.5% +8.8% -3.0% +23.6% ➖ noise
62 duckdb:vortex-file-compressed +4.3% +8.8% -4.1% +20.7% ➖ noise
63 datafusion:vortex-compact -0.4% -0.8% +0.4% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -2.8% -0.8% -2.0% +10.0% ➖ noise
63 duckdb:duckdb +2.4% -0.8% +3.2% +10.0% ➖ noise
63 duckdb:vortex-compact +3.4% -0.8% +4.3% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +0.5% -0.8% +1.3% +10.0% ➖ noise
64 datafusion:vortex-compact +0.1% -0.1% +0.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -0.7% -0.1% -0.7% +10.0% ➖ noise
64 duckdb:duckdb +0.7% -0.1% +0.8% +10.0% ➖ noise
64 duckdb:vortex-compact -3.6% -0.1% -3.5% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -5.8% -0.1% -5.7% +10.3% ➖ noise
65 datafusion:vortex-compact +1.8% +0.7% +1.0% +21.7% ➖ noise
65 datafusion:vortex-file-compressed -1.1% +0.7% -1.8% +10.0% ➖ noise
65 duckdb:duckdb -1.1% +0.7% -1.8% +16.2% ➖ noise
65 duckdb:vortex-compact -1.2% +0.7% -1.9% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +2.4% +0.7% +1.7% +10.0% ➖ noise
66 datafusion:vortex-compact +3.8% +4.6% -0.8% +12.2% ➖ noise
66 datafusion:vortex-file-compressed -2.5% +4.6% -6.8% +13.0% ➖ noise
66 duckdb:duckdb +0.8% +4.6% -3.7% +11.1% ➖ noise
66 duckdb:vortex-compact -11.7% +4.6% -15.6% +16.5% ✅ faster
66 duckdb:vortex-file-compressed +0.2% +4.6% -4.2% +10.1% ➖ noise
67 datafusion:vortex-compact -6.0% +1.6% -7.5% +10.8% ➖ noise
67 datafusion:vortex-file-compressed +3.9% +1.6% +2.3% +11.1% ➖ noise
67 duckdb:duckdb +0.7% +1.6% -0.9% +10.0% ➖ noise
67 duckdb:vortex-compact -0.5% +1.6% -2.1% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -1.7% +1.6% -3.2% +10.0% ➖ noise
68 datafusion:vortex-compact -0.9% -2.7% +1.9% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -2.6% -2.7% +0.0% +10.9% ➖ noise
68 duckdb:duckdb +5.2% -2.7% +8.1% +12.8% ➖ noise
68 duckdb:vortex-compact -1.8% -2.7% +0.9% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -4.4% -2.7% -1.8% +10.0% ➖ noise
69 datafusion:vortex-compact -1.3% -0.5% -0.8% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -0.0% -0.5% +0.5% +10.0% ➖ noise
69 duckdb:duckdb -6.9% -0.5% -6.4% +10.8% ➖ noise
69 duckdb:vortex-compact -1.4% -0.5% -0.9% +10.5% ➖ noise
69 duckdb:vortex-file-compressed +2.4% -0.5% +2.9% +10.6% ➖ noise
70 datafusion:vortex-compact +0.4% -2.3% +2.8% +17.4% ➖ noise
70 datafusion:vortex-file-compressed -5.2% -2.3% -3.0% +13.8% ➖ noise
70 duckdb:duckdb -1.6% -2.3% +0.7% +15.9% ➖ noise
70 duckdb:vortex-compact -2.3% -2.3% -0.0% +14.1% ➖ noise
70 duckdb:vortex-file-compressed -5.5% -2.3% -3.3% +16.2% ➖ noise
71 datafusion:vortex-compact +0.7% +1.0% -0.3% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -2.6% +1.0% -3.5% +10.0% ➖ noise
71 duckdb:duckdb -0.5% +1.0% -1.5% +12.3% ➖ noise
71 duckdb:vortex-compact +0.4% +1.0% -0.6% +10.4% ➖ noise
71 duckdb:vortex-file-compressed +6.3% +1.0% +5.2% +10.0% ➖ noise
72 datafusion:vortex-compact -0.5% -0.3% -0.1% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -0.7% -0.3% -0.4% +10.0% ➖ noise
72 duckdb:duckdb +0.5% -0.3% +0.8% +10.0% ➖ noise
72 duckdb:vortex-compact -1.3% -0.3% -0.9% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.1% -0.3% +0.5% +10.0% ➖ noise
73 datafusion:vortex-compact -1.4% -0.5% -0.9% +10.4% ➖ noise
73 datafusion:vortex-file-compressed -2.6% -0.5% -2.1% +10.0% ➖ noise
73 duckdb:duckdb -3.8% -0.5% -3.3% +13.9% ➖ noise
73 duckdb:vortex-compact +2.3% -0.5% +2.8% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +3.8% -0.5% +4.2% +10.0% ➖ noise
74 datafusion:vortex-compact +0.8% +0.1% +0.7% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -3.3% +0.1% -3.4% +15.6% ➖ noise
74 duckdb:duckdb +0.3% +0.1% +0.2% +10.0% ➖ noise
74 duckdb:vortex-compact +0.3% +0.1% +0.1% +22.8% ➖ noise
74 duckdb:vortex-file-compressed -9.3% +0.1% -9.4% +28.4% ➖ noise
75 datafusion:vortex-compact -3.4% +1.7% -5.1% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -5.0% +1.7% -6.6% +12.8% ➖ noise
75 duckdb:duckdb +2.6% +1.7% +0.9% +10.5% ➖ noise
75 duckdb:vortex-compact +3.4% +1.7% +1.7% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +2.2% +1.7% +0.5% +10.0% ➖ noise
76 datafusion:vortex-compact +1.4% +0.6% +0.8% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -3.1% +0.6% -3.7% +15.6% ➖ noise
76 duckdb:duckdb -3.0% +0.6% -3.6% +15.9% ➖ noise
76 duckdb:vortex-compact -4.8% +0.6% -5.4% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -9.3% +0.6% -9.8% +23.2% ➖ noise
77 datafusion:vortex-compact -4.5% +0.8% -5.2% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -2.5% +0.8% -3.3% +15.6% ➖ noise
77 duckdb:duckdb -0.7% +0.8% -1.5% +10.0% ➖ noise
77 duckdb:vortex-compact +7.1% +0.8% +6.3% +17.7% ➖ noise
77 duckdb:vortex-file-compressed +1.0% +0.8% +0.3% +22.5% ➖ noise
78 datafusion:vortex-compact -1.1% +1.8% -2.9% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -1.9% +1.8% -3.6% +10.0% ➖ noise
78 duckdb:duckdb +3.4% +1.8% +1.5% +11.2% ➖ noise
78 duckdb:vortex-compact -2.0% +1.8% -3.8% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -1.8% +1.8% -3.5% +10.0% ➖ noise
79 datafusion:vortex-compact -1.3% +1.1% -2.3% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -3.8% +1.1% -4.9% +10.0% ➖ noise
79 duckdb:duckdb +1.9% +1.1% +0.8% +10.0% ➖ noise
79 duckdb:vortex-compact -1.1% +1.1% -2.2% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -0.8% +1.1% -1.9% +10.0% ➖ noise
80 datafusion:vortex-compact -1.6% +0.3% -1.9% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +1.8% +0.3% +1.5% +10.8% ➖ noise
80 duckdb:duckdb +2.4% +0.3% +2.1% +26.2% ➖ noise
80 duckdb:vortex-compact -2.0% +0.3% -2.3% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -9.2% +0.3% -9.5% +11.2% ➖ noise
81 datafusion:vortex-compact +6.3% -1.8% +8.3% +10.5% ➖ noise
81 datafusion:vortex-file-compressed -2.3% -1.8% -0.5% +10.0% ➖ noise
81 duckdb:duckdb +6.9% -1.8% +8.9% +10.2% ➖ noise
81 duckdb:vortex-compact -6.9% -1.8% -5.1% +12.5% ➖ noise
81 duckdb:vortex-file-compressed -3.3% -1.8% -1.5% +11.8% ➖ noise
82 datafusion:vortex-compact -1.4% +4.7% -5.8% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -3.3% +4.7% -7.6% +13.5% ➖ noise
82 duckdb:duckdb -6.8% +4.7% -10.9% +14.3% ➖ noise
82 duckdb:vortex-compact -10.7% +4.7% -14.7% +11.7% ✅ faster
82 duckdb:vortex-file-compressed -0.8% +4.7% -5.2% +10.4% ➖ noise
83 datafusion:vortex-compact -1.0% -1.3% +0.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -4.2% -1.3% -2.9% +10.0% ➖ noise
83 duckdb:duckdb -3.2% -1.3% -1.9% +13.5% ➖ noise
83 duckdb:vortex-compact -0.4% -1.3% +0.9% +10.2% ➖ noise
83 duckdb:vortex-file-compressed -2.6% -1.3% -1.3% +11.1% ➖ noise
84 datafusion:vortex-compact -5.5% -2.1% -3.5% +15.6% ➖ noise
84 datafusion:vortex-file-compressed -1.5% -2.1% +0.6% +10.0% ➖ noise
84 duckdb:duckdb +11.8% -2.1% +14.3% +11.3% 🚨 regression
84 duckdb:vortex-compact +1.0% -2.1% +3.1% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -5.9% -2.1% -3.8% +14.9% ➖ noise
85 datafusion:vortex-compact -2.8% +0.3% -3.1% +12.6% ➖ noise
85 datafusion:vortex-file-compressed -3.3% +0.3% -3.6% +10.0% ➖ noise
85 duckdb:duckdb -4.1% +0.3% -4.4% +10.0% ➖ noise
85 duckdb:vortex-compact -8.5% +0.3% -8.7% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +4.8% +0.3% +4.6% +10.0% ➖ noise
86 datafusion:vortex-compact -6.0% -2.4% -3.7% +20.1% ➖ noise
86 datafusion:vortex-file-compressed -2.5% -2.4% -0.1% +18.2% ➖ noise
86 duckdb:duckdb +6.6% -2.4% +9.2% +15.3% ➖ noise
86 duckdb:vortex-compact -3.3% -2.4% -0.9% +20.8% ➖ noise
86 duckdb:vortex-file-compressed -0.6% -2.4% +1.9% +13.1% ➖ noise
87 datafusion:vortex-compact -5.6% +2.3% -7.7% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -1.0% +2.3% -3.3% +10.9% ➖ noise
87 duckdb:duckdb +4.1% +2.3% +1.8% +10.4% ➖ noise
87 duckdb:vortex-compact +4.7% +2.3% +2.3% +10.8% ➖ noise
87 duckdb:vortex-file-compressed -5.7% +2.3% -7.8% +15.1% ➖ noise
88 datafusion:vortex-compact -0.7% +2.1% -2.8% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -2.8% +2.1% -4.8% +10.0% ➖ noise
88 duckdb:duckdb -0.6% +2.1% -2.7% +10.0% ➖ noise
88 duckdb:vortex-compact -3.3% +2.1% -5.3% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -2.6% +2.1% -4.7% +11.2% ➖ noise
89 datafusion:vortex-compact -0.5% +3.0% -3.4% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -1.1% +3.0% -4.0% +10.0% ➖ noise
89 duckdb:duckdb +1.2% +3.0% -1.7% +10.9% ➖ noise
89 duckdb:vortex-compact -1.6% +3.0% -4.5% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -1.6% +3.0% -4.5% +12.9% ➖ noise
90 datafusion:vortex-compact +2.1% -1.8% +4.1% +15.9% ➖ noise
90 datafusion:vortex-file-compressed +3.8% -1.8% +5.7% +15.3% ➖ noise
90 duckdb:duckdb -1.7% -1.8% +0.1% +10.0% ➖ noise
90 duckdb:vortex-compact -2.2% -1.8% -0.4% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -3.8% -1.8% -2.0% +10.0% ➖ noise
91 datafusion:vortex-compact -2.9% +1.1% -4.0% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +1.5% +1.1% +0.4% +10.0% ➖ noise
91 duckdb:duckdb +4.1% +1.1% +2.9% +10.7% ➖ noise
91 duckdb:vortex-compact +3.0% +1.1% +1.8% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +1.6% +1.1% +0.5% +10.0% ➖ noise
92 datafusion:vortex-compact -3.9% +2.6% -6.3% +17.5% ➖ noise
92 datafusion:vortex-file-compressed -3.9% +2.6% -6.3% +14.2% ➖ noise
92 duckdb:duckdb +2.3% +2.6% -0.3% +22.9% ➖ noise
92 duckdb:vortex-compact -7.8% +2.6% -10.1% +22.7% ➖ noise
92 duckdb:vortex-file-compressed +6.8% +2.6% +4.2% +21.4% ➖ noise
93 datafusion:vortex-compact -3.2% -1.7% -1.5% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.9% -1.7% -0.2% +10.0% ➖ noise
93 duckdb:duckdb +7.9% -1.7% +9.8% +15.6% ➖ noise
93 duckdb:vortex-compact -0.4% -1.7% +1.3% +10.1% ➖ noise
93 duckdb:vortex-file-compressed -1.7% -1.7% +0.0% +10.0% ➖ noise
94 datafusion:vortex-compact +11.1% +2.9% +8.0% +11.4% ➖ noise
94 datafusion:vortex-file-compressed -9.7% +2.9% -12.2% +11.7% ✅ faster
94 duckdb:duckdb -4.4% +2.9% -7.1% +13.9% ➖ noise
94 duckdb:vortex-compact +6.5% +2.9% +3.5% +18.3% ➖ noise
94 duckdb:vortex-file-compressed +1.2% +2.9% -1.7% +10.0% ➖ noise
95 datafusion:vortex-compact +1.8% +8.7% -6.4% +10.1% ➖ noise
95 datafusion:vortex-file-compressed +0.9% +8.7% -7.2% +10.3% ➖ noise
95 duckdb:duckdb +12.9% +8.7% +3.8% +19.4% ➖ noise
95 duckdb:vortex-compact +3.3% +8.7% -5.0% +15.3% ➖ noise
95 duckdb:vortex-file-compressed +0.1% +8.7% -7.9% +13.0% ➖ noise
96 datafusion:vortex-compact -1.2% -6.1% +5.2% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +1.5% -6.1% +8.1% +10.6% ➖ noise
96 duckdb:duckdb -3.1% -6.1% +3.2% +17.5% ➖ noise
96 duckdb:vortex-compact +2.2% -6.1% +8.8% +13.9% ➖ noise
96 duckdb:vortex-file-compressed -6.7% -6.1% -0.7% +17.1% ➖ noise
97 datafusion:vortex-compact -0.2% -2.3% +2.2% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +0.6% -2.3% +3.1% +10.0% ➖ noise
97 duckdb:duckdb -4.2% -2.3% -1.9% +17.1% ➖ noise
97 duckdb:vortex-compact +2.8% -2.3% +5.3% +17.0% ➖ noise
97 duckdb:vortex-file-compressed +3.2% -2.3% +5.7% +13.3% ➖ noise
98 datafusion:vortex-compact -1.4% -2.8% +1.5% +12.9% ➖ noise
98 datafusion:vortex-file-compressed -2.4% -2.8% +0.4% +11.3% ➖ noise
98 duckdb:duckdb -2.1% -2.8% +0.7% +17.1% ➖ noise
98 duckdb:vortex-compact +1.0% -2.8% +3.9% +10.5% ➖ noise
98 duckdb:vortex-file-compressed +2.9% -2.8% +5.9% +10.4% ➖ noise
99 datafusion:vortex-compact -0.3% -8.3% +8.7% +25.7% ➖ noise
99 datafusion:vortex-file-compressed +2.4% -8.3% +11.7% +24.6% ➖ noise
99 duckdb:duckdb -2.1% -8.3% +6.8% +29.1% ➖ noise
99 duckdb:vortex-compact +9.0% -8.3% +18.9% +21.5% ➖ noise
99 duckdb:vortex-file-compressed -1.1% -8.3% +7.8% +27.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.1%

datafusion / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50369957 48662830 1.04
tpch_q02/datafusion:vortex-file-compressed 21538201 22131273 0.97
tpch_q03/datafusion:vortex-file-compressed 28134375 27901768 1.01
tpch_q04/datafusion:vortex-file-compressed 20443145 21162909 0.97
tpch_q05/datafusion:vortex-file-compressed 47563529 47405349 1.00
tpch_q06/datafusion:vortex-file-compressed 12880989 12248266 1.05
tpch_q07/datafusion:vortex-file-compressed 54361686 53769548 1.01
tpch_q08/datafusion:vortex-file-compressed 38425496 38676681 0.99
tpch_q09/datafusion:vortex-file-compressed 50281170 50830499 0.99
tpch_q10/datafusion:vortex-file-compressed 39144597 39485454 0.99
tpch_q11/datafusion:vortex-file-compressed 15248356 15430773 0.99
tpch_q12/datafusion:vortex-file-compressed 25864879 24832157 1.04
tpch_q13/datafusion:vortex-file-compressed 24574836 25077872 0.98
tpch_q14/datafusion:vortex-file-compressed 16871239 16713378 1.01
tpch_q15/datafusion:vortex-file-compressed 26102597 25260419 1.03
tpch_q16/datafusion:vortex-file-compressed 18966369 19607510 0.97
tpch_q17/datafusion:vortex-file-compressed 66228443 65428880 1.01
tpch_q18/datafusion:vortex-file-compressed 78000741 81327274 0.96
tpch_q19/datafusion:vortex-file-compressed 23189538 23656477 0.98
tpch_q20/datafusion:vortex-file-compressed 29166548 29795988 0.98
tpch_q21/datafusion:vortex-file-compressed 70269331 71056551 0.99
tpch_q22/datafusion:vortex-file-compressed 12126857 12382702 0.98
datafusion / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58651457 57383674 1.02
tpch_q02/datafusion:vortex-compact 24643057 24989349 0.99
tpch_q03/datafusion:vortex-compact 29830264 29310720 1.02
tpch_q04/datafusion:vortex-compact 23658625 23718522 1.00
tpch_q05/datafusion:vortex-compact 50561195 50440669 1.00
tpch_q06/datafusion:vortex-compact 14480240 14398376 1.01
tpch_q07/datafusion:vortex-compact 59052412 59738955 0.99
tpch_q08/datafusion:vortex-compact 43926796 44456764 0.99
tpch_q09/datafusion:vortex-compact 56068312 55749420 1.01
tpch_q10/datafusion:vortex-compact 45908983 46877658 0.98
tpch_q11/datafusion:vortex-compact 16260373 16542204 0.98
tpch_q12/datafusion:vortex-compact 32256015 32606659 0.99
tpch_q13/datafusion:vortex-compact 30584734 30924110 0.99
tpch_q14/datafusion:vortex-compact 20953462 20093316 1.04
tpch_q15/datafusion:vortex-compact 31642968 31680044 1.00
tpch_q16/datafusion:vortex-compact 23342910 23922921 0.98
tpch_q17/datafusion:vortex-compact 68866250 67339321 1.02
tpch_q18/datafusion:vortex-compact 82833977 83166302 1.00
tpch_q19/datafusion:vortex-compact 30021121 29918032 1.00
tpch_q20/datafusion:vortex-compact 33798530 33851123 1.00
tpch_q21/datafusion:vortex-compact 78828314 78399401 1.01
tpch_q22/datafusion:vortex-compact 12602641 13162852 0.96
datafusion / parquet (0.971x ➖, 1↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 107178799 134717887 0.80
tpch_q02/datafusion:parquet 59969915 63794279 0.94
tpch_q03/datafusion:parquet 71258717 73453983 0.97
tpch_q04/datafusion:parquet 42799939 44012166 0.97
tpch_q05/datafusion:parquet 93199876 94513607 0.99
tpch_q06/datafusion:parquet 41201226 38943843 1.06
tpch_q07/datafusion:parquet 104908285 107924865 0.97
tpch_q08/datafusion:parquet 96085819 98560970 0.97
tpch_q09/datafusion:parquet 128681075 133696480 0.96
tpch_q10/datafusion:parquet 108405569 112561418 0.96
tpch_q11/datafusion:parquet 40504484 42546924 0.95
tpch_q12/datafusion:parquet 🚨 86730308 78227821 1.11
tpch_q13/datafusion:parquet 198289244 201490588 0.98
tpch_q14/datafusion:parquet 45695775 46804562 0.98
tpch_q15/datafusion:parquet 63756463 59438127 1.07
tpch_q16/datafusion:parquet 39440791 40274784 0.98
tpch_q17/datafusion:parquet 136856304 145544737 0.94
tpch_q18/datafusion:parquet 158052935 171682469 0.92
tpch_q19/datafusion:parquet 70620068 78113357 0.90
tpch_q20/datafusion:parquet 68075686 70441691 0.97
tpch_q21/datafusion:parquet 133528023 131031216 1.02
tpch_q22/datafusion:parquet 30489362 30766141 0.99
datafusion / arrow (0.965x ➖, 3↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 50747728 52166213 0.97
tpch_q02/datafusion:arrow 18926741 19275212 0.98
tpch_q03/datafusion:arrow 29269311 30125103 0.97
tpch_q04/datafusion:arrow 24702670 24875773 0.99
tpch_q05/datafusion:arrow 76584454 73424751 1.04
tpch_q06/datafusion:arrow 21008065 19557775 1.07
tpch_q07/datafusion:arrow 100286598 101659387 0.99
tpch_q08/datafusion:arrow 40368185 43119407 0.94
tpch_q09/datafusion:arrow 62076669 64900009 0.96
tpch_q10/datafusion:arrow 45390739 46621120 0.97
tpch_q11/datafusion:arrow 9048828 9443334 0.96
tpch_q12/datafusion:arrow 50418866 50378762 1.00
tpch_q13/datafusion:arrow 47259616 47122416 1.00
tpch_q14/datafusion:arrow 21502074 21727407 0.99
tpch_q15/datafusion:arrow 40887661 44639609 0.92
tpch_q16/datafusion:arrow 18711482 19253526 0.97
tpch_q17/datafusion:arrow 🚀 66145501 73810555 0.90
tpch_q18/datafusion:arrow 131557802 138847583 0.95
tpch_q19/datafusion:arrow 🚀 34221091 38419622 0.89
tpch_q20/datafusion:arrow 🚀 33054439 37180874 0.89
tpch_q21/datafusion:arrow 150858492 161848175 0.93
tpch_q22/datafusion:arrow 17555795 18101951 0.97
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31428693 31168784 1.01
tpch_q02/duckdb:vortex-file-compressed 24380349 24276094 1.00
tpch_q03/duckdb:vortex-file-compressed 28577507 28708444 1.00
tpch_q04/duckdb:vortex-file-compressed 29800572 28604517 1.04
tpch_q05/duckdb:vortex-file-compressed 32383294 32601223 0.99
tpch_q06/duckdb:vortex-file-compressed 9895592 10088888 0.98
tpch_q07/duckdb:vortex-file-compressed 36099812 35141457 1.03
tpch_q08/duckdb:vortex-file-compressed 37763554 37542498 1.01
tpch_q09/duckdb:vortex-file-compressed 69619616 73596485 0.95
tpch_q10/duckdb:vortex-file-compressed 33495555 34014292 0.98
tpch_q11/duckdb:vortex-file-compressed 13769000 13852142 0.99
tpch_q12/duckdb:vortex-file-compressed 21395234 21294022 1.00
tpch_q13/duckdb:vortex-file-compressed 34556962 34476561 1.00
tpch_q14/duckdb:vortex-file-compressed 21257317 20268196 1.05
tpch_q15/duckdb:vortex-file-compressed 16144230 16350648 0.99
tpch_q16/duckdb:vortex-file-compressed 28137036 27503559 1.02
tpch_q17/duckdb:vortex-file-compressed 23984027 24299533 0.99
tpch_q18/duckdb:vortex-file-compressed 48908986 49104405 1.00
tpch_q19/duckdb:vortex-file-compressed 28476795 27822465 1.02
tpch_q20/duckdb:vortex-file-compressed 33130608 33691238 0.98
tpch_q21/duckdb:vortex-file-compressed 103667306 102050220 1.02
tpch_q22/duckdb:vortex-file-compressed 16789675 16418548 1.02
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 37303930 38244008 0.98
tpch_q02/duckdb:vortex-compact 36007765 35335020 1.02
tpch_q03/duckdb:vortex-compact 32373194 31687393 1.02
tpch_q04/duckdb:vortex-compact 34591947 33340008 1.04
tpch_q05/duckdb:vortex-compact 37476972 36695301 1.02
tpch_q06/duckdb:vortex-compact 15101550 14737059 1.02
tpch_q07/duckdb:vortex-compact 41528624 41226591 1.01
tpch_q08/duckdb:vortex-compact 44323853 45030179 0.98
tpch_q09/duckdb:vortex-compact 81090903 82157012 0.99
tpch_q10/duckdb:vortex-compact 38256132 39150993 0.98
tpch_q11/duckdb:vortex-compact 19695894 18677119 1.05
tpch_q12/duckdb:vortex-compact 35021286 35056311 1.00
tpch_q13/duckdb:vortex-compact 43749477 43590649 1.00
tpch_q14/duckdb:vortex-compact 29342709 27514145 1.07
tpch_q15/duckdb:vortex-compact 18966891 19265930 0.98
tpch_q16/duckdb:vortex-compact 34835602 34374948 1.01
tpch_q17/duckdb:vortex-compact 29607109 29651047 1.00
tpch_q18/duckdb:vortex-compact 49535746 50691885 0.98
tpch_q19/duckdb:vortex-compact 34482027 33468941 1.03
tpch_q20/duckdb:vortex-compact 41643856 41559748 1.00
tpch_q21/duckdb:vortex-compact 111829561 109025323 1.03
tpch_q22/duckdb:vortex-compact 19440849 19988971 0.97
duckdb / parquet (1.007x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76281733 77599727 0.98
tpch_q02/duckdb:parquet 38521890 39181181 0.98
tpch_q03/duckdb:parquet 68479899 70168585 0.98
tpch_q04/duckdb:parquet 46828465 46787135 1.00
tpch_q05/duckdb:parquet 64469654 65906886 0.98
tpch_q06/duckdb:parquet 20574275 20509452 1.00
tpch_q07/duckdb:parquet 🚨 78121662 69979188 1.12
tpch_q08/duckdb:parquet 81884034 83467549 0.98
tpch_q09/duckdb:parquet 142968924 136826896 1.04
tpch_q10/duckdb:parquet 123045150 123778669 0.99
tpch_q11/duckdb:parquet 21369525 21020714 1.02
tpch_q12/duckdb:parquet 44927281 45145857 1.00
tpch_q13/duckdb:parquet 247612844 248620677 1.00
tpch_q14/duckdb:parquet 55833200 52001259 1.07
tpch_q15/duckdb:parquet 24195701 24262226 1.00
tpch_q16/duckdb:parquet 55423403 55637050 1.00
tpch_q17/duckdb:parquet 53661461 52922457 1.01
tpch_q18/duckdb:parquet 112297558 113785357 0.99
tpch_q19/duckdb:parquet 67512283 67292427 1.00
tpch_q20/duckdb:parquet 63711291 61655624 1.03
tpch_q21/duckdb:parquet 162337862 162715588 1.00
tpch_q22/duckdb:parquet 51587838 51679329 1.00
duckdb / duckdb (1.021x ➖, 0↑ 2↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16009625 15887057 1.01
tpch_q02/duckdb:duckdb 12583171 12333865 1.02
tpch_q03/duckdb:duckdb 19925710 18744796 1.06
tpch_q04/duckdb:duckdb 🚨 19837444 17817361 1.11
tpch_q05/duckdb:duckdb 19598943 20162126 0.97
tpch_q06/duckdb:duckdb 5440299 5289220 1.03
tpch_q07/duckdb:duckdb 22363838 22236785 1.01
tpch_q08/duckdb:duckdb 20552209 20721919 0.99
tpch_q09/duckdb:duckdb 52713051 53323763 0.99
tpch_q10/duckdb:duckdb 43762895 44135420 0.99
tpch_q11/duckdb:duckdb 5846502 5703305 1.03
tpch_q12/duckdb:duckdb 13655973 13641030 1.00
tpch_q13/duckdb:duckdb 37822735 37657787 1.00
tpch_q14/duckdb:duckdb 🚨 18385146 16128704 1.14
tpch_q15/duckdb:duckdb 11904980 11727243 1.02
tpch_q16/duckdb:duckdb 23202738 23179079 1.00
tpch_q17/duckdb:duckdb 13936214 13466934 1.03
tpch_q18/duckdb:duckdb 38063849 38786181 0.98
tpch_q19/duckdb:duckdb 27353261 25983440 1.05
tpch_q20/duckdb:duckdb 22360227 22357898 1.00
tpch_q21/duckdb:duckdb 56914925 56197333 1.01
tpch_q22/duckdb:duckdb 24643871 24229380 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.7% -11.6% +10.0% +19.1% ➖ noise
1 datafusion:vortex-compact +2.2% -11.6% +15.6% +16.4% ➖ noise
1 datafusion:vortex-file-compressed +3.5% -11.6% +17.0% +16.6% 🚨 regression
1 duckdb:duckdb +0.8% -11.6% +14.0% +16.0% ➖ noise
1 duckdb:vortex-compact -2.5% -11.6% +10.3% +14.9% ➖ noise
1 duckdb:vortex-file-compressed +0.8% -11.6% +14.0% +19.9% ➖ noise
2 datafusion:arrow -1.8% -3.9% +2.1% +10.0% ➖ noise
2 datafusion:vortex-compact -1.4% -3.9% +2.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.7% -3.9% +1.2% +10.0% ➖ noise
2 duckdb:duckdb +2.0% -3.9% +6.1% +10.0% ➖ noise
2 duckdb:vortex-compact +1.9% -3.9% +6.0% +10.2% ➖ noise
2 duckdb:vortex-file-compressed +0.4% -3.9% +4.5% +10.0% ➖ noise
3 datafusion:arrow -2.8% -2.7% -0.1% +10.0% ➖ noise
3 datafusion:vortex-compact +1.8% -2.7% +4.6% +11.2% ➖ noise
3 datafusion:vortex-file-compressed +0.8% -2.7% +3.6% +11.6% ➖ noise
3 duckdb:duckdb +6.3% -2.7% +9.2% +11.0% ➖ noise
3 duckdb:vortex-compact +2.2% -2.7% +5.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.5% -2.7% +2.3% +14.6% ➖ noise
4 datafusion:arrow -0.7% -1.3% +0.7% +10.0% ➖ noise
4 datafusion:vortex-compact -0.3% -1.3% +1.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.4% -1.3% -2.1% +12.8% ➖ noise
4 duckdb:duckdb +11.3% -1.3% +12.9% +10.0% 🚨 regression
4 duckdb:vortex-compact +3.8% -1.3% +5.2% +10.5% ➖ noise
4 duckdb:vortex-file-compressed +4.2% -1.3% +5.6% +10.0% ➖ noise
5 datafusion:arrow +4.3% -1.8% +6.2% +10.0% ➖ noise
5 datafusion:vortex-compact +0.2% -1.8% +2.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.3% -1.8% +2.2% +10.0% ➖ noise
5 duckdb:duckdb -2.8% -1.8% -1.0% +10.0% ➖ noise
5 duckdb:vortex-compact +2.1% -1.8% +4.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.7% -1.8% +1.1% +13.1% ➖ noise
6 datafusion:arrow +7.4% +3.0% +4.3% +16.3% ➖ noise
6 datafusion:vortex-compact +0.6% +3.0% -2.4% +14.5% ➖ noise
6 datafusion:vortex-file-compressed +5.2% +3.0% +2.1% +13.4% ➖ noise
6 duckdb:duckdb +2.9% +3.0% -0.2% +16.2% ➖ noise
6 duckdb:vortex-compact +2.5% +3.0% -0.5% +19.7% ➖ noise
6 duckdb:vortex-file-compressed -1.9% +3.0% -4.8% +17.5% ➖ noise
7 datafusion:arrow -1.4% +4.2% -5.3% +10.9% ➖ noise
7 datafusion:vortex-compact -1.1% +4.2% -5.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.1% +4.2% -2.9% +10.0% ➖ noise
7 duckdb:duckdb +0.6% +4.2% -3.5% +12.2% ➖ noise
7 duckdb:vortex-compact +0.7% +4.2% -3.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.7% +4.2% -1.4% +10.0% ➖ noise
8 datafusion:arrow -6.4% -2.2% -4.3% +10.0% ➖ noise
8 datafusion:vortex-compact -1.2% -2.2% +1.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.6% -2.2% +1.6% +10.0% ➖ noise
8 duckdb:duckdb -0.8% -2.2% +1.4% +10.0% ➖ noise
8 duckdb:vortex-compact -1.6% -2.2% +0.7% +10.4% ➖ noise
8 duckdb:vortex-file-compressed +0.6% -2.2% +2.9% +11.5% ➖ noise
9 datafusion:arrow -4.4% +0.3% -4.6% +10.0% ➖ noise
9 datafusion:vortex-compact +0.6% +0.3% +0.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.1% +0.3% -1.4% +10.0% ➖ noise
9 duckdb:duckdb -1.1% +0.3% -1.4% +10.0% ➖ noise
9 duckdb:vortex-compact -1.3% +0.3% -1.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -5.4% +0.3% -5.7% +10.0% ➖ noise
10 datafusion:arrow -2.6% -2.2% -0.5% +10.0% ➖ noise
10 datafusion:vortex-compact -2.1% -2.2% +0.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.9% -2.2% +1.3% +10.0% ➖ noise
10 duckdb:duckdb -0.8% -2.2% +1.3% +10.0% ➖ noise
10 duckdb:vortex-compact -2.3% -2.2% -0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.5% -2.2% +0.6% +10.0% ➖ noise
11 datafusion:arrow -4.2% -1.6% -2.6% +10.0% ➖ noise
11 datafusion:vortex-compact -1.7% -1.6% -0.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.2% -1.6% +0.4% +10.0% ➖ noise
11 duckdb:duckdb +2.5% -1.6% +4.2% +10.0% ➖ noise
11 duckdb:vortex-compact +5.5% -1.6% +7.2% +15.0% ➖ noise
11 duckdb:vortex-file-compressed -0.6% -1.6% +1.0% +17.5% ➖ noise
12 datafusion:arrow +0.1% +5.0% -4.7% +19.9% ➖ noise
12 datafusion:vortex-compact -1.1% +5.0% -5.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +4.2% +5.0% -0.8% +14.2% ➖ noise
12 duckdb:duckdb +0.1% +5.0% -4.7% +10.1% ➖ noise
12 duckdb:vortex-compact -0.1% +5.0% -4.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.5% +5.0% -4.3% +12.3% ➖ noise
13 datafusion:arrow +0.3% -1.0% +1.3% +10.0% ➖ noise
13 datafusion:vortex-compact -1.1% -1.0% -0.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.0% -1.0% -1.0% +10.0% ➖ noise
13 duckdb:duckdb +0.4% -1.0% +1.5% +10.0% ➖ noise
13 duckdb:vortex-compact +0.4% -1.0% +1.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.2% -1.0% +1.2% +10.0% ➖ noise
14 datafusion:arrow -1.0% +2.4% -3.3% +11.7% ➖ noise
14 datafusion:vortex-compact +4.3% +2.4% +1.9% +11.5% ➖ noise
14 datafusion:vortex-file-compressed +0.9% +2.4% -1.4% +11.3% ➖ noise
14 duckdb:duckdb +14.0% +2.4% +11.3% +16.5% ➖ noise
14 duckdb:vortex-compact +6.6% +2.4% +4.2% +10.3% ➖ noise
14 duckdb:vortex-file-compressed +4.9% +2.4% +2.4% +14.6% ➖ noise
15 datafusion:arrow -8.4% +3.4% -11.4% +11.8% ✅ faster
15 datafusion:vortex-compact -0.1% +3.4% -3.4% +13.6% ➖ noise
15 datafusion:vortex-file-compressed +3.3% +3.4% -0.1% +12.1% ➖ noise
15 duckdb:duckdb +1.5% +3.4% -1.8% +14.1% ➖ noise
15 duckdb:vortex-compact -1.6% +3.4% -4.8% +15.4% ➖ noise
15 duckdb:vortex-file-compressed -1.3% +3.4% -4.5% +12.3% ➖ noise
16 datafusion:arrow -2.8% -1.2% -1.6% +10.0% ➖ noise
16 datafusion:vortex-compact -2.4% -1.2% -1.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -3.3% -1.2% -2.1% +10.1% ➖ noise
16 duckdb:duckdb +0.1% -1.2% +1.3% +10.0% ➖ noise
16 duckdb:vortex-compact +1.3% -1.2% +2.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.3% -1.2% +3.6% +10.0% ➖ noise
17 datafusion:arrow -10.4% -2.4% -8.2% +12.8% ➖ noise
17 datafusion:vortex-compact +2.3% -2.4% +4.7% +10.2% ➖ noise
17 datafusion:vortex-file-compressed +1.2% -2.4% +3.7% +10.3% ➖ noise
17 duckdb:duckdb +3.5% -2.4% +6.0% +11.3% ➖ noise
17 duckdb:vortex-compact -0.1% -2.4% +2.3% +10.9% ➖ noise
17 duckdb:vortex-file-compressed -1.3% -2.4% +1.1% +14.0% ➖ noise
18 datafusion:arrow -5.3% -4.7% -0.6% +10.0% ➖ noise
18 datafusion:vortex-compact -0.4% -4.7% +4.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -4.1% -4.7% +0.6% +10.0% ➖ noise
18 duckdb:duckdb -1.9% -4.7% +3.0% +10.0% ➖ noise
18 duckdb:vortex-compact -2.3% -4.7% +2.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.4% -4.7% +4.5% +10.0% ➖ noise
19 datafusion:arrow -10.9% -4.8% -6.5% +11.8% ➖ noise
19 datafusion:vortex-compact +0.3% -4.8% +5.4% +10.2% ➖ noise
19 datafusion:vortex-file-compressed -2.0% -4.8% +2.9% +10.3% ➖ noise
19 duckdb:duckdb +5.3% -4.8% +10.5% +13.0% ➖ noise
19 duckdb:vortex-compact +3.0% -4.8% +8.2% +10.1% ➖ noise
19 duckdb:vortex-file-compressed +2.4% -4.8% +7.5% +11.6% ➖ noise
20 datafusion:arrow -11.1% -0.1% -11.0% +10.0% ✅ faster
20 datafusion:vortex-compact -0.2% -0.1% -0.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.1% -0.1% -2.0% +10.5% ➖ noise
20 duckdb:duckdb +0.0% -0.1% +0.1% +10.0% ➖ noise
20 duckdb:vortex-compact +0.2% -0.1% +0.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -1.7% -0.1% -1.6% +10.0% ➖ noise
21 datafusion:arrow -6.8% +0.8% -7.6% +10.0% ➖ noise
21 datafusion:vortex-compact +0.5% +0.8% -0.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.1% +0.8% -1.9% +10.0% ➖ noise
21 duckdb:duckdb +1.3% +0.8% +0.4% +10.0% ➖ noise
21 duckdb:vortex-compact +2.6% +0.8% +1.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.6% +0.8% +0.7% +10.0% ➖ noise
22 datafusion:arrow -3.0% -0.5% -2.5% +10.0% ➖ noise
22 datafusion:vortex-compact -4.3% -0.5% -3.7% +11.0% ➖ noise
22 datafusion:vortex-file-compressed -2.1% -0.5% -1.5% +10.0% ➖ noise
22 duckdb:duckdb +1.7% -0.5% +2.3% +10.0% ➖ noise
22 duckdb:vortex-compact -2.7% -0.5% -2.2% +13.8% ➖ noise
22 duckdb:vortex-file-compressed +2.3% -0.5% +2.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.2%
Vortex (geomean): 0.918x ➖
Parquet (geomean): 0.939x ➖
Shifts: Parquet (control) -6.1% · Median polish -6.4%

duckdb / vortex-file-compressed (0.907x ➖, 2↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚀 11709929 13138546 0.89
statpopgen_q01/duckdb:vortex-file-compressed 🚀 20743895 28645375 0.72
statpopgen_q02/duckdb:vortex-file-compressed 1393884626 1490223951 0.94
statpopgen_q03/duckdb:vortex-file-compressed 3130701658 3379768658 0.93
statpopgen_q04/duckdb:vortex-file-compressed 3097904477 3381050799 0.92
statpopgen_q05/duckdb:vortex-file-compressed 1443688812 1550224216 0.93
statpopgen_q06/duckdb:vortex-file-compressed 2145165967 2250346647 0.95
statpopgen_q07/duckdb:vortex-file-compressed 209418996 230528956 0.91
statpopgen_q08/duckdb:vortex-file-compressed 251105830 277126613 0.91
statpopgen_q09/duckdb:vortex-file-compressed 2967296914 3062094875 0.97
statpopgen_q10/duckdb:vortex-file-compressed 4730770970 5048170443 0.94
duckdb / vortex-compact (0.931x ➖, 1↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11421633 12477185 0.92
statpopgen_q01/duckdb:vortex-compact 168229393 173372613 0.97
statpopgen_q02/duckdb:vortex-compact 1830120291 1956992830 0.94
statpopgen_q03/duckdb:vortex-compact 3623235539 3787180629 0.96
statpopgen_q04/duckdb:vortex-compact 3540343264 3783165115 0.94
statpopgen_q05/duckdb:vortex-compact 1836798300 1994656916 0.92
statpopgen_q06/duckdb:vortex-compact 2686285171 2831688533 0.95
statpopgen_q07/duckdb:vortex-compact 893601245 960042160 0.93
statpopgen_q08/duckdb:vortex-compact 929094087 993251277 0.94
statpopgen_q09/duckdb:vortex-compact 🚀 3325017452 3766658817 0.88
statpopgen_q10/duckdb:vortex-compact 5427019499 5984214170 0.91
duckdb / parquet (0.939x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 329470968 350820505 0.94
statpopgen_q01/duckdb:parquet 410866284 437390373 0.94
statpopgen_q02/duckdb:parquet 1003700967 1067675729 0.94
statpopgen_q03/duckdb:parquet 1509278479 1572013368 0.96
statpopgen_q04/duckdb:parquet 1514212148 1569236478 0.96
statpopgen_q05/duckdb:parquet 1015477368 1104825985 0.92
statpopgen_q06/duckdb:parquet 1502089229 1605675764 0.94
statpopgen_q07/duckdb:parquet 1295483119 1401897691 0.92
statpopgen_q08/duckdb:parquet 1320423948 1402815958 0.94
statpopgen_q09/duckdb:parquet 1384618176 1464728855 0.95
statpopgen_q10/duckdb:parquet 2684735978 2911642520 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -8.5% -6.1% -2.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -10.9% -6.1% -5.1% +15.4% ➖ noise
1 duckdb:vortex-compact -3.0% -6.1% +3.3% +23.9% ➖ noise
1 duckdb:vortex-file-compressed -27.6% -6.1% -22.9% +191.8% ➖ noise
2 duckdb:vortex-compact -6.5% -6.0% -0.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -6.5% -6.0% -0.5% +10.0% ➖ noise
3 duckdb:vortex-compact -4.3% -4.0% -0.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -7.4% -4.0% -3.5% +10.0% ➖ noise
4 duckdb:vortex-compact -6.4% -3.5% -3.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -8.4% -3.5% -5.0% +10.0% ➖ noise
5 duckdb:vortex-compact -7.9% -8.1% +0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -6.9% -8.1% +1.3% +10.0% ➖ noise
6 duckdb:vortex-compact -5.1% -6.5% +1.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.7% -6.5% +1.9% +10.0% ➖ noise
7 duckdb:vortex-compact -6.9% -7.6% +0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -9.2% -7.6% -1.7% +10.0% ➖ noise
8 duckdb:vortex-compact -6.5% -5.9% -0.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -9.4% -5.9% -3.7% +10.0% ➖ noise
9 duckdb:vortex-compact -11.7% -5.5% -6.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.1% -5.5% +2.5% +10.0% ➖ noise
10 duckdb:vortex-compact -9.3% -7.8% -1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.3% -7.8% +1.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -1.1%

datafusion / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 386541966 392379111 0.99
tpch_q02/datafusion:vortex-file-compressed 105241902 108202436 0.97
tpch_q03/datafusion:vortex-file-compressed 213318335 216489356 0.99
tpch_q04/datafusion:vortex-file-compressed 112462460 114579095 0.98
tpch_q05/datafusion:vortex-file-compressed 365529638 370825626 0.99
tpch_q06/datafusion:vortex-file-compressed 42652910 44204209 0.96
tpch_q07/datafusion:vortex-file-compressed 492308536 503548531 0.98
tpch_q08/datafusion:vortex-file-compressed 351595152 357990022 0.98
tpch_q09/datafusion:vortex-file-compressed 618425649 633719036 0.98
tpch_q10/datafusion:vortex-file-compressed 227255682 229160328 0.99
tpch_q11/datafusion:vortex-file-compressed 80247746 82821204 0.97
tpch_q12/datafusion:vortex-file-compressed 116944442 121249106 0.96
tpch_q13/datafusion:vortex-file-compressed 208943361 213806930 0.98
tpch_q14/datafusion:vortex-file-compressed 55903872 56466535 0.99
tpch_q15/datafusion:vortex-file-compressed 104806627 105314877 1.00
tpch_q16/datafusion:vortex-file-compressed 73640003 75561677 0.97
tpch_q17/datafusion:vortex-file-compressed 619543808 630973611 0.98
tpch_q18/datafusion:vortex-file-compressed 824874494 841693262 0.98
tpch_q19/datafusion:vortex-file-compressed 88057001 92360981 0.95
tpch_q20/datafusion:vortex-file-compressed 162865225 166176823 0.98
tpch_q21/datafusion:vortex-file-compressed 641291124 657901287 0.97
tpch_q22/datafusion:vortex-file-compressed 64203284 64262207 1.00
datafusion / vortex-compact (0.986x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 435974772 431725137 1.01
tpch_q02/datafusion:vortex-compact 107400415 109818603 0.98
tpch_q03/datafusion:vortex-compact 213839654 216869639 0.99
tpch_q04/datafusion:vortex-compact 119947374 121557540 0.99
tpch_q05/datafusion:vortex-compact 371157952 374410032 0.99
tpch_q06/datafusion:vortex-compact 64076955 65060826 0.98
tpch_q07/datafusion:vortex-compact 514088508 523425623 0.98
tpch_q08/datafusion:vortex-compact 359248441 361997486 0.99
tpch_q09/datafusion:vortex-compact 628719215 633033795 0.99
tpch_q10/datafusion:vortex-compact 243729135 246886101 0.99
tpch_q11/datafusion:vortex-compact 81962059 83081704 0.99
tpch_q12/datafusion:vortex-compact 162537732 165580227 0.98
tpch_q13/datafusion:vortex-compact 257310885 264948931 0.97
tpch_q14/datafusion:vortex-compact 72769880 75019143 0.97
tpch_q15/datafusion:vortex-compact 157904169 160759576 0.98
tpch_q16/datafusion:vortex-compact 78717287 77879552 1.01
tpch_q17/datafusion:vortex-compact 626086601 633171010 0.99
tpch_q18/datafusion:vortex-compact 828322338 842748892 0.98
tpch_q19/datafusion:vortex-compact 130861744 135588112 0.97
tpch_q20/datafusion:vortex-compact 188259905 191145222 0.98
tpch_q21/datafusion:vortex-compact 648736575 659733594 0.98
tpch_q22/datafusion:vortex-compact 72024844 71950119 1.00
datafusion / parquet (0.985x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 462343470 463146752 1.00
tpch_q02/datafusion:parquet 167393898 171587364 0.98
tpch_q03/datafusion:parquet 270818272 276660075 0.98
tpch_q04/datafusion:parquet 122367855 125530650 0.97
tpch_q05/datafusion:parquet 422414394 430060947 0.98
tpch_q06/datafusion:parquet 117474843 127456576 0.92
tpch_q07/datafusion:parquet 593325533 601620660 0.99
tpch_q08/datafusion:parquet 448889001 455851320 0.98
tpch_q09/datafusion:parquet 726731746 734355391 0.99
tpch_q10/datafusion:parquet 484656652 495829550 0.98
tpch_q11/datafusion:parquet 115146414 115479631 1.00
tpch_q12/datafusion:parquet 192419682 191235616 1.01
tpch_q13/datafusion:parquet 331394537 333668817 0.99
tpch_q14/datafusion:parquet 158003435 156875540 1.01
tpch_q15/datafusion:parquet 242192725 244714433 0.99
tpch_q16/datafusion:parquet 119558365 122099002 0.98
tpch_q17/datafusion:parquet 664709119 671895735 0.99
tpch_q18/datafusion:parquet 871664755 878510990 0.99
tpch_q19/datafusion:parquet 250437922 252659875 0.99
tpch_q20/datafusion:parquet 283204511 290051594 0.98
tpch_q21/datafusion:parquet 676863245 686952113 0.99
tpch_q22/datafusion:parquet 210606117 213580185 0.99
datafusion / arrow (0.990x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 589414322 587984182 1.00
tpch_q02/datafusion:arrow 161936740 164873229 0.98
tpch_q03/datafusion:arrow 455569318 462288995 0.99
tpch_q04/datafusion:arrow 337434707 348179427 0.97
tpch_q05/datafusion:arrow 923098835 930823663 0.99
tpch_q06/datafusion:arrow 273923651 281982606 0.97
tpch_q07/datafusion:arrow 1157240416 1151385784 1.01
tpch_q08/datafusion:arrow 1134312559 1127849310 1.01
tpch_q09/datafusion:arrow 1342849877 1344045978 1.00
tpch_q10/datafusion:arrow 583287111 584901992 1.00
tpch_q11/datafusion:arrow 136691363 138042705 0.99
tpch_q12/datafusion:arrow 727700449 760981518 0.96
tpch_q13/datafusion:arrow 503716745 500708887 1.01
tpch_q14/datafusion:arrow 315425016 313089489 1.01
tpch_q15/datafusion:arrow 691624807 688153501 1.01
tpch_q16/datafusion:arrow 104461264 103261130 1.01
tpch_q17/datafusion:arrow 1310473758 1316263569 1.00
tpch_q18/datafusion:arrow 1855301985 1911787146 0.97
tpch_q19/datafusion:arrow 485427129 495439598 0.98
tpch_q20/datafusion:arrow 478422512 492236001 0.97
tpch_q21/datafusion:arrow 2983224330 2989287494 1.00
tpch_q22/datafusion:arrow 128550673 132225851 0.97
duckdb / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169526067 170916239 0.99
tpch_q02/duckdb:vortex-file-compressed 50687347 50385964 1.01
tpch_q03/duckdb:vortex-file-compressed 122842253 125254572 0.98
tpch_q04/duckdb:vortex-file-compressed 148375696 152469422 0.97
tpch_q05/duckdb:vortex-file-compressed 128858738 126028246 1.02
tpch_q06/duckdb:vortex-file-compressed 45539233 48268030 0.94
tpch_q07/duckdb:vortex-file-compressed 141578966 142597840 0.99
tpch_q08/duckdb:vortex-file-compressed 167298179 166792539 1.00
tpch_q09/duckdb:vortex-file-compressed 319175640 321482220 0.99
tpch_q10/duckdb:vortex-file-compressed 141094460 142753449 0.99
tpch_q11/duckdb:vortex-file-compressed 32736484 33632440 0.97
tpch_q12/duckdb:vortex-file-compressed 93534525 92380023 1.01
tpch_q13/duckdb:vortex-file-compressed 225189942 229124559 0.98
tpch_q14/duckdb:vortex-file-compressed 66260988 65752869 1.01
tpch_q15/duckdb:vortex-file-compressed 86528855 86887201 1.00
tpch_q16/duckdb:vortex-file-compressed 77545390 78884779 0.98
tpch_q17/duckdb:vortex-file-compressed 95686904 97230317 0.98
tpch_q18/duckdb:vortex-file-compressed 288486121 287792107 1.00
tpch_q19/duckdb:vortex-file-compressed 83209841 84007730 0.99
tpch_q20/duckdb:vortex-file-compressed 156286928 156426045 1.00
tpch_q21/duckdb:vortex-file-compressed 560410626 563453907 0.99
tpch_q22/duckdb:vortex-file-compressed 70040025 71001074 0.99
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 226978321 228132790 0.99
tpch_q02/duckdb:vortex-compact 54525557 55468855 0.98
tpch_q03/duckdb:vortex-compact 136329290 138623586 0.98
tpch_q04/duckdb:vortex-compact 170656584 171500316 1.00
tpch_q05/duckdb:vortex-compact 142038839 143974304 0.99
tpch_q06/duckdb:vortex-compact 82393001 83506806 0.99
tpch_q07/duckdb:vortex-compact 196198597 196252792 1.00
tpch_q08/duckdb:vortex-compact 183933093 185353912 0.99
tpch_q09/duckdb:vortex-compact 349631698 351008990 1.00
tpch_q10/duckdb:vortex-compact 175782478 175977672 1.00
tpch_q11/duckdb:vortex-compact 39737337 39994431 0.99
tpch_q12/duckdb:vortex-compact 199608921 200940047 0.99
tpch_q13/duckdb:vortex-compact 274216983 278006477 0.99
tpch_q14/duckdb:vortex-compact 96963885 98342815 0.99
tpch_q15/duckdb:vortex-compact 111281624 112293249 0.99
tpch_q16/duckdb:vortex-compact 82674012 83733965 0.99
tpch_q17/duckdb:vortex-compact 111032753 113069427 0.98
tpch_q18/duckdb:vortex-compact 291823421 288651353 1.01
tpch_q19/duckdb:vortex-compact 107240682 106458102 1.01
tpch_q20/duckdb:vortex-compact 199239629 201630373 0.99
tpch_q21/duckdb:vortex-compact 606831885 613669412 0.99
tpch_q22/duckdb:vortex-compact 84634549 85394719 0.99
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258851095 258208878 1.00
tpch_q02/duckdb:parquet 99676500 95814127 1.04
tpch_q03/duckdb:parquet 207107433 205821089 1.01
tpch_q04/duckdb:parquet 134059898 136492186 0.98
tpch_q05/duckdb:parquet 213440395 215316465 0.99
tpch_q06/duckdb:parquet 64560686 65387250 0.99
tpch_q07/duckdb:parquet 178565689 183108775 0.98
tpch_q08/duckdb:parquet 250147594 252357670 0.99
tpch_q09/duckdb:parquet 483791375 482626546 1.00
tpch_q10/duckdb:parquet 608793406 610946636 1.00
tpch_q11/duckdb:parquet 55332271 58682955 0.94
tpch_q12/duckdb:parquet 123400088 121099085 1.02
tpch_q13/duckdb:parquet 440414957 449095570 0.98
tpch_q14/duckdb:parquet 174473802 174228163 1.00
tpch_q15/duckdb:parquet 95276937 95083279 1.00
tpch_q16/duckdb:parquet 162881439 160714191 1.01
tpch_q17/duckdb:parquet 176233979 175825828 1.00
tpch_q18/duckdb:parquet 351685265 351986122 1.00
tpch_q19/duckdb:parquet 280898099 286014243 0.98
tpch_q20/duckdb:parquet 226396977 225256768 1.01
tpch_q21/duckdb:parquet 553978218 559086481 0.99
tpch_q22/duckdb:parquet 288770256 291952278 0.99
duckdb / duckdb (0.996x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116923786 117099782 1.00
tpch_q02/duckdb:duckdb 47504336 45592705 1.04
tpch_q03/duckdb:duckdb 97214444 96475138 1.01
tpch_q04/duckdb:duckdb 132101364 132534160 1.00
tpch_q05/duckdb:duckdb 111136264 108857085 1.02
tpch_q06/duckdb:duckdb 37042401 37043427 1.00
tpch_q07/duckdb:duckdb 85773009 86221321 0.99
tpch_q08/duckdb:duckdb 110097727 111012147 0.99
tpch_q09/duckdb:duckdb 276532282 272791553 1.01
tpch_q10/duckdb:duckdb 200836970 202683657 0.99
tpch_q11/duckdb:duckdb 15787480 15694107 1.01
tpch_q12/duckdb:duckdb 83901864 85448174 0.98
tpch_q13/duckdb:duckdb 218904556 222607816 0.98
tpch_q14/duckdb:duckdb 69715477 71077096 0.98
tpch_q15/duckdb:duckdb 76889975 78093454 0.98
tpch_q16/duckdb:duckdb 73009551 74175508 0.98
tpch_q17/duckdb:duckdb 84676867 84829355 1.00
tpch_q18/duckdb:duckdb 212340620 211914928 1.00
tpch_q19/duckdb:duckdb 116802251 116624892 1.00
tpch_q20/duckdb:duckdb 111913789 113033887 0.99
tpch_q21/duckdb:duckdb 294047790 296838434 0.99
tpch_q22/duckdb:duckdb 66372111 68793945 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.2% +0.0% +0.2% +10.0% ➖ noise
1 datafusion:vortex-compact +1.0% +0.0% +0.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -1.5% +0.0% -1.5% +10.0% ➖ noise
1 duckdb:duckdb -0.2% +0.0% -0.2% +10.0% ➖ noise
1 duckdb:vortex-compact -0.5% +0.0% -0.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.8% +0.0% -0.9% +10.0% ➖ noise
2 datafusion:arrow -1.8% +0.7% -2.5% +10.0% ➖ noise
2 datafusion:vortex-compact -2.2% +0.7% -2.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.7% +0.7% -3.5% +10.0% ➖ noise
2 duckdb:duckdb +4.2% +0.7% +3.4% +10.0% ➖ noise
2 duckdb:vortex-compact -1.7% +0.7% -2.4% +12.7% ➖ noise
2 duckdb:vortex-file-compressed +0.6% +0.7% -0.1% +10.0% ➖ noise
3 datafusion:arrow -1.5% -0.8% -0.7% +10.0% ➖ noise
3 datafusion:vortex-compact -1.4% -0.8% -0.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.5% -0.8% -0.7% +10.0% ➖ noise
3 duckdb:duckdb +0.8% -0.8% +1.5% +10.0% ➖ noise
3 duckdb:vortex-compact -1.7% -0.8% -0.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.9% -0.8% -1.2% +10.0% ➖ noise
4 datafusion:arrow -3.1% -2.2% -1.0% +10.0% ➖ noise
4 datafusion:vortex-compact -1.3% -2.2% +0.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.8% -2.2% +0.3% +10.0% ➖ noise
4 duckdb:duckdb -0.3% -2.2% +1.9% +10.0% ➖ noise
4 duckdb:vortex-compact -0.5% -2.2% +1.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.7% -2.2% -0.5% +10.0% ➖ noise
5 datafusion:arrow -0.8% -1.3% +0.5% +10.0% ➖ noise
5 datafusion:vortex-compact -0.9% -1.3% +0.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.4% -1.3% -0.1% +10.0% ➖ noise
5 duckdb:duckdb +2.1% -1.3% +3.5% +10.0% ➖ noise
5 duckdb:vortex-compact -1.3% -1.3% -0.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.2% -1.3% +3.6% +10.0% ➖ noise
6 datafusion:arrow -2.9% -4.6% +1.8% +10.0% ➖ noise
6 datafusion:vortex-compact -1.5% -4.6% +3.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.5% -4.6% +1.1% +10.0% ➖ noise
6 duckdb:duckdb -0.0% -4.6% +4.8% +10.7% ➖ noise
6 duckdb:vortex-compact -1.3% -4.6% +3.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -5.7% -4.6% -1.1% +13.2% ➖ noise
7 datafusion:arrow +0.5% -1.9% +2.5% +10.0% ➖ noise
7 datafusion:vortex-compact -1.8% -1.9% +0.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.2% -1.9% -0.3% +10.0% ➖ noise
7 duckdb:duckdb -0.5% -1.9% +1.4% +10.0% ➖ noise
7 duckdb:vortex-compact -0.0% -1.9% +1.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.7% -1.9% +1.2% +10.0% ➖ noise
8 datafusion:arrow +0.6% -1.2% +1.8% +10.0% ➖ noise
8 datafusion:vortex-compact -0.8% -1.2% +0.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.8% -1.2% -0.6% +10.0% ➖ noise
8 duckdb:duckdb -0.8% -1.2% +0.4% +10.0% ➖ noise
8 duckdb:vortex-compact -0.8% -1.2% +0.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.3% -1.2% +1.5% +10.0% ➖ noise
9 datafusion:arrow -0.1% -0.4% +0.3% +10.0% ➖ noise
9 datafusion:vortex-compact -0.7% -0.4% -0.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.4% -0.4% -2.0% +10.0% ➖ noise
9 duckdb:duckdb +1.4% -0.4% +1.8% +10.0% ➖ noise
9 duckdb:vortex-compact -0.4% -0.4% +0.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.7% -0.4% -0.3% +10.0% ➖ noise
10 datafusion:arrow -0.3% -1.3% +1.0% +10.0% ➖ noise
10 datafusion:vortex-compact -1.3% -1.3% +0.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.8% -1.3% +0.5% +10.0% ➖ noise
10 duckdb:duckdb -0.9% -1.3% +0.4% +10.0% ➖ noise
10 duckdb:vortex-compact -0.1% -1.3% +1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.2% -1.3% +0.1% +10.0% ➖ noise
11 datafusion:arrow -1.0% -3.0% +2.1% +10.0% ➖ noise
11 datafusion:vortex-compact -1.3% -3.0% +1.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.1% -3.0% -0.1% +10.0% ➖ noise
11 duckdb:duckdb +0.6% -3.0% +3.7% +11.6% ➖ noise
11 duckdb:vortex-compact -0.6% -3.0% +2.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.7% -3.0% +0.4% +10.0% ➖ noise
12 datafusion:arrow -4.4% +1.3% -5.6% +32.3% ➖ noise
12 datafusion:vortex-compact -1.8% +1.3% -3.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -3.6% +1.3% -4.7% +10.0% ➖ noise
12 duckdb:duckdb -1.8% +1.3% -3.0% +10.0% ➖ noise
12 duckdb:vortex-compact -0.7% +1.3% -1.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.2% +1.3% -0.0% +10.0% ➖ noise
13 datafusion:arrow +0.6% -1.3% +1.9% +10.0% ➖ noise
13 datafusion:vortex-compact -2.9% -1.3% -1.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.3% -1.3% -1.0% +10.0% ➖ noise
13 duckdb:duckdb -1.7% -1.3% -0.4% +10.0% ➖ noise
13 duckdb:vortex-compact -1.4% -1.3% -0.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.7% -1.3% -0.4% +10.0% ➖ noise
14 datafusion:arrow +0.7% +0.4% +0.3% +10.0% ➖ noise
14 datafusion:vortex-compact -3.0% +0.4% -3.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.0% +0.4% -1.4% +10.0% ➖ noise
14 duckdb:duckdb -1.9% +0.4% -2.3% +10.0% ➖ noise
14 duckdb:vortex-compact -1.4% +0.4% -1.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.8% +0.4% +0.3% +10.0% ➖ noise
15 datafusion:arrow +0.5% -0.4% +0.9% +10.0% ➖ noise
15 datafusion:vortex-compact -1.8% -0.4% -1.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.5% -0.4% -0.1% +10.0% ➖ noise
15 duckdb:duckdb -1.5% -0.4% -1.1% +10.0% ➖ noise
15 duckdb:vortex-compact -0.9% -0.4% -0.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.4% -0.4% +0.0% +10.0% ➖ noise
16 datafusion:arrow +1.2% -0.4% +1.5% +10.0% ➖ noise
16 datafusion:vortex-compact +1.1% -0.4% +1.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.5% -0.4% -2.2% +10.0% ➖ noise
16 duckdb:duckdb -1.6% -0.4% -1.2% +10.0% ➖ noise
16 duckdb:vortex-compact -1.3% -0.4% -0.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.7% -0.4% -1.3% +10.0% ➖ noise
17 datafusion:arrow -0.4% -0.4% -0.0% +10.0% ➖ noise
17 datafusion:vortex-compact -1.1% -0.4% -0.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.8% -0.4% -1.4% +10.0% ➖ noise
17 duckdb:duckdb -0.2% -0.4% +0.2% +10.0% ➖ noise
17 duckdb:vortex-compact -1.8% -0.4% -1.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -1.6% -0.4% -1.2% +10.0% ➖ noise
18 datafusion:arrow -3.0% -0.4% -2.5% +10.0% ➖ noise
18 datafusion:vortex-compact -1.7% -0.4% -1.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.0% -0.4% -1.6% +10.0% ➖ noise
18 duckdb:duckdb +0.2% -0.4% +0.6% +10.0% ➖ noise
18 duckdb:vortex-compact +1.1% -0.4% +1.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.2% -0.4% +0.7% +10.0% ➖ noise
19 datafusion:arrow -2.0% -1.3% -0.7% +10.0% ➖ noise
19 datafusion:vortex-compact -3.5% -1.3% -2.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -4.7% -1.3% -3.4% +10.0% ➖ noise
19 duckdb:duckdb +0.2% -1.3% +1.5% +10.0% ➖ noise
19 duckdb:vortex-compact +0.7% -1.3% +2.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.9% -1.3% +0.4% +10.0% ➖ noise
20 datafusion:arrow -2.8% -0.9% -1.9% +10.0% ➖ noise
20 datafusion:vortex-compact -1.5% -0.9% -0.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.0% -0.9% -1.1% +10.0% ➖ noise
20 duckdb:duckdb -1.0% -0.9% -0.1% +10.0% ➖ noise
20 duckdb:vortex-compact -1.2% -0.9% -0.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.1% -0.9% +0.9% +10.0% ➖ noise
21 datafusion:arrow -0.2% -1.2% +1.0% +10.0% ➖ noise
21 datafusion:vortex-compact -1.7% -1.2% -0.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -2.5% -1.2% -1.3% +10.0% ➖ noise
21 duckdb:duckdb -0.9% -1.2% +0.3% +10.0% ➖ noise
21 duckdb:vortex-compact -1.1% -1.2% +0.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.5% -1.2% +0.7% +10.0% ➖ noise
22 datafusion:arrow -2.8% -1.2% -1.6% +10.0% ➖ noise
22 datafusion:vortex-compact +0.1% -1.2% +1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.1% -1.2% +1.2% +10.0% ➖ noise
22 duckdb:duckdb -3.5% -1.2% -2.3% +10.0% ➖ noise
22 duckdb:vortex-compact -0.9% -1.2% +0.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -1.4% -1.2% -0.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 1.009x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.4%

datafusion / vortex-file-compressed (0.983x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 33350108 34027644 0.98
fineweb_q01/datafusion:vortex-file-compressed 633086564 652244926 0.97
fineweb_q02/datafusion:vortex-file-compressed 668569519 632557411 1.06
fineweb_q03/datafusion:vortex-file-compressed 1329169537 1443706257 0.92
fineweb_q04/datafusion:vortex-file-compressed 1362202357 1370090172 0.99
fineweb_q05/datafusion:vortex-file-compressed 1346602832 1349924457 1.00
fineweb_q06/datafusion:vortex-file-compressed 1542451251 1586500339 0.97
fineweb_q07/datafusion:vortex-file-compressed 1384389935 1411975495 0.98
fineweb_q08/datafusion:vortex-file-compressed 537316870 548044489 0.98
datafusion / vortex-compact (0.967x ➖, 1↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 53144763 32590656 1.63
fineweb_q01/datafusion:vortex-compact 🚀 509559607 730660136 0.70
fineweb_q02/datafusion:vortex-compact 653013455 699870282 0.93
fineweb_q03/datafusion:vortex-compact 1500700094 1484593111 1.01
fineweb_q04/datafusion:vortex-compact 1777052269 1768637672 1.00
fineweb_q05/datafusion:vortex-compact 1465908604 1473449800 0.99
fineweb_q06/datafusion:vortex-compact 1327900672 1587534801 0.84
fineweb_q07/datafusion:vortex-compact 1165186368 1289323174 0.90
fineweb_q08/datafusion:vortex-compact 373324025 408921761 0.91
datafusion / parquet (1.015x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1652902163 1224064857 1.35
fineweb_q01/datafusion:parquet 2277020242 2005701821 1.14
fineweb_q02/datafusion:parquet 1934664081 2016863655 0.96
fineweb_q03/datafusion:parquet 2127607451 2754710733 0.77
fineweb_q04/datafusion:parquet 2259183517 2044724970 1.10
fineweb_q05/datafusion:parquet 1995499448 2235371944 0.89
fineweb_q06/datafusion:parquet 2273019159 2267568417 1.00
fineweb_q07/datafusion:parquet 2205775016 2651751831 0.83
fineweb_q08/datafusion:parquet 2463622303 2021421498 1.22
duckdb / vortex-file-compressed (1.080x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 93565582 89438231 1.05
fineweb_q01/duckdb:vortex-file-compressed 625255035 601530993 1.04
fineweb_q02/duckdb:vortex-file-compressed 507851651 452458638 1.12
fineweb_q03/duckdb:vortex-file-compressed 1588810523 1467565565 1.08
fineweb_q04/duckdb:vortex-file-compressed 1850922100 1657220754 1.12
fineweb_q05/duckdb:vortex-file-compressed 1553781195 1437670685 1.08
fineweb_q06/duckdb:vortex-file-compressed 1818308405 1744607288 1.04
fineweb_q07/duckdb:vortex-file-compressed 1697854816 1534821155 1.11
fineweb_q08/duckdb:vortex-file-compressed 739019214 678187611 1.09
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 85512796 82683139 1.03
fineweb_q01/duckdb:vortex-compact 628753593 704005943 0.89
fineweb_q02/duckdb:vortex-compact 613206486 608254441 1.01
fineweb_q03/duckdb:vortex-compact 1701326569 1680734836 1.01
fineweb_q04/duckdb:vortex-compact 1900036150 1695075591 1.12
fineweb_q05/duckdb:vortex-compact 1588411447 1577616342 1.01
fineweb_q06/duckdb:vortex-compact 1566207336 1505070835 1.04
fineweb_q07/duckdb:vortex-compact 1470461431 1409512954 1.04
fineweb_q08/duckdb:vortex-compact 524890492 566837653 0.93
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1199352339 1183944850 1.01
fineweb_q01/duckdb:parquet 1293455504 1362173494 0.95
fineweb_q02/duckdb:parquet 1372004837 1410790479 0.97
fineweb_q03/duckdb:parquet 3657401718 3800134761 0.96
fineweb_q04/duckdb:parquet 1948440283 1943794483 1.00
fineweb_q05/duckdb:parquet 2163394396 2337371858 0.93
fineweb_q06/duckdb:parquet 4432285132 4410878181 1.00
fineweb_q07/duckdb:parquet 2835009758 2743369607 1.03
fineweb_q08/duckdb:parquet 1283188523 1125600536 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +63.1% +17.0% +39.4% +180.6% ➖ noise
0 datafusion:vortex-file-compressed -2.0% +17.0% -16.2% +264.5% ➖ noise
0 duckdb:vortex-compact +3.4% +17.0% -11.6% +65.6% ➖ noise
0 duckdb:vortex-file-compressed +4.6% +17.0% -10.6% +42.4% ➖ noise
1 datafusion:vortex-compact -30.3% +3.8% -32.8% +56.7% ➖ noise
1 datafusion:vortex-file-compressed -2.9% +3.8% -6.5% +72.2% ➖ noise
1 duckdb:vortex-compact -10.7% +3.8% -14.0% +50.4% ➖ noise
1 duckdb:vortex-file-compressed +3.9% +3.8% +0.1% +41.6% ➖ noise
2 datafusion:vortex-compact -6.7% -3.4% -3.4% +36.5% ➖ noise
2 datafusion:vortex-file-compressed +5.7% -3.4% +9.4% +43.1% ➖ noise
2 duckdb:vortex-compact +0.8% -3.4% +4.4% +32.1% ➖ noise
2 duckdb:vortex-file-compressed +12.2% -3.4% +16.2% +41.9% ➖ noise
3 datafusion:vortex-compact +1.1% -13.8% +17.2% +32.1% ➖ noise
3 datafusion:vortex-file-compressed -7.9% -13.8% +6.8% +32.1% ➖ noise
3 duckdb:vortex-compact +1.2% -13.8% +17.4% +32.1% ➖ noise
3 duckdb:vortex-file-compressed +8.3% -13.8% +25.6% +32.1% ➖ noise
4 datafusion:vortex-compact +0.5% +5.2% -4.5% +32.1% ➖ noise
4 datafusion:vortex-file-compressed -0.6% +5.2% -5.5% +32.1% ➖ noise
4 duckdb:vortex-compact +12.1% +5.2% +6.5% +32.1% ➖ noise
4 duckdb:vortex-file-compressed +11.7% +5.2% +6.1% +32.1% ➖ noise
5 datafusion:vortex-compact -0.5% -9.1% +9.5% +32.1% ➖ noise
5 datafusion:vortex-file-compressed -0.2% -9.1% +9.7% +32.1% ➖ noise
5 duckdb:vortex-compact +0.7% -9.1% +10.8% +32.1% ➖ noise
5 duckdb:vortex-file-compressed +8.1% -9.1% +18.9% +32.1% ➖ noise
6 datafusion:vortex-compact -16.4% +0.4% -16.7% +32.1% ➖ noise
6 datafusion:vortex-file-compressed -2.8% +0.4% -3.1% +32.1% ➖ noise
6 duckdb:vortex-compact +4.1% +0.4% +3.7% +32.1% ➖ noise
6 duckdb:vortex-file-compressed +4.2% +0.4% +3.8% +32.1% ➖ noise
7 datafusion:vortex-compact -9.6% -7.3% -2.5% +32.1% ➖ noise
7 datafusion:vortex-file-compressed -2.0% -7.3% +5.8% +32.1% ➖ noise
7 duckdb:vortex-compact +4.3% -7.3% +12.5% +32.1% ➖ noise
7 duckdb:vortex-file-compressed +10.6% -7.3% +19.3% +32.1% ➖ noise
8 datafusion:vortex-compact -8.7% +17.9% -22.5% +42.4% ➖ noise
8 datafusion:vortex-file-compressed -2.0% +17.9% -16.8% +53.2% ➖ noise
8 duckdb:vortex-compact -7.4% +17.9% -21.4% +32.1% ➖ noise
8 duckdb:vortex-file-compressed +9.0% +17.9% -7.6% +32.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.1%

datafusion / vortex-file-compressed (1.002x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1720042 1631532 1.05
clickbench_q01/datafusion:vortex-file-compressed 18756653 19214451 0.98
clickbench_q02/datafusion:vortex-file-compressed 38469814 37906319 1.01
clickbench_q03/datafusion:vortex-file-compressed 42756399 43429419 0.98
clickbench_q04/datafusion:vortex-file-compressed 290419401 281988560 1.03
clickbench_q05/datafusion:vortex-file-compressed 300573925 307067168 0.98
clickbench_q06/datafusion:vortex-file-compressed 1640102 1648901 0.99
clickbench_q07/datafusion:vortex-file-compressed 22986931 22298425 1.03
clickbench_q08/datafusion:vortex-file-compressed 352246848 348923990 1.01
clickbench_q09/datafusion:vortex-file-compressed 543699652 546326264 1.00
clickbench_q10/datafusion:vortex-file-compressed 73639088 74080020 0.99
clickbench_q11/datafusion:vortex-file-compressed 85349457 83714789 1.02
clickbench_q12/datafusion:vortex-file-compressed 275892399 258663325 1.07
clickbench_q13/datafusion:vortex-file-compressed 410015857 406303529 1.01
clickbench_q14/datafusion:vortex-file-compressed 243967224 254406313 0.96
clickbench_q15/datafusion:vortex-file-compressed 324244262 326536063 0.99
clickbench_q16/datafusion:vortex-file-compressed 645042865 636676148 1.01
clickbench_q17/datafusion:vortex-file-compressed 627449224 636459025 0.99
clickbench_q18/datafusion:vortex-file-compressed 1275651600 1263400101 1.01
clickbench_q19/datafusion:vortex-file-compressed 🚨 34625613 29356463 1.18
clickbench_q20/datafusion:vortex-file-compressed 336898161 335022000 1.01
clickbench_q21/datafusion:vortex-file-compressed 366905709 363782975 1.01
clickbench_q22/datafusion:vortex-file-compressed 444004030 439301605 1.01
clickbench_q23/datafusion:vortex-file-compressed 645488566 687740432 0.94
clickbench_q24/datafusion:vortex-file-compressed 43390235 45513763 0.95
clickbench_q25/datafusion:vortex-file-compressed 71029305 72934472 0.97
clickbench_q26/datafusion:vortex-file-compressed 43672610 48478982 0.90
clickbench_q27/datafusion:vortex-file-compressed 724289688 716661176 1.01
clickbench_q28/datafusion:vortex-file-compressed 6502277427 6254743494 1.04
clickbench_q29/datafusion:vortex-file-compressed 229524350 247411374 0.93
clickbench_q30/datafusion:vortex-file-compressed 219181644 218149595 1.00
clickbench_q31/datafusion:vortex-file-compressed 251185996 252369686 1.00
clickbench_q32/datafusion:vortex-file-compressed 1097504915 1082603474 1.01
clickbench_q33/datafusion:vortex-file-compressed 1287002009 1266716033 1.02
clickbench_q34/datafusion:vortex-file-compressed 1274582654 1258876220 1.01
clickbench_q35/datafusion:vortex-file-compressed 446171456 444631805 1.00
clickbench_q36/datafusion:vortex-file-compressed 70196142 70658765 0.99
clickbench_q37/datafusion:vortex-file-compressed 34797964 34853866 1.00
clickbench_q38/datafusion:vortex-file-compressed 18666333 19227076 0.97
clickbench_q39/datafusion:vortex-file-compressed 130756605 128954276 1.01
clickbench_q40/datafusion:vortex-file-compressed 15912427 15891321 1.00
clickbench_q41/datafusion:vortex-file-compressed 15284176 14967808 1.02
clickbench_q42/datafusion:vortex-file-compressed 16858133 16997665 0.99
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1528065 1532816 1.00
clickbench_q01/datafusion:parquet 19033167 18278938 1.04
clickbench_q02/datafusion:parquet 47752877 48087925 0.99
clickbench_q03/datafusion:parquet 37274484 37636523 0.99
clickbench_q04/datafusion:parquet 303602319 293197826 1.04
clickbench_q05/datafusion:parquet 351046454 337741862 1.04
clickbench_q06/datafusion:parquet 1589013 1532996 1.04
clickbench_q07/datafusion:parquet 22597519 22179996 1.02
clickbench_q08/datafusion:parquet 372671853 376847604 0.99
clickbench_q09/datafusion:parquet 610895366 610148867 1.00
clickbench_q10/datafusion:parquet 103207302 103353495 1.00
clickbench_q11/datafusion:parquet 127959400 126550712 1.01
clickbench_q12/datafusion:parquet 342962664 335214761 1.02
clickbench_q13/datafusion:parquet 488842455 486826168 1.00
clickbench_q14/datafusion:parquet 342773181 334782932 1.02
clickbench_q15/datafusion:parquet 333600955 331466338 1.01
clickbench_q16/datafusion:parquet 646067885 652333878 0.99
clickbench_q17/datafusion:parquet 637392669 643232666 0.99
clickbench_q18/datafusion:parquet 1311925295 1284834557 1.02
clickbench_q19/datafusion:parquet 29542108 29087534 1.02
clickbench_q20/datafusion:parquet 592682464 582533015 1.02
clickbench_q21/datafusion:parquet 648918393 647427960 1.00
clickbench_q22/datafusion:parquet 971505211 952496194 1.02
clickbench_q23/datafusion:parquet 3595894242 3525827273 1.02
clickbench_q24/datafusion:parquet 80033222 82898176 0.97
clickbench_q25/datafusion:parquet 129061613 127944869 1.01
clickbench_q26/datafusion:parquet 82232757 84780161 0.97
clickbench_q27/datafusion:parquet 1029934272 1042563093 0.99
clickbench_q28/datafusion:parquet 6588106905 6557469017 1.00
clickbench_q29/datafusion:parquet 239808696 247499654 0.97
clickbench_q30/datafusion:parquet 321880486 312657401 1.03
clickbench_q31/datafusion:parquet 359973630 359179624 1.00
clickbench_q32/datafusion:parquet 1124279279 1206059870 0.93
clickbench_q33/datafusion:parquet 1465624068 1440460597 1.02
clickbench_q34/datafusion:parquet 1460555331 1446382723 1.01
clickbench_q35/datafusion:parquet 454309397 450825970 1.01
clickbench_q36/datafusion:parquet 138470810 134767377 1.03
clickbench_q37/datafusion:parquet 55965587 55907677 1.00
clickbench_q38/datafusion:parquet 83445398 83618035 1.00
clickbench_q39/datafusion:parquet 260147320 253857907 1.02
clickbench_q40/datafusion:parquet 29582401 29417156 1.01
clickbench_q41/datafusion:parquet 27093631 26521059 1.02
clickbench_q42/datafusion:parquet 29410678 28490449 1.03
duckdb / vortex-file-compressed (0.973x ➖, 7↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6071437 5882136 1.03
clickbench_q01/duckdb:vortex-file-compressed 13557939 12995305 1.04
clickbench_q02/duckdb:vortex-file-compressed 25482729 24828629 1.03
clickbench_q03/duckdb:vortex-file-compressed 28897621 30744308 0.94
clickbench_q04/duckdb:vortex-file-compressed 179767471 180126017 1.00
clickbench_q05/duckdb:vortex-file-compressed 174670935 173825671 1.00
clickbench_q06/duckdb:vortex-file-compressed 20014210 20150845 0.99
clickbench_q07/duckdb:vortex-file-compressed 16151396 14896966 1.08
clickbench_q08/duckdb:vortex-file-compressed 254010981 254196412 1.00
clickbench_q09/duckdb:vortex-file-compressed 328736870 331015584 0.99
clickbench_q10/duckdb:vortex-file-compressed 64567023 66365857 0.97
clickbench_q11/duckdb:vortex-file-compressed 75038325 76311245 0.98
clickbench_q12/duckdb:vortex-file-compressed 192716679 192778855 1.00
clickbench_q13/duckdb:vortex-file-compressed 397307412 400752218 0.99
clickbench_q14/duckdb:vortex-file-compressed 231227890 224743078 1.03
clickbench_q15/duckdb:vortex-file-compressed 238747752 242106460 0.99
clickbench_q16/duckdb:vortex-file-compressed 580647580 574399117 1.01
clickbench_q17/duckdb:vortex-file-compressed 478220169 459247313 1.04
clickbench_q18/duckdb:vortex-file-compressed 963967945 965794282 1.00
clickbench_q19/duckdb:vortex-file-compressed 21085126 20304991 1.04
clickbench_q20/duckdb:vortex-file-compressed 316508087 326183356 0.97
clickbench_q21/duckdb:vortex-file-compressed 364994174 360409390 1.01
clickbench_q22/duckdb:vortex-file-compressed 🚨 595751023 497273390 1.20
clickbench_q23/duckdb:vortex-file-compressed 🚀 309375651 365775347 0.85
clickbench_q24/duckdb:vortex-file-compressed 36261822 36503855 0.99
clickbench_q25/duckdb:vortex-file-compressed 78785929 77618400 1.02
clickbench_q26/duckdb:vortex-file-compressed 42776749 46009662 0.93
clickbench_q27/duckdb:vortex-file-compressed 462288668 463346875 1.00
clickbench_q28/duckdb:vortex-file-compressed 2961024599 2958662305 1.00
clickbench_q29/duckdb:vortex-file-compressed 27611774 27689455 1.00
clickbench_q30/duckdb:vortex-file-compressed 184603545 187874299 0.98
clickbench_q31/duckdb:vortex-file-compressed 277980616 274215421 1.01
clickbench_q32/duckdb:vortex-file-compressed 1159275120 1190698989 0.97
clickbench_q33/duckdb:vortex-file-compressed 1113425220 1176833276 0.95
clickbench_q34/duckdb:vortex-file-compressed 1193754650 1191575428 1.00
clickbench_q35/duckdb:vortex-file-compressed 375719724 376829137 1.00
clickbench_q36/duckdb:vortex-file-compressed 🚀 25947289 29602102 0.88
clickbench_q37/duckdb:vortex-file-compressed 🚀 18793360 22305071 0.84
clickbench_q38/duckdb:vortex-file-compressed 🚀 20245511 23279646 0.87
clickbench_q39/duckdb:vortex-file-compressed 39326603 41713701 0.94
clickbench_q40/duckdb:vortex-file-compressed 🚀 19160847 24399268 0.79
clickbench_q41/duckdb:vortex-file-compressed 🚀 18631183 23816897 0.78
clickbench_q42/duckdb:vortex-file-compressed 🚀 19382227 23644085 0.82
duckdb / parquet (1.005x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25568436 24978557 1.02
clickbench_q01/duckdb:parquet 26900320 28534000 0.94
clickbench_q02/duckdb:parquet 47922538 48647911 0.99
clickbench_q03/duckdb:parquet 38083993 38591753 0.99
clickbench_q04/duckdb:parquet 199761818 200609074 1.00
clickbench_q05/duckdb:parquet 265848737 266452507 1.00
clickbench_q06/duckdb:parquet 45825582 45927207 1.00
clickbench_q07/duckdb:parquet 29126884 29830739 0.98
clickbench_q08/duckdb:parquet 267481739 263927958 1.01
clickbench_q09/duckdb:parquet 393838581 392706881 1.00
clickbench_q10/duckdb:parquet 81889537 80900132 1.01
clickbench_q11/duckdb:parquet 97768496 97761253 1.00
clickbench_q12/duckdb:parquet 282408753 292750789 0.96
clickbench_q13/duckdb:parquet 477669613 474354593 1.01
clickbench_q14/duckdb:parquet 329359343 326549202 1.01
clickbench_q15/duckdb:parquet 256286203 255944743 1.00
clickbench_q16/duckdb:parquet 645119924 630336323 1.02
clickbench_q17/duckdb:parquet 530297721 530159670 1.00
clickbench_q18/duckdb:parquet 1067231638 1054326155 1.01
clickbench_q19/duckdb:parquet 25889927 25406256 1.02
clickbench_q20/duckdb:parquet 420279835 421818610 1.00
clickbench_q21/duckdb:parquet 541045408 543924876 0.99
clickbench_q22/duckdb:parquet 942972711 936472205 1.01
clickbench_q23/duckdb:parquet 304543619 297569867 1.02
clickbench_q24/duckdb:parquet 68138630 68294358 1.00
clickbench_q25/duckdb:parquet 157228132 157229335 1.00
clickbench_q26/duckdb:parquet 48748443 50585269 0.96
clickbench_q27/duckdb:parquet 641424175 639728251 1.00
clickbench_q28/duckdb:parquet 4809703996 4848957139 0.99
clickbench_q29/duckdb:parquet 40796770 41044234 0.99
clickbench_q30/duckdb:parquet 301439709 298349064 1.01
clickbench_q31/duckdb:parquet 358873168 362475575 0.99
clickbench_q32/duckdb:parquet 1146867207 1204662408 0.95
clickbench_q33/duckdb:parquet 1213899948 1217693952 1.00
clickbench_q34/duckdb:parquet 1256566395 1254436745 1.00
clickbench_q35/duckdb:parquet 362474731 359542977 1.01
clickbench_q36/duckdb:parquet 49577011 49776360 1.00
clickbench_q37/duckdb:parquet 34397067 32713776 1.05
clickbench_q38/duckdb:parquet 33743995 32936540 1.02
clickbench_q39/duckdb:parquet 🚨 83695586 72636389 1.15
clickbench_q40/duckdb:parquet 19159685 17745401 1.08
clickbench_q41/duckdb:parquet 18279739 18199174 1.00
clickbench_q42/duckdb:parquet 20776413 20275973 1.02
duckdb / duckdb (0.984x ➖, 3↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18103588 18092362 1.00
clickbench_q01/duckdb:duckdb 32747432 32038159 1.02
clickbench_q02/duckdb:duckdb 43733066 44241494 0.99
clickbench_q03/duckdb:duckdb 47000806 46590073 1.01
clickbench_q04/duckdb:duckdb 186207584 188309393 0.99
clickbench_q05/duckdb:duckdb 261765567 266173184 0.98
clickbench_q06/duckdb:duckdb 28378559 28578206 0.99
clickbench_q07/duckdb:duckdb 35333187 34890228 1.01
clickbench_q08/duckdb:duckdb 249273381 247831090 1.01
clickbench_q09/duckdb:duckdb 366008602 365848479 1.00
clickbench_q10/duckdb:duckdb 97983720 97363738 1.01
clickbench_q11/duckdb:duckdb 107283594 107772648 1.00
clickbench_q12/duckdb:duckdb 238016023 234966612 1.01
clickbench_q13/duckdb:duckdb 468774575 492915093 0.95
clickbench_q14/duckdb:duckdb 275596548 279497016 0.99
clickbench_q15/duckdb:duckdb 215481377 217450828 0.99
clickbench_q16/duckdb:duckdb 623386203 644617196 0.97
clickbench_q17/duckdb:duckdb 528901989 554383540 0.95
clickbench_q18/duckdb:duckdb 1171326281 1190836644 0.98
clickbench_q19/duckdb:duckdb 34097910 34338584 0.99
clickbench_q20/duckdb:duckdb 🚀 887257202 1067970844 0.83
clickbench_q21/duckdb:duckdb 🚀 937605441 1119551660 0.84
clickbench_q22/duckdb:duckdb 1013401323 1104262159 0.92
clickbench_q23/duckdb:duckdb 254148144 250293303 1.02
clickbench_q24/duckdb:duckdb 61812217 61180736 1.01
clickbench_q25/duckdb:duckdb 141292330 141143081 1.00
clickbench_q26/duckdb:duckdb 59682715 59674062 1.00
clickbench_q27/duckdb:duckdb 🚀 967731835 1081662297 0.89
clickbench_q28/duckdb:duckdb 4586451756 4649396702 0.99
clickbench_q29/duckdb:duckdb 48183090 48307458 1.00
clickbench_q30/duckdb:duckdb 264073288 261265263 1.01
clickbench_q31/duckdb:duckdb 417011029 424540704 0.98
clickbench_q32/duckdb:duckdb 1538169068 1574520792 0.98
clickbench_q33/duckdb:duckdb 1968321902 2011349819 0.98
clickbench_q34/duckdb:duckdb 2089932225 2142017069 0.98
clickbench_q35/duckdb:duckdb 285690409 279853855 1.02
clickbench_q36/duckdb:duckdb 38749666 38362498 1.01
clickbench_q37/duckdb:duckdb 29491904 29967596 0.98
clickbench_q38/duckdb:duckdb 31780040 31527762 1.01
clickbench_q39/duckdb:duckdb 64343710 65532762 0.98
clickbench_q40/duckdb:duckdb 31351579 31108379 1.01
clickbench_q41/duckdb:duckdb 30506731 29394741 1.04
clickbench_q42/duckdb:duckdb 31648575 30743604 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +5.4% +1.0% +4.4% +781.8% ➖ noise
0 duckdb:duckdb +0.1% +1.0% -0.9% +291.1% ➖ noise
0 duckdb:vortex-file-compressed +3.2% +1.0% +2.2% +490.4% ➖ noise
1 datafusion:vortex-file-compressed -2.4% -0.9% -1.5% +25.7% ➖ noise
1 duckdb:duckdb +2.2% -0.9% +3.2% +57.5% ➖ noise
1 duckdb:vortex-file-compressed +4.3% -0.9% +5.3% +24.4% ➖ noise
2 datafusion:vortex-file-compressed +1.5% -1.1% +2.6% +16.2% ➖ noise
2 duckdb:duckdb -1.1% -1.1% -0.1% +19.5% ➖ noise
2 duckdb:vortex-file-compressed +2.6% -1.1% +3.8% +13.5% ➖ noise
3 datafusion:vortex-file-compressed -1.5% -1.1% -0.4% +143.9% ➖ noise
3 duckdb:duckdb +0.9% -1.1% +2.0% +37.6% ➖ noise
3 duckdb:vortex-file-compressed -6.0% -1.1% -4.9% +70.3% ➖ noise
4 datafusion:vortex-file-compressed +3.0% +1.5% +1.4% +10.0% ➖ noise
4 duckdb:duckdb -1.1% +1.5% -2.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% +1.5% -1.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.1% +1.8% -3.9% +10.0% ➖ noise
5 duckdb:duckdb -1.7% +1.8% -3.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.5% +1.8% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.5% +1.7% -2.2% +38.5% ➖ noise
6 duckdb:duckdb -0.7% +1.7% -2.4% +28.3% ➖ noise
6 duckdb:vortex-file-compressed -0.7% +1.7% -2.3% +18.9% ➖ noise
7 datafusion:vortex-file-compressed +3.1% -0.3% +3.4% +15.4% ➖ noise
7 duckdb:duckdb +1.3% -0.3% +1.5% +10.1% ➖ noise
7 duckdb:vortex-file-compressed +8.4% -0.3% +8.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.0% +0.1% +0.8% +10.0% ➖ noise
8 duckdb:duckdb +0.6% +0.1% +0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.1% +0.1% -0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.5% +0.2% -0.7% +10.0% ➖ noise
9 duckdb:duckdb +0.0% +0.2% -0.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.7% +0.2% -0.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.6% +0.5% -1.1% +10.0% ➖ noise
10 duckdb:duckdb +0.6% +0.5% +0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.7% +0.5% -3.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.0% +0.6% +1.4% +10.2% ➖ noise
11 duckdb:duckdb -0.5% +0.6% -1.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.7% +0.6% -2.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +6.7% -0.7% +7.4% +10.0% ➖ noise
12 duckdb:duckdb +1.3% -0.7% +2.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.0% -0.7% +0.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.9% +0.6% +0.4% +10.0% ➖ noise
13 duckdb:duckdb -4.9% +0.6% -5.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.9% +0.6% -1.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -4.1% +1.6% -5.6% +10.0% ➖ noise
14 duckdb:duckdb -1.4% +1.6% -3.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.9% +1.6% +1.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.7% +0.4% -1.1% +10.0% ➖ noise
15 duckdb:duckdb -0.9% +0.4% -1.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.4% +0.4% -1.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.3% +0.7% +0.6% +10.0% ➖ noise
16 duckdb:duckdb -3.3% +0.7% -3.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.1% +0.7% +0.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.4% -0.4% -1.0% +10.0% ➖ noise
17 duckdb:duckdb -4.6% -0.4% -4.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +4.1% -0.4% +4.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.0% +1.7% -0.7% +10.0% ➖ noise
18 duckdb:duckdb -1.6% +1.7% -3.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.2% +1.7% -1.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +17.9% +1.7% +15.9% +28.5% ➖ noise
19 duckdb:duckdb -0.7% +1.7% -2.4% +17.3% ➖ noise
19 duckdb:vortex-file-compressed +3.8% +1.7% +2.1% +19.2% ➖ noise
20 datafusion:vortex-file-compressed +0.6% +0.7% -0.1% +210.5% ➖ noise
20 duckdb:duckdb -16.9% +0.7% -17.5% +24.2% ➖ noise
20 duckdb:vortex-file-compressed -3.0% +0.7% -3.6% +61.1% ➖ noise
21 datafusion:vortex-file-compressed +0.9% -0.2% +1.0% +10.0% ➖ noise
21 duckdb:duckdb -16.3% -0.2% -16.1% +10.0% ✅ faster
21 duckdb:vortex-file-compressed +1.3% -0.2% +1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.1% +1.3% -0.3% +14.8% ➖ noise
22 duckdb:duckdb -8.2% +1.3% -9.4% +10.4% ✅ faster
22 duckdb:vortex-file-compressed +19.8% +1.3% +18.2% +15.5% 🚨 regression
23 datafusion:vortex-file-compressed -6.1% +2.2% -8.1% +51.4% ➖ noise
23 duckdb:duckdb +1.5% +2.2% -0.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -15.4% +2.2% -17.2% +17.2% ✅ faster
24 datafusion:vortex-file-compressed -4.7% -1.9% -2.9% +10.0% ➖ noise
24 duckdb:duckdb +1.0% -1.9% +2.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -0.7% -1.9% +1.2% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -2.6% +0.4% -3.0% +10.0% ➖ noise
25 duckdb:duckdb +0.1% +0.4% -0.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.5% +0.4% +1.1% +11.2% ➖ noise
26 datafusion:vortex-file-compressed -9.9% -3.3% -6.8% +15.0% ➖ noise
26 duckdb:duckdb +0.0% -3.3% +3.4% +11.0% ➖ noise
26 duckdb:vortex-file-compressed -7.0% -3.3% -3.8% +18.8% ➖ noise
27 datafusion:vortex-file-compressed +1.1% -0.5% +1.5% +10.0% ➖ noise
27 duckdb:duckdb -10.5% -0.5% -10.1% +10.0% ✅ faster
27 duckdb:vortex-file-compressed -0.2% -0.5% +0.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +4.0% -0.2% +4.1% +10.9% ➖ noise
28 duckdb:duckdb -1.4% -0.2% -1.2% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.1% -0.2% +0.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -7.2% -1.9% -5.5% +10.0% ➖ noise
29 duckdb:duckdb -0.3% -1.9% +1.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -0.3% -1.9% +1.6% +10.2% ➖ noise
30 datafusion:vortex-file-compressed +0.5% +2.0% -1.5% +10.0% ➖ noise
30 duckdb:duckdb +1.1% +2.0% -0.9% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.7% +2.0% -3.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.5% -0.4% -0.1% +10.0% ➖ noise
31 duckdb:duckdb -1.8% -0.4% -1.4% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +1.4% -0.4% +1.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.4% -5.8% +7.6% +10.0% ➖ noise
32 duckdb:duckdb -2.3% -5.8% +3.7% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -2.6% -5.8% +3.3% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.6% +0.7% +0.9% +10.0% ➖ noise
33 duckdb:duckdb -2.1% +0.7% -2.8% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -5.4% +0.7% -6.1% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.2% +0.6% +0.7% +10.0% ➖ noise
34 duckdb:duckdb -2.4% +0.6% -3.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +0.2% +0.6% -0.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.3% +0.8% -0.4% +10.0% ➖ noise
35 duckdb:duckdb +2.1% +0.8% +1.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.3% +0.8% -1.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -0.7% +1.2% -1.8% +10.0% ➖ noise
36 duckdb:duckdb +1.0% +1.2% -0.2% +14.9% ➖ noise
36 duckdb:vortex-file-compressed -12.3% +1.2% -13.4% +10.6% ✅ faster
37 datafusion:vortex-file-compressed -0.2% +2.6% -2.7% +10.0% ➖ noise
37 duckdb:duckdb -1.6% +2.6% -4.1% +10.5% ➖ noise
37 duckdb:vortex-file-compressed -15.7% +2.6% -17.9% +10.0% ✅ faster
38 datafusion:vortex-file-compressed -2.9% +1.1% -4.0% +10.0% ➖ noise
38 duckdb:duckdb +0.8% +1.1% -0.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -13.0% +1.1% -14.0% +10.9% ✅ faster
39 datafusion:vortex-file-compressed +1.4% +8.7% -6.7% +10.7% ➖ noise
39 duckdb:duckdb -1.8% +8.7% -9.6% +14.0% ➖ noise
39 duckdb:vortex-file-compressed -5.7% +8.7% -13.2% +14.4% ✅ faster
40 datafusion:vortex-file-compressed +0.1% +4.2% -3.9% +11.4% ➖ noise
40 duckdb:duckdb +0.8% +4.2% -3.3% +10.3% ➖ noise
40 duckdb:vortex-file-compressed -21.5% +4.2% -24.6% +15.1% ✅ faster
41 datafusion:vortex-file-compressed +2.1% +1.3% +0.8% +12.7% ➖ noise
41 duckdb:duckdb +3.8% +1.3% +2.5% +10.2% ➖ noise
41 duckdb:vortex-file-compressed -21.8% +1.3% -22.8% +10.1% ✅ faster
42 datafusion:vortex-file-compressed -0.8% +2.8% -3.6% +13.3% ➖ noise
42 duckdb:duckdb +2.9% +2.8% +0.1% +10.8% ➖ noise
42 duckdb:vortex-file-compressed -18.0% +2.8% -20.3% +14.1% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.015x ➖

datafusion / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 124736442 122769870 1.02
polarsignals_q01/datafusion:vortex-file-compressed 272587705 283454978 0.96
polarsignals_q02/datafusion:vortex-file-compressed 23469841 22945137 1.02
polarsignals_q03/datafusion:vortex-file-compressed 281786124 267917550 1.05
polarsignals_q04/datafusion:vortex-file-compressed 11489427 11346827 1.01
polarsignals_q05/datafusion:vortex-file-compressed 15095537 15395212 0.98
polarsignals_q06/datafusion:vortex-file-compressed 19247759 18484895 1.04
polarsignals_q07/datafusion:vortex-file-compressed 14454573 13894905 1.04
polarsignals_q08/datafusion:vortex-file-compressed 424499332 423942692 1.00
polarsignals_q09/datafusion:vortex-file-compressed 11491252 11161383 1.03

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Vortex (geomean): 0.991x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.0%

datafusion / vortex-file-compressed (0.999x ➖, 1↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 6019008 5586863 1.08
fineweb_q01/datafusion:vortex-file-compressed 21556664 21246320 1.01
fineweb_q02/datafusion:vortex-file-compressed 22057572 21320061 1.03
fineweb_q03/datafusion:vortex-file-compressed 🚀 73742258 89966741 0.82
fineweb_q04/datafusion:vortex-file-compressed 238761864 239479298 1.00
fineweb_q05/datafusion:vortex-file-compressed 216384454 216114353 1.00
fineweb_q06/datafusion:vortex-file-compressed 54010628 51512569 1.05
fineweb_q07/datafusion:vortex-file-compressed 60323000 60687068 0.99
fineweb_q08/datafusion:vortex-file-compressed 21570205 21027364 1.03
datafusion / vortex-compact (0.998x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6267825 5615114 1.12
fineweb_q01/datafusion:vortex-compact 130359304 129104044 1.01
fineweb_q02/datafusion:vortex-compact 127912325 129283346 0.99
fineweb_q03/datafusion:vortex-compact 1042457069 1050112037 0.99
fineweb_q04/datafusion:vortex-compact 1105707610 1127421375 0.98
fineweb_q05/datafusion:vortex-compact 961148655 963397436 1.00
fineweb_q06/datafusion:vortex-compact 534926239 541762384 0.99
fineweb_q07/datafusion:vortex-compact 546970328 556920149 0.98
fineweb_q08/datafusion:vortex-compact 18511049 19812553 0.93
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7028544 6787424 1.04
fineweb_q01/datafusion:parquet 296369746 296918023 1.00
fineweb_q02/datafusion:parquet 303854705 298099246 1.02
fineweb_q03/datafusion:parquet 296080540 292021957 1.01
fineweb_q04/datafusion:parquet 307412817 301117838 1.02
fineweb_q05/datafusion:parquet 305588243 300836361 1.02
fineweb_q06/datafusion:parquet 292940593 295895780 0.99
fineweb_q07/datafusion:parquet 285177699 288730752 0.99
fineweb_q08/datafusion:parquet 283587179 288906630 0.98
duckdb / vortex-file-compressed (0.959x ➖, 1↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3261093 3463410 0.94
fineweb_q01/duckdb:vortex-file-compressed 🚀 21698479 24374620 0.89
fineweb_q02/duckdb:vortex-file-compressed 24567100 24845413 0.99
fineweb_q03/duckdb:vortex-file-compressed 117029177 123780458 0.95
fineweb_q04/duckdb:vortex-file-compressed 226845223 224393413 1.01
fineweb_q05/duckdb:vortex-file-compressed 206406102 218769261 0.94
fineweb_q06/duckdb:vortex-file-compressed 52444470 53816536 0.97
fineweb_q07/duckdb:vortex-file-compressed 54231483 56349813 0.96
fineweb_q08/duckdb:vortex-file-compressed 22730852 23214986 0.98
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3907248 4027292 0.97
fineweb_q01/duckdb:vortex-compact 105248845 102442903 1.03
fineweb_q02/duckdb:vortex-compact 119694258 114684572 1.04
fineweb_q03/duckdb:vortex-compact 878726368 873131885 1.01
fineweb_q04/duckdb:vortex-compact 909616818 922630413 0.99
fineweb_q05/duckdb:vortex-compact 827435010 816649380 1.01
fineweb_q06/duckdb:vortex-compact 460392676 464132777 0.99
fineweb_q07/duckdb:vortex-compact 483078368 480605990 1.01
fineweb_q08/duckdb:vortex-compact 19518929 19114280 1.02
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32805388 32077251 1.02
fineweb_q01/duckdb:parquet 84937982 88677368 0.96
fineweb_q02/duckdb:parquet 86321276 86122477 1.00
fineweb_q03/duckdb:parquet 318577562 311595946 1.02
fineweb_q04/duckdb:parquet 445202921 442793536 1.01
fineweb_q05/duckdb:parquet 416738865 415626757 1.00
fineweb_q06/duckdb:parquet 200775751 198728356 1.01
fineweb_q07/duckdb:parquet 215505070 208852473 1.03
fineweb_q08/duckdb:parquet 34138659 35583576 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +11.6% +2.9% +8.5% +48.7% ➖ noise
0 datafusion:vortex-file-compressed +7.7% +2.9% +4.7% +46.1% ➖ noise
0 duckdb:vortex-compact -3.0% +2.9% -5.7% +47.8% ➖ noise
0 duckdb:vortex-file-compressed -5.8% +2.9% -8.5% +80.1% ➖ noise
1 datafusion:vortex-compact +1.0% -2.2% +3.3% +13.3% ➖ noise
1 datafusion:vortex-file-compressed +1.5% -2.2% +3.8% +23.8% ➖ noise
1 duckdb:vortex-compact +2.7% -2.2% +5.1% +14.2% ➖ noise
1 duckdb:vortex-file-compressed -11.0% -2.2% -9.0% +61.7% ➖ noise
2 datafusion:vortex-compact -1.1% +1.1% -2.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +3.5% +1.1% +2.4% +13.4% ➖ noise
2 duckdb:vortex-compact +4.4% +1.1% +3.3% +15.4% ➖ noise
2 duckdb:vortex-file-compressed -1.1% +1.1% -2.2% +10.0% ➖ noise
3 datafusion:vortex-compact -0.7% +1.8% -2.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -18.0% +1.8% -19.5% +47.7% ➖ noise
3 duckdb:vortex-compact +0.6% +1.8% -1.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.5% +1.8% -7.1% +27.6% ➖ noise
4 datafusion:vortex-compact -1.9% +1.3% -3.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.3% +1.3% -1.6% +10.0% ➖ noise
4 duckdb:vortex-compact -1.4% +1.3% -2.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% +1.3% -0.2% +10.0% ➖ noise
5 datafusion:vortex-compact -0.2% +0.9% -1.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.1% +0.9% -0.8% +10.0% ➖ noise
5 duckdb:vortex-compact +1.3% +0.9% +0.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.7% +0.9% -6.5% +10.0% ➖ noise
6 datafusion:vortex-compact -1.3% +0.0% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.8% +0.0% +4.8% +19.1% ➖ noise
6 duckdb:vortex-compact -0.8% +0.0% -0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.5% +0.0% -2.6% +10.0% ➖ noise
7 datafusion:vortex-compact -1.8% +1.0% -2.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.6% +1.0% -1.5% +21.9% ➖ noise
7 duckdb:vortex-compact +0.5% +1.0% -0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.8% +1.0% -4.7% +16.4% ➖ noise
8 datafusion:vortex-compact -6.6% -3.0% -3.7% +24.3% ➖ noise
8 datafusion:vortex-file-compressed +2.6% -3.0% +5.7% +10.0% ➖ noise
8 duckdb:vortex-compact +2.1% -3.0% +5.2% +19.3% ➖ noise
8 duckdb:vortex-file-compressed -2.1% -3.0% +0.9% +54.8% ➖ noise

@joseph-isaacs
add
b33fa40 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 1, 2026 •
edited
Loading

Merging this PR will degrade performance by 14.96%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 11 improved benchmarks
❌ 6 regressed benchmarks
✅ 1189 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation encode_varbinview[(1000, 2)] 244.3 µs 199 µs +22.75%
❌ Simulation filter_all_true[100000] 7.7 µs 8.7 µs -11.51%
❌ Simulation filter_all_true[250000] 7.7 µs 8.7 µs -11.51%
⚡ Simulation execute_scalar_struct_simple 516.5 µs 467.1 µs +10.58%
⚡ Simulation dict_canonicalize_zipfian[16, 1000] 89.3 µs 50.1 µs +78.18%
⚡ Simulation new_bp_prim_test_between[i16, 32768] 134.7 µs 120.3 µs +11.94%
⚡ Simulation new_bp_prim_test_between[i32, 32768] 169.2 µs 140.1 µs +20.83%
⚡ Simulation new_bp_prim_test_between[i32, 16384] 108.8 µs 93.7 µs +16.13%
⚡ Simulation new_bp_prim_test_between[i64, 16384] 143.9 µs 114.4 µs +25.75%
⚡ Simulation decompress_rd[f32, (100000, 0.01)] 583.9 µs 496 µs +17.72%
❌ Simulation decompress_rd[f64, (10000, 0.01)] 123.3 µs 139.6 µs -11.72%
❌ Simulation decompress_rd[f32, (100000, 0.0)] 496.9 µs 584.4 µs -14.96%
❌ Simulation decompress_rd[f64, (10000, 0.0)] 123.4 µs 139.6 µs -11.58%
⚡ Simulation decompress_rd[f64, (100000, 0.1)] 1,022 µs 843.4 µs +21.18%
❌ Simulation decompress_rd[f64, (10000, 0.1)] 123.4 µs 139.5 µs -11.53%
⚡ Simulation decompress_rd[f32, (100000, 0.1)] 583.9 µs 496.1 µs +17.71%
⚡ Simulation decompress_rd[f64, (100000, 0.01)] 1,021.8 µs 843.4 µs +21.15%

Comparing ji/vtable-array-outer (2fd02cb) with develop (fb0f605)

Open in CodSpeed

joseph-isaacs
joseph-isaacs commented May 5, 2026
View reviewed changes
Comment thread vortex-array/src/array/typed.rs Outdated
joseph-isaacs
joseph-isaacs commented May 5, 2026
View reviewed changes
Comment thread vortex-array/src/array/typed.rs Outdated
@joseph-isaacs
add
df45b29 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
add
d4fc23c 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
add
a3e495b 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
add
39e382a 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
add
2ea2bc8 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
add
07f977d 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement labels May 5, 2026
@joseph-isaacs joseph-isaacs changed the title do not merge: try out a new array memory layout perf[array]: outline the array parts data from the DynArray May 5, 2026
joseph-isaacs and others added 2 commits May 5, 2026 16:41
@joseph-isaacs
Merge remote-tracking branch 'origin/develop' into ji/vtable-array-outer
48f3028 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-array/src/array/erased.rs
#	vortex-array/src/array/mod.rs
@robert3005
fixes
0c4ab52 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
Copy link
Copy Markdown
Contributor

robert3005 commented May 5, 2026

@joseph-isaacs I made it compile but I maybe there's a better way

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 6, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 6, 2026
@joseph-isaacs
Copy link
Copy Markdown
Contributor Author

joseph-isaacs commented May 6, 2026

This seems like a reasonable why to do this for now

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 0c4ab52 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@joseph-isaacs
add
2fd02cb 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@joseph-isaacs joseph-isaacs marked this pull request as ready for review May 6, 2026 09:29
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@joseph-isaacs @robert3005