Skip to content

RowFn binary numeric ScalarFn rewrite - #9320

Closed
connortsui20 wants to merge 1 commit into
ct/row-fn-apifrom
ct/row-fn-numeric
Closed

RowFn binary numeric ScalarFn rewrite#9320
connortsui20 wants to merge 1 commit into
ct/row-fn-apifrom
ct/row-fn-numeric

Conversation

@connortsui20

@connortsui20 connortsui20 commented Aug 10, 2026

Copy link
Copy Markdown
Member

Tracking Issue: #9130

Moves primitive numeric arithmetic and comparisons to RowFn. Selected measured comparison cases retain their columnar paths.

TODO

@connortsui20 connortsui20 added the changelog/performance A performance improvement label Aug 10, 2026
@codspeed-hq

codspeed-hq Bot commented Aug 10, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 13.72%

⚡ 5 improved benchmarks
❌ 43 regressed benchmarks
✅ 1927 untouched benchmarks
🆕 1 new benchmark
⏩ 89 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation case_when_nary_10_conditions[1000] 425.9 µs 614.8 µs -30.72%
Simulation baseline_lt[4, 1024] 98.2 µs 131.1 µs -25.14%
Simulation case_when_nary_equality_lookup[1000] 323.1 µs 426.2 µs -24.2%
Simulation case_when_nary_10_conditions[10000] 766.3 µs 1,004.4 µs -23.71%
Simulation baseline_eq[4, 1024] 97.1 µs 127 µs -23.53%
Simulation baseline_eq[16, 1024] 98.8 µs 128.5 µs -23.09%
Simulation eq_i64_constant 372.2 µs 481.3 µs -22.68%
Simulation baseline_lt[16, 1024] 99.6 µs 128.3 µs -22.38%
Simulation case_when_nary_early_dominant[1000] 234.4 µs 296.9 µs -21.06%
Simulation case_when_nary_3_conditions[1000] 236.5 µs 298.7 µs -20.8%
Simulation case_when_nary_equality_lookup[10000] 526.1 µs 654.3 µs -19.59%
Simulation cold_misaligned[(64, 256)] 4.4 ms 5.4 ms -18.59%
Simulation case_when_all_false[1000] 125 µs 152.4 µs -17.95%
Simulation bench_compare_sliced_dict_primitive[(1000, 10000)] 130.6 µs 158.7 µs -17.76%
Simulation bench_compare_sliced_dict_primitive[(2500, 10000)] 151.2 µs 182.2 µs -17.01%
Simulation bench_compare_sliced_dict_primitive[(2000, 10000)] 144.5 µs 173.7 µs -16.82%
Simulation case_when_all_true[1000] 131.1 µs 156.9 µs -16.45%
Simulation case_when_nary_early_dominant[10000] 391.7 µs 468.5 µs -16.39%
Simulation case_when_nary_3_conditions[10000] 394.1 µs 471.1 µs -16.35%
Simulation bench_compare_sliced_dict_primitive[(3333, 10000)] 165.6 µs 197.1 µs -15.97%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ct/row-fn-numeric (b490007) with ct/row-fn-api (f759998)

Open in CodSpeed

Footnotes

  1. 89 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@connortsui20 connortsui20 changed the title Execute primitive numeric operators with RowFn Execute primitive binary operators with RowFn Aug 10, 2026

connortsui20 commented Aug 10, 2026

Copy link
Copy Markdown
Member Author

Local wall-time results do not reproduce the broad CodSpeed simulation regressions. Ratios below are candidate time / base time, so lower is better.

For example, locally (on my machine) the comparison commit improves the eq_i64_constant case to 0.817x locally, whereas CodSpeed reports a 1.221x regression. There are many more benchmarks that are wildly different on my local machine.

Measurement types
  • Isolated: A directly affected benchmark run by itself in a fresh process. Each result is the median of six base/candidate process pairs. Each revision ran first in three pairs. These are the primary performance measurements.
  • Control: A benchmark that does not execute the code changed by the commit. Controls came from eight full-matrix runs with alternating revision order. They detect unrelated process, allocator, cache, and machine movement.
  • Unstable control: An unchanged control with a wide range across process medians. Its aggregate ratio is not evidence for or against the change.
Primitive comparison results

Base is the numeric-only commit edbbbcd07. Candidate is the comparison commit 37eb039e2.

Benchmark Base Candidate Ratio Type
compare_int 27.395 µs 27.360 µs 0.999× isolated
compare_int_nullable 27.555 µs 27.560 µs 1.000× isolated
compare_int_constant 23.170 µs 23.200 µs 1.001× isolated
compare_int_constant_lhs 23.155 µs 23.185 µs 1.001× isolated
compare_int_eq 21.685 µs 19.310 µs 0.890× isolated
compare_i32 19.020 µs 7.389 µs 0.388× isolated
compare_i32_constant 18.990 µs 7.784 µs 0.410× isolated
compare_f32 33.125 µs 14.360 µs 0.434× isolated
compare_f32_eq 19.050 µs 7.214 µs 0.379× isolated
compare_float 49.590 µs 49.620 µs 1.001× isolated
compare_float_eq 21.805 µs 19.390 µs 0.889× isolated
compare_u64 27.375 µs 23.755 µs 0.868× isolated
compare_u64_constant 23.190 µs 23.210 µs 1.001× isolated
compare_u64_eq 21.780 µs 19.360 µs 0.889× isolated
compare_u8 39.045 µs 3.034 µs 0.078× isolated
compare_u8_constant 31.320 µs 3.374 µs 0.108× isolated

Ten cases are at or below 0.890×. The remaining six are between 0.999× and 1.001×.

Comparison controls

Base is edbbbcd07. Candidate is 37eb039e2.

Benchmark Base Candidate Ratio Type
compare_bool 1.504 µs 1.499 µs 0.997× control
compare_bool_constant 0.740 µs 0.740 µs 1.000× control
compare_bool_nullable 1.719 µs 1.729 µs 1.006× control
compare_decimal 37.090 µs 37.115 µs 1.001× control
compare_string_constant 36.145 µs 35.800 µs 0.990× control
compare_string_eq 32.250 µs 32.325 µs 1.002× control
compare_string_lt 44.600 µs 44.565 µs 0.999× control
compare_struct_eq 181.700 µs 180.550 µs 0.994× unstable control
compare_struct_lt 237.800 µs 238.500 µs 1.003× unstable control

The process medians ranged from 180.0 to 195.3 µs for the base compare_struct_eq control and from 179.8 to 194.6 µs for the candidate. For compare_struct_lt, the ranges were 194.6 to 252.9 µs and 180.0 to 253.5 µs.

Primitive numeric results

Base is the RowFn API commit 84837ad36, which does not use RowFn for primitive numeric arithmetic. Candidate is the numeric-only commit edbbbcd07, which does.

Benchmark Base Candidate Ratio Type
add_i32_nonnull 4.479 µs 4.659 µs 1.040× isolated
add_i64_constant 8.414 µs 9.254 µs 1.100× isolated
add_i64_nonnull 9.159 µs 9.389 µs 1.025× isolated
add_i64_nullable 10.275 µs 10.275 µs 1.000× isolated
add_u32_nonnull 4.019 µs 4.194 µs 1.044× isolated
div_i64_nonnull 44.800 µs 45.050 µs 1.006× isolated
div_i64_nullable 37.120 µs 41.165 µs 1.109× isolated
mul_i8_nonnull 6.179 µs 6.364 µs 1.030× isolated
mul_i16_nonnull 4.159 µs 4.339 µs 1.043× isolated
mul_i32_constant 26.440 µs 18.915 µs 0.715× isolated
mul_i32_nonnull 26.420 µs 26.640 µs 1.008× isolated
mul_i32_nullable 27.375 µs 27.450 µs 1.003× isolated
mul_i64_nonnull 23.175 µs 23.410 µs 1.010× isolated
mul_u8_nonnull 3.339 µs 3.539 µs 1.060× isolated
mul_u16_nonnull 2.614 µs 2.404 µs 0.920× isolated
mul_u32_nonnull 7.014 µs 7.184 µs 1.024× isolated
mul_u64_nonnull 19.160 µs 19.390 µs 1.012× isolated
sub_i64_constant 8.259 µs 9.164 µs 1.110× isolated

The numeric port is mixed. Two cases are below 0.921×, four are between 1.000× and 1.008×, and twelve are between 1.010× and 1.110×.

Numeric controls

Base is 84837ad36. Candidate is edbbbcd07.

Benchmark Base Candidate Ratio Type
add_decimal_i128_nullable 124.500 µs 124.800 µs 1.002× control
add_decimal_i64_nonnull 33.030 µs 33.140 µs 1.003× unstable control
and_bool_nullable 2.194 µs 2.244 µs 1.023× unstable control
div_decimal_i128_nullable 283.800 µs 283.700 µs 1.000× control
div_decimal_i64_nonnull 51.490 µs 51.470 µs 1.000× control
eq_i64_constant 12.040 µs 12.020 µs 0.998× control
lt_i64_nullable 16.705 µs 16.680 µs 0.999× control
mul_decimal_i128_nullable 82.780 µs 82.840 µs 1.001× control
mul_decimal_i64_nonnull 10.865 µs 10.865 µs 1.000× control
or_bool_constant 0.880 µs 0.890 µs 1.011× control

The base and candidate ranges for add_decimal_i64_nonnull were 31.590 to 34.470 µs and 31.660 to 34.590 µs. The ranges for and_bool_nullable were 2.179 to 2.669 µs and 2.209 to 2.339 µs.

Cross-benchmark sensitivity

The eight-run full matrix gave compare_int_nullable a 1.476× aggregate ratio. Running that benchmark alone gave 1.000×. This isolates the apparent regression to cross-benchmark process state, not the comparison kernel.

This is also why the tables separate isolated measurements from controls and unstable controls.

Method
  • CPU: AMD Ryzen 9 7950X, pinned to logical CPU 2.
  • Toolchain: Rust 1.91.0 with LLVM 21.1.2.
  • Build: default target, bench profile optimization level 3, 16 codegen units.
  • Timer: TSC, 100 samples.
  • Full matrix: 53 cases, eight fresh-process runs, alternating revision order, 500 ms per case.
  • Isolated cases: six fresh-process pairs, with each revision first three times, 500 ms per case.
  • Exact CodSpeed cases: eight fresh-process pairs, one second per case.
  • Each reported time is the median of the per-process Divan medians.
  • The same benchmark source was used for each compared revision.

These are local wall-time measurements. They are not CodSpeed CPU-simulation measurements and do not explain CodSpeed cache or instruction-cost changes.

Observations

There are only a few numeric arithmetic regressions of at most 10%, and they all are related to 64-bit operations being harder for the compiler to optimize. If I can't find a way to undo this regression via the RowFn API, then we can just special case on those and use handwritten kernels.

But in general, everything else is at parity or obviously better.

@connortsui20
connortsui20 marked this pull request as ready for review August 10, 2026 02:59
@connortsui20 connortsui20 changed the title Execute primitive binary operators with RowFn RowFn Binary Numeric Implementations Aug 10, 2026
@connortsui20 connortsui20 changed the title RowFn Binary Numeric Implementations RowFn binary numeric ScalarFn rewrite Aug 10, 2026
@joseph-isaacs

Copy link
Copy Markdown
Contributor

To help with the regressions, we could have support a mode that gives you constant size blocks of data instead of just row. But that can come later!

@connortsui20

connortsui20 commented Aug 10, 2026

Copy link
Copy Markdown
Member Author

@joseph-isaacs I already have batch execution built in to the machinery driving the RowFn framework, and also if we did that it would make it harder to define constant handling and null propagation semantics.

I am pretty certain that the regressions come from 1) initialization costs that might not need to be paid (this is why we have the UninitElementSink but it might be a bit wrong rn) and 2) cache line boundaries (something fit in 64-byte cache line but not anymore with all these generics) which are unfixable and have to have special casing around the RowFn.

@connortsui20 connortsui20 added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR labels Aug 10, 2026
@github-actions github-actions Bot removed action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Aug 10, 2026
@github-actions

github-actions Bot commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 32ad0bf clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 32ad0bf clickbench-nvme 1 Explore Profiling Data
🟢 Done 32ad0bf tpcds-nvme 1 Explore Profiling Data
🟢 Done 32ad0bf polarsignals 1 Explore Profiling Data
🟢 Done 32ad0bf fineweb 1 Explore Profiling Data
🟢 Done 32ad0bf tpch-nvme-10 1 Explore Profiling Data
🟢 Done 32ad0bf tpch-s3 1 Explore Profiling Data
🟢 Done 32ad0bf statpopgen 1 Explore Profiling Data
🟢 Done 32ad0bf fineweb-s3 1 Explore Profiling Data
🟢 Done 32ad0bf tpch-nvme 1 Explore Profiling Data
🟢 Done 32ad0bf tpch-s3-10 1 Explore Profiling Data
🟢 Done 32ad0bf appian-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-1.0%, environment too noisy confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 0.997x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 49695409 49005786 1.01
tpch_q02/datafusion:vortex-compact 27362166 27200043 1.01
tpch_q03/datafusion:vortex-compact 31638381 31557002 1.00
tpch_q04/datafusion:vortex-compact 18036251 17369199 1.04
tpch_q05/datafusion:vortex-compact 51967686 51798108 1.00
tpch_q06/datafusion:vortex-compact 9700111 9831323 0.99
tpch_q07/datafusion:vortex-compact 56759812 56977449 1.00
tpch_q08/datafusion:vortex-compact 48019252 47772855 1.01
tpch_q09/datafusion:vortex-compact 59153916 59925216 0.99
tpch_q10/datafusion:vortex-compact 34150163 34985193 0.98
tpch_q11/datafusion:vortex-compact 19278077 19646551 0.98
tpch_q12/datafusion:vortex-compact 31763732 31031147 1.02
tpch_q13/datafusion:vortex-compact 28377951 27697512 1.02
tpch_q14/datafusion:vortex-compact 17197439 17785058 0.97
tpch_q15/datafusion:vortex-compact 25882477 25176575 1.03
tpch_q16/datafusion:vortex-compact 28601441 28856020 0.99
tpch_q17/datafusion:vortex-compact 57586994 58784486 0.98
tpch_q18/datafusion:vortex-compact 69599226 68458822 1.02
tpch_q19/datafusion:vortex-compact 33058519 33061774 1.00
tpch_q20/datafusion:vortex-compact 34694455 34337833 1.01
tpch_q21/datafusion:vortex-compact 65728424 64775642 1.01
tpch_q22/datafusion:vortex-compact 13342829 13426911 0.99
datafusion / parquet / ns (1.012x ➖, 1↑ 2↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 132250524 113725116 1.16
tpch_q02/datafusion:parquet 71614590 71137921 1.01
tpch_q03/datafusion:parquet 🚨 106672613 95701877 1.11
tpch_q04/datafusion:parquet 57820791 55509049 1.04
tpch_q05/datafusion:parquet 126340215 115735329 1.09
tpch_q06/datafusion:parquet 🚀 42395521 48537598 0.87
tpch_q07/datafusion:parquet 128731810 127392557 1.01
tpch_q08/datafusion:parquet 130727601 127772293 1.02
tpch_q09/datafusion:parquet 160040096 150234723 1.07
tpch_q10/datafusion:parquet 117317131 128080082 0.92
tpch_q11/datafusion:parquet 50129546 49727358 1.01
tpch_q12/datafusion:parquet 95421733 100508829 0.95
tpch_q13/datafusion:parquet 222517261 230879882 0.96
tpch_q14/datafusion:parquet 53826718 54335320 0.99
tpch_q15/datafusion:parquet 69404071 64781846 1.07
tpch_q16/datafusion:parquet 48737462 49116495 0.99
tpch_q17/datafusion:parquet 145107077 151044279 0.96
tpch_q18/datafusion:parquet 181109247 176717576 1.02
tpch_q19/datafusion:parquet 75865468 77607085 0.98
tpch_q20/datafusion:parquet 93889291 91235037 1.03
tpch_q21/datafusion:parquet 169661548 174760806 0.97
tpch_q22/datafusion:parquet 58184709 55182389 1.05
duckdb / vortex-compact / ns (0.993x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 28756931 28486586 1.01
tpch_q02/duckdb:vortex-compact 41325910 40300339 1.03
tpch_q03/duckdb:vortex-compact 40290302 37368073 1.08
tpch_q04/duckdb:vortex-compact 34433884 33785217 1.02
tpch_q05/duckdb:vortex-compact 43453568 45407263 0.96
tpch_q06/duckdb:vortex-compact 🚀 13259517 15082198 0.88
tpch_q07/duckdb:vortex-compact 44548368 46381417 0.96
tpch_q08/duckdb:vortex-compact 55647528 59131257 0.94
tpch_q09/duckdb:vortex-compact 64845647 65910660 0.98
tpch_q10/duckdb:vortex-compact 57932438 56431768 1.03
tpch_q11/duckdb:vortex-compact 20053324 18963678 1.06
tpch_q12/duckdb:vortex-compact 32333929 32661664 0.99
tpch_q13/duckdb:vortex-compact 44195910 47761258 0.93
tpch_q14/duckdb:vortex-compact 25563671 25854057 0.99
tpch_q15/duckdb:vortex-compact 19789901 20540273 0.96
tpch_q16/duckdb:vortex-compact 35250239 35045825 1.01
tpch_q17/duckdb:vortex-compact 38867360 38118873 1.02
tpch_q18/duckdb:vortex-compact 55415216 53250582 1.04
tpch_q19/duckdb:vortex-compact 41698394 39403932 1.06
tpch_q20/duckdb:vortex-compact 42685598 44841196 0.95
tpch_q21/duckdb:vortex-compact 122975222 128935753 0.95
tpch_q22/duckdb:vortex-compact 23546201 22951122 1.03
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81646419 81684460 1.00
tpch_q02/duckdb:parquet 46131276 45703766 1.01
tpch_q03/duckdb:parquet 80774680 80746601 1.00
tpch_q04/duckdb:parquet 58069108 57578923 1.01
tpch_q05/duckdb:parquet 78177894 79048019 0.99
tpch_q06/duckdb:parquet 25119348 25115773 1.00
tpch_q07/duckdb:parquet 80376489 80138678 1.00
tpch_q08/duckdb:parquet 96642019 98385574 0.98
tpch_q09/duckdb:parquet 148833627 149768068 0.99
tpch_q10/duckdb:parquet 141202604 141689060 1.00
tpch_q11/duckdb:parquet 25427081 25117489 1.01
tpch_q12/duckdb:parquet 53550684 53102323 1.01
tpch_q13/duckdb:parquet 289283434 286244542 1.01
tpch_q14/duckdb:parquet 55980882 55879227 1.00
tpch_q15/duckdb:parquet 30612998 30723877 1.00
tpch_q16/duckdb:parquet 66979636 66786002 1.00
tpch_q17/duckdb:parquet 58198404 58314587 1.00
tpch_q18/duckdb:parquet 128951206 127767502 1.01
tpch_q19/duckdb:parquet 78053391 77342187 1.01
tpch_q20/duckdb:parquet 77645662 76882286 1.01
tpch_q21/duckdb:parquet 188896494 188450565 1.00
tpch_q22/duckdb:parquet 63827314 62979872 1.01

File Size Changes (9 files changed, -56.1% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-file-compressed 8.78 MB 0 B 8.78 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-file-compressed 164.64 MB 0 B 164.64 MB -100.0%
nation.vortex 1.0 vortex-file-compressed 11.68 KB 0 B 11.68 KB -100.0%
orders.vortex 1.0 vortex-file-compressed 39.39 MB 0 B 39.39 MB -100.0%
part.vortex 1.0 vortex-file-compressed 5.33 MB 0 B 5.33 MB -100.0%
partsupp.vortex 1.0 vortex-file-compressed 23.83 MB 0 B 23.83 MB -100.0%
region.vortex 1.0 vortex-file-compressed 7.20 KB 0 B 7.20 KB -100.0%
supplier.vortex 1.0 vortex-file-compressed 612.28 KB 0 B 612.28 KB -100.0%

Totals:

  • vortex-compact: 189.74 MB → 189.74 MB (0.0%)
  • vortex-file-compressed: 242.86 MB → 0 B (-100.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+1.6%, environment too noisy confidence)
Vortex (geomean): 1.006x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.003x ➖, 2↑ 2↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27952479 28836972 0.97
tpcds_q02/datafusion:vortex-compact 59512382 59004390 1.01
tpcds_q03/datafusion:vortex-compact 16546392 16839850 0.98
tpcds_q04/datafusion:vortex-compact 243133796 249194492 0.98
tpcds_q05/datafusion:vortex-compact 64000865 66069976 0.97
tpcds_q06/datafusion:vortex-compact 29861674 29644172 1.01
tpcds_q07/datafusion:vortex-compact 56917512 55241112 1.03
tpcds_q08/datafusion:vortex-compact 44139859 41769224 1.06
tpcds_q09/datafusion:vortex-compact 42599372 43307817 0.98
tpcds_q10/datafusion:vortex-compact 53826332 53242806 1.01
tpcds_q11/datafusion:vortex-compact 134892597 136727509 0.99
tpcds_q12/datafusion:vortex-compact 25987395 25249224 1.03
tpcds_q13/datafusion:vortex-compact 112669267 118942521 0.95
tpcds_q14/datafusion:vortex-compact 220874096 221953349 1.00
tpcds_q15/datafusion:vortex-compact 34815521 34868821 1.00
tpcds_q16/datafusion:vortex-compact 31142411 31572328 0.99
tpcds_q17/datafusion:vortex-compact 111454396 110928892 1.00
tpcds_q18/datafusion:vortex-compact 101735203 100863822 1.01
tpcds_q19/datafusion:vortex-compact 30606705 31233552 0.98
tpcds_q20/datafusion:vortex-compact 27261233 27592811 0.99
tpcds_q21/datafusion:vortex-compact 33810595 34003489 0.99
tpcds_q22/datafusion:vortex-compact 119459077 117776398 1.01
tpcds_q23/datafusion:vortex-compact 141743698 141533825 1.00
tpcds_q24/datafusion:vortex-compact 115156972 119450056 0.96
tpcds_q25/datafusion:vortex-compact 82168924 83754060 0.98
tpcds_q26/datafusion:vortex-compact 51263412 51404260 1.00
tpcds_q27/datafusion:vortex-compact 115143245 120846417 0.95
tpcds_q28/datafusion:vortex-compact 61650196 62737539 0.98
tpcds_q29/datafusion:vortex-compact 81541626 83234148 0.98
tpcds_q30/datafusion:vortex-compact 33803467 33997992 0.99
tpcds_q31/datafusion:vortex-compact 102956418 100658271 1.02
tpcds_q32/datafusion:vortex-compact 22650965 21946316 1.03
tpcds_q33/datafusion:vortex-compact 39026615 38317223 1.02
tpcds_q34/datafusion:vortex-compact 38167968 38014279 1.00
tpcds_q35/datafusion:vortex-compact 58236728 56122010 1.04
tpcds_q36/datafusion:vortex-compact 73396654 73966224 0.99
tpcds_q37/datafusion:vortex-compact 24441196 24169840 1.01
tpcds_q38/datafusion:vortex-compact 50067626 49200871 1.02
tpcds_q39/datafusion:vortex-compact 102252912 99101322 1.03
tpcds_q40/datafusion:vortex-compact 37257218 37628697 0.99
tpcds_q41/datafusion:vortex-compact 26472424 26645699 0.99
tpcds_q42/datafusion:vortex-compact 16678816 16839384 0.99
tpcds_q43/datafusion:vortex-compact 24514576 24926535 0.98
tpcds_q44/datafusion:vortex-compact 🚨 53659568 46806390 1.15
tpcds_q45/datafusion:vortex-compact 39544430 38491495 1.03
tpcds_q46/datafusion:vortex-compact 45744959 46964566 0.97
tpcds_q47/datafusion:vortex-compact 144264083 143217084 1.01
tpcds_q48/datafusion:vortex-compact 89258490 90756973 0.98
tpcds_q49/datafusion:vortex-compact 84312008 84215153 1.00
tpcds_q50/datafusion:vortex-compact 55388538 56183024 0.99
tpcds_q51/datafusion:vortex-compact 81752353 79441866 1.03
tpcds_q52/datafusion:vortex-compact 17214683 16961497 1.01
tpcds_q53/datafusion:vortex-compact 29051628 31144889 0.93
tpcds_q54/datafusion:vortex-compact 44754521 47004219 0.95
tpcds_q55/datafusion:vortex-compact 16680051 16697919 1.00
tpcds_q56/datafusion:vortex-compact 38852195 39574218 0.98
tpcds_q57/datafusion:vortex-compact 109850312 110599562 0.99
tpcds_q58/datafusion:vortex-compact 67433820 65462487 1.03
tpcds_q59/datafusion:vortex-compact 64708097 62493811 1.04
tpcds_q60/datafusion:vortex-compact 37938228 40192983 0.94
tpcds_q61/datafusion:vortex-compact 47212476 47646663 0.99
tpcds_q62/datafusion:vortex-compact 🚨 28198812 22946699 1.23
tpcds_q63/datafusion:vortex-compact 29155544 29564148 0.99
tpcds_q64/datafusion:vortex-compact 525530970 521269568 1.01
tpcds_q65/datafusion:vortex-compact 83401264 83098706 1.00
tpcds_q66/datafusion:vortex-compact 82588878 80886208 1.02
tpcds_q67/datafusion:vortex-compact 127288179 126631315 1.01
tpcds_q68/datafusion:vortex-compact 50496034 46899362 1.08
tpcds_q69/datafusion:vortex-compact 51226517 51830866 0.99
tpcds_q70/datafusion:vortex-compact 119424684 117444268 1.02
tpcds_q71/datafusion:vortex-compact 30083372 30876473 0.97
tpcds_q72/datafusion:vortex-compact 1496297380 1520485424 0.98
tpcds_q73/datafusion:vortex-compact 35785504 34894698 1.03
tpcds_q74/datafusion:vortex-compact 🚀 88365904 105131277 0.84
tpcds_q75/datafusion:vortex-compact 163621336 156807243 1.04
tpcds_q76/datafusion:vortex-compact 49550642 48724704 1.02
tpcds_q77/datafusion:vortex-compact 50655033 49868528 1.02
tpcds_q78/datafusion:vortex-compact 134555491 130163800 1.03
tpcds_q79/datafusion:vortex-compact 40009308 39336295 1.02
tpcds_q80/datafusion:vortex-compact 107263815 107052123 1.00
tpcds_q81/datafusion:vortex-compact 38387017 35354343 1.09
tpcds_q82/datafusion:vortex-compact 24717495 25726914 0.96
tpcds_q83/datafusion:vortex-compact 43534469 42582373 1.02
tpcds_q84/datafusion:vortex-compact 15216290 14748169 1.03
tpcds_q85/datafusion:vortex-compact 165235530 163462661 1.01
tpcds_q86/datafusion:vortex-compact 20702127 21065492 0.98
tpcds_q87/datafusion:vortex-compact 53450327 52090855 1.03
tpcds_q88/datafusion:vortex-compact 83260674 82113468 1.01
tpcds_q89/datafusion:vortex-compact 35171138 34565935 1.02
tpcds_q90/datafusion:vortex-compact 17288497 16417885 1.05
tpcds_q91/datafusion:vortex-compact 41961268 42823485 0.98
tpcds_q92/datafusion:vortex-compact 20367953 20453401 1.00
tpcds_q93/datafusion:vortex-compact 39377294 39255068 1.00
tpcds_q94/datafusion:vortex-compact 30687568 28659810 1.07
tpcds_q95/datafusion:vortex-compact 70870865 69668412 1.02
tpcds_q96/datafusion:vortex-compact 🚀 17100549 19065881 0.90
tpcds_q97/datafusion:vortex-compact 33882708 34633290 0.98
tpcds_q98/datafusion:vortex-compact 30756396 30583933 1.01
tpcds_q99/datafusion:vortex-compact 32133357 31364614 1.02
datafusion / parquet / ns (1.000x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30700942 32785949 0.94
tpcds_q02/datafusion:parquet 52954014 51404260 1.03
tpcds_q03/datafusion:parquet 17535174 17904073 0.98
tpcds_q04/datafusion:parquet 337512543 339927256 0.99
tpcds_q05/datafusion:parquet 80720284 80522045 1.00
tpcds_q06/datafusion:parquet 31726359 30814609 1.03
tpcds_q07/datafusion:parquet 97981089 99267916 0.99
tpcds_q08/datafusion:parquet 38896891 38218983 1.02
tpcds_q09/datafusion:parquet 36217255 37128567 0.98
tpcds_q10/datafusion:parquet 88834423 89601389 0.99
tpcds_q11/datafusion:parquet 163907746 169632240 0.97
tpcds_q12/datafusion:parquet 22740588 24363006 0.93
tpcds_q13/datafusion:parquet 101747159 98375874 1.03
tpcds_q14/datafusion:parquet 285156110 271871989 1.05
tpcds_q15/datafusion:parquet 37591582 37146004 1.01
tpcds_q16/datafusion:parquet 48788057 48665899 1.00
tpcds_q17/datafusion:parquet 110124028 107636543 1.02
tpcds_q18/datafusion:parquet 131734942 135680788 0.97
tpcds_q19/datafusion:parquet 28489913 28428018 1.00
tpcds_q20/datafusion:parquet 23507311 22971173 1.02
tpcds_q21/datafusion:parquet 22748885 24122370 0.94
tpcds_q22/datafusion:parquet 108923428 106903152 1.02
tpcds_q23/datafusion:parquet 176263706 177439065 0.99
tpcds_q24/datafusion:parquet 139538985 135957880 1.03
tpcds_q25/datafusion:parquet 108401226 107292685 1.01
tpcds_q26/datafusion:parquet 87452011 83868106 1.04
tpcds_q27/datafusion:parquet 167175505 166669310 1.00
tpcds_q28/datafusion:parquet 42711632 41347587 1.03
tpcds_q29/datafusion:parquet 109185033 106740961 1.02
tpcds_q30/datafusion:parquet 47291840 44815147 1.06
tpcds_q31/datafusion:parquet 95486717 93569275 1.02
tpcds_q32/datafusion:parquet 23883684 23949314 1.00
tpcds_q33/datafusion:parquet 37802571 37793700 1.00
tpcds_q34/datafusion:parquet 29496925 30033186 0.98
tpcds_q35/datafusion:parquet 89182052 93946774 0.95
tpcds_q36/datafusion:parquet 67525282 69725352 0.97
tpcds_q37/datafusion:parquet 23437004 23511413 1.00
tpcds_q38/datafusion:parquet 57250652 58490522 0.98
tpcds_q39/datafusion:parquet 83427599 81900201 1.02
tpcds_q40/datafusion:parquet 33612476 34403984 0.98
tpcds_q41/datafusion:parquet 19560546 19589929 1.00
tpcds_q42/datafusion:parquet 17110661 16570728 1.03
tpcds_q43/datafusion:parquet 23274894 22852267 1.02
tpcds_q44/datafusion:parquet 41113183 39648807 1.04
tpcds_q45/datafusion:parquet 44448333 44499723 1.00
tpcds_q46/datafusion:parquet 41319029 42511554 0.97
tpcds_q47/datafusion:parquet 151479731 153656710 0.99
tpcds_q48/datafusion:parquet 88562617 88264234 1.00
tpcds_q49/datafusion:parquet 77286896 76379000 1.01
tpcds_q50/datafusion:parquet 72669217 72628362 1.00
tpcds_q51/datafusion:parquet 84469446 82106583 1.03
tpcds_q52/datafusion:parquet 17135214 16754950 1.02
tpcds_q53/datafusion:parquet 25048677 24812123 1.01
tpcds_q54/datafusion:parquet 44932127 45446781 0.99
tpcds_q55/datafusion:parquet 16246113 17117403 0.95
tpcds_q56/datafusion:parquet 35982696 37091122 0.97
tpcds_q57/datafusion:parquet 130312369 128363641 1.02
tpcds_q58/datafusion:parquet 84766441 82032762 1.03
tpcds_q59/datafusion:parquet 75069418 74569455 1.01
tpcds_q60/datafusion:parquet 36006955 36813553 0.98
tpcds_q61/datafusion:parquet 45171010 45825225 0.99
tpcds_q62/datafusion:parquet 27760918 27808121 1.00
tpcds_q63/datafusion:parquet 25154478 24985771 1.01
tpcds_q64/datafusion:parquet 361772854 363765551 0.99
tpcds_q65/datafusion:parquet 48544578 52747581 0.92
tpcds_q66/datafusion:parquet 88259724 88153434 1.00
tpcds_q67/datafusion:parquet 143430559 147800846 0.97
tpcds_q68/datafusion:parquet 🚨 45170078 40643886 1.11
tpcds_q69/datafusion:parquet 84388462 87249154 0.97
tpcds_q70/datafusion:parquet 44066342 44737601 0.98
tpcds_q71/datafusion:parquet 26361554 27670927 0.95
tpcds_q72/datafusion:parquet 444178616 459571793 0.97
tpcds_q73/datafusion:parquet 28637859 27808807 1.03
tpcds_q74/datafusion:parquet 101443282 104322765 0.97
tpcds_q75/datafusion:parquet 166492931 177695596 0.94
tpcds_q76/datafusion:parquet 59787189 63640359 0.94
tpcds_q77/datafusion:parquet 56966810 58030526 0.98
tpcds_q78/datafusion:parquet 128687731 123546127 1.04
tpcds_q79/datafusion:parquet 34538049 34077499 1.01
tpcds_q80/datafusion:parquet 96633293 96381957 1.00
tpcds_q81/datafusion:parquet 39944341 38450977 1.04
tpcds_q82/datafusion:parquet 23244080 23131922 1.00
tpcds_q83/datafusion:parquet 56979877 56239124 1.01
tpcds_q84/datafusion:parquet 48587422 48008606 1.01
tpcds_q85/datafusion:parquet 196639835 196775760 1.00
tpcds_q86/datafusion:parquet 23710814 21902413 1.08
tpcds_q87/datafusion:parquet 60806867 61790121 0.98
tpcds_q88/datafusion:parquet 59867773 58867603 1.02
tpcds_q89/datafusion:parquet 30111186 29950806 1.01
tpcds_q90/datafusion:parquet 19641047 19380274 1.01
tpcds_q91/datafusion:parquet 64098442 64939010 0.99
tpcds_q92/datafusion:parquet 25335452 25379735 1.00
tpcds_q93/datafusion:parquet 36174935 36651839 0.99
tpcds_q94/datafusion:parquet 31092312 30968453 1.00
tpcds_q95/datafusion:parquet 90686183 89697931 1.01
tpcds_q96/datafusion:parquet 17723394 16573844 1.07
tpcds_q97/datafusion:parquet 38915039 39285643 0.99
tpcds_q98/datafusion:parquet 26890778 27790234 0.97
tpcds_q99/datafusion:parquet 34071202 34765558 0.98
duckdb / vortex-compact / ns (1.008x ➖, 3↑ 9↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 29110033 28950548 1.01
tpcds_q02/duckdb:vortex-compact 31630690 33922355 0.93
tpcds_q03/duckdb:vortex-compact 🚨 48185477 43001176 1.12
tpcds_q04/duckdb:vortex-compact 108570513 100139634 1.08
tpcds_q05/duckdb:vortex-compact 49851947 48684265 1.02
tpcds_q06/duckdb:vortex-compact 62223148 58933075 1.06
tpcds_q07/duckdb:vortex-compact 56477036 56940281 0.99
tpcds_q08/duckdb:vortex-compact 🚨 111079922 96360075 1.15
tpcds_q09/duckdb:vortex-compact 24041716 25398901 0.95
tpcds_q10/duckdb:vortex-compact 89549002 86627097 1.03
tpcds_q11/duckdb:vortex-compact 80752943 81052290 1.00
tpcds_q12/duckdb:vortex-compact 22520202 22181204 1.02
tpcds_q13/duckdb:vortex-compact 74226528 75201160 0.99
tpcds_q14/duckdb:vortex-compact 132088703 129220116 1.02
tpcds_q15/duckdb:vortex-compact 41931671 40704745 1.03
tpcds_q16/duckdb:vortex-compact 43432752 43982008 0.99
tpcds_q17/duckdb:vortex-compact 88371413 83824314 1.05
tpcds_q18/duckdb:vortex-compact 69614099 69017202 1.01
tpcds_q19/duckdb:vortex-compact 64716823 65921260 0.98
tpcds_q20/duckdb:vortex-compact 🚨 24557066 21661737 1.13
tpcds_q21/duckdb:vortex-compact 21924896 24183310 0.91
tpcds_q22/duckdb:vortex-compact 68230836 71758033 0.95
tpcds_q23/duckdb:vortex-compact 92946065 91748611 1.01
tpcds_q24/duckdb:vortex-compact 76607735 70605350 1.09
tpcds_q25/duckdb:vortex-compact 78315118 77377629 1.01
tpcds_q26/duckdb:vortex-compact 🚨 40337921 35891449 1.12
tpcds_q27/duckdb:vortex-compact 59832787 61094818 0.98
tpcds_q28/duckdb:vortex-compact 20645543 21077750 0.98
tpcds_q29/duckdb:vortex-compact 86130853 82571461 1.04
tpcds_q30/duckdb:vortex-compact 39925261 43334533 0.92
tpcds_q31/duckdb:vortex-compact 43085702 46593922 0.92
tpcds_q32/duckdb:vortex-compact 25076681 24130745 1.04
tpcds_q33/duckdb:vortex-compact 50565766 46648076 1.08
tpcds_q34/duckdb:vortex-compact 47918362 50078231 0.96
tpcds_q35/duckdb:vortex-compact 116100750 116644822 1.00
tpcds_q36/duckdb:vortex-compact 43215882 44050793 0.98
tpcds_q37/duckdb:vortex-compact 29802402 30339833 0.98
tpcds_q38/duckdb:vortex-compact 52008576 51990515 1.00
tpcds_q39/duckdb:vortex-compact 39182886 37388478 1.05
tpcds_q40/duckdb:vortex-compact 26879301 26748731 1.00
tpcds_q41/duckdb:vortex-compact 16647159 16235807 1.03
tpcds_q42/duckdb:vortex-compact 🚨 28205447 24710500 1.14
tpcds_q43/duckdb:vortex-compact 35295220 33238614 1.06
tpcds_q44/duckdb:vortex-compact 🚨 35977137 31961871 1.13
tpcds_q45/duckdb:vortex-compact 45902807 46019292 1.00
tpcds_q46/duckdb:vortex-compact 62555114 64416879 0.97
tpcds_q47/duckdb:vortex-compact 72777069 69867579 1.04
tpcds_q48/duckdb:vortex-compact 68148260 68670058 0.99
tpcds_q49/duckdb:vortex-compact 58441932 61708935 0.95
tpcds_q50/duckdb:vortex-compact 58196174 55864817 1.04
tpcds_q51/duckdb:vortex-compact 🚨 133435015 111781218 1.19
tpcds_q52/duckdb:vortex-compact 23823969 25569195 0.93
tpcds_q53/duckdb:vortex-compact 45588137 43713510 1.04
tpcds_q54/duckdb:vortex-compact 56643973 58176846 0.97
tpcds_q55/duckdb:vortex-compact 25190306 24559585 1.03
tpcds_q56/duckdb:vortex-compact 45645139 42916694 1.06
tpcds_q57/duckdb:vortex-compact 47708880 49819573 0.96
tpcds_q58/duckdb:vortex-compact 🚀 44231388 52194308 0.85
tpcds_q59/duckdb:vortex-compact 50926490 49005831 1.04
tpcds_q60/duckdb:vortex-compact 47717314 47927272 1.00
tpcds_q61/duckdb:vortex-compact 65455403 64318482 1.02
tpcds_q62/duckdb:vortex-compact 22824400 25319699 0.90
tpcds_q63/duckdb:vortex-compact 39780111 41507792 0.96
tpcds_q64/duckdb:vortex-compact 164523596 166003865 0.99
tpcds_q65/duckdb:vortex-compact 36993215 37439267 0.99
tpcds_q66/duckdb:vortex-compact 47995319 48117073 1.00
tpcds_q67/duckdb:vortex-compact 148174115 144779657 1.02
tpcds_q68/duckdb:vortex-compact 62096487 61367872 1.01
tpcds_q69/duckdb:vortex-compact 89965436 94636258 0.95
tpcds_q70/duckdb:vortex-compact 64770267 67924385 0.95
tpcds_q71/duckdb:vortex-compact 38474117 37455627 1.03
tpcds_q72/duckdb:vortex-compact 172149893 166711122 1.03
tpcds_q73/duckdb:vortex-compact 44157209 46633758 0.95
tpcds_q74/duckdb:vortex-compact 63073893 59918471 1.05
tpcds_q75/duckdb:vortex-compact 69353116 67289349 1.03
tpcds_q76/duckdb:vortex-compact 31682211 32541249 0.97
tpcds_q77/duckdb:vortex-compact 48238520 44830413 1.08
tpcds_q78/duckdb:vortex-compact 89908236 90967054 0.99
tpcds_q79/duckdb:vortex-compact 🚨 94576193 76569625 1.24
tpcds_q80/duckdb:vortex-compact 73281903 73122958 1.00
tpcds_q81/duckdb:vortex-compact 44367428 43255303 1.03
tpcds_q82/duckdb:vortex-compact 55602275 59233319 0.94
tpcds_q83/duckdb:vortex-compact 50528965 48630013 1.04
tpcds_q84/duckdb:vortex-compact 31522768 34928136 0.90
tpcds_q85/duckdb:vortex-compact 83054762 82185738 1.01
tpcds_q86/duckdb:vortex-compact 23008452 22689137 1.01
tpcds_q87/duckdb:vortex-compact 57537850 56094040 1.03
tpcds_q88/duckdb:vortex-compact 119768331 113548112 1.05
tpcds_q89/duckdb:vortex-compact 40046778 44213382 0.91
tpcds_q90/duckdb:vortex-compact 24054810 22918670 1.05
tpcds_q91/duckdb:vortex-compact 69360361 69740086 0.99
tpcds_q92/duckdb:vortex-compact 40965564 41908268 0.98
tpcds_q93/duckdb:vortex-compact 38923397 35710196 1.09
tpcds_q94/duckdb:vortex-compact 38821341 40952951 0.95
tpcds_q95/duckdb:vortex-compact 159084798 158613239 1.00
tpcds_q96/duckdb:vortex-compact 🚀 36141808 40498547 0.89
tpcds_q97/duckdb:vortex-compact 🚀 50831007 57671762 0.88
tpcds_q98/duckdb:vortex-compact 34815489 34862555 1.00
tpcds_q99/duckdb:vortex-compact 🚨 31286146 28307167 1.11
duckdb / parquet / ns (0.992x ➖, 5↑ 3↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31388637 34023631 0.92
tpcds_q02/duckdb:parquet 21790947 21907620 0.99
tpcds_q03/duckdb:parquet 12172165 12287938 0.99
tpcds_q04/duckdb:parquet 194425961 199318284 0.98
tpcds_q05/duckdb:parquet 32786540 34053986 0.96
tpcds_q06/duckdb:parquet 36997894 36129129 1.02
tpcds_q07/duckdb:parquet 23116303 22079892 1.05
tpcds_q08/duckdb:parquet 32419689 33255410 0.97
tpcds_q09/duckdb:parquet 30705589 30041396 1.02
tpcds_q10/duckdb:parquet 41333907 39912437 1.04
tpcds_q11/duckdb:parquet 109521591 103790508 1.06
tpcds_q12/duckdb:parquet 17988094 17992455 1.00
tpcds_q13/duckdb:parquet 33992797 35504254 0.96
tpcds_q14/duckdb:parquet 106116461 106260166 1.00
tpcds_q15/duckdb:parquet 34781515 36053941 0.96
tpcds_q16/duckdb:parquet 27684013 27335755 1.01
tpcds_q17/duckdb:parquet 44824367 44649882 1.00
tpcds_q18/duckdb:parquet 55653504 56045015 0.99
tpcds_q19/duckdb:parquet 33592075 33541905 1.00
tpcds_q20/duckdb:parquet 19497313 19455237 1.00
tpcds_q21/duckdb:parquet 14253904 14170041 1.01
tpcds_q22/duckdb:parquet 🚨 62318780 50582712 1.23
tpcds_q23/duckdb:parquet 68490292 65965546 1.04
tpcds_q24/duckdb:parquet 50032628 53611997 0.93
tpcds_q25/duckdb:parquet 42019365 42282981 0.99
tpcds_q26/duckdb:parquet 43930173 45722572 0.96
tpcds_q27/duckdb:parquet 57612546 56380528 1.02
tpcds_q28/duckdb:parquet 29919175 29099065 1.03
tpcds_q29/duckdb:parquet 43481721 47426986 0.92
tpcds_q30/duckdb:parquet 44155753 43320495 1.02
tpcds_q31/duckdb:parquet 29035255 29640668 0.98
tpcds_q32/duckdb:parquet 14827268 14924596 0.99
tpcds_q33/duckdb:parquet 23570028 24162242 0.98
tpcds_q34/duckdb:parquet 🚀 22163322 24639888 0.90
tpcds_q35/duckdb:parquet 67390121 68789590 0.98
tpcds_q36/duckdb:parquet 22224348 22416139 0.99
tpcds_q37/duckdb:parquet 18072039 18432429 0.98
tpcds_q38/duckdb:parquet 40225210 40891596 0.98
tpcds_q39/duckdb:parquet 38636136 38993995 0.99
tpcds_q40/duckdb:parquet 23300450 22363468 1.04
tpcds_q41/duckdb:parquet 10691376 10265521 1.04
tpcds_q42/duckdb:parquet 11758364 11925510 0.99
tpcds_q43/duckdb:parquet 14723309 14442502 1.02
tpcds_q44/duckdb:parquet 24772756 25168192 0.98
tpcds_q45/duckdb:parquet 33062178 32877841 1.01
tpcds_q46/duckdb:parquet 50498820 50963823 0.99
tpcds_q47/duckdb:parquet 51541842 50654574 1.02
tpcds_q48/duckdb:parquet 🚨 35400580 30401226 1.16
tpcds_q49/duckdb:parquet 28392128 28250679 1.01
tpcds_q50/duckdb:parquet 24642766 25253452 0.98
tpcds_q51/duckdb:parquet 97949601 99840886 0.98
tpcds_q52/duckdb:parquet 13627601 13311898 1.02
tpcds_q53/duckdb:parquet 🚀 15767375 18046030 0.87
tpcds_q54/duckdb:parquet 29395433 29628180 0.99
tpcds_q55/duckdb:parquet 11720657 12008099 0.98
tpcds_q56/duckdb:parquet 25193725 23694023 1.06
tpcds_q57/duckdb:parquet 42766108 42766620 1.00
tpcds_q58/duckdb:parquet 27216509 27708988 0.98
tpcds_q59/duckdb:parquet 30419437 29242555 1.04
tpcds_q60/duckdb:parquet 25901328 25213411 1.03
tpcds_q61/duckdb:parquet 31970810 31092417 1.03
tpcds_q62/duckdb:parquet 15943091 15097040 1.06
tpcds_q63/duckdb:parquet 17029024 17530054 0.97
tpcds_q64/duckdb:parquet 80663890 81556734 0.99
tpcds_q65/duckdb:parquet 🚀 22056439 25002577 0.88
tpcds_q66/duckdb:parquet 35127622 34461430 1.02
tpcds_q67/duckdb:parquet 127975570 142053478 0.90
tpcds_q68/duckdb:parquet 39549099 39141355 1.01
tpcds_q69/duckdb:parquet 44846096 41994721 1.07
tpcds_q70/duckdb:parquet 26216608 27240881 0.96
tpcds_q71/duckdb:parquet 21564860 21259408 1.01
tpcds_q72/duckdb:parquet 🚀 121303815 177399326 0.68
tpcds_q73/duckdb:parquet 🚀 18505321 21215177 0.87
tpcds_q74/duckdb:parquet 148480373 145589952 1.02
tpcds_q75/duckdb:parquet 60171334 59691694 1.01
tpcds_q76/duckdb:parquet 19166535 20120988 0.95
tpcds_q77/duckdb:parquet 25125225 25214805 1.00
tpcds_q78/duckdb:parquet 77878064 78875247 0.99
tpcds_q79/duckdb:parquet 33130920 32881731 1.01
tpcds_q80/duckdb:parquet 46660181 49124936 0.95
tpcds_q81/duckdb:parquet 41251503 41215615 1.00
tpcds_q82/duckdb:parquet 18983164 18611578 1.02
tpcds_q83/duckdb:parquet 22208029 22186447 1.00
tpcds_q84/duckdb:parquet 23723149 23874962 0.99
tpcds_q85/duckdb:parquet 48091444 47929205 1.00
tpcds_q86/duckdb:parquet 14793366 14908295 0.99
tpcds_q87/duckdb:parquet 43797631 43692030 1.00
tpcds_q88/duckdb:parquet 42839808 42855805 1.00
tpcds_q89/duckdb:parquet 17975874 18834450 0.95
tpcds_q90/duckdb:parquet 9552319 10101984 0.95
tpcds_q91/duckdb:parquet 26959357 27683699 0.97
tpcds_q92/duckdb:parquet 15345887 15343066 1.00
tpcds_q93/duckdb:parquet 🚨 35317092 31328066 1.13
tpcds_q94/duckdb:parquet 22075038 21893524 1.01
tpcds_q95/duckdb:parquet 136756126 137879718 0.99
tpcds_q96/duckdb:parquet 9550256 10149928 0.94
tpcds_q97/duckdb:parquet 38768993 38879357 1.00
tpcds_q98/duckdb:parquet 21394662 21132461 1.01
tpcds_q99/duckdb:parquet 23437043 23297980 1.01

File Size Changes (25 files changed, -56.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-file-compressed 57.01 KB 0 B 57.01 KB -100.0%
catalog_page.vortex 1.0 vortex-file-compressed 570.80 KB 0 B 570.80 KB -100.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.17 MB 0 B 7.17 MB -100.0%
catalog_sales.vortex 1.0 vortex-file-compressed 70.45 MB 0 B 70.45 MB -100.0%
customer.vortex 1.0 vortex-file-compressed 4.21 MB 0 B 4.21 MB -100.0%
customer_address.vortex 1.0 vortex-file-compressed 838.38 KB 0 B 838.38 KB -100.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 0 B 1.49 MB -100.0%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 0 B 1.03 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-file-compressed 17.99 KB 0 B 17.99 KB -100.0%
income_band.vortex 1.0 vortex-file-compressed 6.91 KB 0 B 6.91 KB -100.0%
inventory.vortex 1.0 vortex-file-compressed 36.64 MB 0 B 36.64 MB -100.0%
item.vortex 1.0 vortex-file-compressed 1.64 MB 0 B 1.64 MB -100.0%
promotion.vortex 1.0 vortex-file-compressed 61.96 KB 0 B 61.96 KB -100.0%
reason.vortex 1.0 vortex-file-compressed 8.18 KB 0 B 8.18 KB -100.0%
ship_mode.vortex 1.0 vortex-file-compressed 13.83 KB 0 B 13.83 KB -100.0%
store.vortex 1.0 vortex-file-compressed 52.18 KB 0 B 52.18 KB -100.0%
store_returns.vortex 1.0 vortex-file-compressed 10.98 MB 0 B 10.98 MB -100.0%
store_sales.vortex 1.0 vortex-file-compressed 96.34 MB 0 B 96.34 MB -100.0%
time_dim.vortex 1.0 vortex-file-compressed 409.85 KB 0 B 409.85 KB -100.0%
warehouse.vortex 1.0 vortex-file-compressed 25.23 KB 0 B 25.23 KB -100.0%
web_page.vortex 1.0 vortex-file-compressed 33.16 KB 0 B 33.16 KB -100.0%
web_returns.vortex 1.0 vortex-file-compressed 3.55 MB 0 B 3.55 MB -100.0%
web_sales.vortex 1.0 vortex-file-compressed 34.21 MB 0 B 34.21 MB -100.0%
web_site.vortex 1.0 vortex-file-compressed 57.06 KB 0 B 57.06 KB -100.0%

Totals:

  • vortex-compact: 208.03 MB → 208.03 MB (0.0%)
  • vortex-file-compressed: 270.07 MB → 0 B (-100.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+1.2%, environment too noisy confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): 0.996x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (0.993x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 9112359 9081996 1.00
fineweb_q01/datafusion:vortex-compact 100605194 101316939 0.99
fineweb_q02/datafusion:vortex-compact 97826236 99026813 0.99
fineweb_q03/datafusion:vortex-compact 530320255 532710488 1.00
fineweb_q04/datafusion:vortex-compact 554989819 556228070 1.00
fineweb_q05/datafusion:vortex-compact 505280647 506337595 1.00
fineweb_q06/datafusion:vortex-compact 287223430 289810837 0.99
fineweb_q07/datafusion:vortex-compact 295797722 297085256 1.00
fineweb_q08/datafusion:vortex-compact 14705871 15141056 0.97
datafusion / parquet / ns (0.981x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 9080666 10739866 0.85
fineweb_q01/datafusion:parquet 198183296 197723338 1.00
fineweb_q02/datafusion:parquet 200189302 199001126 1.01
fineweb_q03/datafusion:parquet 193595227 193356448 1.00
fineweb_q04/datafusion:parquet 209194472 209488216 1.00
fineweb_q05/datafusion:parquet 204207516 206776734 0.99
fineweb_q06/datafusion:parquet 200613499 200074079 1.00
fineweb_q07/datafusion:parquet 192627067 194304269 0.99
fineweb_q08/datafusion:parquet 190770749 190298482 1.00
duckdb / vortex-compact / ns (0.999x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 5392529 6256582 0.86
fineweb_q01/duckdb:vortex-compact 107684737 106714247 1.01
fineweb_q02/duckdb:vortex-compact 115215582 108942655 1.06
fineweb_q03/duckdb:vortex-compact 344962654 353204254 0.98
fineweb_q04/duckdb:vortex-compact 402597315 385725393 1.04
fineweb_q05/duckdb:vortex-compact 347668162 354159773 0.98
fineweb_q06/duckdb:vortex-compact 232714987 221674486 1.05
fineweb_q07/duckdb:vortex-compact 231955747 225045560 1.03
fineweb_q08/duckdb:vortex-compact 31139602 31264938 1.00
duckdb / parquet / ns (1.013x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 38898727 36462566 1.07
fineweb_q01/duckdb:parquet 77906573 74974561 1.04
fineweb_q02/duckdb:parquet 77129982 75051346 1.03
fineweb_q03/duckdb:parquet 207926560 207251747 1.00
fineweb_q04/duckdb:parquet 228005478 226969770 1.00
fineweb_q05/duckdb:parquet 201221809 201609096 1.00
fineweb_q06/duckdb:parquet 143799005 141702908 1.01
fineweb_q07/duckdb:parquet 143177569 140287280 1.02
fineweb_q08/duckdb:parquet 39058334 41130398 0.95

File Size Changes (2 files changed, -53.7% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-file-compressed 1.43 GB 0 B 1.43 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 0 B (-100.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.5%
Engines: DataFusion No clear signal (+4.8%, environment too noisy confidence) · DuckDB No clear signal (+4.2%, environment too noisy confidence)
Vortex (geomean): 1.021x ➖
Parquet (geomean): 0.977x ➖
Shifts: Parquet (control) -2.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.009x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-compact 196695615 203923754 0.96
clickbench-sorted_q24/datafusion:vortex-compact 53651159 50535432 1.06
clickbench-sorted_q26/datafusion:vortex-compact 52332055 52511350 1.00
clickbench-sorted_q36/datafusion:vortex-compact 58083700 59286662 0.98
clickbench-sorted_q37/datafusion:vortex-compact 46301460 47129953 0.98
clickbench-sorted_q38/datafusion:vortex-compact 45438305 44664269 1.02
clickbench-sorted_q39/datafusion:vortex-compact 103470015 101018310 1.02
clickbench-sorted_q40/datafusion:vortex-compact 25718219 24512387 1.05
clickbench-sorted_q41/datafusion:vortex-compact 22428304 21933057 1.02
clickbench-sorted_q42/datafusion:vortex-compact 15107537 15122666 1.00
datafusion / parquet / ns (0.963x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2934155506 2919510738 1.01
clickbench-sorted_q24/datafusion:parquet 33129325 35751803 0.93
clickbench-sorted_q26/datafusion:parquet 🚀 32475652 39668761 0.82
clickbench-sorted_q36/datafusion:parquet 165450325 178803904 0.93
clickbench-sorted_q37/datafusion:parquet 113496851 110070565 1.03
clickbench-sorted_q38/datafusion:parquet 163464136 171214107 0.95
clickbench-sorted_q39/datafusion:parquet 302959320 325748846 0.93
clickbench-sorted_q40/datafusion:parquet 67278412 65008042 1.03
clickbench-sorted_q41/datafusion:parquet 63306544 61557342 1.03
clickbench-sorted_q42/datafusion:parquet 34790268 34902040 1.00
duckdb / vortex-compact / ns (1.033x ➖, 0↑ 2↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-compact 237783833 239675315 0.99
clickbench-sorted_q24/duckdb:vortex-compact 66105464 68308231 0.97
clickbench-sorted_q26/duckdb:vortex-compact 🚨 101511252 87866948 1.16
clickbench-sorted_q36/duckdb:vortex-compact 69665943 67742822 1.03
clickbench-sorted_q37/duckdb:vortex-compact 66034083 61420615 1.08
clickbench-sorted_q38/duckdb:vortex-compact 61622199 62089678 0.99
clickbench-sorted_q39/duckdb:vortex-compact 🚨 121093272 108376857 1.12
clickbench-sorted_q40/duckdb:vortex-compact 39385655 40995136 0.96
clickbench-sorted_q41/duckdb:vortex-compact 40635251 39040288 1.04
clickbench-sorted_q42/duckdb:vortex-compact 33028000 32348265 1.02
duckdb / parquet / ns (0.992x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 220023728 224703202 0.98
clickbench-sorted_q24/duckdb:parquet 🚀 29668053 33000880 0.90
clickbench-sorted_q26/duckdb:parquet 23475487 22421299 1.05
clickbench-sorted_q36/duckdb:parquet 72712413 67313330 1.08
clickbench-sorted_q37/duckdb:parquet 54288627 54700324 0.99
clickbench-sorted_q38/duckdb:parquet 59828786 60471923 0.99
clickbench-sorted_q39/duckdb:parquet 107766725 107716474 1.00
clickbench-sorted_q40/duckdb:parquet 29465646 30650749 0.96
clickbench-sorted_q41/duckdb:parquet 28037813 27912061 1.00
clickbench-sorted_q42/duckdb:parquet 19888865 20394220 0.98

File Size Changes (201 files changed, -57.2% overall, 49↑ 152↓)
File Scale Format Base HEAD Change %
hits_067.vortex 1.0 vortex-compact 98.54 MB 100.16 MB +1.62 MB +1.6%
hits_065.vortex 1.0 vortex-compact 124.44 MB 125.65 MB +1.21 MB +1.0%
hits_012.vortex 1.0 vortex-compact 138.76 MB 140.06 MB +1.30 MB +0.9%
hits_061.vortex 1.0 vortex-compact 123.50 MB 124.44 MB +963.62 KB +0.8%
hits_097.vortex 1.0 vortex-compact 140.26 MB 141.33 MB +1.07 MB +0.8%
hits_026.vortex 1.0 vortex-compact 98.22 MB 98.96 MB +752.60 KB +0.7%
hits_002.vortex 1.0 vortex-compact 124.26 MB 125.15 MB +912.17 KB +0.7%
hits_015.vortex 1.0 vortex-compact 97.39 MB 98.09 MB +713.40 KB +0.7%
hits_098.vortex 1.0 vortex-compact 103.70 MB 104.29 MB +608.12 KB +0.6%
hits_056.vortex 1.0 vortex-compact 100.87 MB 101.43 MB +577.73 KB +0.6%
hits_048.vortex 1.0 vortex-compact 152.57 MB 153.39 MB +843.95 KB +0.5%
hits_091.vortex 1.0 vortex-compact 111.69 MB 112.29 MB +610.62 KB +0.5%
hits_049.vortex 1.0 vortex-compact 139.87 MB 140.59 MB +739.20 KB +0.5%
hits_029.vortex 1.0 vortex-compact 152.81 MB 153.51 MB +709.18 KB +0.5%
hits_033.vortex 1.0 vortex-compact 152.71 MB 153.38 MB +686.55 KB +0.4%
hits_071.vortex 1.0 vortex-compact 105.74 MB 106.21 MB +474.42 KB +0.4%
hits_045.vortex 1.0 vortex-compact 105.66 MB 106.11 MB +469.66 KB +0.4%
hits_017.vortex 1.0 vortex-compact 111.83 MB 112.29 MB +473.72 KB +0.4%
hits_081.vortex 1.0 vortex-compact 153.03 MB 153.62 MB +601.09 KB +0.4%
hits_041.vortex 1.0 vortex-compact 97.83 MB 98.12 MB +296.92 KB +0.3%
hits_030.vortex 1.0 vortex-compact 98.03 MB 98.31 MB +288.65 KB +0.3%
hits_066.vortex 1.0 vortex-compact 117.37 MB 117.70 MB +334.95 KB +0.3%
hits_008.vortex 1.0 vortex-compact 105.91 MB 106.19 MB +293.13 KB +0.3%
hits_089.vortex 1.0 vortex-compact 98.78 MB 98.98 MB +206.43 KB +0.2%
hits_036.vortex 1.0 vortex-compact 133.26 MB 133.48 MB +226.11 KB +0.2%
hits_007.vortex 1.0 vortex-compact 153.64 MB 153.87 MB +233.58 KB +0.1%
hits_011.vortex 1.0 vortex-compact 152.91 MB 153.11 MB +205.88 KB +0.1%
hits_094.vortex 1.0 vortex-compact 110.77 MB 110.88 MB +111.07 KB +0.1%
hits_064.vortex 1.0 vortex-compact 140.06 MB 140.18 MB +123.62 KB +0.1%
hits_043.vortex 1.0 vortex-compact 94.38 MB 94.44 MB +68.56 KB +0.1%
hits_042.vortex 1.0 vortex-compact 136.33 MB 136.43 MB +97.88 KB +0.1%
hits_095.vortex 1.0 vortex-compact 110.64 MB 110.71 MB +71.20 KB +0.1%
hits_027.vortex 1.0 vortex-compact 139.29 MB 139.38 MB +88.57 KB +0.1%
hits_085.vortex 1.0 vortex-compact 153.39 MB 153.48 MB +85.48 KB +0.1%
hits_020.vortex 1.0 vortex-compact 111.68 MB 111.74 MB +56.22 KB +0.0%
hits_060.vortex 1.0 vortex-compact 141.16 MB 141.23 MB +70.76 KB +0.0%
hits_044.vortex 1.0 vortex-compact 153.75 MB 153.82 MB +73.75 KB +0.0%
hits_006.vortex 1.0 vortex-compact 96.36 MB 96.41 MB +45.98 KB +0.0%
hits_087.vortex 1.0 vortex-compact 125.56 MB 125.61 MB +52.94 KB +0.0%
hits_083.vortex 1.0 vortex-compact 110.01 MB 110.04 MB +36.31 KB +0.0%
hits_090.vortex 1.0 vortex-compact 141.25 MB 141.29 MB +41.13 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.69 MB 110.72 MB +31.09 KB +0.0%
hits_037.vortex 1.0 vortex-compact 132.54 MB 132.56 MB +28.12 KB +0.0%
hits_032.vortex 1.0 vortex-compact 110.64 MB 110.66 MB +22.12 KB +0.0%
hits_028.vortex 1.0 vortex-compact 115.71 MB 115.73 MB +20.49 KB +0.0%
hits_058.vortex 1.0 vortex-compact 111.11 MB 111.13 MB +15.09 KB +0.0%
hits_021.vortex 1.0 vortex-compact 110.67 MB 110.67 MB +8.93 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.51 MB 110.52 MB +4.60 KB +0.0%
hits_069.vortex 1.0 vortex-compact 100.11 MB 100.11 MB +752 B +0.0%
hits_009.vortex 1.0 vortex-compact 75.27 MB 75.27 MB 480 B -0.0%
hits_062.vortex 1.0 vortex-compact 132.65 MB 132.65 MB 984 B -0.0%
hits_019.vortex 1.0 vortex-compact 106.18 MB 106.17 MB 5.45 KB -0.0%
hits_096.vortex 1.0 vortex-compact 153.28 MB 153.27 MB 9.62 KB -0.0%
hits_053.vortex 1.0 vortex-compact 138.48 MB 138.47 MB 11.04 KB -0.0%
hits_035.vortex 1.0 vortex-compact 75.97 MB 75.96 MB 6.87 KB -0.0%
hits_068.vortex 1.0 vortex-compact 112.46 MB 112.45 MB 10.30 KB -0.0%
hits_034.vortex 1.0 vortex-compact 133.45 MB 133.43 MB 13.91 KB -0.0%
hits_080.vortex 1.0 vortex-compact 96.73 MB 96.72 MB 10.80 KB -0.0%
hits_003.vortex 1.0 vortex-compact 104.57 MB 104.56 MB 11.91 KB -0.0%
hits_024.vortex 1.0 vortex-compact 125.34 MB 125.32 MB 21.72 KB -0.0%
hits_075.vortex 1.0 vortex-compact 139.23 MB 139.20 MB 27.13 KB -0.0%
hits_040.vortex 1.0 vortex-compact 110.50 MB 110.48 MB 23.24 KB -0.0%
hits_070.vortex 1.0 vortex-compact 153.79 MB 153.75 MB 32.50 KB -0.0%
hits_088.vortex 1.0 vortex-compact 134.39 MB 134.36 MB 29.08 KB -0.0%
hits_054.vortex 1.0 vortex-compact 112.20 MB 112.18 MB 28.55 KB -0.0%
hits_022.vortex 1.0 vortex-compact 153.22 MB 153.18 MB 40.16 KB -0.0%
hits_001.vortex 1.0 vortex-compact 139.08 MB 139.03 MB 44.63 KB -0.0%
hits_023.vortex 1.0 vortex-compact 142.80 MB 142.74 MB 60.96 KB -0.0%
hits_046.vortex 1.0 vortex-compact 75.03 MB 74.99 MB 35.42 KB -0.0%
hits_072.vortex 1.0 vortex-compact 75.69 MB 75.66 MB 35.91 KB -0.0%
hits_079.vortex 1.0 vortex-compact 128.28 MB 128.21 MB 68.36 KB -0.1%
hits_073.vortex 1.0 vortex-compact 134.30 MB 134.22 MB 75.15 KB -0.1%
hits_010.vortex 1.0 vortex-compact 123.56 MB 123.48 MB 83.20 KB -0.1%
hits_038.vortex 1.0 vortex-compact 139.61 MB 139.48 MB 135.15 KB -0.1%
hits_074.vortex 1.0 vortex-compact 153.21 MB 153.07 MB 148.81 KB -0.1%
hits_051.vortex 1.0 vortex-compact 134.04 MB 133.89 MB 151.20 KB -0.1%
hits_099.vortex 1.0 vortex-compact 133.36 MB 133.18 MB 182.03 KB -0.1%
hits_055.vortex 1.0 vortex-compact 153.45 MB 153.22 MB 235.59 KB -0.1%
hits_016.vortex 1.0 vortex-compact 127.64 MB 127.44 MB 200.66 KB -0.2%
hits_057.vortex 1.0 vortex-compact 112.03 MB 111.84 MB 192.89 KB -0.2%
hits_025.vortex 1.0 vortex-compact 133.72 MB 133.49 MB 233.85 KB -0.2%
hits_039.vortex 1.0 vortex-compact 125.49 MB 125.26 MB 238.79 KB -0.2%
hits_078.vortex 1.0 vortex-compact 97.20 MB 97.02 MB 189.17 KB -0.2%
hits_076.vortex 1.0 vortex-compact 125.34 MB 125.08 MB 272.96 KB -0.2%
hits_077.vortex 1.0 vortex-compact 134.59 MB 134.25 MB 350.36 KB -0.3%
hits_092.vortex 1.0 vortex-compact 153.55 MB 153.14 MB 420.55 KB -0.3%
hits_086.vortex 1.0 vortex-compact 141.24 MB 140.86 MB 389.64 KB -0.3%
hits_014.vortex 1.0 vortex-compact 134.58 MB 134.16 MB 428.32 KB -0.3%
hits_082.vortex 1.0 vortex-compact 106.28 MB 105.88 MB 417.42 KB -0.4%
hits_052.vortex 1.0 vortex-compact 98.41 MB 98.03 MB 389.81 KB -0.4%
hits_005.vortex 1.0 vortex-compact 116.36 MB 115.90 MB 466.51 KB -0.4%
hits_050.vortex 1.0 vortex-compact 125.45 MB 124.88 MB 589.91 KB -0.5%
hits_059.vortex 1.0 vortex-compact 152.82 MB 152.06 MB 781.57 KB -0.5%
hits_031.vortex 1.0 vortex-compact 111.74 MB 111.18 MB 582.30 KB -0.5%
hits_063.vortex 1.0 vortex-compact 98.53 MB 98.01 MB 535.68 KB -0.5%
hits_018.vortex 1.0 vortex-compact 153.82 MB 152.95 MB 892.12 KB -0.6%
hits_004.vortex 1.0 vortex-compact 98.92 MB 98.12 MB 818.00 KB -0.8%
hits_000.vortex 1.0 vortex-compact 99.17 MB 98.25 MB 943.03 KB -0.9%
hits_093.vortex 1.0 vortex-compact 99.58 MB 98.49 MB 1.09 MB -1.1%
hits_013.vortex 1.0 vortex-compact 125.68 MB 123.98 MB 1.70 MB -1.4%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-file-compressed 131.51 MB 0 B 131.51 MB -100.0%
hits_001.vortex 1.0 vortex-file-compressed 191.58 MB 0 B 191.58 MB -100.0%
hits_002.vortex 1.0 vortex-file-compressed 161.06 MB 0 B 161.06 MB -100.0%
hits_003.vortex 1.0 vortex-file-compressed 136.66 MB 0 B 136.66 MB -100.0%
hits_004.vortex 1.0 vortex-file-compressed 131.58 MB 0 B 131.58 MB -100.0%
hits_005.vortex 1.0 vortex-file-compressed 167.61 MB 0 B 167.61 MB -100.0%
hits_006.vortex 1.0 vortex-file-compressed 126.44 MB 0 B 126.44 MB -100.0%
hits_007.vortex 1.0 vortex-file-compressed 200.28 MB 0 B 200.28 MB -100.0%
hits_008.vortex 1.0 vortex-file-compressed 140.05 MB 0 B 140.05 MB -100.0%
hits_009.vortex 1.0 vortex-file-compressed 101.41 MB 0 B 101.41 MB -100.0%
hits_010.vortex 1.0 vortex-file-compressed 169.14 MB 0 B 169.14 MB -100.0%
hits_011.vortex 1.0 vortex-file-compressed 199.60 MB 0 B 199.60 MB -100.0%
hits_012.vortex 1.0 vortex-file-compressed 191.43 MB 0 B 191.43 MB -100.0%
hits_013.vortex 1.0 vortex-file-compressed 161.34 MB 0 B 161.34 MB -100.0%
hits_014.vortex 1.0 vortex-file-compressed 172.14 MB 0 B 172.14 MB -100.0%
hits_015.vortex 1.0 vortex-file-compressed 131.25 MB 0 B 131.25 MB -100.0%
hits_016.vortex 1.0 vortex-file-compressed 180.68 MB 0 B 180.68 MB -100.0%
hits_017.vortex 1.0 vortex-file-compressed 146.88 MB 0 B 146.88 MB -100.0%
hits_018.vortex 1.0 vortex-file-compressed 199.51 MB 0 B 199.51 MB -100.0%
hits_019.vortex 1.0 vortex-file-compressed 140.90 MB 0 B 140.90 MB -100.0%
hits_020.vortex 1.0 vortex-file-compressed 160.84 MB 0 B 160.84 MB -100.0%
hits_021.vortex 1.0 vortex-file-compressed 154.40 MB 0 B 154.40 MB -100.0%
hits_022.vortex 1.0 vortex-file-compressed 198.25 MB 0 B 198.25 MB -100.0%
hits_023.vortex 1.0 vortex-file-compressed 195.57 MB 0 B 195.57 MB -100.0%
hits_024.vortex 1.0 vortex-file-compressed 160.83 MB 0 B 160.83 MB -100.0%
hits_025.vortex 1.0 vortex-file-compressed 171.94 MB 0 B 171.94 MB -100.0%
hits_026.vortex 1.0 vortex-file-compressed 131.37 MB 0 B 131.37 MB -100.0%
hits_027.vortex 1.0 vortex-file-compressed 189.90 MB 0 B 189.90 MB -100.0%
hits_028.vortex 1.0 vortex-file-compressed 152.85 MB 0 B 152.85 MB -100.0%
hits_029.vortex 1.0 vortex-file-compressed 199.87 MB 0 B 199.87 MB -100.0%
hits_030.vortex 1.0 vortex-file-compressed 132.15 MB 0 B 132.15 MB -100.0%
hits_031.vortex 1.0 vortex-file-compressed 159.59 MB 0 B 159.59 MB -100.0%
hits_032.vortex 1.0 vortex-file-compressed 154.64 MB 0 B 154.64 MB -100.0%
hits_033.vortex 1.0 vortex-file-compressed 199.93 MB 0 B 199.93 MB -100.0%
hits_034.vortex 1.0 vortex-file-compressed 182.21 MB 0 B 182.21 MB -100.0%
hits_035.vortex 1.0 vortex-file-compressed 103.07 MB 0 B 103.07 MB -100.0%
hits_036.vortex 1.0 vortex-file-compressed 171.46 MB 0 B 171.46 MB -100.0%
hits_037.vortex 1.0 vortex-file-compressed 177.38 MB 0 B 177.38 MB -100.0%
hits_038.vortex 1.0 vortex-file-compressed 190.55 MB 0 B 190.55 MB -100.0%
hits_039.vortex 1.0 vortex-file-compressed 161.66 MB 0 B 161.66 MB -100.0%
hits_040.vortex 1.0 vortex-file-compressed 143.21 MB 0 B 143.21 MB -100.0%
hits_041.vortex 1.0 vortex-file-compressed 131.35 MB 0 B 131.35 MB -100.0%
hits_042.vortex 1.0 vortex-file-compressed 202.16 MB 0 B 202.16 MB -100.0%
hits_043.vortex 1.0 vortex-file-compressed 126.55 MB 0 B 126.55 MB -100.0%
hits_044.vortex 1.0 vortex-file-compressed 200.19 MB 0 B 200.19 MB -100.0%
hits_045.vortex 1.0 vortex-file-compressed 140.13 MB 0 B 140.13 MB -100.0%
hits_046.vortex 1.0 vortex-file-compressed 101.38 MB 0 B 101.38 MB -100.0%
hits_047.vortex 1.0 vortex-file-compressed 154.50 MB 0 B 154.50 MB -100.0%
hits_048.vortex 1.0 vortex-file-compressed 197.99 MB 0 B 197.99 MB -100.0%
hits_049.vortex 1.0 vortex-file-compressed 191.58 MB 0 B 191.58 MB -100.0%
hits_050.vortex 1.0 vortex-file-compressed 160.84 MB 0 B 160.84 MB -100.0%
hits_051.vortex 1.0 vortex-file-compressed 172.94 MB 0 B 172.94 MB -100.0%
hits_052.vortex 1.0 vortex-file-compressed 130.90 MB 0 B 130.90 MB -100.0%
hits_053.vortex 1.0 vortex-file-compressed 192.31 MB 0 B 192.31 MB -100.0%
hits_054.vortex 1.0 vortex-file-compressed 147.14 MB 0 B 147.14 MB -100.0%
hits_055.vortex 1.0 vortex-file-compressed 200.36 MB 0 B 200.36 MB -100.0%
hits_056.vortex 1.0 vortex-file-compressed 135.77 MB 0 B 135.77 MB -100.0%
hits_057.vortex 1.0 vortex-file-compressed 160.54 MB 0 B 160.54 MB -100.0%
hits_058.vortex 1.0 vortex-file-compressed 155.32 MB 0 B 155.32 MB -100.0%
hits_059.vortex 1.0 vortex-file-compressed 199.19 MB 0 B 199.19 MB -100.0%
hits_060.vortex 1.0 vortex-file-compressed 195.81 MB 0 B 195.81 MB -100.0%
hits_061.vortex 1.0 vortex-file-compressed 160.84 MB 0 B 160.84 MB -100.0%
hits_062.vortex 1.0 vortex-file-compressed 170.94 MB 0 B 170.94 MB -100.0%
hits_063.vortex 1.0 vortex-file-compressed 131.80 MB 0 B 131.80 MB -100.0%
hits_064.vortex 1.0 vortex-file-compressed 193.32 MB 0 B 193.32 MB -100.0%
hits_065.vortex 1.0 vortex-file-compressed 161.41 MB 0 B 161.41 MB -100.0%
hits_066.vortex 1.0 vortex-file-compressed 163.21 MB 0 B 163.21 MB -100.0%
hits_067.vortex 1.0 vortex-file-compressed 131.68 MB 0 B 131.68 MB -100.0%
hits_068.vortex 1.0 vortex-file-compressed 160.82 MB 0 B 160.82 MB -100.0%
hits_069.vortex 1.0 vortex-file-compressed 142.35 MB 0 B 142.35 MB -100.0%
hits_070.vortex 1.0 vortex-file-compressed 200.15 MB 0 B 200.15 MB -100.0%
hits_071.vortex 1.0 vortex-file-compressed 140.03 MB 0 B 140.03 MB -100.0%
hits_072.vortex 1.0 vortex-file-compressed 102.52 MB 0 B 102.52 MB -100.0%
hits_073.vortex 1.0 vortex-file-compressed 172.60 MB 0 B 172.60 MB -100.0%
hits_074.vortex 1.0 vortex-file-compressed 199.71 MB 0 B 199.71 MB -100.0%
hits_075.vortex 1.0 vortex-file-compressed 189.90 MB 0 B 189.90 MB -100.0%
hits_076.vortex 1.0 vortex-file-compressed 161.08 MB 0 B 161.08 MB -100.0%
hits_077.vortex 1.0 vortex-file-compressed 172.43 MB 0 B 172.43 MB -100.0%
hits_078.vortex 1.0 vortex-file-compressed 130.82 MB 0 B 130.82 MB -100.0%
hits_079.vortex 1.0 vortex-file-compressed 181.19 MB 0 B 181.19 MB -100.0%
hits_080.vortex 1.0 vortex-file-compressed 126.86 MB 0 B 126.86 MB -100.0%
hits_081.vortex 1.0 vortex-file-compressed 198.95 MB 0 B 198.95 MB -100.0%
hits_082.vortex 1.0 vortex-file-compressed 140.00 MB 0 B 140.00 MB -100.0%
hits_083.vortex 1.0 vortex-file-compressed 157.43 MB 0 B 157.43 MB -100.0%
hits_084.vortex 1.0 vortex-file-compressed 154.82 MB 0 B 154.82 MB -100.0%
hits_085.vortex 1.0 vortex-file-compressed 200.16 MB 0 B 200.16 MB -100.0%
hits_086.vortex 1.0 vortex-file-compressed 192.22 MB 0 B 192.22 MB -100.0%
hits_087.vortex 1.0 vortex-file-compressed 161.06 MB 0 B 161.06 MB -100.0%
hits_088.vortex 1.0 vortex-file-compressed 172.10 MB 0 B 172.10 MB -100.0%
hits_089.vortex 1.0 vortex-file-compressed 131.66 MB 0 B 131.66 MB -100.0%
hits_090.vortex 1.0 vortex-file-compressed 192.71 MB 0 B 192.71 MB -100.0%
hits_091.vortex 1.0 vortex-file-compressed 147.15 MB 0 B 147.15 MB -100.0%
hits_092.vortex 1.0 vortex-file-compressed 199.76 MB 0 B 199.76 MB -100.0%
hits_093.vortex 1.0 vortex-file-compressed 131.79 MB 0 B 131.79 MB -100.0%
hits_094.vortex 1.0 vortex-file-compressed 157.29 MB 0 B 157.29 MB -100.0%
hits_095.vortex 1.0 vortex-file-compressed 154.47 MB 0 B 154.47 MB -100.0%
hits_096.vortex 1.0 vortex-file-compressed 199.57 MB 0 B 199.57 MB -100.0%
hits_097.vortex 1.0 vortex-file-compressed 193.16 MB 0 B 193.16 MB -100.0%
hits_098.vortex 1.0 vortex-file-compressed 137.59 MB 0 B 137.59 MB -100.0%
hits_099.vortex 1.0 vortex-file-compressed 171.24 MB 0 B 171.24 MB -100.0%

Totals:

  • vortex-compact: 11.94 GB → 11.94 GB (+0.0%)
  • vortex-file-compressed: 15.97 GB → 0 B (-100.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (+3.3%, low confidence)
Vortex (geomean): 1.016x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.005x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base c0334e1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 359209351 347908937 1.03
tpch_q02/datafusion:vortex-compact 108304588 104749810 1.03
tpch_q03/datafusion:vortex-compact 161688808 155121018 1.04
tpch_q04/datafusion:vortex-compact 83614081 82776680 1.01
tpch_q05/datafusion:vortex-compact 273759979 277731325 0.99
tpch_q06/datafusion:vortex-compact 39779222 38967789 1.02
tpch_q07/datafusion:vortex-compact 369476234 365087885 1.01
tpch_q08/datafusion:vortex-compact 287122850 290210424 0.99
tpch_q09/datafusion:vortex-compact 490708548 475181934 1.03
tpch_q10/datafusion:vortex-compact 194558219 197443670 0.99
tpch_q11/datafusion:vortex-compact 75087203 79146808 0.95
tpch_q12/datafusion:vortex-compact 123506370 121029994 1.02
tpch_q13/datafusion:vortex-compact 147340374 145535930 1.01
tpch_q14/datafusion:vortex-compact 53141477 51827957 1.03
tpch_q15/datafusion:vortex-compact 110229913 107557767 1.02
tpch_q16/datafusion:vortex-compact 75228570 74241943 1.01
tpch_q17/datafusion:vortex-compact 426622420 442706456 0.96
tpch_q18/datafusion:vortex-compact 656275720 652284252 1.01
tpch_q19/datafusion:vortex-compact 148747297 149709055 0.99
tpch_q20/datafusion:vortex-compact 149317048 148241009 1.01
tpch_q21/datafusion:vortex-compact 506106928 487942463 1.04
tpch_q22/datafusion:vortex-compact 47628388 52167242 0.91
datafusion / parquet / ns (0.996x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base c0334e1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 323317894 323487189 1.00
tpch_q02/datafusion:parquet 219068166 222272492 0.99
tpch_q03/datafusion:parquet 229636854 233070752 0.99
tpch_q04/datafusion:parquet 100877888 100515707 1.00
tpch_q05/datafusion:parquet 362176676 361549071 1.00
tpch_q06/datafusion:parquet 75949676 70572097 1.08
tpch_q07/datafusion:parquet 513996992 519272071 0.99
tpch_q08/datafusion:parquet 414238973 412345436 1.00
tpch_q09/datafusion:parquet 669865364 676527847 0.99
tpch_q10/datafusion:parquet 553338056 563984545 0.98
tpch_q11/datafusion:parquet 🚀 149185689 170612543 0.87
tpch_q12/datafusion:parquet 152498092 149924153 1.02
tpch_q13/datafusion:parquet 358118151 358826608 1.00
tpch_q14/datafusion:parquet 117842430 118743676 0.99
tpch_q15/datafusion:parquet 190363465 198197078 0.96
tpch_q16/datafusion:parquet 147225934 140760168 1.05
tpch_q17/datafusion:parquet 512612998 518179039 0.99
tpch_q18/datafusion:parquet 697790401 705292043 0.99
tpch_q19/datafusion:parquet 197595041 197860747 1.00
tpch_q20/datafusion:parquet 304210002 298658242 1.02
tpch_q21/datafusion:parquet 547602409 537527850 1.02
tpch_q22/datafusion:parquet 260373331 258715579 1.01
duckdb / vortex-compact / ns (1.028x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base c0334e1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 111656314 110664947 1.01
tpch_q02/duckdb:vortex-compact 75266998 71665237 1.05
tpch_q03/duckdb:vortex-compact 126047538 121594898 1.04
tpch_q04/duckdb:vortex-compact 157956954 158785594 0.99
tpch_q05/duckdb:vortex-compact 149557011 150144395 1.00
tpch_q06/duckdb:vortex-compact 42720207 39204301 1.09
tpch_q07/duckdb:vortex-compact 136657138 129476660 1.06
tpch_q08/duckdb:vortex-compact 183018607 181530447 1.01
tpch_q09/duckdb:vortex-compact 315437913 307406826 1.03
tpch_q10/duckdb:vortex-compact 212375558 210350439 1.01
tpch_q11/duckdb:vortex-compact 🚨 45630555 41319133 1.10
tpch_q12/duckdb:vortex-compact 125392562 118960082 1.05
tpch_q13/duckdb:vortex-compact 170848759 174267403 0.98
tpch_q14/duckdb:vortex-compact 69261571 63080596 1.10
tpch_q15/duckdb:vortex-compact 90607118 86715571 1.04
tpch_q16/duckdb:vortex-compact 86047826 91282089 0.94
tpch_q17/duckdb:vortex-compact 111369120 107162541 1.04
tpch_q18/duckdb:vortex-compact 255294164 259608364 0.98
tpch_q19/duckdb:vortex-compact 90122360 85752331 1.05
tpch_q20/duckdb:vortex-compact 146176523 142857206 1.02
tpch_q21/duckdb:vortex-compact 474752358 458556820 1.04
tpch_q22/duckdb:vortex-compact 80274101 79800438 1.01
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base c0334e1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 142455584 148487236 0.96
tpch_q02/duckdb:parquet 101239510 101222537 1.00
tpch_q03/duckdb:parquet 165820848 164828372 1.01
tpch_q04/duckdb:parquet 119155166 120762807 0.99
tpch_q05/duckdb:parquet 189821849 189426458 1.00
tpch_q06/duckdb:parquet 56020161 58220482 0.96
tpch_q07/duckdb:parquet 141912617 139794757 1.02
tpch_q08/duckdb:parquet 221848315 216215651 1.03
tpch_q09/duckdb:parquet 347041250 347631104 1.00
tpch_q10/duckdb:parquet 649128793 648131435 1.00
tpch_q11/duckdb:parquet 41557820 43545632 0.95
tpch_q12/duckdb:parquet 118564295 119620087 0.99
tpch_q13/duckdb:parquet 399846407 400056145 1.00
tpch_q14/duckdb:parquet 151543953 153403151 0.99
tpch_q15/duckdb:parquet 73552223 75892564 0.97
tpch_q16/duckdb:parquet 154539595 154100524 1.00
tpch_q17/duckdb:parquet 122511250 117110817 1.05
tpch_q18/duckdb:parquet 299594994 304673475 0.98
tpch_q19/duckdb:parquet 232491125 228505310 1.02
tpch_q20/duckdb:parquet 197179271 197966624 1.00
tpch_q21/duckdb:parquet 433133338 435880146 0.99
tpch_q22/duckdb:parquet 336817946 336024354 1.00

File Size Changes (9 files changed, -56.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-file-compressed 87.23 MB 0 B 87.23 MB -100.0%
duckdb.db 10.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-file-compressed 1.65 GB 0 B 1.65 GB -100.0%
nation.vortex 10.0 vortex-file-compressed 11.68 KB 0 B 11.68 KB -100.0%
orders.vortex 10.0 vortex-file-compressed 436.71 MB 0 B 436.71 MB -100.0%
part.vortex 10.0 vortex-file-compressed 53.62 MB 0 B 53.62 MB -100.0%
partsupp.vortex 10.0 vortex-file-compressed 240.78 MB 0 B 240.78 MB -100.0%
region.vortex 10.0 vortex-file-compressed 7.20 KB 0 B 7.20 KB -100.0%
supplier.vortex 10.0 vortex-file-compressed 5.69 MB 0 B 5.69 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 1.92 GB (0.0%)
  • vortex-file-compressed: 2.45 GB → 0 B (-100.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (+3.1%, environment too noisy confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 1.050x ➖
Parquet (geomean): 1.035x ➖
Shifts: Parquet (control) +3.5% · Median polish +3.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.059x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 245517111 247264556 0.99
tpch_q02/datafusion:vortex-compact 421657103 398552960 1.06
tpch_q03/datafusion:vortex-compact 349154283 319638576 1.09
tpch_q04/datafusion:vortex-compact 169821715 157036337 1.08
tpch_q05/datafusion:vortex-compact 402811158 316625231 1.27
tpch_q06/datafusion:vortex-compact 296765572 268661771 1.10
tpch_q07/datafusion:vortex-compact 426033702 356078345 1.20
tpch_q08/datafusion:vortex-compact 543118186 436607767 1.24
tpch_q09/datafusion:vortex-compact 🚨 486757502 283813166 1.72
tpch_q10/datafusion:vortex-compact 357214650 343729941 1.04
tpch_q11/datafusion:vortex-compact 309023908 277406679 1.11
tpch_q12/datafusion:vortex-compact 302937193 418019539 0.72
tpch_q13/datafusion:vortex-compact 124076333 130902561 0.95
tpch_q14/datafusion:vortex-compact 171133517 182115030 0.94
tpch_q15/datafusion:vortex-compact 300556692 289740969 1.04
tpch_q16/datafusion:vortex-compact 198186666 201320832 0.98
tpch_q17/datafusion:vortex-compact 281703284 294173811 0.96
tpch_q18/datafusion:vortex-compact 227956162 241989589 0.94
tpch_q19/datafusion:vortex-compact 436144847 438477135 0.99
tpch_q20/datafusion:vortex-compact 324083956 340257267 0.95
tpch_q21/datafusion:vortex-compact 416174782 388543243 1.07
tpch_q22/datafusion:vortex-compact 156244033 138853422 1.13
datafusion / parquet / ns (1.027x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 236955566 299118024 0.79
tpch_q02/datafusion:parquet 300963075 289241874 1.04
tpch_q03/datafusion:parquet 331935700 350693829 0.95
tpch_q04/datafusion:parquet 193791925 171709598 1.13
tpch_q05/datafusion:parquet 388269570 360891568 1.08
tpch_q06/datafusion:parquet 150900986 135885077 1.11
tpch_q07/datafusion:parquet 378567042 380895889 0.99
tpch_q08/datafusion:parquet 443711191 429632435 1.03
tpch_q09/datafusion:parquet 476079575 465318100 1.02
tpch_q10/datafusion:parquet 415592058 408971886 1.02
tpch_q11/datafusion:parquet 275965771 296783300 0.93
tpch_q12/datafusion:parquet 204090157 214223106 0.95
tpch_q13/datafusion:parquet 456749587 465871077 0.98
tpch_q14/datafusion:parquet 183786664 172370692 1.07
tpch_q15/datafusion:parquet 312337469 292201074 1.07
tpch_q16/datafusion:parquet 125294006 119267571 1.05
tpch_q17/datafusion:parquet 318803111 325002061 0.98
tpch_q18/datafusion:parquet 461554237 442945930 1.04
tpch_q19/datafusion:parquet 198957399 180450526 1.10
tpch_q20/datafusion:parquet 274625038 279250765 0.98
tpch_q21/datafusion:parquet 448175013 413877852 1.08
tpch_q22/datafusion:parquet 210441574 165582835 1.27
duckdb / vortex-compact / ns (1.042x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 246405402 239113187 1.03
tpch_q02/duckdb:vortex-compact 626394542 589833345 1.06
tpch_q03/duckdb:vortex-compact 544352218 446798732 1.22
tpch_q04/duckdb:vortex-compact 314572094 256186946 1.23
tpch_q05/duckdb:vortex-compact 587838851 509562128 1.15
tpch_q06/duckdb:vortex-compact 289759739 270195020 1.07
tpch_q07/duckdb:vortex-compact 571217376 525387320 1.09
tpch_q08/duckdb:vortex-compact 723147129 663098919 1.09
tpch_q09/duckdb:vortex-compact 609711638 551988504 1.10
tpch_q10/duckdb:vortex-compact 476584931 471615715 1.01
tpch_q11/duckdb:vortex-compact 261104497 270855084 0.96
tpch_q12/duckdb:vortex-compact 443000013 412649316 1.07
tpch_q13/duckdb:vortex-compact 241520090 301650105 0.80
tpch_q14/duckdb:vortex-compact 255657231 264209751 0.97
tpch_q15/duckdb:vortex-compact 176322214 182209059 0.97
tpch_q16/duckdb:vortex-compact 217773019 223095035 0.98
tpch_q17/duckdb:vortex-compact 444373234 435447971 1.02
tpch_q18/duckdb:vortex-compact 390665692 343398718 1.14
tpch_q19/duckdb:vortex-compact 382852097 370078783 1.03
tpch_q20/duckdb:vortex-compact 502727522 472129718 1.06
tpch_q21/duckdb:vortex-compact 729104560 684904500 1.06
tpch_q22/duckdb:vortex-compact 154061129 171500238 0.90
duckdb / parquet / ns (1.044x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 324634239 317786056 1.02
tpch_q02/duckdb:parquet 693330499 650075483 1.07
tpch_q03/duckdb:parquet 769405189 774300115 0.99
tpch_q04/duckdb:parquet 520143198 475780607 1.09
tpch_q05/duckdb:parquet 982234395 930727416 1.06
tpch_q06/duckdb:parquet 324375713 297129005 1.09
tpch_q07/duckdb:parquet 910676726 864827530 1.05
tpch_q08/duckdb:parquet 1087815735 1088956630 1.00
tpch_q09/duckdb:parquet 1094064747 1033516705 1.06
tpch_q10/duckdb:parquet 1020315671 985580810 1.04
tpch_q11/duckdb:parquet 469161648 460324132 1.02
tpch_q12/duckdb:parquet 560606355 545478444 1.03
tpch_q13/duckdb:parquet 849230206 830628467 1.02
tpch_q14/duckdb:parquet 541006913 500846861 1.08
tpch_q15/duckdb:parquet 391580392 392720495 1.00
tpch_q16/duckdb:parquet 518535242 491079549 1.06
tpch_q17/duckdb:parquet 494775012 466607702 1.06
tpch_q18/duckdb:parquet 674307039 681031196 0.99
tpch_q19/duckdb:parquet 611623561 582354836 1.05
tpch_q20/duckdb:parquet 859349357 802187106 1.07
tpch_q21/duckdb:parquet 790306643 753264376 1.05
tpch_q22/duckdb:parquet 463415576 428901146 1.08

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.005x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base dda041c (ns) ratio (PR/base)
appian_q01/datafusion:vortex-compact 100736086 101572980 0.99
appian_q02/datafusion:vortex-compact 476106847 472461375 1.01
appian_q03/datafusion:vortex-compact 285210531 282601829 1.01
appian_q04/datafusion:vortex-compact 13556643975 13605898931 1.00
appian_q05/datafusion:vortex-compact 232479299 229595840 1.01
appian_q06/datafusion:vortex-compact 279214572 272885095 1.02
appian_q07/datafusion:vortex-compact 358927989 357752900 1.00
appian_q08/datafusion:vortex-compact 1417441989 1423778389 1.00
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base dda041c (ns) ratio (PR/base)
appian_q01/datafusion:parquet 132973475 135222026 0.98
appian_q02/datafusion:parquet 588631467 592418695 0.99
appian_q03/datafusion:parquet 310468612 307455397 1.01
appian_q04/datafusion:parquet 13635368828 13675426873 1.00
appian_q05/datafusion:parquet 309867792 306617300 1.01
appian_q06/datafusion:parquet 313361124 307952388 1.02
appian_q07/datafusion:parquet 437276266 437289370 1.00
appian_q08/datafusion:parquet 1536092949 1549820965 0.99
duckdb / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base dda041c (ns) ratio (PR/base)
appian_q01/duckdb:vortex-compact 154926052 155736713 0.99
appian_q02/duckdb:vortex-compact 407568858 414190975 0.98
appian_q03/duckdb:vortex-compact 259737991 263209499 0.99
appian_q04/duckdb:vortex-compact 1582389231 1573356360 1.01
appian_q05/duckdb:vortex-compact 247701240 253889871 0.98
appian_q06/duckdb:vortex-compact 1048912128 1010990926 1.04
appian_q07/duckdb:vortex-compact 286680658 293302933 0.98
appian_q08/duckdb:vortex-compact 921673671 920778657 1.00
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base dda041c (ns) ratio (PR/base)
appian_q01/duckdb:parquet 159283741 155718271 1.02
appian_q02/duckdb:parquet 363300361 360427374 1.01
appian_q03/duckdb:parquet 217619356 220868267 0.99
appian_q04/duckdb:parquet 1475980495 1468120153 1.01
appian_q05/duckdb:parquet 248184679 244747063 1.01
appian_q06/duckdb:parquet 967858904 953420613 1.02
appian_q07/duckdb:parquet 266342302 267714427 0.99
appian_q08/duckdb:parquet 782491637 791035797 0.99

File Size Changes (10 files changed, -63.8% overall, 0↑ 10↓)
File Scale Format Base HEAD Change %
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 0 B 34.62 MB -100.0%
categoryview.vortex 1.0 vortex-file-compressed 21.70 KB 0 B 21.70 KB -100.0%
creditcardview.vortex 1.0 vortex-file-compressed 59.15 MB 0 B 59.15 MB -100.0%
customerview.vortex 1.0 vortex-file-compressed 19.98 MB 0 B 19.98 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
orderitemnovelty_update.vortex 1.0 vortex-file-compressed 13.77 KB 0 B 13.77 KB -100.0%
orderitemview.vortex 1.0 vortex-file-compressed 265.21 MB 0 B 265.21 MB -100.0%
orderview.vortex 1.0 vortex-file-compressed 78.51 MB 0 B 78.51 MB -100.0%
productview.vortex 1.0 vortex-file-compressed 21.25 KB 0 B 21.25 KB -100.0%
taxrecordview.vortex 1.0 vortex-file-compressed 21.92 MB 0 B 21.92 MB -100.0%

Totals:

  • vortex-compact: 271.93 MB → 271.93 MB (0.0%)
  • vortex-file-compressed: 479.71 MB → 0 B (-100.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +13.0%
Engines: DataFusion No clear signal (+3.4%, environment too noisy confidence) · DuckDB No clear signal (+23.6%, environment too noisy confidence)
Vortex (geomean): 1.117x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish +2.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.220x ➖, 0↑ 2↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 56149213 54806227 1.02
fineweb_q01/datafusion:vortex-compact 469050051 418208863 1.12
fineweb_q02/datafusion:vortex-compact 451715976 468054576 0.97
fineweb_q03/datafusion:vortex-compact 803136526 761113463 1.06
fineweb_q04/datafusion:vortex-compact 747412604 779809601 0.96
fineweb_q05/datafusion:vortex-compact 684471492 709163699 0.97
fineweb_q06/datafusion:vortex-compact 🚨 1493760214 798715218 1.87
fineweb_q07/datafusion:vortex-compact 633454699 573532190 1.10
fineweb_q08/datafusion:vortex-compact 🚨 474039645 176812484 2.68
datafusion / parquet / ns (1.180x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 530000810 467886792 1.13
fineweb_q01/datafusion:parquet 884269903 897299744 0.99
fineweb_q02/datafusion:parquet 993247539 836525027 1.19
fineweb_q03/datafusion:parquet 1036878069 866420515 1.20
fineweb_q04/datafusion:parquet 893582452 890065710 1.00
fineweb_q05/datafusion:parquet 995560289 811025840 1.23
fineweb_q06/datafusion:parquet 1022191929 802968394 1.27
fineweb_q07/datafusion:parquet 🚨 1468143215 889363704 1.65
fineweb_q08/datafusion:parquet 1055088170 975411953 1.08
duckdb / vortex-compact / ns (1.023x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 52381602 46929935 1.12
fineweb_q01/duckdb:vortex-compact 589327821 597311409 0.99
fineweb_q02/duckdb:vortex-compact 598297918 716825471 0.83
fineweb_q03/duckdb:vortex-compact 1643167461 1604689546 1.02
fineweb_q04/duckdb:vortex-compact 1837835563 1711914772 1.07
fineweb_q05/duckdb:vortex-compact 1741678054 1710204546 1.02
fineweb_q06/duckdb:vortex-compact 1786076471 1663465765 1.07
fineweb_q07/duckdb:vortex-compact 1654591940 1526646863 1.08
fineweb_q08/duckdb:vortex-compact 630332938 615369832 1.02
duckdb / parquet / ns (0.828x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 5255898401 5278756471 1.00
fineweb_q01/duckdb:parquet 5338983687 5328317494 1.00
fineweb_q02/duckdb:parquet 5327921719 5292779934 1.01
fineweb_q03/duckdb:parquet 5369891448 5331687476 1.01
fineweb_q04/duckdb:parquet 5293811813 5287710918 1.00
fineweb_q05/duckdb:parquet 🚀 961127620 5313593488 0.18
fineweb_q06/duckdb:parquet 5369950153 5405100594 0.99
fineweb_q07/duckdb:parquet 5359280020 5311127278 1.01
fineweb_q08/duckdb:parquet 5254582093 5288703352 0.99

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.4%, environment too noisy confidence) · DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): 1.005x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 44984212 44806872 1.00
tpch_q02/datafusion:vortex-file-compressed 22684306 22992702 0.99
tpch_q03/datafusion:vortex-file-compressed 30961963 30733144 1.01
tpch_q04/datafusion:vortex-file-compressed 15973798 16151203 0.99
tpch_q05/datafusion:vortex-file-compressed 50122838 49772776 1.01
tpch_q06/datafusion:vortex-file-compressed 9008498 8591308 1.05
tpch_q07/datafusion:vortex-file-compressed 55759850 56886095 0.98
tpch_q08/datafusion:vortex-file-compressed 45353870 45716238 0.99
tpch_q09/datafusion:vortex-file-compressed 56197582 56996885 0.99
tpch_q10/datafusion:vortex-file-compressed 28182935 28910943 0.97
tpch_q11/datafusion:vortex-file-compressed 17119992 17374765 0.99
tpch_q12/datafusion:vortex-file-compressed 27649222 27561502 1.00
tpch_q13/datafusion:vortex-file-compressed 25079313 25091915 1.00
tpch_q14/datafusion:vortex-file-compressed 14636794 14653111 1.00
tpch_q15/datafusion:vortex-file-compressed 21042214 20757473 1.01
tpch_q16/datafusion:vortex-file-compressed 24484790 25046046 0.98
tpch_q17/datafusion:vortex-file-compressed 55801454 55449374 1.01
tpch_q18/datafusion:vortex-file-compressed 68908902 68813035 1.00
tpch_q19/datafusion:vortex-file-compressed 18752459 19580962 0.96
tpch_q20/datafusion:vortex-file-compressed 32693606 31244371 1.05
tpch_q21/datafusion:vortex-file-compressed 59998461 59716031 1.00
tpch_q22/datafusion:vortex-file-compressed 12427343 11978104 1.04
datafusion / parquet / ns (0.996x ➖, 1↑ 2↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 110616485 113725116 0.97
tpch_q02/datafusion:parquet 69859151 71137921 0.98
tpch_q03/datafusion:parquet 95197735 95701877 0.99
tpch_q04/datafusion:parquet 50973102 55509049 0.92
tpch_q05/datafusion:parquet 🚨 129128309 115735329 1.12
tpch_q06/datafusion:parquet 🚀 42255642 48537598 0.87
tpch_q07/datafusion:parquet 126324787 127392557 0.99
tpch_q08/datafusion:parquet 127419032 127772293 1.00
tpch_q09/datafusion:parquet 156348134 150234723 1.04
tpch_q10/datafusion:parquet 118359086 128080082 0.92
tpch_q11/datafusion:parquet 49296140 49727358 0.99
tpch_q12/datafusion:parquet 96134993 100508829 0.96
tpch_q13/datafusion:parquet 226857291 230879882 0.98
tpch_q14/datafusion:parquet 52317904 54335320 0.96
tpch_q15/datafusion:parquet 🚨 71924594 64781846 1.11
tpch_q16/datafusion:parquet 50343002 49116495 1.02
tpch_q17/datafusion:parquet 159620729 151044279 1.06
tpch_q18/datafusion:parquet 183885201 176717576 1.04
tpch_q19/datafusion:parquet 77570416 77607085 1.00
tpch_q20/datafusion:parquet 92575928 91235037 1.01
tpch_q21/datafusion:parquet 172460255 174760806 0.99
tpch_q22/datafusion:parquet 55780378 55182389 1.01
duckdb / vortex-file-compressed / ns (1.009x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 24299334 24033278 1.01
tpch_q02/duckdb:vortex-file-compressed 34408042 36097972 0.95
tpch_q03/duckdb:vortex-file-compressed 40534701 38919119 1.04
tpch_q04/duckdb:vortex-file-compressed 34407588 31840004 1.08
tpch_q05/duckdb:vortex-file-compressed 43185073 45471154 0.95
tpch_q06/duckdb:vortex-file-compressed 🚨 13973983 12208619 1.14
tpch_q07/duckdb:vortex-file-compressed 45465481 44519370 1.02
tpch_q08/duckdb:vortex-file-compressed 55504163 53474670 1.04
tpch_q09/duckdb:vortex-file-compressed 63654443 64949392 0.98
tpch_q10/duckdb:vortex-file-compressed 56984781 5344871 1.07
tpch_q11/duckdb:vortex-file-compressed 17849223 19586912 0.91
tpch_q12/duckdb:vortex-file-compressed 31492613 31196600 1.01
tpch_q13/duckdb:vortex-file-compressed 45669217 44211716 1.03
tpch_q14/duckdb:vortex-file-compressed 21634727 22199245 0.97
tpch_q15/duckdb:vortex-file-compressed 20435377 20371008 1.00
tpch_q16/duckdb:vortex-file-compressed 33161712 33895756 0.98
tpch_q17/duckdb:vortex-file-compressed 32395075 34130268 0.95
tpch_q18/duckdb:vortex-file-compressed 52136978 53000785 0.98
tpch_q19/duckdb:vortex-file-compressed 39747412 37262514 1.07
tpch_q20/duckdb:vortex-file-compressed 39168431 39073769 1.00
tpch_q21/duckdb:vortex-file-compressed 129869755 125962597 1.03
tpch_q22/duckdb:vortex-file-compressed 21732390 21715666 1.00
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81517670 81684460 1.00
tpch_q02/duckdb:parquet 45828264 45703766 1.00
tpch_q03/duckdb:parquet 80742811 80746601 1.00
tpch_q04/duckdb:parquet 57689439 57578923 1.00
tpch_q05/duckdb:parquet 78222791 79048019 0.99
tpch_q06/duckdb:parquet 24941788 25115773 0.99
tpch_q07/duckdb:parquet 80014434 80138678 1.00
tpch_q08/duckdb:parquet 96957626 98385574 0.99
tpch_q09/duckdb:parquet 148103699 149768068 0.99
tpch_q10/duckdb:parquet 140662965 141689060 0.99
tpch_q11/duckdb:parquet 25047890 25117489 1.00
tpch_q12/duckdb:parquet 52943160 53102323 1.00
tpch_q13/duckdb:parquet 283321530 286244542 0.99
tpch_q14/duckdb:parquet 56050395 55879227 1.00
tpch_q15/duckdb:parquet 30546499 30723877 0.99
tpch_q16/duckdb:parquet 67254360 66786002 1.01
tpch_q17/duckdb:parquet 57944922 58314587 0.99
tpch_q18/duckdb:parquet 129864175 127767502 1.02
tpch_q19/duckdb:parquet 77691604 77342187 1.00
tpch_q20/duckdb:parquet 77415477 76882286 1.01
tpch_q21/duckdb:parquet 187716838 188450565 1.00
tpch_q22/duckdb:parquet 63768859 62979872 1.01

File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-compact 126.01 MB 0 B 126.01 MB -100.0%
nation.vortex 1.0 vortex-compact 8.63 KB 0 B 8.63 KB -100.0%
orders.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region.vortex 1.0 vortex-compact 6.39 KB 0 B 6.39 KB -100.0%
supplier.vortex 1.0 vortex-compact 497.62 KB 0 B 497.62 KB -100.0%

Totals:

  • vortex-compact: 189.74 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.86 MB → 242.86 MB (0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.3%, environment too noisy confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.006x ➖, 1↑ 2↓)
name PR 32ad0bf (ns) base de32234 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-compact 2037612 1989004 1.02
clickbench_q01/datafusion:vortex-compact 🚨 16838847 14414618 1.17
clickbench_q02/datafusion:vortex-compact 52600762 52886601 0.99
clickbench_q03/datafusion:vortex-compact 32175660 32976363 0.98
clickbench_q04/datafusion:vortex-compact 163475738 168694425 0.97
clickbench_q05/datafusion:vortex-compact 248212305 233470287 1.06
clickbench_q06/datafusion:vortex-compact 2035795 2083995 0.98
clickbench_q07/datafusion:vortex-compact 26352607 24526152 1.07
clickbench_q08/datafusion:vortex-compact 243436943 239332115 1.02
clickbench_q09/datafusion:vortex-compact 405975496 396656858 1.02
clickbench_q10/datafusion:vortex-compact 113336592 109628398 1.03
clickbench_q11/datafusion:vortex-compact 153135094 149851485 1.02
clickbench_q12/datafusion:vortex-compact 228460536 225993295 1.01
clickbench_q13/datafusion:vortex-compact 388504295 400249264 0.97
clickbench_q14/datafusion:vortex-compact 243545196 241955976 1.01
clickbench_q15/datafusion:vortex-compact 203008958 189704913 1.07
clickbench_q16/datafusion:vortex-compact 498934832 516705360 0.97
clickbench_q17/datafusion:vortex-compact 500063656 495615277 1.01
clickbench_q18/datafusion:vortex-compact 928730988 934595231 0.99
clickbench_q19/datafusion:vortex-compact 23618774 23584873 1.00
clickbench_q20/datafusion:vortex-compact 244462123 244689962 1.00
clickbench_q21/datafusion:vortex-compact 356153404 348911237 1.02
clickbench_q22/datafusion:vortex-compact 549640347 552370746 1.00
clickbench_q23/datafusion:vortex-compact 1577315693 1560668599 1.01
clickbench_q24/datafusion:vortex-compact 73915388 73908348 1.00
clickbench_q25/datafusion:vortex-compact 104650735 106817500 0.98
clickbench_q26/datafusion:vortex-compact 70247704 72264503 0.97
clickbench_q27/datafusion:vortex-compact 330029980 323055183 1.02
clickbench_q28/datafusion:vortex-compact 1512967156 1564304476 0.97
clickbench_q29/datafusion:vortex-compact 🚨 74474373 66094643 1.13
clickbench_q30/datafusion:vortex-compact 269219052 273285529 0.99
clickbench_q31/datafusion:vortex-compact 289247581 289654163 1.00
clickbench_q32/datafusion:vortex-compact 850537375 847525602 1.00
clickbench_q33/datafusion:vortex-compact 1054897196 1041812305 1.01
clickbench_q34/datafusion:vortex-compact 1049493548 1060164872 0.99
clickbench_q35/datafusion:vortex-compact 174849918 169827044 1.03
clickbench_q36/datafusion:vortex-compact 🚀 62181768 74187379 0.84
clickbench_q37/datafusion:vortex-compact 30024145 29973076 1.00
clickbench_q38/datafusion:vortex-compact 18388327 18800178 0.98
clickbench_q39/datafusion:vortex-compact 136481501 136268630 1.00
clickbench_q40/datafusion:vortex-compact 15326550 15783853 0.97
clickbench_q41/datafusion:vortex-compact 18331967 17223881 1.06
clickbench_q42/datafusion:vortex-compact 13626553 13908475 0.98
datafusion / parquet / ns (1.003x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base de32234 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1983994 1969825 1.01
clickbench_q01/datafusion:parquet 17477491 17630749 0.99
clickbench_q02/datafusion:parquet 32230246 31325990 1.03
clickbench_q03/datafusion:parquet 25247554 26894340 0.94
clickbench_q04/datafusion:parquet 170826333 171497735 1.00
clickbench_q05/datafusion:parquet 239242517 238438919 1.00
clickbench_q06/datafusion:parquet 1970319 1970925 1.00
clickbench_q07/datafusion:parquet 18230594 18558483 0.98
clickbench_q08/datafusion:parquet 235143632 239698078 0.98
clickbench_q09/datafusion:parquet 384461759 375337164 1.02
clickbench_q10/datafusion:parquet 70821592 72298661 0.98
clickbench_q11/datafusion:parquet 91984766 92544209 0.99
clickbench_q12/datafusion:parquet 247153184 238093699 1.04
clickbench_q13/datafusion:parquet 391029391 397170735 0.98
clickbench_q14/datafusion:parquet 252097292 252123069 1.00
clickbench_q15/datafusion:parquet 199932707 200397429 1.00
clickbench_q16/datafusion:parquet 485490263 482115766 1.01
clickbench_q17/datafusion:parquet 484979639 481214610 1.01
clickbench_q18/datafusion:parquet 920990501 940641000 0.98
clickbench_q19/datafusion:parquet 🚨 30991954 22836778 1.36
clickbench_q20/datafusion:parquet 468137283 465916942 1.00
clickbench_q21/datafusion:parquet 493916836 490903197 1.01
clickbench_q22/datafusion:parquet 658382596 658430390 1.00
clickbench_q23/datafusion:parquet 2849897939 2853908295 1.00
clickbench_q24/datafusion:parquet 51185918 52035176 0.98
clickbench_q25/datafusion:parquet 99906414 96276913 1.04
clickbench_q26/datafusion:parquet 51588926 49244040 1.05
clickbench_q27/datafusion:parquet 543465802 539211471 1.01
clickbench_q28/datafusion:parquet 1545186441 1546386060 1.00
clickbench_q29/datafusion:parquet 41205503 40827890 1.01
clickbench_q30/datafusion:parquet 241540662 239196248 1.01
clickbench_q31/datafusion:parquet 286021350 281280602 1.02
clickbench_q32/datafusion:parquet 846768351 870575743 0.97
clickbench_q33/datafusion:parquet 1086627952 1100217143 0.99
clickbench_q34/datafusion:parquet 1081742772 1070173264 1.01
clickbench_q35/datafusion:parquet 167315348 178619990 0.94
clickbench_q36/datafusion:parquet 116228637 118783280 0.98
clickbench_q37/datafusion:parquet 51167044 54338703 0.94
clickbench_q38/datafusion:parquet 69755467 69788706 1.00
clickbench_q39/datafusion:parquet 227191422 231557762 0.98
clickbench_q40/datafusion:parquet 25821927 26093710 0.99
clickbench_q41/datafusion:parquet 24810042 25522195 0.97
clickbench_q42/datafusion:parquet 25341286 25301868 1.00
duckdb / vortex-compact / ns (1.004x ➖, 0↑ 2↓)
name PR 32ad0bf (ns) base de32234 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-compact 12205868 13435007 0.91
clickbench_q01/duckdb:vortex-compact 23658827 24897943 0.95
clickbench_q02/duckdb:vortex-compact 33649588 33280186 1.01
clickbench_q03/duckdb:vortex-compact 35477501 33839084 1.05
clickbench_q04/duckdb:vortex-compact 137888154 135931902 1.01
clickbench_q05/duckdb:vortex-compact 170629270 162715198 1.05
clickbench_q06/duckdb:vortex-compact 20102662 20932826 0.96
clickbench_q07/duckdb:vortex-compact 27994745 26219662 1.07
clickbench_q08/duckdb:vortex-compact 181693535 182258459 1.00
clickbench_q09/duckdb:vortex-compact 261407476 259814258 1.01
clickbench_q10/duckdb:vortex-compact 76913851 80457419 0.96
clickbench_q11/duckdb:vortex-compact 99304926 97974082 1.01
clickbench_q12/duckdb:vortex-compact 207509038 204467673 1.01
clickbench_q13/duckdb:vortex-compact 356756310 356765738 1.00
clickbench_q14/duckdb:vortex-compact 211069884 215512718 0.98
clickbench_q15/duckdb:vortex-compact 189612702 188875277 1.00
clickbench_q16/duckdb:vortex-compact 423126245 424921322 1.00
clickbench_q17/duckdb:vortex-compact 397405010 395028362 1.01
clickbench_q18/duckdb:vortex-compact 747062439 746000354 1.00
clickbench_q19/duckdb:vortex-compact 26640536 26269442 1.01
clickbench_q20/duckdb:vortex-compact 212203303 208480316 1.02
clickbench_q21/duckdb:vortex-compact 312905285 328641422 0.95
clickbench_q22/duckdb:vortex-compact 467269610 479690664 0.97
clickbench_q23/duckdb:vortex-compact 295650555 307315604 0.96
clickbench_q24/duckdb:vortex-compact 78693695 84808412 0.93
clickbench_q25/duckdb:vortex-compact 90596963 91723851 0.99
clickbench_q26/duckdb:vortex-compact 75072322 83222606 0.90
clickbench_q27/duckdb:vortex-compact 375867360 379138243 0.99
clickbench_q28/duckdb:vortex-compact 1505166161 1611892795 0.93
clickbench_q29/duckdb:vortex-compact 42624393 42646428 1.00
clickbench_q30/duckdb:vortex-compact 197995222 201312043 0.98
clickbench_q31/duckdb:vortex-compact 358194039 347237179 1.03
clickbench_q32/duckdb:vortex-compact 930899643 958707161 0.97
clickbench_q33/duckdb:vortex-compact 1055352859 1024773793 1.03
clickbench_q34/duckdb:vortex-compact 1087840010 1065290858 1.02
clickbench_q35/duckdb:vortex-compact 219904550 222878032 0.99
clickbench_q36/duckdb:vortex-compact 39024295 37575102 1.04
clickbench_q37/duckdb:vortex-compact 28916983 26926522 1.07
clickbench_q38/duckdb:vortex-compact 🚨 34476323 30720557 1.12
clickbench_q39/duckdb:vortex-compact 55357397 51591667 1.07
clickbench_q40/duckdb:vortex-compact 🚨 31325195 26301115 1.19
clickbench_q41/duckdb:vortex-compact 28827028 27145348 1.06
clickbench_q42/duckdb:vortex-compact 26762359 26611760 1.01
duckdb / parquet / ns (1.001x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base de32234 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 13847656 15414693 0.90
clickbench_q01/duckdb:parquet 17274957 17673184 0.98
clickbench_q02/duckdb:parquet 25534068 24222002 1.05
clickbench_q03/duckdb:parquet 26597159 25442619 1.05
clickbench_q04/duckdb:parquet 129527240 131743582 0.98
clickbench_q05/duckdb:parquet 182158966 183423931 0.99
clickbench_q06/duckdb:parquet 22856217 23413221 0.98
clickbench_q07/duckdb:parquet 18492950 19063205 0.97
clickbench_q08/duckdb:parquet 163594352 162600133 1.01
clickbench_q09/duckdb:parquet 228901931 231060782 0.99
clickbench_q10/duckdb:parquet 57679668 57585671 1.00
clickbench_q11/duckdb:parquet 67097425 66647250 1.01
clickbench_q12/duckdb:parquet 173034649 169650900 1.02
clickbench_q13/duckdb:parquet 306068338 311162760 0.98
clickbench_q14/duckdb:parquet 184524267 187744644 0.98
clickbench_q15/duckdb:parquet 181591710 186403171 0.97
clickbench_q16/duckdb:parquet 356664589 357904754 1.00
clickbench_q17/duckdb:parquet 361318004 365656670 0.99
clickbench_q18/duckdb:parquet 690939969 688376606 1.00
clickbench_q19/duckdb:parquet 20754806 20946833 0.99
clickbench_q20/duckdb:parquet 262530197 259046496 1.01
clickbench_q21/duckdb:parquet 322293103 316669949 1.02
clickbench_q22/duckdb:parquet 469797324 474090380 0.99
clickbench_q23/duckdb:parquet 243821883 242094997 1.01
clickbench_q24/duckdb:parquet 68516999 69188778 0.99
clickbench_q25/duckdb:parquet 73663570 70656761 1.04
clickbench_q26/duckdb:parquet 46838009 47810205 0.98
clickbench_q27/duckdb:parquet 272175238 278529343 0.98
clickbench_q28/duckdb:parquet 1728033049 1744217582 0.99
clickbench_q29/duckdb:parquet 27462123 25729190 1.07
clickbench_q30/duckdb:parquet 175422204 177632899 0.99
clickbench_q31/duckdb:parquet 327524560 312854815 1.05
clickbench_q32/duckdb:parquet 912426539 914491303 1.00
clickbench_q33/duckdb:parquet 767436127 788785832 0.97
clickbench_q34/duckdb:parquet 803962070 796997703 1.01
clickbench_q35/duckdb:parquet 207710325 210712822 0.99
clickbench_q36/duckdb:parquet 52752609 48784617 1.08
clickbench_q37/duckdb:parquet 36272539 35424651 1.02
clickbench_q38/duckdb:parquet 38774878 40442248 0.96
clickbench_q39/duckdb:parquet 87737088 86889329 1.01
clickbench_q40/duckdb:parquet 20730756 19614936 1.06
clickbench_q41/duckdb:parquet 20244693 19683718 1.03
clickbench_q42/duckdb:parquet 22533633 23090429 0.98

File Size Changes (101 files changed, -60.8% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-file-compressed 90.01 MB 0 B 90.01 MB -100.0%
hits_1.vortex 1.0 vortex-file-compressed 138.90 MB 0 B 138.90 MB -100.0%
hits_10.vortex 1.0 vortex-file-compressed 69.61 MB 0 B 69.61 MB -100.0%
hits_11.vortex 1.0 vortex-file-compressed 80.02 MB 0 B 80.02 MB -100.0%
hits_12.vortex 1.0 vortex-file-compressed 101.36 MB 0 B 101.36 MB -100.0%
hits_13.vortex 1.0 vortex-file-compressed 99.68 MB 0 B 99.68 MB -100.0%
hits_14.vortex 1.0 vortex-file-compressed 111.66 MB 0 B 111.66 MB -100.0%
hits_15.vortex 1.0 vortex-file-compressed 89.30 MB 0 B 89.30 MB -100.0%
hits_16.vortex 1.0 vortex-file-compressed 79.49 MB 0 B 79.49 MB -100.0%
hits_17.vortex 1.0 vortex-file-compressed 87.62 MB 0 B 87.62 MB -100.0%
hits_18.vortex 1.0 vortex-file-compressed 104.90 MB 0 B 104.90 MB -100.0%
hits_19.vortex 1.0 vortex-file-compressed 73.39 MB 0 B 73.39 MB -100.0%
hits_2.vortex 1.0 vortex-file-compressed 187.10 MB 0 B 187.10 MB -100.0%
hits_20.vortex 1.0 vortex-file-compressed 62.67 MB 0 B 62.67 MB -100.0%
hits_21.vortex 1.0 vortex-file-compressed 93.17 MB 0 B 93.17 MB -100.0%
hits_22.vortex 1.0 vortex-file-compressed 77.11 MB 0 B 77.11 MB -100.0%
hits_23.vortex 1.0 vortex-file-compressed 76.53 MB 0 B 76.53 MB -100.0%
hits_24.vortex 1.0 vortex-file-compressed 76.04 MB 0 B 76.04 MB -100.0%
hits_25.vortex 1.0 vortex-file-compressed 113.83 MB 0 B 113.83 MB -100.0%
hits_26.vortex 1.0 vortex-file-compressed 109.82 MB 0 B 109.82 MB -100.0%
hits_27.vortex 1.0 vortex-file-compressed 123.33 MB 0 B 123.33 MB -100.0%
hits_28.vortex 1.0 vortex-file-compressed 120.56 MB 0 B 120.56 MB -100.0%
hits_29.vortex 1.0 vortex-file-compressed 59.56 MB 0 B 59.56 MB -100.0%
hits_3.vortex 1.0 vortex-file-compressed 142.59 MB 0 B 142.59 MB -100.0%
hits_30.vortex 1.0 vortex-file-compressed 87.21 MB 0 B 87.21 MB -100.0%
hits_31.vortex 1.0 vortex-file-compressed 90.34 MB 0 B 90.34 MB -100.0%
hits_32.vortex 1.0 vortex-file-compressed 66.86 MB 0 B 66.86 MB -100.0%
hits_33.vortex 1.0 vortex-file-compressed 57.20 MB 0 B 57.20 MB -100.0%
hits_34.vortex 1.0 vortex-file-compressed 97.89 MB 0 B 97.89 MB -100.0%
hits_35.vortex 1.0 vortex-file-compressed 115.55 MB 0 B 115.55 MB -100.0%
hits_36.vortex 1.0 vortex-file-compressed 68.63 MB 0 B 68.63 MB -100.0%
hits_37.vortex 1.0 vortex-file-compressed 85.70 MB 0 B 85.70 MB -100.0%
hits_38.vortex 1.0 vortex-file-compressed 99.40 MB 0 B 99.40 MB -100.0%
hits_39.vortex 1.0 vortex-file-compressed 80.42 MB 0 B 80.42 MB -100.0%
hits_4.vortex 1.0 vortex-file-compressed 109.12 MB 0 B 109.12 MB -100.0%
hits_40.vortex 1.0 vortex-file-compressed 118.12 MB 0 B 118.12 MB -100.0%
hits_41.vortex 1.0 vortex-file-compressed 224.41 MB 0 B 224.41 MB -100.0%
hits_42.vortex 1.0 vortex-file-compressed 223.28 MB 0 B 223.28 MB -100.0%
hits_43.vortex 1.0 vortex-file-compressed 227.75 MB 0 B 227.75 MB -100.0%
hits_44.vortex 1.0 vortex-file-compressed 186.92 MB 0 B 186.92 MB -100.0%
hits_45.vortex 1.0 vortex-file-compressed 122.45 MB 0 B 122.45 MB -100.0%
hits_46.vortex 1.0 vortex-file-compressed 69.38 MB 0 B 69.38 MB -100.0%
hits_47.vortex 1.0 vortex-file-compressed 41.27 MB 0 B 41.27 MB -100.0%
hits_48.vortex 1.0 vortex-file-compressed 28.05 MB 0 B 28.05 MB -100.0%
hits_49.vortex 1.0 vortex-file-compressed 75.76 MB 0 B 75.76 MB -100.0%
hits_5.vortex 1.0 vortex-file-compressed 93.72 MB 0 B 93.72 MB -100.0%
hits_50.vortex 1.0 vortex-file-compressed 180.40 MB 0 B 180.40 MB -100.0%
hits_51.vortex 1.0 vortex-file-compressed 280.37 MB 0 B 280.37 MB -100.0%
hits_52.vortex 1.0 vortex-file-compressed 103.93 MB 0 B 103.93 MB -100.0%
hits_53.vortex 1.0 vortex-file-compressed 85.85 MB 0 B 85.85 MB -100.0%
hits_54.vortex 1.0 vortex-file-compressed 223.22 MB 0 B 223.22 MB -100.0%
hits_55.vortex 1.0 vortex-file-compressed 170.21 MB 0 B 170.21 MB -100.0%
hits_56.vortex 1.0 vortex-file-compressed 124.05 MB 0 B 124.05 MB -100.0%
hits_57.vortex 1.0 vortex-file-compressed 128.70 MB 0 B 128.70 MB -100.0%
hits_58.vortex 1.0 vortex-file-compressed 90.83 MB 0 B 90.83 MB -100.0%
hits_59.vortex 1.0 vortex-file-compressed 102.07 MB 0 B 102.07 MB -100.0%
hits_6.vortex 1.0 vortex-file-compressed 94.10 MB 0 B 94.10 MB -100.0%
hits_60.vortex 1.0 vortex-file-compressed 103.60 MB 0 B 103.60 MB -100.0%
hits_61.vortex 1.0 vortex-file-compressed 101.44 MB 0 B 101.44 MB -100.0%
hits_62.vortex 1.0 vortex-file-compressed 117.82 MB 0 B 117.82 MB -100.0%
hits_63.vortex 1.0 vortex-file-compressed 69.30 MB 0 B 69.30 MB -100.0%
hits_64.vortex 1.0 vortex-file-compressed 81.25 MB 0 B 81.25 MB -100.0%
hits_65.vortex 1.0 vortex-file-compressed 184.43 MB 0 B 184.43 MB -100.0%
hits_66.vortex 1.0 vortex-file-compressed 90.43 MB 0 B 90.43 MB -100.0%
hits_67.vortex 1.0 vortex-file-compressed 185.44 MB 0 B 185.44 MB -100.0%
hits_68.vortex 1.0 vortex-file-compressed 123.53 MB 0 B 123.53 MB -100.0%
hits_69.vortex 1.0 vortex-file-compressed 123.50 MB 0 B 123.50 MB -100.0%
hits_7.vortex 1.0 vortex-file-compressed 94.75 MB 0 B 94.75 MB -100.0%
hits_70.vortex 1.0 vortex-file-compressed 93.96 MB 0 B 93.96 MB -100.0%
hits_71.vortex 1.0 vortex-file-compressed 102.19 MB 0 B 102.19 MB -100.0%
hits_72.vortex 1.0 vortex-file-compressed 84.72 MB 0 B 84.72 MB -100.0%
hits_73.vortex 1.0 vortex-file-compressed 109.95 MB 0 B 109.95 MB -100.0%
hits_74.vortex 1.0 vortex-file-compressed 120.21 MB 0 B 120.21 MB -100.0%
hits_75.vortex 1.0 vortex-file-compressed 63.52 MB 0 B 63.52 MB -100.0%
hits_76.vortex 1.0 vortex-file-compressed 114.38 MB 0 B 114.38 MB -100.0%
hits_77.vortex 1.0 vortex-file-compressed 169.04 MB 0 B 169.04 MB -100.0%
hits_78.vortex 1.0 vortex-file-compressed 165.55 MB 0 B 165.55 MB -100.0%
hits_79.vortex 1.0 vortex-file-compressed 144.86 MB 0 B 144.86 MB -100.0%
hits_8.vortex 1.0 vortex-file-compressed 94.01 MB 0 B 94.01 MB -100.0%
hits_80.vortex 1.0 vortex-file-compressed 105.50 MB 0 B 105.50 MB -100.0%
hits_81.vortex 1.0 vortex-file-compressed 101.39 MB 0 B 101.39 MB -100.0%
hits_82.vortex 1.0 vortex-file-compressed 100.02 MB 0 B 100.02 MB -100.0%
hits_83.vortex 1.0 vortex-file-compressed 89.44 MB 0 B 89.44 MB -100.0%
hits_84.vortex 1.0 vortex-file-compressed 117.89 MB 0 B 117.89 MB -100.0%
hits_85.vortex 1.0 vortex-file-compressed 91.83 MB 0 B 91.83 MB -100.0%
hits_86.vortex 1.0 vortex-file-compressed 69.44 MB 0 B 69.44 MB -100.0%
hits_87.vortex 1.0 vortex-file-compressed 173.06 MB 0 B 173.06 MB -100.0%
hits_88.vortex 1.0 vortex-file-compressed 111.40 MB 0 B 111.40 MB -100.0%
hits_89.vortex 1.0 vortex-file-compressed 185.69 MB 0 B 185.69 MB -100.0%
hits_9.vortex 1.0 vortex-file-compressed 99.74 MB 0 B 99.74 MB -100.0%
hits_90.vortex 1.0 vortex-file-compressed 142.91 MB 0 B 142.91 MB -100.0%
hits_91.vortex 1.0 vortex-file-compressed 97.39 MB 0 B 97.39 MB -100.0%
hits_92.vortex 1.0 vortex-file-compressed 147.54 MB 0 B 147.54 MB -100.0%
hits_93.vortex 1.0 vortex-file-compressed 90.71 MB 0 B 90.71 MB -100.0%
hits_94.vortex 1.0 vortex-file-compressed 139.42 MB 0 B 139.42 MB -100.0%
hits_95.vortex 1.0 vortex-file-compressed 96.50 MB 0 B 96.50 MB -100.0%
hits_96.vortex 1.0 vortex-file-compressed 136.20 MB 0 B 136.20 MB -100.0%
hits_97.vortex 1.0 vortex-file-compressed 107.29 MB 0 B 107.29 MB -100.0%
hits_98.vortex 1.0 vortex-file-compressed 118.93 MB 0 B 118.93 MB -100.0%
hits_99.vortex 1.0 vortex-file-compressed 123.62 MB 0 B 123.62 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 7.11 GB (0.0%)
  • vortex-file-compressed: 11.04 GB → 0 B (-100.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): 0.989x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-compact / ns (0.989x ➖, 1↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 13875218 14858040 0.93
statpopgen_q01/duckdb:vortex-compact 15941008 16650405 0.96
statpopgen_q02/duckdb:vortex-compact 743006429 748469209 0.99
statpopgen_q03/duckdb:vortex-compact 🚀 1326147258 1920839942 0.69
statpopgen_q04/duckdb:vortex-compact 🚨 1912367142 1392379365 1.37
statpopgen_q05/duckdb:vortex-compact 677789593 661579747 1.02
statpopgen_q06/duckdb:vortex-compact 1754696673 1745351230 1.01
statpopgen_q07/duckdb:vortex-compact 1067571445 1108240035 0.96
statpopgen_q08/duckdb:vortex-compact 1130998804 1116742374 1.01
statpopgen_q09/duckdb:vortex-compact 1113849045 1081872260 1.03
statpopgen_q10/duckdb:vortex-compact 3147698049 3082503744 1.02
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 375820116 376395363 1.00
statpopgen_q01/duckdb:parquet 467887553 468423293 1.00
statpopgen_q02/duckdb:parquet 770758846 778518087 0.99
statpopgen_q03/duckdb:parquet 1059086700 1063025192 1.00
statpopgen_q04/duckdb:parquet 1057209334 1066514006 0.99
statpopgen_q05/duckdb:parquet 763604655 768064300 0.99
statpopgen_q06/duckdb:parquet 1012359249 1019430472 0.99
statpopgen_q07/duckdb:parquet 953681678 960940577 0.99
statpopgen_q08/duckdb:parquet 961208113 969394552 0.99
statpopgen_q09/duckdb:parquet 1001968145 1016692043 0.99
statpopgen_q10/duckdb:parquet 1655622755 1649436677 1.00

File Size Changes (2 files changed, -67.7% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 0 B 1.96 GB -100.0%

Totals:

  • vortex-compact: 961.01 MB → 961.01 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 0 B (-100.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): 0.986x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed / ns (0.986x ➖, 2↑ 2↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 13901376 13779760 1.01
statpopgen_q01/duckdb:vortex-file-compressed 12970512 13015682 1.00
statpopgen_q02/duckdb:vortex-file-compressed 577318500 583752605 0.99
statpopgen_q03/duckdb:vortex-file-compressed 1742462736 1729416654 1.01
statpopgen_q04/duckdb:vortex-file-compressed 🚀 1228712805 1720447036 0.71
statpopgen_q05/duckdb:vortex-file-compressed 🚀 580143437 721192867 0.80
statpopgen_q06/duckdb:vortex-file-compressed 🚨 2175306720 1822171704 1.19
statpopgen_q07/duckdb:vortex-file-compressed 269236934 278048663 0.97
statpopgen_q08/duckdb:vortex-file-compressed 296048313 305920345 0.97
statpopgen_q09/duckdb:vortex-file-compressed 🚨 1252024678 948586716 1.32
statpopgen_q10/duckdb:vortex-file-compressed 2936691210 2926075720 1.00
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 375804183 376395363 1.00
statpopgen_q01/duckdb:parquet 468775996 468423293 1.00
statpopgen_q02/duckdb:parquet 772642265 778518087 0.99
statpopgen_q03/duckdb:parquet 1048564393 1063025192 0.99
statpopgen_q04/duckdb:parquet 1047402587 1066514006 0.98
statpopgen_q05/duckdb:parquet 764879070 768064300 1.00
statpopgen_q06/duckdb:parquet 1011602999 1019430472 0.99
statpopgen_q07/duckdb:parquet 954972813 960940577 0.99
statpopgen_q08/duckdb:parquet 972304728 969394552 1.00
statpopgen_q09/duckdb:parquet 989478980 1016692043 0.97
statpopgen_q10/duckdb:parquet 1643009476 1649436677 1.00

File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.75 MB 0 B 960.75 MB -100.0%

Totals:

  • vortex-compact: 961.01 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +35.8%
Engines: DataFusion No clear signal (+11.2%, environment too noisy confidence) · DuckDB No clear signal (+65.8%, environment too noisy confidence)
Vortex (geomean): 1.074x ➖
Parquet (geomean): 0.791x ➖
Shifts: Parquet (control) -20.9% · Median polish +3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.116x ➖, 1↑ 3↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 33959032 58684185 0.58
fineweb_q01/datafusion:vortex-file-compressed 388774523 433878022 0.90
fineweb_q02/datafusion:vortex-file-compressed 427370283 369537222 1.16
fineweb_q03/datafusion:vortex-file-compressed 620783974 498417354 1.25
fineweb_q04/datafusion:vortex-file-compressed 🚨 524393565 398013627 1.32
fineweb_q05/datafusion:vortex-file-compressed 🚨 610038933 377571484 1.62
fineweb_q06/datafusion:vortex-file-compressed 🚨 906387852 659514976 1.37
fineweb_q07/datafusion:vortex-file-compressed 542058672 454027668 1.19
fineweb_q08/datafusion:vortex-file-compressed 187027751 182081725 1.03
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 483057681 467886792 1.03
fineweb_q01/datafusion:parquet 951835923 897299744 1.06
fineweb_q02/datafusion:parquet 870877066 836525027 1.04
fineweb_q03/datafusion:parquet 887082472 866420515 1.02
fineweb_q04/datafusion:parquet 830410238 890065710 0.93
fineweb_q05/datafusion:parquet 818590881 811025840 1.01
fineweb_q06/datafusion:parquet 874380838 802968394 1.09
fineweb_q07/datafusion:parquet 860343818 889363704 0.97
fineweb_q08/datafusion:parquet 869050495 975411953 0.89
duckdb / vortex-file-compressed / ns (1.033x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 54052099 45585956 1.19
fineweb_q01/duckdb:vortex-file-compressed 607744623 557999905 1.09
fineweb_q02/duckdb:vortex-file-compressed 534376699 512541408 1.04
fineweb_q03/duckdb:vortex-file-compressed 1508074613 1538712461 0.98
fineweb_q04/duckdb:vortex-file-compressed 1872980902 1817993777 1.03
fineweb_q05/duckdb:vortex-file-compressed 1644102516 1738590402 0.95
fineweb_q06/duckdb:vortex-file-compressed 1709468870 1702069596 1.00
fineweb_q07/duckdb:vortex-file-compressed 1553034843 1527915638 1.02
fineweb_q08/duckdb:vortex-file-compressed 699081563 685662818 1.02
duckdb / parquet / ns (0.623x ✅, 2↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 588934056 5278756471 0.11
fineweb_q01/duckdb:parquet 5328519520 5328317494 1.00
fineweb_q02/duckdb:parquet 5312427035 5292779934 1.00
fineweb_q03/duckdb:parquet 5330099750 5331687476 1.00
fineweb_q04/duckdb:parquet 5289101133 5287710918 1.00
fineweb_q05/duckdb:parquet 5282531327 5313593488 0.99
fineweb_q06/duckdb:parquet 5383629207 5405100594 1.00
fineweb_q07/duckdb:parquet 5337096225 5311127278 1.00
fineweb_q08/duckdb:parquet 🚀 669990002 5288703352 0.13

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+5.0%, environment too noisy confidence) · DuckDB No clear signal (-3.6%, environment too noisy confidence)
Vortex (geomean): 1.024x ➖
Parquet (geomean): 1.018x ➖
Shifts: Parquet (control) +1.8% · Median polish +1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.054x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base 5fa8077 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 565155124 582898110 0.97
tpch_q02/datafusion:vortex-compact 539510203 569204519 0.95
tpch_q03/datafusion:vortex-compact 627863033 483188496 1.30
tpch_q04/datafusion:vortex-compact 313412349 242647063 1.29
tpch_q05/datafusion:vortex-compact 636912190 625436822 1.02
tpch_q06/datafusion:vortex-compact 282662458 270716587 1.04
tpch_q07/datafusion:vortex-compact 676864261 661628841 1.02
tpch_q08/datafusion:vortex-compact 843862416 829992532 1.02
tpch_q09/datafusion:vortex-compact 837554018 800826290 1.05
tpch_q10/datafusion:vortex-compact 757306823 636042099 1.19
tpch_q11/datafusion:vortex-compact 335331715 371023643 0.90
tpch_q12/datafusion:vortex-compact 497010284 444377701 1.12
tpch_q13/datafusion:vortex-compact 235706337 243445989 0.97
tpch_q14/datafusion:vortex-compact 383941857 326727112 1.18
tpch_q15/datafusion:vortex-compact 537495085 541969376 0.99
tpch_q16/datafusion:vortex-compact 284676572 303245755 0.94
tpch_q17/datafusion:vortex-compact 770863698 749013340 1.03
tpch_q18/datafusion:vortex-compact 914485918 853332490 1.07
tpch_q19/datafusion:vortex-compact 🚨 675632255 488417221 1.38
tpch_q20/datafusion:vortex-compact 662829128 619181261 1.07
tpch_q21/datafusion:vortex-compact 910095222 895848958 1.02
tpch_q22/datafusion:vortex-compact 324472581 385665821 0.84
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 5fa8077 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 415831027 420857496 0.99
tpch_q02/datafusion:parquet 581627434 604761707 0.96
tpch_q03/datafusion:parquet 643986537 705948180 0.91
tpch_q04/datafusion:parquet 426330577 398347963 1.07
tpch_q05/datafusion:parquet 760910953 882847586 0.86
tpch_q06/datafusion:parquet 316994030 246682235 1.29
tpch_q07/datafusion:parquet 859054434 866355308 0.99
tpch_q08/datafusion:parquet 861214678 1000436950 0.86
tpch_q09/datafusion:parquet 1207453809 1217057749 0.99
tpch_q10/datafusion:parquet 1747742854 1710771636 1.02
tpch_q11/datafusion:parquet 450988102 435276862 1.04
tpch_q12/datafusion:parquet 462623962 455191721 1.02
tpch_q13/datafusion:parquet 584404198 604082446 0.97
tpch_q14/datafusion:parquet 449217572 432354364 1.04
tpch_q15/datafusion:parquet 726619618 722328346 1.01
tpch_q16/datafusion:parquet 276594841 304535108 0.91
tpch_q17/datafusion:parquet 836602140 806303560 1.04
tpch_q18/datafusion:parquet 1216622470 1154264189 1.05
tpch_q19/datafusion:parquet 500847880 495023379 1.01
tpch_q20/datafusion:parquet 936454189 814359816 1.15
tpch_q21/datafusion:parquet 1208615217 1195841718 1.01
tpch_q22/datafusion:parquet 689203866 702095125 0.98
duckdb / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 5fa8077 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 590575934 590577157 1.00
tpch_q02/duckdb:vortex-compact 799425146 710033383 1.13
tpch_q03/duckdb:vortex-compact 761887080 738945164 1.03
tpch_q04/duckdb:vortex-compact 545578650 556577641 0.98
tpch_q05/duckdb:vortex-compact 871482651 858662062 1.01
tpch_q06/duckdb:vortex-compact 655826882 655690829 1.00
tpch_q07/duckdb:vortex-compact 1091384129 1110878301 0.98
tpch_q08/duckdb:vortex-compact 1231393400 1156828638 1.06
tpch_q09/duckdb:vortex-compact 1245829242 1227946805 1.01
tpch_q10/duckdb:vortex-compact 1108907113 1164263241 0.95
tpch_q11/duckdb:vortex-compact 425246762 431732221 0.98
tpch_q12/duckdb:vortex-compact 1081627649 1135793517 0.95
tpch_q13/duckdb:vortex-compact 711382259 654234754 1.09
tpch_q14/duckdb:vortex-compact 625234551 582212158 1.07
tpch_q15/duckdb:vortex-compact 571527420 559531303 1.02
tpch_q16/duckdb:vortex-compact 340227689 300805386 1.13
tpch_q17/duckdb:vortex-compact 982441329 941740004 1.04
tpch_q18/duckdb:vortex-compact 655832848 674311895 0.97
tpch_q19/duckdb:vortex-compact 790761858 923055516 0.86
tpch_q20/duckdb:vortex-compact 975331978 1130194085 0.86
tpch_q21/duckdb:vortex-compact 1656397503 1786054487 0.93
tpch_q22/duckdb:vortex-compact 271313609 311592077 0.87
duckdb / parquet / ns (1.032x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base 5fa8077 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 460745955 512415864 0.90
tpch_q02/duckdb:parquet 830098685 832214586 1.00
tpch_q03/duckdb:parquet 1047971738 1020275171 1.03
tpch_q04/duckdb:parquet 630958746 660805237 0.95
tpch_q05/duckdb:parquet 1182577339 1106674523 1.07
tpch_q06/duckdb:parquet 🚨 477766024 357941830 1.33
tpch_q07/duckdb:parquet 1031894352 1022548240 1.01
tpch_q08/duckdb:parquet 1310763350 1281051573 1.02
tpch_q09/duckdb:parquet 1284424761 1345764068 0.95
tpch_q10/duckdb:parquet 2403661835 2419836198 0.99
tpch_q11/duckdb:parquet 517629219 488532751 1.06
tpch_q12/duckdb:parquet 769316140 644653668 1.19
tpch_q13/duckdb:parquet 996166294 1030730632 0.97
tpch_q14/duckdb:parquet 729106824 687573301 1.06
tpch_q15/duckdb:parquet 536131791 456223296 1.18
tpch_q16/duckdb:parquet 731485445 657226324 1.11
tpch_q17/duckdb:parquet 659473167 619804744 1.06
tpch_q18/duckdb:parquet 887512560 905839919 0.98
tpch_q19/duckdb:parquet 785707835 825949436 0.95
tpch_q20/duckdb:parquet 1203496303 1210790040 0.99
tpch_q21/duckdb:parquet 1073525535 1035744242 1.04
tpch_q22/duckdb:parquet 896554479 956981219 0.94

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.9%
Engines: DataFusion No clear signal (+2.5%, environment too noisy confidence) · DuckDB No clear signal (-7.9%, low confidence)
Vortex (geomean): 0.971x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 8475293 8509497 1.00
fineweb_q01/datafusion:vortex-file-compressed 29109338 31822858 0.91
fineweb_q02/datafusion:vortex-file-compressed 33008212 34137372 0.97
fineweb_q03/datafusion:vortex-file-compressed 43336652 41224431 1.05
fineweb_q04/datafusion:vortex-file-compressed 208321926 206369573 1.01
fineweb_q05/datafusion:vortex-file-compressed 156569076 155797008 1.00
fineweb_q06/datafusion:vortex-file-compressed 37918607 36530018 1.04
fineweb_q07/datafusion:vortex-file-compressed 40634140 40919540 0.99
fineweb_q08/datafusion:vortex-file-compressed 16662286 16225089 1.03
datafusion / parquet / ns (0.975x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 8999509 10739866 0.84
fineweb_q01/datafusion:parquet 195085138 197723338 0.99
fineweb_q02/datafusion:parquet 198162264 199001126 1.00
fineweb_q03/datafusion:parquet 192317831 193356448 0.99
fineweb_q04/datafusion:parquet 208549491 209488216 1.00
fineweb_q05/datafusion:parquet 204992451 206776734 0.99
fineweb_q06/datafusion:parquet 201098543 200074079 1.01
fineweb_q07/datafusion:parquet 193254896 194304269 0.99
fineweb_q08/datafusion:parquet 188180341 190298482 0.99
duckdb / vortex-file-compressed / ns (0.944x ➖, 5↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 4608300 3057899 1.51
fineweb_q01/duckdb:vortex-file-compressed 🚀 41584965 46852331 0.89
fineweb_q02/duckdb:vortex-file-compressed 46368866 49091913 0.94
fineweb_q03/duckdb:vortex-file-compressed 🚀 63718040 77543543 0.82
fineweb_q04/duckdb:vortex-file-compressed 293944813 290858486 1.01
fineweb_q05/duckdb:vortex-file-compressed 220504809 233772114 0.94
fineweb_q06/duckdb:vortex-file-compressed 🚀 71614029 80502687 0.89
fineweb_q07/duckdb:vortex-file-compressed 🚀 69756469 85867100 0.81
fineweb_q08/duckdb:vortex-file-compressed 🚀 30538474 36719476 0.83
duckdb / parquet / ns (1.025x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 39310329 36462566 1.08
fineweb_q01/duckdb:parquet 78823023 74974561 1.05
fineweb_q02/duckdb:parquet 78798735 75051346 1.05
fineweb_q03/duckdb:parquet 210046292 207251747 1.01
fineweb_q04/duckdb:parquet 234107935 226969770 1.03
fineweb_q05/duckdb:parquet 203286586 201609096 1.01
fineweb_q06/duckdb:parquet 144459503 141702908 1.02
fineweb_q07/duckdb:parquet 145360253 140287280 1.04
fineweb_q08/duckdb:parquet 38872365 41130398 0.95

File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (+1.7%, environment too noisy confidence)
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base c0334e1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 334379157 350108619 0.96
tpch_q02/datafusion:vortex-file-compressed 102007479 102523861 0.99
tpch_q03/datafusion:vortex-file-compressed 158035350 153643024 1.03
tpch_q04/datafusion:vortex-file-compressed 70459118 68641791 1.03
tpch_q05/datafusion:vortex-file-compressed 272728256 268170987 1.02
tpch_q06/datafusion:vortex-file-compressed 26243483 25651526 1.02
tpch_q07/datafusion:vortex-file-compressed 356898101 356910141 1.00
tpch_q08/datafusion:vortex-file-compressed 293940745 284163540 1.03
tpch_q09/datafusion:vortex-file-compressed 496534027 500707136 0.99
tpch_q10/datafusion:vortex-file-compressed 180961741 181891346 0.99
tpch_q11/datafusion:vortex-file-compressed 74429051 77013877 0.97
tpch_q12/datafusion:vortex-file-compressed 87512549 86387833 1.01
tpch_q13/datafusion:vortex-file-compressed 118083929 118282063 1.00
tpch_q14/datafusion:vortex-file-compressed 41773782 40153264 1.04
tpch_q15/datafusion:vortex-file-compressed 72327951 72979490 0.99
tpch_q16/datafusion:vortex-file-compressed 68748955 72996146 0.94
tpch_q17/datafusion:vortex-file-compressed 430018942 433711925 0.99
tpch_q18/datafusion:vortex-file-compressed 650101713 630689190 1.03
tpch_q19/datafusion:vortex-file-compressed 63925168 62807895 1.02
tpch_q20/datafusion:vortex-file-compressed 141675326 137264059 1.03
tpch_q21/datafusion:vortex-file-compressed 474222334 475206999 1.00
tpch_q22/datafusion:vortex-file-compressed 41914205 42309922 0.99
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base c0334e1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 324579168 323487189 1.00
tpch_q02/datafusion:parquet 213509469 222272492 0.96
tpch_q03/datafusion:parquet 231125407 233070752 0.99
tpch_q04/datafusion:parquet 99551871 100515707 0.99
tpch_q05/datafusion:parquet 363667888 361549071 1.01
tpch_q06/datafusion:parquet 72812858 70572097 1.03
tpch_q07/datafusion:parquet 532117030 519272071 1.02
tpch_q08/datafusion:parquet 406292484 412345436 0.99
tpch_q09/datafusion:parquet 665900296 676527847 0.98
tpch_q10/datafusion:parquet 551425570 563984545 0.98
tpch_q11/datafusion:parquet 158872023 170612543 0.93
tpch_q12/datafusion:parquet 151039657 149924153 1.01
tpch_q13/datafusion:parquet 355410750 358826608 0.99
tpch_q14/datafusion:parquet 121593202 118743676 1.02
tpch_q15/datafusion:parquet 193011954 198197078 0.97
tpch_q16/datafusion:parquet 143861390 140760168 1.02
tpch_q17/datafusion:parquet 504030044 518179039 0.97
tpch_q18/datafusion:parquet 695875956 705292043 0.99
tpch_q19/datafusion:parquet 196126072 197860747 0.99
tpch_q20/datafusion:parquet 302049142 298658242 1.01
tpch_q21/datafusion:parquet 541667823 537527850 1.01
tpch_q22/datafusion:parquet 258794851 258715579 1.00
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base c0334e1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 89626998 89245219 1.00
tpch_q02/duckdb:vortex-file-compressed 72456869 74809611 0.97
tpch_q03/duckdb:vortex-file-compressed 138670416 135831363 1.02
tpch_q04/duckdb:vortex-file-compressed 169136902 165916849 1.02
tpch_q05/duckdb:vortex-file-compressed 147718500 149846570 0.99
tpch_q06/duckdb:vortex-file-compressed 38080930 39053011 0.98
tpch_q07/duckdb:vortex-file-compressed 128754583 131611770 0.98
tpch_q08/duckdb:vortex-file-compressed 190145311 183151973 1.04
tpch_q09/duckdb:vortex-file-compressed 309619415 307488926 1.01
tpch_q10/duckdb:vortex-file-compressed 220302211 221285847 1.00
tpch_q11/duckdb:vortex-file-compressed 40181389 41899725 0.96
tpch_q12/duckdb:vortex-file-compressed 119979861 116471714 1.03
tpch_q13/duckdb:vortex-file-compressed 166324437 169544965 0.98
tpch_q14/duckdb:vortex-file-compressed 59706733 61375706 0.97
tpch_q15/duckdb:vortex-file-compressed 88031134 85466228 1.03
tpch_q16/duckdb:vortex-file-compressed 85360707 84964646 1.00
tpch_q17/duckdb:vortex-file-compressed 105268299 106197766 0.99
tpch_q18/duckdb:vortex-file-compressed 259435538 262007476 0.99
tpch_q19/duckdb:vortex-file-compressed 83267555 82924912 1.00
tpch_q20/duckdb:vortex-file-compressed 146530888 139748530 1.05
tpch_q21/duckdb:vortex-file-compressed 475847434 477688907 1.00
tpch_q22/duckdb:vortex-file-compressed 78725652 76888469 1.02
duckdb / parquet / ns (0.984x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base c0334e1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 97468121 148487236 0.66
tpch_q02/duckdb:parquet 101732977 101222537 1.01
tpch_q03/duckdb:parquet 166941541 164828372 1.01
tpch_q04/duckdb:parquet 117330723 120762807 0.97
tpch_q05/duckdb:parquet 188607327 189426458 1.00
tpch_q06/duckdb:parquet 60256275 58220482 1.03
tpch_q07/duckdb:parquet 142431019 139794757 1.02
tpch_q08/duckdb:parquet 219567085 216215651 1.02
tpch_q09/duckdb:parquet 346799844 347631104 1.00
tpch_q10/duckdb:parquet 652206048 648131435 1.01
tpch_q11/duckdb:parquet 41412306 43545632 0.95
tpch_q12/duckdb:parquet 120071215 119620087 1.00
tpch_q13/duckdb:parquet 394719529 400056145 0.99
tpch_q14/duckdb:parquet 152150160 153403151 0.99
tpch_q15/duckdb:parquet 80804562 75892564 1.06
tpch_q16/duckdb:parquet 156285470 154100524 1.01
tpch_q17/duckdb:parquet 117498711 117110817 1.00
tpch_q18/duckdb:parquet 314078674 304673475 1.03
tpch_q19/duckdb:parquet 224508365 228505310 0.98
tpch_q20/duckdb:parquet 197122814 197966624 1.00
tpch_q21/duckdb:parquet 431775841 435880146 0.99
tpch_q22/duckdb:parquet 334410730 336024354 1.00

File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 0 B 1.28 GB -100.0%
nation.vortex 10.0 vortex-compact 8.63 KB 0 B 8.63 KB -100.0%
orders.vortex 10.0 vortex-compact 344.31 MB 0 B 344.31 MB -100.0%
part.vortex 10.0 vortex-compact 35.89 MB 0 B 35.89 MB -100.0%
partsupp.vortex 10.0 vortex-compact 203.66 MB 0 B 203.66 MB -100.0%
region.vortex 10.0 vortex-compact 6.39 KB 0 B 6.39 KB -100.0%
supplier.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+4.2%, environment too noisy confidence) · DuckDB No clear signal (-2.8%, low confidence)
Vortex (geomean): 1.041x ➖
Parquet (geomean): 1.034x ➖
Shifts: Parquet (control) +3.4% · Median polish +3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.068x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 259900484 233633539 1.11
tpch_q02/datafusion:vortex-file-compressed 487208064 408471377 1.19
tpch_q03/datafusion:vortex-file-compressed 356592635 310410333 1.15
tpch_q04/datafusion:vortex-file-compressed 173560142 162377828 1.07
tpch_q05/datafusion:vortex-file-compressed 347621531 319004122 1.09
tpch_q06/datafusion:vortex-file-compressed 252743378 238934961 1.06
tpch_q07/datafusion:vortex-file-compressed 341309916 321333976 1.06
tpch_q08/datafusion:vortex-file-compressed 462490510 477896234 0.97
tpch_q09/datafusion:vortex-file-compressed 333737403 310531049 1.07
tpch_q10/datafusion:vortex-file-compressed 383057561 349078921 1.10
tpch_q11/datafusion:vortex-file-compressed 284556241 286530259 0.99
tpch_q12/datafusion:vortex-file-compressed 363367408 308854311 1.18
tpch_q13/datafusion:vortex-file-compressed 129059971 111049489 1.16
tpch_q14/datafusion:vortex-file-compressed 173228694 163101112 1.06
tpch_q15/datafusion:vortex-file-compressed 301240265 290465202 1.04
tpch_q16/datafusion:vortex-file-compressed 214420578 202945378 1.06
tpch_q17/datafusion:vortex-file-compressed 307478080 293925696 1.05
tpch_q18/datafusion:vortex-file-compressed 312679896 279112867 1.12
tpch_q19/datafusion:vortex-file-compressed 339971170 378152488 0.90
tpch_q20/datafusion:vortex-file-compressed 349601757 355416717 0.98
tpch_q21/datafusion:vortex-file-compressed 417384234 422045481 0.99
tpch_q22/datafusion:vortex-file-compressed 148722854 129281863 1.15
datafusion / parquet / ns (1.024x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 234785550 299118024 0.78
tpch_q02/datafusion:parquet 299170135 289241874 1.03
tpch_q03/datafusion:parquet 308881073 350693829 0.88
tpch_q04/datafusion:parquet 151417510 171709598 0.88
tpch_q05/datafusion:parquet 360749729 360891568 1.00
tpch_q06/datafusion:parquet 141958595 135885077 1.04
tpch_q07/datafusion:parquet 386858497 380895889 1.02
tpch_q08/datafusion:parquet 432165879 429632435 1.01
tpch_q09/datafusion:parquet 469160044 465318100 1.01
tpch_q10/datafusion:parquet 488270877 408971886 1.19
tpch_q11/datafusion:parquet 286859218 296783300 0.97
tpch_q12/datafusion:parquet 207526374 214223106 0.97
tpch_q13/datafusion:parquet 458541388 465871077 0.98
tpch_q14/datafusion:parquet 180501505 172370692 1.05
tpch_q15/datafusion:parquet 270694480 292201074 0.93
tpch_q16/datafusion:parquet 118204830 119267571 0.99
tpch_q17/datafusion:parquet 313897604 325002061 0.97
tpch_q18/datafusion:parquet 457950901 442945930 1.03
tpch_q19/datafusion:parquet 227582412 180450526 1.26
tpch_q20/datafusion:parquet 🚨 371886311 279250765 1.33
tpch_q21/datafusion:parquet 459431274 413877852 1.11
tpch_q22/datafusion:parquet 210848731 165582835 1.27
duckdb / vortex-file-compressed / ns (1.015x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 284635517 258777941 1.10
tpch_q02/duckdb:vortex-file-compressed 655046885 604961972 1.08
tpch_q03/duckdb:vortex-file-compressed 449010022 457009072 0.98
tpch_q04/duckdb:vortex-file-compressed 264153425 265568107 0.99
tpch_q05/duckdb:vortex-file-compressed 584595900 493554241 1.18
tpch_q06/duckdb:vortex-file-compressed 270928216 263093494 1.03
tpch_q07/duckdb:vortex-file-compressed 597311849 556542842 1.07
tpch_q08/duckdb:vortex-file-compressed 724504744 690513562 1.05
tpch_q09/duckdb:vortex-file-compressed 549178240 540339305 1.02
tpch_q10/duckdb:vortex-file-compressed 473517257 477917981 0.99
tpch_q11/duckdb:vortex-file-compressed 264013989 263166722 1.00
tpch_q12/duckdb:vortex-file-compressed 432442987 500554847 0.86
tpch_q13/duckdb:vortex-file-compressed 323116341 329290345 0.98
tpch_q14/duckdb:vortex-file-compressed 262071048 278117659 0.94
tpch_q15/duckdb:vortex-file-compressed 175453577 178277343 0.98
tpch_q16/duckdb:vortex-file-compressed 225497589 232956131 0.97
tpch_q17/duckdb:vortex-file-compressed 460515409 441837445 1.04
tpch_q18/duckdb:vortex-file-compressed 347471557 343994510 1.01
tpch_q19/duckdb:vortex-file-compressed 360286513 348835625 1.03
tpch_q20/duckdb:vortex-file-compressed 515562552 466556671 1.11
tpch_q21/duckdb:vortex-file-compressed 692483864 749530981 0.92
tpch_q22/duckdb:vortex-file-compressed 153247577 149714738 1.02
duckdb / parquet / ns (1.044x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 326506809 317786056 1.03
tpch_q02/duckdb:parquet 668980704 650075483 1.03
tpch_q03/duckdb:parquet 800510318 774300115 1.03
tpch_q04/duckdb:parquet 497503923 475780607 1.05
tpch_q05/duckdb:parquet 940300754 930727416 1.01
tpch_q06/duckdb:parquet 332075810 297129005 1.12
tpch_q07/duckdb:parquet 1022504727 864827530 1.18
tpch_q08/duckdb:parquet 1130922090 1088956630 1.04
tpch_q09/duckdb:parquet 1087163505 1033516705 1.05
tpch_q10/duckdb:parquet 1077513774 985580810 1.09
tpch_q11/duckdb:parquet 454673805 460324132 0.99
tpch_q12/duckdb:parquet 578034814 545478444 1.06
tpch_q13/duckdb:parquet 849194004 830628467 1.02
tpch_q14/duckdb:parquet 530159293 500846861 1.06
tpch_q15/duckdb:parquet 386017653 392720495 0.98
tpch_q16/duckdb:parquet 519298028 491079549 1.06
tpch_q17/duckdb:parquet 505803603 466607702 1.08
tpch_q18/duckdb:parquet 673787118 681031196 0.99
tpch_q19/duckdb:parquet 600430022 582354836 1.03
tpch_q20/duckdb:parquet 865623542 802187106 1.08
tpch_q21/duckdb:parquet 760552965 753264376 1.01
tpch_q22/duckdb:parquet 430685532 428901146 1.00

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.008x ➖


datafusion / vortex-file-compressed / ns (1.008x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 126434624 124900476 1.01
polarsignals_q01/datafusion:vortex-file-compressed 161395906 162626441 0.99
polarsignals_q02/datafusion:vortex-file-compressed 20736157 20616899 1.01
polarsignals_q03/datafusion:vortex-file-compressed 163797806 161497285 1.01
polarsignals_q04/datafusion:vortex-file-compressed 10481085 10293882 1.02
polarsignals_q05/datafusion:vortex-file-compressed 14027970 14725194 0.95
polarsignals_q06/datafusion:vortex-file-compressed 24205673 22022396 1.10
polarsignals_q07/datafusion:vortex-file-compressed 11904102 11623633 1.02
polarsignals_q08/datafusion:vortex-file-compressed 275522478 277335290 0.99
polarsignals_q09/datafusion:vortex-file-compressed 11434138 11723529 0.98

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.4%, environment too noisy confidence)
Vortex (geomean): 0.999x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.001x ➖, 1↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 29498045 29648459 0.99
tpcds_q02/datafusion:vortex-file-compressed 52368009 52379724 1.00
tpcds_q03/datafusion:vortex-file-compressed 14138958 14290111 0.99
tpcds_q04/datafusion:vortex-file-compressed 217043688 216988424 1.00
tpcds_q05/datafusion:vortex-file-compressed 67344400 64421313 1.05
tpcds_q06/datafusion:vortex-file-compressed 26590933 26256534 1.01
tpcds_q07/datafusion:vortex-file-compressed 42459235 42795041 0.99
tpcds_q08/datafusion:vortex-file-compressed 33941117 33618826 1.01
tpcds_q09/datafusion:vortex-file-compressed 28210118 28424351 0.99
tpcds_q10/datafusion:vortex-file-compressed 36515431 36157636 1.01
tpcds_q11/datafusion:vortex-file-compressed 117851147 116762280 1.01
tpcds_q12/datafusion:vortex-file-compressed 20187941 21687107 0.93
tpcds_q13/datafusion:vortex-file-compressed 48271331 50298234 0.96
tpcds_q14/datafusion:vortex-file-compressed 209252498 205696594 1.02
tpcds_q15/datafusion:vortex-file-compressed 29163143 29104419 1.00
tpcds_q16/datafusion:vortex-file-compressed 24964255 24077324 1.04
tpcds_q17/datafusion:vortex-file-compressed 71894950 74404385 0.97
tpcds_q18/datafusion:vortex-file-compressed 88357302 89268478 0.99
tpcds_q19/datafusion:vortex-file-compressed 21479201 21439298 1.00
tpcds_q20/datafusion:vortex-file-compressed 22140540 24097911 0.92
tpcds_q21/datafusion:vortex-file-compressed 31899125 33941111 0.94
tpcds_q22/datafusion:vortex-file-compressed 106017970 115953056 0.91
tpcds_q23/datafusion:vortex-file-compressed 129266619 129930977 0.99
tpcds_q24/datafusion:vortex-file-compressed 96689086 99721723 0.97
tpcds_q25/datafusion:vortex-file-compressed 72045737 72510963 0.99
tpcds_q26/datafusion:vortex-file-compressed 37340429 37385428 1.00
tpcds_q27/datafusion:vortex-file-compressed 96811075 94207111 1.03
tpcds_q28/datafusion:vortex-file-compressed 27352327 28890827 0.95
tpcds_q29/datafusion:vortex-file-compressed 70958020 71046663 1.00
tpcds_q30/datafusion:vortex-file-compressed 30140501 29640507 1.02
tpcds_q31/datafusion:vortex-file-compressed 77422423 79413906 0.97
tpcds_q32/datafusion:vortex-file-compressed 19131577 17729235 1.08
tpcds_q33/datafusion:vortex-file-compressed 32875187 33614618 0.98
tpcds_q34/datafusion:vortex-file-compressed 25894409 25890828 1.00
tpcds_q35/datafusion:vortex-file-compressed 🚨 50041284 44401904 1.13
tpcds_q36/datafusion:vortex-file-compressed 64391017 65434862 0.98
tpcds_q37/datafusion:vortex-file-compressed 18401299 17246061 1.07
tpcds_q38/datafusion:vortex-file-compressed 40540699 42176606 0.96
tpcds_q39/datafusion:vortex-file-compressed 98330385 97810625 1.01
tpcds_q40/datafusion:vortex-file-compressed 35088546 34043179 1.03
tpcds_q41/datafusion:vortex-file-compressed 25180619 24279378 1.04
tpcds_q42/datafusion:vortex-file-compressed 13514549 14004960 0.96
tpcds_q43/datafusion:vortex-file-compressed 18941571 19255370 0.98
tpcds_q44/datafusion:vortex-file-compressed 36016793 34215363 1.05
tpcds_q45/datafusion:vortex-file-compressed 33339551 33732976 0.99
tpcds_q46/datafusion:vortex-file-compressed 35620473 37375954 0.95
tpcds_q47/datafusion:vortex-file-compressed 135782608 126139638 1.08
tpcds_q48/datafusion:vortex-file-compressed 38164998 42110089 0.91
tpcds_q49/datafusion:vortex-file-compressed 73529289 74410149 0.99
tpcds_q50/datafusion:vortex-file-compressed 46404242 47038119 0.99
tpcds_q51/datafusion:vortex-file-compressed 76046725 83033769 0.92
tpcds_q52/datafusion:vortex-file-compressed 14849166 14130351 1.05
tpcds_q53/datafusion:vortex-file-compressed 24624264 24362068 1.01
tpcds_q54/datafusion:vortex-file-compressed 39303383 38339858 1.03
tpcds_q55/datafusion:vortex-file-compressed 13486753 13668885 0.99
tpcds_q56/datafusion:vortex-file-compressed 33606378 33546636 1.00
tpcds_q57/datafusion:vortex-file-compressed 100594552 99578274 1.01
tpcds_q58/datafusion:vortex-file-compressed 61340836 62034390 0.99
tpcds_q59/datafusion:vortex-file-compressed 56297592 56799564 0.99
tpcds_q60/datafusion:vortex-file-compressed 33260405 32906849 1.01
tpcds_q61/datafusion:vortex-file-compressed 36471759 37503641 0.97
tpcds_q62/datafusion:vortex-file-compressed 25021209 24985010 1.00
tpcds_q63/datafusion:vortex-file-compressed 24922701 24281868 1.03
tpcds_q64/datafusion:vortex-file-compressed 485579730 457225082 1.06
tpcds_q65/datafusion:vortex-file-compressed 72595338 73283594 0.99
tpcds_q66/datafusion:vortex-file-compressed 80532622 77188195 1.04
tpcds_q67/datafusion:vortex-file-compressed 115679064 120939425 0.96
tpcds_q68/datafusion:vortex-file-compressed 34980102 32950553 1.06
tpcds_q69/datafusion:vortex-file-compressed 35165596 33674595 1.04
tpcds_q70/datafusion:vortex-file-compressed 118087365 109845094 1.08
tpcds_q71/datafusion:vortex-file-compressed 23489488 24179328 0.97
tpcds_q72/datafusion:vortex-file-compressed 1477410868 1476624080 1.00
tpcds_q73/datafusion:vortex-file-compressed 24454255 24500134 1.00
tpcds_q74/datafusion:vortex-file-compressed 75191948 75407547 1.00
tpcds_q75/datafusion:vortex-file-compressed 147038085 147965014 0.99
tpcds_q76/datafusion:vortex-file-compressed 43075967 41919105 1.03
tpcds_q77/datafusion:vortex-file-compressed 47119119 45656392 1.03
tpcds_q78/datafusion:vortex-file-compressed 111495050 109393363 1.02
tpcds_q79/datafusion:vortex-file-compressed 28697090 28197178 1.02
tpcds_q80/datafusion:vortex-file-compressed 104026781 106048031 0.98
tpcds_q81/datafusion:vortex-file-compressed 🚀 29136125 32871394 0.89
tpcds_q82/datafusion:vortex-file-compressed 20681903 19711596 1.05
tpcds_q83/datafusion:vortex-file-compressed 43315090 41691082 1.04
tpcds_q84/datafusion:vortex-file-compressed 14382176 14232480 1.01
tpcds_q85/datafusion:vortex-file-compressed 115399059 115989005 0.99
tpcds_q86/datafusion:vortex-file-compressed 18952457 18993491 1.00
tpcds_q87/datafusion:vortex-file-compressed 43107492 41213571 1.05
tpcds_q88/datafusion:vortex-file-compressed 53981687 53673239 1.01
tpcds_q89/datafusion:vortex-file-compressed 27118993 27597449 0.98
tpcds_q90/datafusion:vortex-file-compressed 14353484 14219586 1.01
tpcds_q91/datafusion:vortex-file-compressed 19877148 20314757 0.98
tpcds_q92/datafusion:vortex-file-compressed 18273139 17102811 1.07
tpcds_q93/datafusion:vortex-file-compressed 33009227 32202494 1.03
tpcds_q94/datafusion:vortex-file-compressed 24709177 24363427 1.01
tpcds_q95/datafusion:vortex-file-compressed 62633282 62820187 1.00
tpcds_q96/datafusion:vortex-file-compressed 11488660 11751715 0.98
tpcds_q97/datafusion:vortex-file-compressed 27930565 28355017 0.99
tpcds_q98/datafusion:vortex-file-compressed 26258130 25306426 1.04
tpcds_q99/datafusion:vortex-file-compressed 29738767 29377332 1.01
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 32375861 32785949 0.99
tpcds_q02/datafusion:parquet 54360967 51404260 1.06
tpcds_q03/datafusion:parquet 17042729 17904073 0.95
tpcds_q04/datafusion:parquet 338050866 339927256 0.99
tpcds_q05/datafusion:parquet 81174338 80522045 1.01
tpcds_q06/datafusion:parquet 32194540 30814609 1.04
tpcds_q07/datafusion:parquet 97567370 99267916 0.98
tpcds_q08/datafusion:parquet 39008013 38218983 1.02
tpcds_q09/datafusion:parquet 37013458 37128567 1.00
tpcds_q10/datafusion:parquet 90080658 89601389 1.01
tpcds_q11/datafusion:parquet 164678736 169632240 0.97
tpcds_q12/datafusion:parquet 24664719 24363006 1.01
tpcds_q13/datafusion:parquet 99410139 98375874 1.01
tpcds_q14/datafusion:parquet 288595742 271871989 1.06
tpcds_q15/datafusion:parquet 37598664 37146004 1.01
tpcds_q16/datafusion:parquet 46898503 48665899 0.96
tpcds_q17/datafusion:parquet 112394005 107636543 1.04
tpcds_q18/datafusion:parquet 136356960 135680788 1.00
tpcds_q19/datafusion:parquet 28723490 28428018 1.01
tpcds_q20/datafusion:parquet 23205267 22971173 1.01
tpcds_q21/datafusion:parquet 22063122 24122370 0.91
tpcds_q22/datafusion:parquet 116069768 106903152 1.09
tpcds_q23/datafusion:parquet 171430424 177439065 0.97
tpcds_q24/datafusion:parquet 135812837 135957880 1.00
tpcds_q25/datafusion:parquet 112010755 107292685 1.04
tpcds_q26/datafusion:parquet 85288833 83868106 1.02
tpcds_q27/datafusion:parquet 157828361 166669310 0.95
tpcds_q28/datafusion:parquet 40063659 41347587 0.97
tpcds_q29/datafusion:parquet 106053243 106740961 0.99
tpcds_q30/datafusion:parquet 41627828 44815147 0.93
tpcds_q31/datafusion:parquet 94441144 93569275 1.01
tpcds_q32/datafusion:parquet 23521997 23949314 0.98
tpcds_q33/datafusion:parquet 36905272 37793700 0.98
tpcds_q34/datafusion:parquet 29554755 30033186 0.98
tpcds_q35/datafusion:parquet 93233192 93946774 0.99
tpcds_q36/datafusion:parquet 67106668 69725352 0.96
tpcds_q37/datafusion:parquet 24065666 23511413 1.02
tpcds_q38/datafusion:parquet 57718873 58490522 0.99
tpcds_q39/datafusion:parquet 83531742 81900201 1.02
tpcds_q40/datafusion:parquet 32862495 34403984 0.96
tpcds_q41/datafusion:parquet 18992616 19589929 0.97
tpcds_q42/datafusion:parquet 16189448 16570728 0.98
tpcds_q43/datafusion:parquet 23299499 22852267 1.02
tpcds_q44/datafusion:parquet 40882591 39648807 1.03
tpcds_q45/datafusion:parquet 46073293 44499723 1.04
tpcds_q46/datafusion:parquet 41634124 42511554 0.98
tpcds_q47/datafusion:parquet 152839425 153656710 0.99
tpcds_q48/datafusion:parquet 88965389 88264234 1.01
tpcds_q49/datafusion:parquet 76448616 76379000 1.00
tpcds_q50/datafusion:parquet 69551916 72628362 0.96
tpcds_q51/datafusion:parquet 83197254 82106583 1.01
tpcds_q52/datafusion:parquet 16751335 16754950 1.00
tpcds_q53/datafusion:parquet 25824319 24812123 1.04
tpcds_q54/datafusion:parquet 46035383 45446781 1.01
tpcds_q55/datafusion:parquet 16360326 17117403 0.96
tpcds_q56/datafusion:parquet 36804007 37091122 0.99
tpcds_q57/datafusion:parquet 125493458 128363641 0.98
tpcds_q58/datafusion:parquet 82048422 82032762 1.00
tpcds_q59/datafusion:parquet 74939384 74569455 1.00
tpcds_q60/datafusion:parquet 36471729 36813553 0.99
tpcds_q61/datafusion:parquet 45837149 45825225 1.00
tpcds_q62/datafusion:parquet 29701492 27808121 1.07
tpcds_q63/datafusion:parquet 25312274 24985771 1.01
tpcds_q64/datafusion:parquet 356053998 363765551 0.98
tpcds_q65/datafusion:parquet 49902069 52747581 0.95
tpcds_q66/datafusion:parquet 85018919 88153434 0.96
tpcds_q67/datafusion:parquet 145857532 147800846 0.99
tpcds_q68/datafusion:parquet 40881222 40643886 1.01
tpcds_q69/datafusion:parquet 87161979 87249154 1.00
tpcds_q70/datafusion:parquet 43804128 44737601 0.98
tpcds_q71/datafusion:parquet 26308754 27670927 0.95
tpcds_q72/datafusion:parquet 458736571 459571793 1.00
tpcds_q73/datafusion:parquet 27776277 27808807 1.00
tpcds_q74/datafusion:parquet 99839812 104322765 0.96
tpcds_q75/datafusion:parquet 168295003 177695596 0.95
tpcds_q76/datafusion:parquet 61276130 63640359 0.96
tpcds_q77/datafusion:parquet 55548625 58030526 0.96
tpcds_q78/datafusion:parquet 129962334 123546127 1.05
tpcds_q79/datafusion:parquet 35280993 34077499 1.04
tpcds_q80/datafusion:parquet 97653141 96381957 1.01
tpcds_q81/datafusion:parquet 39167309 38450977 1.02
tpcds_q82/datafusion:parquet 23279569 23131922 1.01
tpcds_q83/datafusion:parquet 58116667 56239124 1.03
tpcds_q84/datafusion:parquet 47846667 48008606 1.00
tpcds_q85/datafusion:parquet 195806591 196775760 1.00
tpcds_q86/datafusion:parquet 20759781 21902413 0.95
tpcds_q87/datafusion:parquet 61590654 61790121 1.00
tpcds_q88/datafusion:parquet 58603118 58867603 1.00
tpcds_q89/datafusion:parquet 29808627 29950806 1.00
tpcds_q90/datafusion:parquet 19316260 19380274 1.00
tpcds_q91/datafusion:parquet 65079764 64939010 1.00
tpcds_q92/datafusion:parquet 25823654 25379735 1.02
tpcds_q93/datafusion:parquet 39040012 36651839 1.07
tpcds_q94/datafusion:parquet 30758765 30968453 0.99
tpcds_q95/datafusion:parquet 90177824 89697931 1.01
tpcds_q96/datafusion:parquet 16388992 16573844 0.99
tpcds_q97/datafusion:parquet 39540979 39285643 1.01
tpcds_q98/datafusion:parquet 26922873 27790234 0.97
tpcds_q99/datafusion:parquet 37155105 34765558 1.07
duckdb / vortex-file-compressed / ns (0.996x ➖, 7↑ 7↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 29108353 28308135 1.03
tpcds_q02/duckdb:vortex-file-compressed 28976507 29886759 0.97
tpcds_q03/duckdb:vortex-file-compressed 🚨 24840667 18937190 1.31
tpcds_q04/duckdb:vortex-file-compressed 98602635 98980399 1.00
tpcds_q05/duckdb:vortex-file-compressed 40693670 39933270 1.02
tpcds_q06/duckdb:vortex-file-compressed 48996388 51092764 0.96
tpcds_q07/duckdb:vortex-file-compressed 30602609 32797045 0.93
tpcds_q08/duckdb:vortex-file-compressed 34335626 35180856 0.98
tpcds_q09/duckdb:vortex-file-compressed 19991869 19170216 1.04
tpcds_q10/duckdb:vortex-file-compressed 54407480 56781992 0.96
tpcds_q11/duckdb:vortex-file-compressed 75944928 78154110 0.97
tpcds_q12/duckdb:vortex-file-compressed 🚀 17123682 19747108 0.87
tpcds_q13/duckdb:vortex-file-compressed 41451036 39504938 1.05
tpcds_q14/duckdb:vortex-file-compressed 114596450 118148797 0.97
tpcds_q15/duckdb:vortex-file-compressed 34346179 34538111 0.99
tpcds_q16/duckdb:vortex-file-compressed 🚨 35961899 32430678 1.11
tpcds_q17/duckdb:vortex-file-compressed 55639603 57981207 0.96
tpcds_q18/duckdb:vortex-file-compressed 51134636 52062384 0.98
tpcds_q19/duckdb:vortex-file-compressed 41045710 39972119 1.03
tpcds_q20/duckdb:vortex-file-compressed 18765078 20150389 0.93
tpcds_q21/duckdb:vortex-file-compressed 21676600 23536123 0.92
tpcds_q22/duckdb:vortex-file-compressed 67182453 65233292 1.03
tpcds_q23/duckdb:vortex-file-compressed 79779031 74973236 1.06
tpcds_q24/duckdb:vortex-file-compressed 49058169 50924762 0.96
tpcds_q25/duckdb:vortex-file-compressed 49425539 51054782 0.97
tpcds_q26/duckdb:vortex-file-compressed 23459205 25860988 0.91
tpcds_q27/duckdb:vortex-file-compressed 35167172 35139506 1.00
tpcds_q28/duckdb:vortex-file-compressed 🚀 13564847 15627806 0.87
tpcds_q29/duckdb:vortex-file-compressed 57829927 57277142 1.01
tpcds_q30/duckdb:vortex-file-compressed 37108880 39533317 0.94
tpcds_q31/duckdb:vortex-file-compressed 35071040 34386603 1.02
tpcds_q32/duckdb:vortex-file-compressed 20842096 21293758 0.98
tpcds_q33/duckdb:vortex-file-compressed 32891393 35105444 0.94
tpcds_q34/duckdb:vortex-file-compressed 30592216 32205975 0.95
tpcds_q35/duckdb:vortex-file-compressed 91184982 85737606 1.06
tpcds_q36/duckdb:vortex-file-compressed 31623519 32921375 0.96
tpcds_q37/duckdb:vortex-file-compressed 25668056 25936448 0.99
tpcds_q38/duckdb:vortex-file-compressed 44964417 44945843 1.00
tpcds_q39/duckdb:vortex-file-compressed 37151003 36717682 1.01
tpcds_q40/duckdb:vortex-file-compressed 23741689 22834170 1.04
tpcds_q41/duckdb:vortex-file-compressed 14154698 14690163 0.96
tpcds_q42/duckdb:vortex-file-compressed 20017152 18739312 1.07
tpcds_q43/duckdb:vortex-file-compressed 23489787 21414987 1.10
tpcds_q44/duckdb:vortex-file-compressed 25324938 28012927 0.90
tpcds_q45/duckdb:vortex-file-compressed 37446547 38542999 0.97
tpcds_q46/duckdb:vortex-file-compressed 🚀 37581591 43074158 0.87
tpcds_q47/duckdb:vortex-file-compressed 61074174 60127353 1.02
tpcds_q48/duckdb:vortex-file-compressed 36928731 37309224 0.99
tpcds_q49/duckdb:vortex-file-compressed 44304502 40890271 1.08
tpcds_q50/duckdb:vortex-file-compressed 🚀 33917458 38616833 0.88
tpcds_q51/duckdb:vortex-file-compressed 🚨 137003047 110458160 1.24
tpcds_q52/duckdb:vortex-file-compressed 19161512 17456737 1.10
tpcds_q53/duckdb:vortex-file-compressed 29504868 30837995 0.96
tpcds_q54/duckdb:vortex-file-compressed 46550430 48953445 0.95
tpcds_q55/duckdb:vortex-file-compressed 17711011 17976870 0.99
tpcds_q56/duckdb:vortex-file-compressed 32834606 33549658 0.98
tpcds_q57/duckdb:vortex-file-compressed 45622732 43592910 1.05
tpcds_q58/duckdb:vortex-file-compressed 42182302 41308071 1.02
tpcds_q59/duckdb:vortex-file-compressed 40736817 40433748 1.01
tpcds_q60/duckdb:vortex-file-compressed 37467789 37661096 0.99
tpcds_q61/duckdb:vortex-file-compressed 41792494 40318163 1.04
tpcds_q62/duckdb:vortex-file-compressed 🚨 21895452 19305503 1.13
tpcds_q63/duckdb:vortex-file-compressed 30906698 29017439 1.07
tpcds_q64/duckdb:vortex-file-compressed 119215779 116051207 1.03
tpcds_q65/duckdb:vortex-file-compressed 28560829 27013066 1.06
tpcds_q66/duckdb:vortex-file-compressed 40159638 40125163 1.00
tpcds_q67/duckdb:vortex-file-compressed 137061669 131086817 1.05
tpcds_q68/duckdb:vortex-file-compressed 34965983 38235740 0.91
tpcds_q69/duckdb:vortex-file-compressed 59808088 63123353 0.95
tpcds_q70/duckdb:vortex-file-compressed 44417140 42816765 1.04
tpcds_q71/duckdb:vortex-file-compressed 24830806 25982618 0.96
tpcds_q72/duckdb:vortex-file-compressed 151863931 154008831 0.99
tpcds_q73/duckdb:vortex-file-compressed 31179743 32727794 0.95
tpcds_q74/duckdb:vortex-file-compressed 52226899 53143921 0.98
tpcds_q75/duckdb:vortex-file-compressed 60463839 58439390 1.03
tpcds_q76/duckdb:vortex-file-compressed 24780447 24966127 0.99
tpcds_q77/duckdb:vortex-file-compressed 🚀 31700253 35919139 0.88
tpcds_q78/duckdb:vortex-file-compressed 80231201 79696357 1.01
tpcds_q79/duckdb:vortex-file-compressed 31802998 33043839 0.96
tpcds_q80/duckdb:vortex-file-compressed 58816930 58026464 1.01
tpcds_q81/duckdb:vortex-file-compressed 42399827 41721718 1.02
tpcds_q82/duckdb:vortex-file-compressed 54467822 56270162 0.97
tpcds_q83/duckdb:vortex-file-compressed 42356347 40469949 1.05
tpcds_q84/duckdb:vortex-file-compressed 28937617 28638466 1.01
tpcds_q85/duckdb:vortex-file-compressed 56778642 58010004 0.98
tpcds_q86/duckdb:vortex-file-compressed 19429021 20487328 0.95
tpcds_q87/duckdb:vortex-file-compressed 47948002 47951059 1.00
tpcds_q88/duckdb:vortex-file-compressed 62553069 64132299 0.98
tpcds_q89/duckdb:vortex-file-compressed 27083990 27797563 0.97
tpcds_q90/duckdb:vortex-file-compressed 🚨 18947190 16705913 1.13
tpcds_q91/duckdb:vortex-file-compressed 🚀 34519623 39444118 0.88
tpcds_q92/duckdb:vortex-file-compressed 🚀 24361071 27925012 0.87
tpcds_q93/duckdb:vortex-file-compressed 31165364 30507504 1.02
tpcds_q94/duckdb:vortex-file-compressed 35525442 33951873 1.05
tpcds_q95/duckdb:vortex-file-compressed 150277165 153737265 0.98
tpcds_q96/duckdb:vortex-file-compressed 🚨 19914919 17312518 1.15
tpcds_q97/duckdb:vortex-file-compressed 42684618 46858417 0.91
tpcds_q98/duckdb:vortex-file-compressed 25562278 25881910 0.99
tpcds_q99/duckdb:vortex-file-compressed 🚨 26387607 23752285 1.11
duckdb / parquet / ns (1.000x ➖, 5↑ 3↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 32411290 34023631 0.95
tpcds_q02/duckdb:parquet 🚨 25661380 21907620 1.17
tpcds_q03/duckdb:parquet 12272408 12287938 1.00
tpcds_q04/duckdb:parquet 194815329 199318284 0.98
tpcds_q05/duckdb:parquet 33089977 34053986 0.97
tpcds_q06/duckdb:parquet 36561088 36129129 1.01
tpcds_q07/duckdb:parquet 22161155 22079892 1.00
tpcds_q08/duckdb:parquet 33212666 33255410 1.00
tpcds_q09/duckdb:parquet 30310682 30041396 1.01
tpcds_q10/duckdb:parquet 42047480 39912437 1.05
tpcds_q11/duckdb:parquet 105226593 103790508 1.01
tpcds_q12/duckdb:parquet 18033910 17992455 1.00
tpcds_q13/duckdb:parquet 🚨 39598835 35504254 1.12
tpcds_q14/duckdb:parquet 102266044 106260166 0.96
tpcds_q15/duckdb:parquet 35090141 36053941 0.97
tpcds_q16/duckdb:parquet 27461871 27335755 1.00
tpcds_q17/duckdb:parquet 45129104 44649882 1.01
tpcds_q18/duckdb:parquet 57214546 56045015 1.02
tpcds_q19/duckdb:parquet 33926733 33541905 1.01
tpcds_q20/duckdb:parquet 19397000 19455237 1.00
tpcds_q21/duckdb:parquet 13834341 14170041 0.98
tpcds_q22/duckdb:parquet 49769457 50582712 0.98
tpcds_q23/duckdb:parquet 71211350 65965546 1.08
tpcds_q24/duckdb:parquet 50405594 53611997 0.94
tpcds_q25/duckdb:parquet 42545320 42282981 1.01
tpcds_q26/duckdb:parquet 43692442 45722572 0.96
tpcds_q27/duckdb:parquet 54828935 56380528 0.97
tpcds_q28/duckdb:parquet 28813715 29099065 0.99
tpcds_q29/duckdb:parquet 🚀 42403942 47426986 0.89
tpcds_q30/duckdb:parquet 44482613 43320495 1.03
tpcds_q31/duckdb:parquet 29282808 29640668 0.99
tpcds_q32/duckdb:parquet 15880192 14924596 1.06
tpcds_q33/duckdb:parquet 23095069 24162242 0.96
tpcds_q34/duckdb:parquet 25420317 24639888 1.03
tpcds_q35/duckdb:parquet 69131125 68789590 1.00
tpcds_q36/duckdb:parquet 22417599 22416139 1.00
tpcds_q37/duckdb:parquet 18683473 18432429 1.01
tpcds_q38/duckdb:parquet 41427956 40891596 1.01
tpcds_q39/duckdb:parquet 38556652 38993995 0.99
tpcds_q40/duckdb:parquet 22681039 22363468 1.01
tpcds_q41/duckdb:parquet 10393416 10265521 1.01
tpcds_q42/duckdb:parquet 11594999 11925510 0.97
tpcds_q43/duckdb:parquet 14618918 14442502 1.01
tpcds_q44/duckdb:parquet 25327230 25168192 1.01
tpcds_q45/duckdb:parquet 33064274 32877841 1.01
tpcds_q46/duckdb:parquet 51618579 50963823 1.01
tpcds_q47/duckdb:parquet 47911669 50654574 0.95
tpcds_q48/duckdb:parquet 30211650 30401226 0.99
tpcds_q49/duckdb:parquet 30227993 28250679 1.07
tpcds_q50/duckdb:parquet 24879220 25253452 0.99
tpcds_q51/duckdb:parquet 🚨 130768361 99840886 1.31
tpcds_q52/duckdb:parquet 🚀 11967015 13311898 0.90
tpcds_q53/duckdb:parquet 🚀 15699129 18046030 0.87
tpcds_q54/duckdb:parquet 29158244 29628180 0.98
tpcds_q55/duckdb:parquet 11805762 12008099 0.98
tpcds_q56/duckdb:parquet 25425784 23694023 1.07
tpcds_q57/duckdb:parquet 42513950 42766620 0.99
tpcds_q58/duckdb:parquet 26989432 27708988 0.97
tpcds_q59/duckdb:parquet 30488616 29242555 1.04
tpcds_q60/duckdb:parquet 25645312 25213411 1.02
tpcds_q61/duckdb:parquet 32739411 31092417 1.05
tpcds_q62/duckdb:parquet 14829153 15097040 0.98
tpcds_q63/duckdb:parquet 18101256 17530054 1.03
tpcds_q64/duckdb:parquet 82263371 81556734 1.01
tpcds_q65/duckdb:parquet 25265066 25002577 1.01
tpcds_q66/duckdb:parquet 34583108 34461430 1.00
tpcds_q67/duckdb:parquet 137529805 142053478 0.97
tpcds_q68/duckdb:parquet 39624091 39141355 1.01
tpcds_q69/duckdb:parquet 41166529 41994721 0.98
tpcds_q70/duckdb:parquet 29444833 27240881 1.08
tpcds_q71/duckdb:parquet 22850210 21259408 1.07
tpcds_q72/duckdb:parquet 181424842 177399326 1.02
tpcds_q73/duckdb:parquet 🚀 18464228 21215177 0.87
tpcds_q74/duckdb:parquet 144211355 145589952 0.99
tpcds_q75/duckdb:parquet 60532106 59691694 1.01
tpcds_q76/duckdb:parquet 19275162 20120988 0.96
tpcds_q77/duckdb:parquet 25768043 25214805 1.02
tpcds_q78/duckdb:parquet 77378337 78875247 0.98
tpcds_q79/duckdb:parquet 🚀 27562675 32881731 0.84
tpcds_q80/duckdb:parquet 46156603 49124936 0.94
tpcds_q81/duckdb:parquet 40514178 41215615 0.98
tpcds_q82/duckdb:parquet 18760972 18611578 1.01
tpcds_q83/duckdb:parquet 22294918 22186447 1.00
tpcds_q84/duckdb:parquet 23156551 23874962 0.97
tpcds_q85/duckdb:parquet 47973573 47929205 1.00
tpcds_q86/duckdb:parquet 14702385 14908295 0.99
tpcds_q87/duckdb:parquet 43937949 43692030 1.01
tpcds_q88/duckdb:parquet 42736076 42855805 1.00
tpcds_q89/duckdb:parquet 19835648 18834450 1.05
tpcds_q90/duckdb:parquet 9913664 10101984 0.98
tpcds_q91/duckdb:parquet 27408049 27683699 0.99
tpcds_q92/duckdb:parquet 15465149 15343066 1.01
tpcds_q93/duckdb:parquet 31149486 31328066 0.99
tpcds_q94/duckdb:parquet 21243619 21893524 0.97
tpcds_q95/duckdb:parquet 137746631 137879718 1.00
tpcds_q96/duckdb:parquet 9652171 10149928 0.95
tpcds_q97/duckdb:parquet 38966352 38879357 1.00
tpcds_q98/duckdb:parquet 21669182 21132461 1.03
tpcds_q99/duckdb:parquet 23757919 23297980 1.02

File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 50.71 KB 0 B 50.71 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 364.34 KB 0 B 364.34 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.05 MB 0 B 6.05 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.50 MB 0 B 59.50 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 639.69 KB 0 B 639.69 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 426.00 KB 0 B 426.00 KB -100.0%
date_dim.vortex 1.0 vortex-compact 145.50 KB 0 B 145.50 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 11.73 KB 0 B 11.73 KB -100.0%
income_band.vortex 1.0 vortex-compact 6.70 KB 0 B 6.70 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1003.01 KB 0 B 1003.01 KB -100.0%
promotion.vortex 1.0 vortex-compact 52.33 KB 0 B 52.33 KB -100.0%
reason.vortex 1.0 vortex-compact 6.49 KB 0 B 6.49 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 11.26 KB 0 B 11.26 KB -100.0%
store.vortex 1.0 vortex-compact 46.18 KB 0 B 46.18 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.37 MB 0 B 9.37 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.13 MB 0 B 78.13 MB -100.0%
time_dim.vortex 1.0 vortex-compact 98.38 KB 0 B 98.38 KB -100.0%
warehouse.vortex 1.0 vortex-compact 23.28 KB 0 B 23.28 KB -100.0%
web_page.vortex 1.0 vortex-compact 27.63 KB 0 B 27.63 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.01 MB 0 B 3.01 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.46 MB 0 B 29.46 MB -100.0%
web_site.vortex 1.0 vortex-compact 44.53 KB 0 B 44.53 KB -100.0%

Totals:

  • vortex-compact: 208.03 MB → 0 B (-100.0%)
  • vortex-file-compressed: 270.07 MB → 270.07 MB (0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+2.0%, low confidence)
Vortex (geomean): 1.013x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.996x ➖, 2↑ 2↓)
name PR 32ad0bf (ns) base de32234 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2010293 2010957 1.00
clickbench_q01/datafusion:vortex-file-compressed 🚨 12988154 11599136 1.12
clickbench_q02/datafusion:vortex-file-compressed 23245426 22970762 1.01
clickbench_q03/datafusion:vortex-file-compressed 26285194 26157054 1.00
clickbench_q04/datafusion:vortex-file-compressed 160680083 163888119 0.98
clickbench_q05/datafusion:vortex-file-compressed 216115712 215399249 1.00
clickbench_q06/datafusion:vortex-file-compressed 1999201 1998069 1.00
clickbench_q07/datafusion:vortex-file-compressed 15686110 14652863 1.07
clickbench_q08/datafusion:vortex-file-compressed 224371335 225894297 0.99
clickbench_q09/datafusion:vortex-file-compressed 334865708 356962565 0.94
clickbench_q10/datafusion:vortex-file-compressed 51846528 52186565 0.99
clickbench_q11/datafusion:vortex-file-compressed 60025307 60302952 1.00
clickbench_q12/datafusion:vortex-file-compressed 194529252 200010956 0.97
clickbench_q13/datafusion:vortex-file-compressed 333676895 341481171 0.98
clickbench_q14/datafusion:vortex-file-compressed 205699517 205115818 1.00
clickbench_q15/datafusion:vortex-file-compressed 193865736 195249192 0.99
clickbench_q16/datafusion:vortex-file-compressed 474481756 479308288 0.99
clickbench_q17/datafusion:vortex-file-compressed 477930768 490159953 0.98
clickbench_q18/datafusion:vortex-file-compressed 944272664 923476744 1.02
clickbench_q19/datafusion:vortex-file-compressed 🚀 17227429 23152808 0.74
clickbench_q20/datafusion:vortex-file-compressed 200170817 194968712 1.03
clickbench_q21/datafusion:vortex-file-compressed 263890095 271105899 0.97
clickbench_q22/datafusion:vortex-file-compressed 339271066 336238808 1.01
clickbench_q23/datafusion:vortex-file-compressed 398937448 408842474 0.98
clickbench_q24/datafusion:vortex-file-compressed 🚨 43514693 35941470 1.21
clickbench_q25/datafusion:vortex-file-compressed 49304276 48461989 1.02
clickbench_q26/datafusion:vortex-file-compressed 37309590 37250447 1.00
clickbench_q27/datafusion:vortex-file-compressed 285551289 286324038 1.00
clickbench_q28/datafusion:vortex-file-compressed 1468248385 1470953973 1.00
clickbench_q29/datafusion:vortex-file-compressed 50453184 51023595 0.99
clickbench_q30/datafusion:vortex-file-compressed 166787081 160298020 1.04
clickbench_q31/datafusion:vortex-file-compressed 193612061 191731770 1.01
clickbench_q32/datafusion:vortex-file-compressed 834086336 824149371 1.01
clickbench_q33/datafusion:vortex-file-compressed 999269461 1036930120 0.96
clickbench_q34/datafusion:vortex-file-compressed 1012754873 1049509849 0.96
clickbench_q35/datafusion:vortex-file-compressed 168984380 164952414 1.02
clickbench_q36/datafusion:vortex-file-compressed 🚀 59962494 67352524 0.89
clickbench_q37/datafusion:vortex-file-compressed 28566138 28321250 1.01
clickbench_q38/datafusion:vortex-file-compressed 16323188 16096142 1.01
clickbench_q39/datafusion:vortex-file-compressed 132425014 138084330 0.96
clickbench_q40/datafusion:vortex-file-compressed 12898282 12528551 1.03
clickbench_q41/datafusion:vortex-file-compressed 12230706 12307848 0.99
clickbench_q42/datafusion:vortex-file-compressed 13329273 13337024 1.00
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name PR 32ad0bf (ns) base de32234 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 2009877 1969825 1.02
clickbench_q01/datafusion:parquet 17379268 17630749 0.99
clickbench_q02/datafusion:parquet 30586867 31325990 0.98
clickbench_q03/datafusion:parquet 26611908 26894340 0.99
clickbench_q04/datafusion:parquet 172685685 171497735 1.01
clickbench_q05/datafusion:parquet 237945851 238438919 1.00
clickbench_q06/datafusion:parquet 1987246 1970925 1.01
clickbench_q07/datafusion:parquet 17882471 18558483 0.96
clickbench_q08/datafusion:parquet 235440607 239698078 0.98
clickbench_q09/datafusion:parquet 363841630 375337164 0.97
clickbench_q10/datafusion:parquet 71853536 72298661 0.99
clickbench_q11/datafusion:parquet 90909655 92544209 0.98
clickbench_q12/datafusion:parquet 247175650 238093699 1.04
clickbench_q13/datafusion:parquet 390436771 397170735 0.98
clickbench_q14/datafusion:parquet 252923844 252123069 1.00
clickbench_q15/datafusion:parquet 193976177 200397429 0.97
clickbench_q16/datafusion:parquet 478768933 482115766 0.99
clickbench_q17/datafusion:parquet 477287764 481214610 0.99
clickbench_q18/datafusion:parquet 953369219 940641000 1.01
clickbench_q19/datafusion:parquet 23702428 22836778 1.04
clickbench_q20/datafusion:parquet 466975135 465916942 1.00
clickbench_q21/datafusion:parquet 493753289 490903197 1.01
clickbench_q22/datafusion:parquet 658572331 658430390 1.00
clickbench_q23/datafusion:parquet 2821866550 2853908295 0.99
clickbench_q24/datafusion:parquet 50240272 52035176 0.97
clickbench_q25/datafusion:parquet 100775097 96276913 1.05
clickbench_q26/datafusion:parquet 49740354 49244040 1.01
clickbench_q27/datafusion:parquet 524454465 539211471 0.97
clickbench_q28/datafusion:parquet 1553269471 1546386060 1.00
clickbench_q29/datafusion:parquet 41179600 40827890 1.01
clickbench_q30/datafusion:parquet 240436714 239196248 1.01
clickbench_q31/datafusion:parquet 276957309 281280602 0.98
clickbench_q32/datafusion:parquet 844295508 870575743 0.97
clickbench_q33/datafusion:parquet 1083369178 1100217143 0.98
clickbench_q34/datafusion:parquet 1059403780 1070173264 0.99
clickbench_q35/datafusion:parquet 168053634 178619990 0.94
clickbench_q36/datafusion:parquet 117480350 118783280 0.99
clickbench_q37/datafusion:parquet 51358480 54338703 0.95
clickbench_q38/datafusion:parquet 70909195 69788706 1.02
clickbench_q39/datafusion:parquet 236268227 231557762 1.02
clickbench_q40/datafusion:parquet 26173589 26093710 1.00
clickbench_q41/datafusion:parquet 24103620 25522195 0.94
clickbench_q42/datafusion:parquet 25522807 25301868 1.01
duckdb / vortex-file-compressed / ns (1.030x ➖, 0↑ 8↓)
name PR 32ad0bf (ns) base de32234 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 13977595 13022012 1.07
clickbench_q01/duckdb:vortex-file-compressed 🚨 23747946 20159131 1.18
clickbench_q02/duckdb:vortex-file-compressed 🚨 31283430 28200394 1.11
clickbench_q03/duckdb:vortex-file-compressed 34644094 37708803 0.92
clickbench_q04/duckdb:vortex-file-compressed 131691073 128943278 1.02
clickbench_q05/duckdb:vortex-file-compressed 162567281 159443912 1.02
clickbench_q06/duckdb:vortex-file-compressed 21655627 21628676 1.00
clickbench_q07/duckdb:vortex-file-compressed 🚨 25892726 22799261 1.14
clickbench_q08/duckdb:vortex-file-compressed 165032089 167460820 0.99
clickbench_q09/duckdb:vortex-file-compressed 204192830 205212097 1.00
clickbench_q10/duckdb:vortex-file-compressed 67654878 67333689 1.00
clickbench_q11/duckdb:vortex-file-compressed 69544112 72721393 0.96
clickbench_q12/duckdb:vortex-file-compressed 193449862 199368279 0.97
clickbench_q13/duckdb:vortex-file-compressed 333562635 344244145 0.97
clickbench_q14/duckdb:vortex-file-compressed 210343213 215422219 0.98
clickbench_q15/duckdb:vortex-file-compressed 185076114 185034172 1.00
clickbench_q16/duckdb:vortex-file-compressed 391125364 387980173 1.01
clickbench_q17/duckdb:vortex-file-compressed 370344928 383007129 0.97
clickbench_q18/duckdb:vortex-file-compressed 736426820 739305976 1.00
clickbench_q19/duckdb:vortex-file-compressed 28154512 26408148 1.07
clickbench_q20/duckdb:vortex-file-compressed 236372891 238001726 0.99
clickbench_q21/duckdb:vortex-file-compressed 337466862 333009964 1.01
clickbench_q22/duckdb:vortex-file-compressed 511118123 507257980 1.01
clickbench_q23/duckdb:vortex-file-compressed 226940297 212159841 1.07
clickbench_q24/duckdb:vortex-file-compressed 59031825 55835424 1.06
clickbench_q25/duckdb:vortex-file-compressed 79554849 74666953 1.07
clickbench_q26/duckdb:vortex-file-compressed 69470000 69560038 1.00
clickbench_q27/duckdb:vortex-file-compressed 192235924 188898667 1.02
clickbench_q28/duckdb:vortex-file-compressed 1735971807 1719653597 1.01
clickbench_q29/duckdb:vortex-file-compressed 31159618 30866268 1.01
clickbench_q30/duckdb:vortex-file-compressed 152644706 153702881 0.99
clickbench_q31/duckdb:vortex-file-compressed 311687349 303778767 1.03
clickbench_q32/duckdb:vortex-file-compressed 909937920 902228209 1.01
clickbench_q33/duckdb:vortex-file-compressed 1089867839 1134017964 0.96
clickbench_q34/duckdb:vortex-file-compressed 1164366502 1137968216 1.02
clickbench_q35/duckdb:vortex-file-compressed 209365310 212578813 0.98
clickbench_q36/duckdb:vortex-file-compressed 🚨 38835309 33969088 1.14
clickbench_q37/duckdb:vortex-file-compressed 🚨 27724329 25071077 1.11
clickbench_q38/duckdb:vortex-file-compressed 🚨 33043396 27165170 1.22
clickbench_q39/duckdb:vortex-file-compressed 53602648 52581781 1.02
clickbench_q40/duckdb:vortex-file-compressed 🚨 31072820 26537481 1.17
clickbench_q41/duckdb:vortex-file-compressed 🚨 29213184 26077375 1.12
clickbench_q42/duckdb:vortex-file-compressed 27768057 27148424 1.02
duckdb / parquet / ns (1.010x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base de32234 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 17414264 15414693 1.13
clickbench_q01/duckdb:parquet 16959312 17673184 0.96
clickbench_q02/duckdb:parquet 24275468 24222002 1.00
clickbench_q03/duckdb:parquet 27342698 25442619 1.07
clickbench_q04/duckdb:parquet 130873604 131743582 0.99
clickbench_q05/duckdb:parquet 199258147 183423931 1.09
clickbench_q06/duckdb:parquet 22450868 23413221 0.96
clickbench_q07/duckdb:parquet 19596838 19063205 1.03
clickbench_q08/duckdb:parquet 162185721 162600133 1.00
clickbench_q09/duckdb:parquet 227870449 231060782 0.99
clickbench_q10/duckdb:parquet 58057997 57585671 1.01
clickbench_q11/duckdb:parquet 66860660 66647250 1.00
clickbench_q12/duckdb:parquet 174454483 169650900 1.03
clickbench_q13/duckdb:parquet 306721296 311162760 0.99
clickbench_q14/duckdb:parquet 184709556 187744644 0.98
clickbench_q15/duckdb:parquet 183929042 186403171 0.99
clickbench_q16/duckdb:parquet 354987972 357904754 0.99
clickbench_q17/duckdb:parquet 357217240 365656670 0.98
clickbench_q18/duckdb:parquet 686707752 688376606 1.00
clickbench_q19/duckdb:parquet 21177773 20946833 1.01
clickbench_q20/duckdb:parquet 264153241 259046496 1.02
clickbench_q21/duckdb:parquet 318674793 316669949 1.01
clickbench_q22/duckdb:parquet 460861323 474090380 0.97
clickbench_q23/duckdb:parquet 260987152 242094997 1.08
clickbench_q24/duckdb:parquet 68589061 69188778 0.99
clickbench_q25/duckdb:parquet 71550116 70656761 1.01
clickbench_q26/duckdb:parquet 50854742 47810205 1.06
clickbench_q27/duckdb:parquet 269884425 278529343 0.97
clickbench_q28/duckdb:parquet 1715862552 1744217582 0.98
clickbench_q29/duckdb:parquet 26619484 25729190 1.03
clickbench_q30/duckdb:parquet 176266438 177632899 0.99
clickbench_q31/duckdb:parquet 308245632 312854815 0.99
clickbench_q32/duckdb:parquet 903543342 914491303 0.99
clickbench_q33/duckdb:parquet 772515618 788785832 0.98
clickbench_q34/duckdb:parquet 800275957 796997703 1.00
clickbench_q35/duckdb:parquet 208492101 210712822 0.99
clickbench_q36/duckdb:parquet 50760196 48784617 1.04
clickbench_q37/duckdb:parquet 36496826 35424651 1.03
clickbench_q38/duckdb:parquet 38639842 40442248 0.96
clickbench_q39/duckdb:parquet 91538892 86889329 1.05
clickbench_q40/duckdb:parquet 20985208 19614936 1.07
clickbench_q41/duckdb:parquet 20453964 19683718 1.04
clickbench_q42/duckdb:parquet 23436330 23090429 1.01

File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.91 MB 0 B 58.91 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.70 MB 0 B 90.70 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.51 MB 0 B 49.51 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.14 MB 0 B 56.14 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.89 MB 0 B 69.89 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.27 MB 0 B 69.27 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.91 MB 0 B 74.91 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.44 MB 0 B 48.44 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.59 MB 0 B 49.59 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.82 MB 0 B 58.82 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.76 MB 0 B 49.76 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.19 MB 0 B 129.19 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.39 MB 0 B 38.39 MB -100.0%
hits_21.vortex 1.0 vortex-compact 52.02 MB 0 B 52.02 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.25 MB 0 B 46.25 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.16 MB 0 B 46.16 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.14 MB 0 B 45.14 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.91 MB 0 B 73.91 MB -100.0%
hits_26.vortex 1.0 vortex-compact 72.02 MB 0 B 72.02 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.89 MB 0 B 69.89 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.95 MB 0 B 70.95 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.71 MB 0 B 36.71 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.15 MB 0 B 95.15 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.60 MB 0 B 58.60 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.80 MB 0 B 55.80 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.64 MB 0 B 44.64 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.95 MB 0 B 35.95 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.26 MB 0 B 58.26 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.56 MB 0 B 75.56 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.24 MB 0 B 49.24 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.78 MB 0 B 54.78 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.42 MB 0 B 63.42 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.12 MB 0 B 50.12 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.97 MB 0 B 71.97 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.45 MB 0 B 77.45 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.08 MB 0 B 166.08 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.55 MB 0 B 164.55 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.23 MB 0 B 169.23 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.29 MB 0 B 133.29 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.82 MB 0 B 75.82 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.30 MB 0 B 42.30 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.24 MB 0 B 18.24 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.88 MB 0 B 17.88 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.02 MB 0 B 51.02 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.35 MB 0 B 63.35 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.23 MB 0 B 114.23 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.37 MB 0 B 168.37 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.11 MB 0 B 65.11 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.07 MB 0 B 60.07 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.60 MB 0 B 117.60 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.59 MB 0 B 92.59 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.61 MB 0 B 78.61 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.76 MB 0 B 83.76 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.27 MB 0 B 61.27 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.71 MB 0 B 66.71 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.60 MB 0 B 63.60 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.95 MB 0 B 64.95 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.76 MB 0 B 57.76 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.48 MB 0 B 75.48 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.47 MB 0 B 46.47 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.12 MB 0 B 54.12 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.43 MB 0 B 129.43 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.55 MB 0 B 53.55 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.47 MB 0 B 114.47 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.70 MB 0 B 76.70 MB -100.0%
hits_69.vortex 1.0 vortex-compact 81.01 MB 0 B 81.01 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.21 MB 0 B 64.21 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.87 MB 0 B 61.87 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.99 MB 0 B 69.99 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.77 MB 0 B 52.77 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.09 MB 0 B 71.09 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.90 MB 0 B 71.90 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.15 MB 0 B 45.15 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.13 MB 0 B 77.13 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.53 MB 0 B 118.53 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.88 MB 0 B 97.88 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.20 MB 0 B 86.20 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.42 MB 0 B 63.42 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.70 MB 0 B 68.70 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.98 MB 0 B 65.98 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.46 MB 0 B 67.46 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.64 MB 0 B 53.64 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.38 MB 0 B 74.38 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.89 MB 0 B 52.89 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.15 MB 0 B 49.15 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.89 MB 0 B 118.89 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.61 MB 0 B 73.61 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.12 MB 0 B 114.12 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.35 MB 0 B 66.35 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.12 MB 0 B 82.12 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.27 MB 0 B 61.27 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.43 MB 0 B 94.43 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.95 MB 0 B 59.95 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.92 MB 0 B 90.92 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.23 MB 0 B 58.23 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.76 MB 0 B 91.76 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.60 MB 0 B 69.60 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.18 MB 0 B 73.18 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.67 MB 0 B 77.67 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (+2.1%, environment too noisy confidence) · DuckDB No clear signal (-4.7%, environment too noisy confidence)
Vortex (geomean): 0.980x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.007x ➖, 1↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 🚀 442268797 508753044 0.87
clickbench-sorted_q24/datafusion:vortex-file-compressed 🚨 23756237 20929970 1.14
clickbench-sorted_q26/datafusion:vortex-file-compressed 22038820 22068790 1.00
clickbench-sorted_q36/datafusion:vortex-file-compressed 48348316 47282448 1.02
clickbench-sorted_q37/datafusion:vortex-file-compressed 35783838 38473306 0.93
clickbench-sorted_q38/datafusion:vortex-file-compressed 41608450 40735936 1.02
clickbench-sorted_q39/datafusion:vortex-file-compressed 91437991 89840402 1.02
clickbench-sorted_q40/datafusion:vortex-file-compressed 17760893 17681406 1.00
clickbench-sorted_q41/datafusion:vortex-file-compressed 18092939 17014503 1.06
clickbench-sorted_q42/datafusion:vortex-file-compressed 13758841 13320294 1.03
datafusion / parquet / ns (0.986x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2916690562 2919510738 1.00
clickbench-sorted_q24/datafusion:parquet 🚀 30882240 35751803 0.86
clickbench-sorted_q26/datafusion:parquet 41725207 39668761 1.05
clickbench-sorted_q36/datafusion:parquet 177280019 178803904 0.99
clickbench-sorted_q37/datafusion:parquet 119669780 110070565 1.09
clickbench-sorted_q38/datafusion:parquet 168674350 171214107 0.99
clickbench-sorted_q39/datafusion:parquet 297263870 325748846 0.91
clickbench-sorted_q40/datafusion:parquet 65448283 65008042 1.01
clickbench-sorted_q41/datafusion:parquet 61112969 61557342 0.99
clickbench-sorted_q42/datafusion:parquet 34639262 34902040 0.99
duckdb / vortex-file-compressed / ns (0.954x ➖, 1↑ 0↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 233750532 250856592 0.93
clickbench-sorted_q24/duckdb:vortex-file-compressed 🚀 40553567 45463463 0.89
clickbench-sorted_q26/duckdb:vortex-file-compressed 63664023 66605069 0.96
clickbench-sorted_q36/duckdb:vortex-file-compressed 67785159 65609053 1.03
clickbench-sorted_q37/duckdb:vortex-file-compressed 52578742 54325355 0.97
clickbench-sorted_q38/duckdb:vortex-file-compressed 63065507 62410673 1.01
clickbench-sorted_q39/duckdb:vortex-file-compressed 110540637 110730746 1.00
clickbench-sorted_q40/duckdb:vortex-file-compressed 36271972 39497938 0.92
clickbench-sorted_q41/duckdb:vortex-file-compressed 37758025 40860847 0.92
clickbench-sorted_q42/duckdb:vortex-file-compressed 30712990 33317800 0.92
duckdb / parquet / ns (1.001x ➖, 0↑ 1↓)
name PR 32ad0bf (ns) base 17b190b (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 219985613 224703202 0.98
clickbench-sorted_q24/duckdb:parquet 29948595 33000880 0.91
clickbench-sorted_q26/duckdb:parquet 22618743 22421299 1.01
clickbench-sorted_q36/duckdb:parquet 69247976 67313330 1.03
clickbench-sorted_q37/duckdb:parquet 🚨 60676880 54700324 1.11
clickbench-sorted_q38/duckdb:parquet 62030321 60471923 1.03
clickbench-sorted_q39/duckdb:parquet 107129773 107716474 0.99
clickbench-sorted_q40/duckdb:parquet 29607528 30650749 0.97
clickbench-sorted_q41/duckdb:parquet 27741478 27912061 0.99
clickbench-sorted_q42/duckdb:parquet 20634518 20394220 1.01

File Size Changes (201 files changed, -42.8% overall, 50↑ 151↓)
File Scale Format Base HEAD Change %
hits_034.vortex 1.0 vortex-file-compressed 182.21 MB 183.99 MB +1.78 MB +1.0%
hits_001.vortex 1.0 vortex-file-compressed 191.58 MB 193.40 MB +1.82 MB +1.0%
hits_094.vortex 1.0 vortex-file-compressed 157.29 MB 158.71 MB +1.42 MB +0.9%
hits_048.vortex 1.0 vortex-file-compressed 197.99 MB 199.54 MB +1.54 MB +0.8%
hits_071.vortex 1.0 vortex-file-compressed 140.03 MB 141.09 MB +1.06 MB +0.8%
hits_081.vortex 1.0 vortex-file-compressed 198.95 MB 200.00 MB +1.05 MB +0.5%
hits_008.vortex 1.0 vortex-file-compressed 140.05 MB 140.69 MB +656.77 KB +0.5%
hits_045.vortex 1.0 vortex-file-compressed 140.13 MB 140.75 MB +638.99 KB +0.4%
hits_014.vortex 1.0 vortex-file-compressed 172.14 MB 172.90 MB +776.32 KB +0.4%
hits_009.vortex 1.0 vortex-file-compressed 101.41 MB 101.82 MB +421.19 KB +0.4%
hits_068.vortex 1.0 vortex-file-compressed 160.82 MB 161.41 MB +598.77 KB +0.4%
hits_087.vortex 1.0 vortex-file-compressed 161.06 MB 161.56 MB +508.30 KB +0.3%
hits_000.vortex 1.0 vortex-file-compressed 131.51 MB 131.92 MB +414.62 KB +0.3%
hits_029.vortex 1.0 vortex-file-compressed 199.87 MB 200.36 MB +503.42 KB +0.2%
hits_054.vortex 1.0 vortex-file-compressed 147.14 MB 147.49 MB +358.62 KB +0.2%
hits_093.vortex 1.0 vortex-file-compressed 131.79 MB 132.09 MB +303.33 KB +0.2%
hits_007.vortex 1.0 vortex-file-compressed 200.28 MB 200.70 MB +432.85 KB +0.2%
hits_005.vortex 1.0 vortex-file-compressed 167.61 MB 167.89 MB +288.70 KB +0.2%
hits_095.vortex 1.0 vortex-file-compressed 154.47 MB 154.72 MB +259.85 KB +0.2%
hits_050.vortex 1.0 vortex-file-compressed 160.84 MB 161.09 MB +252.97 KB +0.2%
hits_058.vortex 1.0 vortex-file-compressed 155.32 MB 155.55 MB +242.16 KB +0.2%
hits_098.vortex 1.0 vortex-file-compressed 137.59 MB 137.79 MB +207.29 KB +0.1%
hits_022.vortex 1.0 vortex-file-compressed 198.25 MB 198.48 MB +235.20 KB +0.1%
hits_073.vortex 1.0 vortex-file-compressed 172.60 MB 172.79 MB +194.12 KB +0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.82 MB 130.94 MB +125.47 KB +0.1%
hits_015.vortex 1.0 vortex-file-compressed 131.25 MB 131.36 MB +111.56 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.90 MB 130.99 MB +98.59 KB +0.1%
hits_099.vortex 1.0 vortex-file-compressed 171.24 MB 171.36 MB +124.59 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.90 MB 140.99 MB +99.19 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 199.51 MB 199.64 MB +133.87 KB +0.1%
hits_017.vortex 1.0 vortex-file-compressed 146.88 MB 146.98 MB +95.38 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 101.38 MB 101.44 MB +61.62 KB +0.1%
hits_090.vortex 1.0 vortex-file-compressed 192.71 MB 192.82 MB +116.20 KB +0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.43 MB 172.52 MB +88.71 KB +0.1%
hits_033.vortex 1.0 vortex-file-compressed 199.93 MB 200.02 MB +97.88 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.86 MB 126.92 MB +59.94 KB +0.0%
hits_082.vortex 1.0 vortex-file-compressed 140.00 MB 140.06 MB +58.45 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 160.84 MB 160.90 MB +59.44 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 171.94 MB 171.99 MB +56.67 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.90 MB 189.96 MB +60.81 KB +0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.08 MB 161.12 MB +44.43 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.44 MB 126.46 MB +21.10 KB +0.0%
hits_021.vortex 1.0 vortex-file-compressed 154.40 MB 154.42 MB +23.09 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.64 MB 154.66 MB +21.22 KB +0.0%
hits_086.vortex 1.0 vortex-file-compressed 192.22 MB 192.24 MB +18.77 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.06 MB 161.07 MB +13.16 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.66 MB 161.67 MB +11.89 KB +0.0%
hits_066.vortex 1.0 vortex-file-compressed 163.21 MB 163.22 MB +11.19 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.15 MB 147.15 MB +8.87 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 131.68 MB 131.69 MB +5.59 KB +0.0%
hits_089.vortex 1.0 vortex-file-compressed 131.66 MB 131.65 MB 1.12 KB -0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.10 MB 172.10 MB 2.53 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 169.14 MB 169.13 MB 7.65 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.55 MB 126.54 MB 10.81 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 154.50 MB 154.48 MB 21.94 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.59 MB 159.57 MB 26.48 KB -0.0%
hits_037.vortex 1.0 vortex-file-compressed 177.38 MB 177.35 MB 31.88 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.34 MB 161.30 MB 39.95 KB -0.0%
hits_004.vortex 1.0 vortex-file-compressed 131.58 MB 131.55 MB 33.70 KB -0.0%
hits_035.vortex 1.0 vortex-file-compressed 103.07 MB 103.04 MB 27.88 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 131.37 MB 131.34 MB 40.16 KB -0.0%
hits_063.vortex 1.0 vortex-file-compressed 131.80 MB 131.75 MB 47.60 KB -0.0%
hits_041.vortex 1.0 vortex-file-compressed 131.35 MB 131.30 MB 47.59 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.35 MB 142.29 MB 61.68 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.66 MB 136.59 MB 67.79 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.77 MB 135.70 MB 68.51 KB -0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.46 MB 171.37 MB 95.92 KB -0.1%
hits_059.vortex 1.0 vortex-file-compressed 199.19 MB 199.08 MB 112.05 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 199.71 MB 199.60 MB 113.54 KB -0.1%
hits_097.vortex 1.0 vortex-file-compressed 193.16 MB 193.03 MB 124.03 KB -0.1%
hits_023.vortex 1.0 vortex-file-compressed 195.57 MB 195.44 MB 132.74 KB -0.1%
hits_096.vortex 1.0 vortex-file-compressed 199.57 MB 199.43 MB 146.16 KB -0.1%
hits_040.vortex 1.0 vortex-file-compressed 143.21 MB 143.10 MB 116.70 KB -0.1%
hits_079.vortex 1.0 vortex-file-compressed 181.19 MB 181.03 MB 164.35 KB -0.1%
hits_062.vortex 1.0 vortex-file-compressed 170.94 MB 170.79 MB 155.27 KB -0.1%
hits_064.vortex 1.0 vortex-file-compressed 193.32 MB 193.14 MB 182.34 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 132.15 MB 132.03 MB 124.91 KB -0.1%
hits_092.vortex 1.0 vortex-file-compressed 199.76 MB 199.56 MB 197.62 KB -0.1%
hits_016.vortex 1.0 vortex-file-compressed 180.68 MB 180.48 MB 209.80 KB -0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.58 MB 191.36 MB 229.70 KB -0.1%
hits_020.vortex 1.0 vortex-file-compressed 160.84 MB 160.64 MB 199.43 KB -0.1%
hits_070.vortex 1.0 vortex-file-compressed 200.15 MB 199.87 MB 286.23 KB -0.1%
hits_083.vortex 1.0 vortex-file-compressed 157.43 MB 157.20 MB 238.73 KB -0.1%
hits_038.vortex 1.0 vortex-file-compressed 190.55 MB 190.27 MB 291.33 KB -0.1%
hits_012.vortex 1.0 vortex-file-compressed 191.43 MB 191.12 MB 323.61 KB -0.2%
hits_084.vortex 1.0 vortex-file-compressed 154.82 MB 154.55 MB 276.80 KB -0.2%
hits_057.vortex 1.0 vortex-file-compressed 160.54 MB 160.23 MB 316.37 KB -0.2%
hits_024.vortex 1.0 vortex-file-compressed 160.83 MB 160.51 MB 328.37 KB -0.2%
hits_075.vortex 1.0 vortex-file-compressed 189.90 MB 189.50 MB 411.71 KB -0.2%
hits_072.vortex 1.0 vortex-file-compressed 102.52 MB 102.30 MB 224.27 KB -0.2%
hits_051.vortex 1.0 vortex-file-compressed 172.94 MB 172.52 MB 429.65 KB -0.2%
hits_042.vortex 1.0 vortex-file-compressed 202.16 MB 201.57 MB 601.20 KB -0.3%
hits_085.vortex 1.0 vortex-file-compressed 200.16 MB 199.49 MB 683.66 KB -0.3%
hits_044.vortex 1.0 vortex-file-compressed 200.19 MB 199.00 MB 1.19 MB -0.6%
hits_028.vortex 1.0 vortex-file-compressed 152.85 MB 151.94 MB 932.96 KB -0.6%
hits_011.vortex 1.0 vortex-file-compressed 199.60 MB 198.26 MB 1.34 MB -0.7%
hits_055.vortex 1.0 vortex-file-compressed 200.36 MB 198.20 MB 2.16 MB -1.1%
hits_065.vortex 1.0 vortex-file-compressed 161.41 MB 159.58 MB 1.84 MB -1.1%
hits_053.vortex 1.0 vortex-file-compressed 192.31 MB 189.97 MB 2.34 MB -1.2%
hits_060.vortex 1.0 vortex-file-compressed 195.81 MB 193.29 MB 2.51 MB -1.3%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 99.17 MB 0 B 99.17 MB -100.0%
hits_001.vortex 1.0 vortex-compact 139.08 MB 0 B 139.08 MB -100.0%
hits_002.vortex 1.0 vortex-compact 124.26 MB 0 B 124.26 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.57 MB 0 B 104.57 MB -100.0%
hits_004.vortex 1.0 vortex-compact 98.92 MB 0 B 98.92 MB -100.0%
hits_005.vortex 1.0 vortex-compact 116.36 MB 0 B 116.36 MB -100.0%
hits_006.vortex 1.0 vortex-compact 96.36 MB 0 B 96.36 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.64 MB 0 B 153.64 MB -100.0%
hits_008.vortex 1.0 vortex-compact 105.91 MB 0 B 105.91 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.27 MB 0 B 75.27 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.56 MB 0 B 123.56 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.91 MB 0 B 152.91 MB -100.0%
hits_012.vortex 1.0 vortex-compact 138.76 MB 0 B 138.76 MB -100.0%
hits_013.vortex 1.0 vortex-compact 125.68 MB 0 B 125.68 MB -100.0%
hits_014.vortex 1.0 vortex-compact 134.58 MB 0 B 134.58 MB -100.0%
hits_015.vortex 1.0 vortex-compact 97.39 MB 0 B 97.39 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.64 MB 0 B 127.64 MB -100.0%
hits_017.vortex 1.0 vortex-compact 111.83 MB 0 B 111.83 MB -100.0%
hits_018.vortex 1.0 vortex-compact 153.82 MB 0 B 153.82 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.18 MB 0 B 106.18 MB -100.0%
hits_020.vortex 1.0 vortex-compact 111.68 MB 0 B 111.68 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.67 MB 0 B 110.67 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.22 MB 0 B 153.22 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.80 MB 0 B 142.80 MB -100.0%
hits_024.vortex 1.0 vortex-compact 125.34 MB 0 B 125.34 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.72 MB 0 B 133.72 MB -100.0%
hits_026.vortex 1.0 vortex-compact 98.22 MB 0 B 98.22 MB -100.0%
hits_027.vortex 1.0 vortex-compact 139.29 MB 0 B 139.29 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.71 MB 0 B 115.71 MB -100.0%
hits_029.vortex 1.0 vortex-compact 152.81 MB 0 B 152.81 MB -100.0%
hits_030.vortex 1.0 vortex-compact 98.03 MB 0 B 98.03 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.74 MB 0 B 111.74 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.64 MB 0 B 110.64 MB -100.0%
hits_033.vortex 1.0 vortex-compact 152.71 MB 0 B 152.71 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.45 MB 0 B 133.45 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.97 MB 0 B 75.97 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.54 MB 0 B 132.54 MB -100.0%
hits_038.vortex 1.0 vortex-compact 139.61 MB 0 B 139.61 MB -100.0%
hits_039.vortex 1.0 vortex-compact 125.49 MB 0 B 125.49 MB -100.0%
hits_040.vortex 1.0 vortex-compact 110.50 MB 0 B 110.50 MB -100.0%
hits_041.vortex 1.0 vortex-compact 97.83 MB 0 B 97.83 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.33 MB 0 B 136.33 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.38 MB 0 B 94.38 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.75 MB 0 B 153.75 MB -100.0%
hits_045.vortex 1.0 vortex-compact 105.66 MB 0 B 105.66 MB -100.0%
hits_046.vortex 1.0 vortex-compact 75.03 MB 0 B 75.03 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.51 MB 0 B 110.51 MB -100.0%
hits_048.vortex 1.0 vortex-compact 152.57 MB 0 B 152.57 MB -100.0%
hits_049.vortex 1.0 vortex-compact 139.87 MB 0 B 139.87 MB -100.0%
hits_050.vortex 1.0 vortex-compact 125.45 MB 0 B 125.45 MB -100.0%
hits_051.vortex 1.0 vortex-compact 134.04 MB 0 B 134.04 MB -100.0%
hits_052.vortex 1.0 vortex-compact 98.41 MB 0 B 98.41 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.48 MB 0 B 138.48 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.20 MB 0 B 112.20 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.45 MB 0 B 153.45 MB -100.0%
hits_056.vortex 1.0 vortex-compact 100.87 MB 0 B 100.87 MB -100.0%
hits_057.vortex 1.0 vortex-compact 112.03 MB 0 B 112.03 MB -100.0%
hits_058.vortex 1.0 vortex-compact 111.11 MB 0 B 111.11 MB -100.0%
hits_059.vortex 1.0 vortex-compact 152.82 MB 0 B 152.82 MB -100.0%
hits_060.vortex 1.0 vortex-compact 141.16 MB 0 B 141.16 MB -100.0%
hits_061.vortex 1.0 vortex-compact 123.50 MB 0 B 123.50 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.65 MB 0 B 132.65 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.53 MB 0 B 98.53 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.06 MB 0 B 140.06 MB -100.0%
hits_065.vortex 1.0 vortex-compact 124.44 MB 0 B 124.44 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.37 MB 0 B 117.37 MB -100.0%
hits_067.vortex 1.0 vortex-compact 98.54 MB 0 B 98.54 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.46 MB 0 B 112.46 MB -100.0%
hits_069.vortex 1.0 vortex-compact 100.11 MB 0 B 100.11 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.79 MB 0 B 153.79 MB -100.0%
hits_071.vortex 1.0 vortex-compact 105.74 MB 0 B 105.74 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.69 MB 0 B 75.69 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.30 MB 0 B 134.30 MB -100.0%
hits_074.vortex 1.0 vortex-compact 153.21 MB 0 B 153.21 MB -100.0%
hits_075.vortex 1.0 vortex-compact 139.23 MB 0 B 139.23 MB -100.0%
hits_076.vortex 1.0 vortex-compact 125.34 MB 0 B 125.34 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.59 MB 0 B 134.59 MB -100.0%
hits_078.vortex 1.0 vortex-compact 97.20 MB 0 B 97.20 MB -100.0%
hits_079.vortex 1.0 vortex-compact 128.28 MB 0 B 128.28 MB -100.0%
hits_080.vortex 1.0 vortex-compact 96.73 MB 0 B 96.73 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.03 MB 0 B 153.03 MB -100.0%
hits_082.vortex 1.0 vortex-compact 106.28 MB 0 B 106.28 MB -100.0%
hits_083.vortex 1.0 vortex-compact 110.01 MB 0 B 110.01 MB -100.0%
hits_084.vortex 1.0 vortex-compact 110.69 MB 0 B 110.69 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.39 MB 0 B 153.39 MB -100.0%
hits_086.vortex 1.0 vortex-compact 141.24 MB 0 B 141.24 MB -100.0%
hits_087.vortex 1.0 vortex-compact 125.56 MB 0 B 125.56 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.39 MB 0 B 134.39 MB -100.0%
hits_089.vortex 1.0 vortex-compact 98.78 MB 0 B 98.78 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.25 MB 0 B 141.25 MB -100.0%
hits_091.vortex 1.0 vortex-compact 111.69 MB 0 B 111.69 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.55 MB 0 B 153.55 MB -100.0%
hits_093.vortex 1.0 vortex-compact 99.58 MB 0 B 99.58 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.77 MB 0 B 110.77 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.64 MB 0 B 110.64 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.28 MB 0 B 153.28 MB -100.0%
hits_097.vortex 1.0 vortex-compact 140.26 MB 0 B 140.26 MB -100.0%
hits_098.vortex 1.0 vortex-compact 103.70 MB 0 B 103.70 MB -100.0%
hits_099.vortex 1.0 vortex-compact 133.36 MB 0 B 133.36 MB -100.0%

Totals:

  • vortex-compact: 11.94 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.97 GB → 15.97 GB (-0.0%)

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
connortsui20 marked this pull request as draft August 11, 2026 03:13
@connortsui20
connortsui20 deleted the ct/row-fn-numeric branch August 11, 2026 11:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants