Use smallvec for internal stats storage by robert3005 · Pull Request #7823 · vortex-data/vortex

robert3005 · 2026-05-06T22:22:36Z

Instead of always allocating fixed sized vec we can use a smallvec instead

Signed-off-by: Robert Kruszewski github@robertk.io

a10y

Do we think these allocations are significant?

robert3005 · 2026-05-06T22:30:12Z

I am not sure, trying things out to see benchmarks

codspeed-hq · 2026-05-06T22:33:15Z

Merging this PR will degrade performance by 23.06%

⚠️

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 6 improved benchmarks
❌ 5 regressed benchmarks
✅ 1195 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
⚡	Simulation	`chunked_constant_i32_append_to_builder[(1000, 10)]`	40.6 µs	30.1 µs	+34.78%
⚡	Simulation	`chunked_bool_canonical_into[(1000, 10)]`	57.2 µs	50.3 µs	+13.74%
⚡	Simulation	`varbinview_large`	436.3 µs	174.5 µs	×2.5
❌	Simulation	`patched_take_10k_contiguous_patches`	228.6 µs	288.2 µs	-20.66%
❌	Simulation	`take_10k_contiguous`	270.9 µs	329.1 µs	-17.69%
❌	Simulation	`patched_take_10k_random`	241 µs	300.1 µs	-19.7%
❌	Simulation	`take_10k_random`	194.9 µs	253.4 µs	-23.06%
⚡	Simulation	`null_count_run_end[(10000, 1024, 0.01)]`	4 µs	3.2 µs	+24.46%
⚡	Simulation	`null_count_run_end[(10000, 256, 0.01)]`	4 µs	3.2 µs	+25.61%
⚡	Simulation	`null_count_run_end[(100000, 1024, 0.01)]`	4 µs	3.2 µs	+25.61%
❌	Simulation	`decompress_rd[f64, (10000, 0.1)]`	121.8 µs	136.6 µs	-10.83%

_{Comparing rk/statssmallvec (dbd087e) with develop (115b3ba)}

github-actions · 2026-05-06T22:37:07Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`14e3931`		1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-05-06T22:39:20Z

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.015x ➖

datafusion / vortex-file-compressed (1.015x ➖, 0↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed	120559506	123402731	0.98
polarsignals_q01/datafusion:vortex-file-compressed	269465738	283046410	0.95
polarsignals_q02/datafusion:vortex-file-compressed	23724895	23993648	0.99
polarsignals_q03/datafusion:vortex-file-compressed	283573328	278565420	1.02
polarsignals_q04/datafusion:vortex-file-compressed	11826305	11641773	1.02
polarsignals_q05/datafusion:vortex-file-compressed	15560716	15208556	1.02
polarsignals_q06/datafusion:vortex-file-compressed	19716111	18512506	1.07
polarsignals_q07/datafusion:vortex-file-compressed 🚨	15690122	13742818	1.14
polarsignals_q08/datafusion:vortex-file-compressed	415496584	405949392	1.02
polarsignals_q09/datafusion:vortex-file-compressed	11212467	11756145	0.95

github-actions · 2026-05-06T22:39:23Z

File Sizes: PolarSignals Profiling

No file size changes detected.

github-actions · 2026-05-06T22:40:06Z

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 1.018x ➖
Parquet (geomean): 1.020x ➖
Shifts: Parquet (control) +2.0% · Median polish +0.9%

datafusion / vortex-file-compressed (1.047x ➖, 0↑ 2↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed	5290336	5240437	1.01
fineweb_q01/datafusion:vortex-file-compressed 🚨	22853239	18153299	1.26
fineweb_q02/datafusion:vortex-file-compressed	22145566	22276798	0.99
fineweb_q03/datafusion:vortex-file-compressed 🚨	83055899	71841428	1.16
fineweb_q04/datafusion:vortex-file-compressed	233324154	230610117	1.01
fineweb_q05/datafusion:vortex-file-compressed	218034859	217474354	1.00
fineweb_q06/datafusion:vortex-file-compressed	53583460	52447646	1.02
fineweb_q07/datafusion:vortex-file-compressed	59652702	57760278	1.03
fineweb_q08/datafusion:vortex-file-compressed	22343873	23037662	0.97

datafusion / vortex-compact (1.029x ➖, 0↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact	5963865	5822199	1.02
fineweb_q01/datafusion:vortex-compact	133801549	125015824	1.07
fineweb_q02/datafusion:vortex-compact 🚨	140696044	127370506	1.10
fineweb_q03/datafusion:vortex-compact	1055960543	1034611154	1.02
fineweb_q04/datafusion:vortex-compact	1120131969	1106650099	1.01
fineweb_q05/datafusion:vortex-compact	946478415	945434365	1.00
fineweb_q06/datafusion:vortex-compact	529607408	531718283	1.00
fineweb_q07/datafusion:vortex-compact	542703230	538985213	1.01
fineweb_q08/datafusion:vortex-compact	18060974	17522147	1.03

datafusion / parquet (1.015x ➖, 0↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨	6787074	6090788	1.11
fineweb_q01/datafusion:parquet	284202891	293771590	0.97
fineweb_q02/datafusion:parquet	288806434	288715952	1.00
fineweb_q03/datafusion:parquet	297773716	281631940	1.06
fineweb_q04/datafusion:parquet	302473669	300096112	1.01
fineweb_q05/datafusion:parquet	297608375	296467213	1.00
fineweb_q06/datafusion:parquet	289593675	296636369	0.98
fineweb_q07/datafusion:parquet	282432812	282343279	1.00
fineweb_q08/datafusion:parquet	281753920	277655583	1.01

duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	3235489	3105144	1.04
fineweb_q01/duckdb:vortex-file-compressed	22309661	22069466	1.01
fineweb_q02/duckdb:vortex-file-compressed	23486573	24101855	0.97
fineweb_q03/duckdb:vortex-file-compressed	119269787	115070826	1.04
fineweb_q04/duckdb:vortex-file-compressed	220073597	218806463	1.01
fineweb_q05/duckdb:vortex-file-compressed	206965848	212871474	0.97
fineweb_q06/duckdb:vortex-file-compressed	51503434	51946802	0.99
fineweb_q07/duckdb:vortex-file-compressed	55331374	55328220	1.00
fineweb_q08/duckdb:vortex-file-compressed	22619800	22093382	1.02

duckdb / vortex-compact (0.990x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact	3779457	4098618	0.92
fineweb_q01/duckdb:vortex-compact	103656402	110192498	0.94
fineweb_q02/duckdb:vortex-compact	114508149	107362806	1.07
fineweb_q03/duckdb:vortex-compact	869276841	858268788	1.01
fineweb_q04/duckdb:vortex-compact	903513401	901297491	1.00
fineweb_q05/duckdb:vortex-compact	817672705	818236412	1.00
fineweb_q06/duckdb:vortex-compact	459084397	461451428	0.99
fineweb_q07/duckdb:vortex-compact	476585861	479660440	0.99
fineweb_q08/duckdb:vortex-compact	20645619	20918249	0.99

duckdb / parquet (1.025x ➖, 0↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	30685329	31509844	0.97
fineweb_q01/duckdb:parquet	82807356	82191426	1.01
fineweb_q02/duckdb:parquet	85906379	83049048	1.03
fineweb_q03/duckdb:parquet	313270706	310001613	1.01
fineweb_q04/duckdb:parquet	441421689	438683126	1.01
fineweb_q05/duckdb:parquet	410967192	411075453	1.00
fineweb_q06/duckdb:parquet	199512127	196711053	1.01
fineweb_q07/duckdb:parquet	210400362	207643158	1.01
fineweb_q08/duckdb:parquet 🚨	34095916	28910941	1.18

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	+2.4%	+4.2%	-1.7%	+50.7%	➖ noise
0	datafusion:vortex-file-compressed	+1.0%	+4.2%	-3.1%	+51.9%	➖ noise
0	duckdb:vortex-compact	-7.8%	+4.2%	-11.5%	+95.5%	➖ noise
0	duckdb:vortex-file-compressed	+4.2%	+4.2%	+0.0%	+82.7%	➖ noise
1	datafusion:vortex-compact	+7.0%	-1.3%	+8.4%	+13.6%	➖ noise
1	datafusion:vortex-file-compressed	+25.9%	-1.3%	+27.5%	+29.2%	➖ noise
1	duckdb:vortex-compact	-5.9%	-1.3%	-4.7%	+24.2%	➖ noise
1	duckdb:vortex-file-compressed	+1.1%	-1.3%	+2.4%	+62.6%	➖ noise
2	datafusion:vortex-compact	+10.5%	+1.7%	+8.6%	+12.2%	➖ noise
2	datafusion:vortex-file-compressed	-0.6%	+1.7%	-2.3%	+17.5%	➖ noise
2	duckdb:vortex-compact	+6.7%	+1.7%	+4.9%	+14.5%	➖ noise
2	duckdb:vortex-file-compressed	-2.6%	+1.7%	-4.2%	+22.3%	➖ noise
3	datafusion:vortex-compact	+2.1%	+3.4%	-1.3%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	+15.6%	+3.4%	+11.8%	+24.4%	➖ noise
3	duckdb:vortex-compact	+1.3%	+3.4%	-2.0%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	+3.6%	+3.4%	+0.3%	+34.3%	➖ noise
4	datafusion:vortex-compact	+1.2%	+0.7%	+0.5%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	+1.2%	+0.7%	+0.5%	+10.0%	➖ noise
4	duckdb:vortex-compact	+0.2%	+0.7%	-0.5%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	+0.6%	+0.7%	-0.1%	+10.0%	➖ noise
5	datafusion:vortex-compact	+0.1%	+0.2%	-0.1%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	+0.3%	+0.2%	+0.1%	+10.0%	➖ noise
5	duckdb:vortex-compact	-0.1%	+0.2%	-0.2%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-2.8%	+0.2%	-2.9%	+10.0%	➖ noise
6	datafusion:vortex-compact	-0.4%	-0.5%	+0.1%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	+2.2%	-0.5%	+2.7%	+10.0%	➖ noise
6	duckdb:vortex-compact	-0.5%	-0.5%	-0.0%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-0.9%	-0.5%	-0.4%	+10.0%	➖ noise
7	datafusion:vortex-compact	+0.7%	+0.7%	+0.0%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	+3.3%	+0.7%	+2.6%	+15.8%	➖ noise
7	duckdb:vortex-compact	-0.6%	+0.7%	-1.3%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	+0.0%	+0.7%	-0.7%	+12.8%	➖ noise
8	datafusion:vortex-compact	+3.1%	+9.4%	-5.8%	+11.0%	➖ noise
8	datafusion:vortex-file-compressed	-3.0%	+9.4%	-11.3%	+17.7%	➖ noise
8	duckdb:vortex-compact	-1.3%	+9.4%	-9.8%	+21.7%	➖ noise
8	duckdb:vortex-file-compressed	+2.4%	+9.4%	-6.4%	+14.0%	➖ noise

github-actions · 2026-05-06T22:40:09Z

File Sizes: FineWeb NVMe

No file size changes detected.

github-actions · 2026-05-06T22:40:29Z

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.4%
Vortex (geomean): 0.864x ✅
Parquet (geomean): 0.893x ✅
Shifts: Parquet (control) -10.7% · Median polish -12.8%

datafusion / vortex-file-compressed (0.863x ✅, 20↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	51085579	55420292	0.92
tpch_q02/datafusion:vortex-file-compressed 🚀	21110568	24613980	0.86
tpch_q03/datafusion:vortex-file-compressed 🚀	28550972	32466751	0.88
tpch_q04/datafusion:vortex-file-compressed 🚀	20415746	23388320	0.87
tpch_q05/datafusion:vortex-file-compressed 🚀	47270469	58272735	0.81
tpch_q06/datafusion:vortex-file-compressed 🚀	12528283	14191106	0.88
tpch_q07/datafusion:vortex-file-compressed 🚀	53589434	66237477	0.81
tpch_q08/datafusion:vortex-file-compressed 🚀	39966553	46290556	0.86
tpch_q09/datafusion:vortex-file-compressed 🚀	50948829	59480088	0.86
tpch_q10/datafusion:vortex-file-compressed 🚀	39860587	46613632	0.86
tpch_q11/datafusion:vortex-file-compressed 🚀	15953535	18657371	0.86
tpch_q12/datafusion:vortex-file-compressed 🚀	25750014	28842239	0.89
tpch_q13/datafusion:vortex-file-compressed 🚀	24987228	28990339	0.86
tpch_q14/datafusion:vortex-file-compressed 🚀	17187963	20471306	0.84
tpch_q15/datafusion:vortex-file-compressed 🚀	26260029	29842948	0.88
tpch_q16/datafusion:vortex-file-compressed 🚀	19231463	22229467	0.87
tpch_q17/datafusion:vortex-file-compressed 🚀	65073427	79998302	0.81
tpch_q18/datafusion:vortex-file-compressed 🚀	79932307	93173766	0.86
tpch_q19/datafusion:vortex-file-compressed	23330676	25649224	0.91
tpch_q20/datafusion:vortex-file-compressed 🚀	29058973	34069126	0.85
tpch_q21/datafusion:vortex-file-compressed 🚀	71393377	82634492	0.86
tpch_q22/datafusion:vortex-file-compressed 🚀	12176873	13731544	0.89

datafusion / vortex-compact (0.886x ✅, 17↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	59953589	62764996	0.96
tpch_q02/datafusion:vortex-compact 🚀	24561624	27462127	0.89
tpch_q03/datafusion:vortex-compact 🚀	29676224	33304161	0.89
tpch_q04/datafusion:vortex-compact 🚀	23589118	26227697	0.90
tpch_q05/datafusion:vortex-compact 🚀	50368638	58976681	0.85
tpch_q06/datafusion:vortex-compact 🚀	14081711	15851445	0.89
tpch_q07/datafusion:vortex-compact 🚀	59235587	67592871	0.88
tpch_q08/datafusion:vortex-compact 🚀	43576370	49413589	0.88
tpch_q09/datafusion:vortex-compact 🚀	55356831	63290793	0.87
tpch_q10/datafusion:vortex-compact 🚀	46336176	52871613	0.88
tpch_q11/datafusion:vortex-compact 🚀	16577763	18929647	0.88
tpch_q12/datafusion:vortex-compact 🚀	32049538	36344195	0.88
tpch_q13/datafusion:vortex-compact 🚀	30906447	34790025	0.89
tpch_q14/datafusion:vortex-compact	20169301	22169380	0.91
tpch_q15/datafusion:vortex-compact	32535994	35853327	0.91
tpch_q16/datafusion:vortex-compact 🚀	22892826	26024243	0.88
tpch_q17/datafusion:vortex-compact 🚀	67777623	76400835	0.89
tpch_q18/datafusion:vortex-compact	85218493	93957982	0.91
tpch_q19/datafusion:vortex-compact	30405657	32785688	0.93
tpch_q20/datafusion:vortex-compact 🚀	34418135	39780385	0.87
tpch_q21/datafusion:vortex-compact 🚀	77287532	91177918	0.85
tpch_q22/datafusion:vortex-compact 🚀	12309303	14847846	0.83

datafusion / parquet (0.876x ✅, 14↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	135200835	140905780	0.96
tpch_q02/datafusion:parquet 🚀	59583265	69313314	0.86
tpch_q03/datafusion:parquet 🚀	67140966	79638122	0.84
tpch_q04/datafusion:parquet	42716212	47458651	0.90
tpch_q05/datafusion:parquet 🚀	91176315	103652591	0.88
tpch_q06/datafusion:parquet	40668299	44747529	0.91
tpch_q07/datafusion:parquet 🚀	102036265	119441030	0.85
tpch_q08/datafusion:parquet	95854630	100361025	0.96
tpch_q09/datafusion:parquet 🚀	127355339	145278383	0.88
tpch_q10/datafusion:parquet	110737316	122051372	0.91
tpch_q11/datafusion:parquet 🚀	40384058	46344706	0.87
tpch_q12/datafusion:parquet 🚀	79728106	90121375	0.88
tpch_q13/datafusion:parquet 🚀	195339947	218646983	0.89
tpch_q14/datafusion:parquet 🚀	45124229	51985148	0.87
tpch_q15/datafusion:parquet 🚀	58740316	66482930	0.88
tpch_q16/datafusion:parquet 🚀	39307693	49352812	0.80
tpch_q17/datafusion:parquet 🚀	123821830	177079279	0.70
tpch_q18/datafusion:parquet 🚀	160918306	183226016	0.88
tpch_q19/datafusion:parquet 🚀	68264714	80520776	0.85
tpch_q20/datafusion:parquet	68632598	75253898	0.91
tpch_q21/datafusion:parquet	132782198	145636541	0.91
tpch_q22/datafusion:parquet	31054978	33914136	0.92

datafusion / arrow (0.850x ✅, 15↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow 🚀	49816350	57892702	0.86
tpch_q02/datafusion:arrow	18527765	19695731	0.94
tpch_q03/datafusion:arrow 🚀	28845052	34615692	0.83
tpch_q04/datafusion:arrow 🚀	25016511	30005693	0.83
tpch_q05/datafusion:arrow	77642912	81881218	0.95
tpch_q06/datafusion:arrow	20428902	22667580	0.90
tpch_q07/datafusion:arrow	102226304	113138284	0.90
tpch_q08/datafusion:arrow 🚀	41694076	53141857	0.78
tpch_q09/datafusion:arrow 🚀	63309016	82819873	0.76
tpch_q10/datafusion:arrow 🚀	44560039	54827213	0.81
tpch_q11/datafusion:arrow	9019257	9831642	0.92
tpch_q12/datafusion:arrow 🚀	50537815	60275068	0.84
tpch_q13/datafusion:arrow	46291716	49415343	0.94
tpch_q14/datafusion:arrow 🚀	21255355	25507617	0.83
tpch_q15/datafusion:arrow 🚀	40158035	51925226	0.77
tpch_q16/datafusion:arrow 🚀	18770061	20978975	0.89
tpch_q17/datafusion:arrow 🚀	66387046	84816613	0.78
tpch_q18/datafusion:arrow 🚀	134099872	156494204	0.86
tpch_q19/datafusion:arrow 🚀	34027977	45448944	0.75
tpch_q20/datafusion:arrow 🚀	33407057	41402776	0.81
tpch_q21/datafusion:arrow 🚀	147095747	174695313	0.84
tpch_q22/datafusion:arrow	17666259	18981293	0.93

duckdb / vortex-file-compressed (0.837x ✅, 21↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	31207833	34170214	0.91
tpch_q02/duckdb:vortex-file-compressed 🚀	24081365	28319493	0.85
tpch_q03/duckdb:vortex-file-compressed 🚀	28564937	34358590	0.83
tpch_q04/duckdb:vortex-file-compressed 🚀	29041223	33937877	0.86
tpch_q05/duckdb:vortex-file-compressed 🚀	32877016	37244595	0.88
tpch_q06/duckdb:vortex-file-compressed 🚀	9996024	11699187	0.85
tpch_q07/duckdb:vortex-file-compressed 🚀	35222920	42028063	0.84
tpch_q08/duckdb:vortex-file-compressed 🚀	37030349	43654533	0.85
tpch_q09/duckdb:vortex-file-compressed 🚀	72126275	87789055	0.82
tpch_q10/duckdb:vortex-file-compressed 🚀	34412250	38506886	0.89
tpch_q11/duckdb:vortex-file-compressed 🚀	14102517	16883016	0.84
tpch_q12/duckdb:vortex-file-compressed 🚀	20991816	24556100	0.85
tpch_q13/duckdb:vortex-file-compressed 🚀	34330233	41026051	0.84
tpch_q14/duckdb:vortex-file-compressed 🚀	21298473	25423047	0.84
tpch_q15/duckdb:vortex-file-compressed 🚀	15811752	19793085	0.80
tpch_q16/duckdb:vortex-file-compressed 🚀	28724226	33301671	0.86
tpch_q17/duckdb:vortex-file-compressed 🚀	23806132	29187934	0.82
tpch_q18/duckdb:vortex-file-compressed 🚀	47872512	55681579	0.86
tpch_q19/duckdb:vortex-file-compressed 🚀	27850832	36507867	0.76
tpch_q20/duckdb:vortex-file-compressed 🚀	32498887	40100471	0.81
tpch_q21/duckdb:vortex-file-compressed 🚀	102518517	131732766	0.78
tpch_q22/duckdb:vortex-file-compressed 🚀	16480338	21096378	0.78

duckdb / vortex-compact (0.871x ✅, 18↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	37370902	41185497	0.91
tpch_q02/duckdb:vortex-compact 🚀	35677930	42073672	0.85
tpch_q03/duckdb:vortex-compact 🚀	31934289	36898596	0.87
tpch_q04/duckdb:vortex-compact 🚀	33898781	38716894	0.88
tpch_q05/duckdb:vortex-compact 🚀	36837978	41375381	0.89
tpch_q06/duckdb:vortex-compact 🚀	14186107	16136343	0.88
tpch_q07/duckdb:vortex-compact	42352375	47050018	0.90
tpch_q08/duckdb:vortex-compact	44154378	48956810	0.90
tpch_q09/duckdb:vortex-compact 🚀	82428234	99833988	0.83
tpch_q10/duckdb:vortex-compact 🚀	38150214	45008660	0.85
tpch_q11/duckdb:vortex-compact 🚀	18917825	21144710	0.89
tpch_q12/duckdb:vortex-compact 🚀	34393399	38474609	0.89
tpch_q13/duckdb:vortex-compact 🚀	43589076	50999161	0.85
tpch_q14/duckdb:vortex-compact	28892890	31994217	0.90
tpch_q15/duckdb:vortex-compact 🚀	19078731	21534063	0.89
tpch_q16/duckdb:vortex-compact 🚀	33721133	37829575	0.89
tpch_q17/duckdb:vortex-compact 🚀	29142991	33782330	0.86
tpch_q18/duckdb:vortex-compact 🚀	49080856	55530134	0.88
tpch_q19/duckdb:vortex-compact 🚀	33658583	40335568	0.83
tpch_q20/duckdb:vortex-compact 🚀	42146147	46867007	0.90
tpch_q21/duckdb:vortex-compact 🚀	107241743	134332815	0.80
tpch_q22/duckdb:vortex-compact 🚀	19068167	23134237	0.82

duckdb / parquet (0.911x ➖, 9↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet 🚀	79225968	90438159	0.88
tpch_q02/duckdb:parquet	38017951	41890263	0.91
tpch_q03/duckdb:parquet	73669960	74165270	0.99
tpch_q04/duckdb:parquet 🚀	45672760	51453552	0.89
tpch_q05/duckdb:parquet	64530111	70706687	0.91
tpch_q06/duckdb:parquet	19841539	21996005	0.90
tpch_q07/duckdb:parquet 🚀	66986899	82490139	0.81
tpch_q08/duckdb:parquet 🚀	80646635	100907209	0.80
tpch_q09/duckdb:parquet	153255818	160365813	0.96
tpch_q10/duckdb:parquet	125965265	133526680	0.94
tpch_q11/duckdb:parquet 🚀	20118586	23617910	0.85
tpch_q12/duckdb:parquet	44858174	47811718	0.94
tpch_q13/duckdb:parquet 🚀	248298327	294877694	0.84
tpch_q14/duckdb:parquet	48510604	52911751	0.92
tpch_q15/duckdb:parquet	28097140	25829388	1.09
tpch_q16/duckdb:parquet 🚀	54513104	61680015	0.88
tpch_q17/duckdb:parquet	53830423	53374086	1.01
tpch_q18/duckdb:parquet	116134305	118690334	0.98
tpch_q19/duckdb:parquet 🚀	67593927	76439365	0.88
tpch_q20/duckdb:parquet	63371591	65987987	0.96
tpch_q21/duckdb:parquet 🚀	166289444	200522257	0.83
tpch_q22/duckdb:parquet	51105759	55836761	0.92

duckdb / duckdb (0.871x ✅, 16↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb 🚀	15732889	17562255	0.90
tpch_q02/duckdb:duckdb 🚀	12356559	14738189	0.84
tpch_q03/duckdb:duckdb 🚀	18740232	22076571	0.85
tpch_q04/duckdb:duckdb	19047933	20730285	0.92
tpch_q05/duckdb:duckdb 🚀	19837241	22315476	0.89
tpch_q06/duckdb:duckdb	5263207	5744100	0.92
tpch_q07/duckdb:duckdb 🚀	21818936	26424499	0.83
tpch_q08/duckdb:duckdb 🚀	20504937	23209296	0.88
tpch_q09/duckdb:duckdb 🚀	54741568	67206828	0.81
tpch_q10/duckdb:duckdb 🚀	43093850	48724874	0.88
tpch_q11/duckdb:duckdb 🚀	5723533	7114298	0.80
tpch_q12/duckdb:duckdb 🚀	13644191	16462642	0.83
tpch_q13/duckdb:duckdb	38970044	42703852	0.91
tpch_q14/duckdb:duckdb 🚀	17205333	19264182	0.89
tpch_q15/duckdb:duckdb	11997742	12749155	0.94
tpch_q16/duckdb:duckdb 🚀	23755584	26914600	0.88
tpch_q17/duckdb:duckdb 🚀	13276712	15959552	0.83
tpch_q18/duckdb:duckdb	38332309	41757473	0.92
tpch_q19/duckdb:duckdb 🚀	27241419	31498641	0.86
tpch_q20/duckdb:duckdb	22883616	25424894	0.90
tpch_q21/duckdb:duckdb 🚀	54252410	67904002	0.80
tpch_q22/duckdb:duckdb 🚀	24228454	27109775	0.89

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-14.0%	-8.3%	-6.1%	+21.2%	➖ noise
1	datafusion:vortex-compact	-4.5%	-8.3%	+4.2%	+18.1%	➖ noise
1	datafusion:vortex-file-compressed	-7.8%	-8.3%	+0.5%	+18.5%	➖ noise
1	duckdb:duckdb	-10.4%	-8.3%	-2.3%	+18.1%	➖ noise
1	duckdb:vortex-compact	-9.3%	-8.3%	-1.0%	+17.7%	➖ noise
1	duckdb:vortex-file-compressed	-8.7%	-8.3%	-0.4%	+20.6%	➖ noise
2	datafusion:arrow	-5.9%	-11.7%	+6.5%	+10.9%	➖ noise
2	datafusion:vortex-compact	-10.6%	-11.7%	+1.3%	+10.9%	➖ noise
2	datafusion:vortex-file-compressed	-14.2%	-11.7%	-2.9%	+10.9%	➖ noise
2	duckdb:duckdb	-16.2%	-11.7%	-5.1%	+10.9%	➖ noise
2	duckdb:vortex-compact	-15.2%	-11.7%	-4.0%	+10.9%	➖ noise
2	duckdb:vortex-file-compressed	-15.0%	-11.7%	-3.7%	+10.9%	➖ noise
3	datafusion:arrow	-16.7%	-8.5%	-8.9%	+10.9%	➖ noise
3	datafusion:vortex-compact	-10.9%	-8.5%	-2.6%	+10.9%	➖ noise
3	datafusion:vortex-file-compressed	-12.1%	-8.5%	-3.9%	+10.9%	➖ noise
3	duckdb:duckdb	-15.1%	-8.5%	-7.2%	+12.8%	➖ noise
3	duckdb:vortex-compact	-13.5%	-8.5%	-5.4%	+10.9%	➖ noise
3	duckdb:vortex-file-compressed	-16.9%	-8.5%	-9.2%	+17.6%	➖ noise
4	datafusion:arrow	-16.6%	-10.6%	-6.7%	+10.9%	➖ noise
4	datafusion:vortex-compact	-10.1%	-10.6%	+0.6%	+10.9%	➖ noise
4	datafusion:vortex-file-compressed	-12.7%	-10.6%	-2.3%	+11.8%	➖ noise
4	duckdb:duckdb	-8.1%	-10.6%	+2.8%	+10.9%	➖ noise
4	duckdb:vortex-compact	-12.4%	-10.6%	-2.0%	+10.9%	➖ noise
4	duckdb:vortex-file-compressed	-14.4%	-10.6%	-4.3%	+10.9%	➖ noise
5	datafusion:arrow	-5.2%	-10.4%	+5.8%	+10.9%	➖ noise
5	datafusion:vortex-compact	-14.6%	-10.4%	-4.7%	+10.9%	➖ noise
5	datafusion:vortex-file-compressed	-18.9%	-10.4%	-9.5%	+10.9%	➖ noise
5	duckdb:duckdb	-11.1%	-10.4%	-0.8%	+10.9%	➖ noise
5	duckdb:vortex-compact	-11.0%	-10.4%	-0.6%	+10.9%	➖ noise
5	duckdb:vortex-file-compressed	-11.7%	-10.4%	-1.5%	+13.3%	➖ noise
6	datafusion:arrow	-9.9%	-9.5%	-0.5%	+13.3%	➖ noise
6	datafusion:vortex-compact	-11.2%	-9.5%	-1.9%	+12.7%	➖ noise
6	datafusion:vortex-file-compressed	-11.7%	-9.5%	-2.5%	+12.7%	➖ noise
6	duckdb:duckdb	-8.4%	-9.5%	+1.2%	+15.5%	➖ noise
6	duckdb:vortex-compact	-12.1%	-9.5%	-2.9%	+19.1%	➖ noise
6	duckdb:vortex-file-compressed	-14.6%	-9.5%	-5.6%	+14.6%	➖ noise
7	datafusion:arrow	-9.6%	-16.7%	+8.5%	+10.9%	➖ noise
7	datafusion:vortex-compact	-12.4%	-16.7%	+5.2%	+10.9%	➖ noise
7	datafusion:vortex-file-compressed	-19.1%	-16.7%	-2.9%	+10.9%	➖ noise
7	duckdb:duckdb	-17.4%	-16.7%	-0.9%	+10.9%	➖ noise
7	duckdb:vortex-compact	-10.0%	-16.7%	+8.1%	+10.9%	➖ noise
7	duckdb:vortex-file-compressed	-16.2%	-16.7%	+0.6%	+10.9%	➖ noise
8	datafusion:arrow	-21.5%	-12.6%	-10.2%	+10.9%	✅ faster
8	datafusion:vortex-compact	-11.8%	-12.6%	+0.9%	+10.9%	➖ noise
8	datafusion:vortex-file-compressed	-13.7%	-12.6%	-1.2%	+10.9%	➖ noise
8	duckdb:duckdb	-11.7%	-12.6%	+1.1%	+10.9%	➖ noise
8	duckdb:vortex-compact	-9.8%	-12.6%	+3.2%	+10.9%	➖ noise
8	duckdb:vortex-file-compressed	-15.2%	-12.6%	-2.9%	+10.9%	➖ noise
9	datafusion:arrow	-23.6%	-8.5%	-16.5%	+10.9%	✅ faster
9	datafusion:vortex-compact	-12.5%	-8.5%	-4.4%	+10.9%	➖ noise
9	datafusion:vortex-file-compressed	-14.3%	-8.5%	-6.4%	+10.9%	➖ noise
9	duckdb:duckdb	-18.5%	-8.5%	-11.0%	+10.9%	✅ faster
9	duckdb:vortex-compact	-17.4%	-8.5%	-9.8%	+10.9%	✅ faster
9	duckdb:vortex-file-compressed	-17.8%	-8.5%	-10.2%	+10.9%	✅ faster
10	datafusion:arrow	-18.7%	-7.5%	-12.2%	+10.9%	✅ faster
10	datafusion:vortex-compact	-12.4%	-7.5%	-5.3%	+10.9%	➖ noise
10	datafusion:vortex-file-compressed	-14.5%	-7.5%	-7.6%	+10.9%	➖ noise
10	duckdb:duckdb	-11.6%	-7.5%	-4.4%	+12.0%	➖ noise
10	duckdb:vortex-compact	-15.2%	-7.5%	-8.4%	+10.9%	➖ noise
10	duckdb:vortex-file-compressed	-10.6%	-7.5%	-3.4%	+10.9%	➖ noise
11	datafusion:arrow	-8.3%	-13.8%	+6.5%	+10.9%	➖ noise
11	datafusion:vortex-compact	-12.4%	-13.8%	+1.6%	+10.9%	➖ noise
11	datafusion:vortex-file-compressed	-14.5%	-13.8%	-0.8%	+10.9%	➖ noise
11	duckdb:duckdb	-19.5%	-13.8%	-6.6%	+11.9%	➖ noise
11	duckdb:vortex-compact	-10.5%	-13.8%	+3.8%	+14.0%	➖ noise
11	duckdb:vortex-file-compressed	-16.5%	-13.8%	-3.0%	+10.9%	➖ noise
12	datafusion:arrow	-16.2%	-8.9%	-8.0%	+19.9%	➖ noise
12	datafusion:vortex-compact	-11.8%	-8.9%	-3.2%	+10.9%	➖ noise
12	datafusion:vortex-file-compressed	-10.7%	-8.9%	-2.0%	+11.0%	➖ noise
12	duckdb:duckdb	-17.1%	-8.9%	-9.0%	+13.1%	➖ noise
12	duckdb:vortex-compact	-10.6%	-8.9%	-1.9%	+10.9%	➖ noise
12	duckdb:vortex-file-compressed	-14.5%	-8.9%	-6.2%	+11.7%	➖ noise
13	datafusion:arrow	-6.3%	-13.3%	+8.0%	+13.2%	➖ noise
13	datafusion:vortex-compact	-11.2%	-13.3%	+2.4%	+10.9%	➖ noise
13	datafusion:vortex-file-compressed	-13.8%	-13.3%	-0.6%	+10.9%	➖ noise
13	duckdb:duckdb	-8.7%	-13.3%	+5.2%	+11.4%	➖ noise
13	duckdb:vortex-compact	-14.5%	-13.3%	-1.5%	+10.9%	➖ noise
13	duckdb:vortex-file-compressed	-16.3%	-13.3%	-3.5%	+10.9%	➖ noise
14	datafusion:arrow	-16.7%	-10.8%	-6.6%	+16.5%	➖ noise
14	datafusion:vortex-compact	-9.0%	-10.8%	+2.0%	+10.9%	➖ noise
14	datafusion:vortex-file-compressed	-16.0%	-10.8%	-5.9%	+10.9%	➖ noise
14	duckdb:duckdb	-10.7%	-10.8%	+0.1%	+16.1%	➖ noise
14	duckdb:vortex-compact	-9.7%	-10.8%	+1.2%	+10.9%	➖ noise
14	duckdb:vortex-file-compressed	-16.2%	-10.8%	-6.1%	+16.3%	➖ noise
15	datafusion:arrow	-22.7%	-2.0%	-21.1%	+11.2%	✅ faster
15	datafusion:vortex-compact	-9.3%	-2.0%	-7.4%	+10.9%	➖ noise
15	datafusion:vortex-file-compressed	-12.0%	-2.0%	-10.2%	+11.9%	➖ noise
15	duckdb:duckdb	-5.9%	-2.0%	-4.0%	+14.2%	➖ noise
15	duckdb:vortex-compact	-11.4%	-2.0%	-9.6%	+15.4%	➖ noise
15	duckdb:vortex-file-compressed	-20.1%	-2.0%	-18.5%	+12.1%	✅ faster
16	datafusion:arrow	-10.5%	-16.1%	+6.6%	+10.9%	➖ noise
16	datafusion:vortex-compact	-12.0%	-16.1%	+4.8%	+10.9%	➖ noise
16	datafusion:vortex-file-compressed	-13.5%	-16.1%	+3.1%	+10.9%	➖ noise
16	duckdb:duckdb	-11.7%	-16.1%	+5.2%	+10.9%	➖ noise
16	duckdb:vortex-compact	-10.9%	-16.1%	+6.2%	+10.9%	➖ noise
16	duckdb:vortex-file-compressed	-13.7%	-16.1%	+2.8%	+10.9%	➖ noise
17	datafusion:arrow	-21.7%	-16.0%	-6.8%	+13.9%	➖ noise
17	datafusion:vortex-compact	-11.3%	-16.0%	+5.6%	+10.9%	➖ noise
17	datafusion:vortex-file-compressed	-18.7%	-16.0%	-3.1%	+12.1%	➖ noise
17	duckdb:duckdb	-16.8%	-16.0%	-0.9%	+13.0%	➖ noise
17	duckdb:vortex-compact	-13.7%	-16.0%	+2.7%	+13.5%	➖ noise
17	duckdb:vortex-file-compressed	-18.4%	-16.0%	-2.9%	+13.2%	➖ noise
18	datafusion:arrow	-14.3%	-7.3%	-7.6%	+10.9%	➖ noise
18	datafusion:vortex-compact	-9.3%	-7.3%	-2.2%	+10.9%	➖ noise
18	datafusion:vortex-file-compressed	-14.2%	-7.3%	-7.5%	+10.9%	➖ noise
18	duckdb:duckdb	-8.2%	-7.3%	-1.0%	+10.9%	➖ noise
18	duckdb:vortex-compact	-11.6%	-7.3%	-4.7%	+10.9%	➖ noise
18	duckdb:vortex-file-compressed	-14.0%	-7.3%	-7.3%	+10.9%	➖ noise
19	datafusion:arrow	-25.1%	-13.4%	-13.5%	+16.2%	➖ noise
19	datafusion:vortex-compact	-7.3%	-13.4%	+7.1%	+13.3%	➖ noise
19	datafusion:vortex-file-compressed	-9.0%	-13.4%	+5.1%	+11.2%	➖ noise
19	duckdb:duckdb	-13.5%	-13.4%	-0.1%	+13.3%	➖ noise
19	duckdb:vortex-compact	-16.6%	-13.4%	-3.6%	+12.4%	➖ noise
19	duckdb:vortex-file-compressed	-23.7%	-13.4%	-11.9%	+11.1%	✅ faster
20	datafusion:arrow	-19.3%	-6.4%	-13.8%	+10.9%	✅ faster
20	datafusion:vortex-compact	-13.5%	-6.4%	-7.6%	+10.9%	➖ noise
20	datafusion:vortex-file-compressed	-14.7%	-6.4%	-8.9%	+10.9%	➖ noise
20	duckdb:duckdb	-10.0%	-6.4%	-3.8%	+10.9%	➖ noise
20	duckdb:vortex-compact	-10.1%	-6.4%	-3.9%	+10.9%	➖ noise
20	duckdb:vortex-file-compressed	-19.0%	-6.4%	-13.4%	+11.7%	✅ faster
21	datafusion:arrow	-15.8%	-13.0%	-3.2%	+10.9%	➖ noise
21	datafusion:vortex-compact	-15.2%	-13.0%	-2.5%	+10.9%	➖ noise
21	datafusion:vortex-file-compressed	-13.6%	-13.0%	-0.6%	+10.9%	➖ noise
21	duckdb:duckdb	-20.1%	-13.0%	-8.1%	+10.9%	➖ noise
21	duckdb:vortex-compact	-20.2%	-13.0%	-8.2%	+10.9%	➖ noise
21	duckdb:vortex-file-compressed	-22.2%	-13.0%	-10.5%	+10.9%	✅ faster
22	datafusion:arrow	-6.9%	-8.5%	+1.7%	+10.9%	➖ noise
22	datafusion:vortex-compact	-17.1%	-8.5%	-9.4%	+10.9%	➖ noise
22	datafusion:vortex-file-compressed	-11.3%	-8.5%	-3.1%	+10.9%	➖ noise
22	duckdb:duckdb	-10.6%	-8.5%	-2.4%	+10.9%	➖ noise
22	duckdb:vortex-compact	-17.6%	-8.5%	-10.0%	+10.9%	✅ faster
22	duckdb:vortex-file-compressed	-21.9%	-8.5%	-14.7%	+10.9%	✅ faster

github-actions · 2026-05-06T22:40:32Z

File Sizes: TPC-H SF=1 on NVME

File Size Changes (195 files changed, -98.4% overall, 0↑ 195↓)

File	Scale	Format	Base	Change	%
partsupp_15.vortex	100	vortex-file-compressed	191.52 MB	191.52 MB	-100.0%
partsupp_7.vortex	100	vortex-file-compressed	191.61 MB	191.61 MB	-100.0%
lineitem_78.vortex	100	vortex-file-compressed	147.35 MB	147.35 MB	-100.0%
lineitem_117.vortex	100	vortex-file-compressed	148.24 MB	148.24 MB	-100.0%
part_15.vortex	100	vortex-file-compressed	28.48 MB	28.48 MB	-100.0%
partsupp_4.vortex	100	vortex-file-compressed	191.40 MB	191.40 MB	-100.0%
lineitem_103.vortex	100	vortex-file-compressed	148.37 MB	148.37 MB	-100.0%
lineitem_80.vortex	100	vortex-file-compressed	147.55 MB	147.55 MB	-100.0%
lineitem_73.vortex	100	vortex-file-compressed	148.32 MB	148.32 MB	-100.0%
lineitem_84.vortex	100	vortex-file-compressed	147.94 MB	147.94 MB	-100.0%
region_0.vortex	100	vortex-file-compressed	6.13 KB	6.13 KB	-100.0%
lineitem_30.vortex	100	vortex-file-compressed	147.46 MB	147.46 MB	-100.0%
supplier_0.vortex	100	vortex-file-compressed	66.71 MB	66.71 MB	-100.0%
orders_21.vortex	100	vortex-file-compressed	179.89 MB	179.89 MB	-100.0%
lineitem_21.vortex	100	vortex-file-compressed	148.33 MB	148.33 MB	-100.0%
lineitem_93.vortex	100	vortex-file-compressed	147.77 MB	147.77 MB	-100.0%
lineitem_81.vortex	100	vortex-file-compressed	147.75 MB	147.75 MB	-100.0%
lineitem_32.vortex	100	vortex-file-compressed	148.90 MB	148.90 MB	-100.0%
partsupp_12.vortex	100	vortex-file-compressed	191.50 MB	191.50 MB	-100.0%
lineitem_26.vortex	100	vortex-file-compressed	148.11 MB	148.11 MB	-100.0%
orders_26.vortex	100	vortex-file-compressed	179.99 MB	179.99 MB	-100.0%
lineitem_40.vortex	100	vortex-file-compressed	147.97 MB	147.97 MB	-100.0%
lineitem_119.vortex	100	vortex-file-compressed	148.33 MB	148.33 MB	-100.0%
partsupp_5.vortex	100	vortex-file-compressed	191.41 MB	191.41 MB	-100.0%
lineitem_90.vortex	100	vortex-file-compressed	147.82 MB	147.82 MB	-100.0%
orders_8.vortex	100	vortex-file-compressed	180.21 MB	180.21 MB	-100.0%
lineitem_18.vortex	100	vortex-file-compressed	147.55 MB	147.55 MB	-100.0%
lineitem_8.vortex	100	vortex-file-compressed	148.56 MB	148.56 MB	-100.0%
lineitem_36.vortex	100	vortex-file-compressed	147.64 MB	147.64 MB	-100.0%
lineitem_83.vortex	100	vortex-file-compressed	148.68 MB	148.68 MB	-100.0%
lineitem_65.vortex	100	vortex-file-compressed	147.57 MB	147.57 MB	-100.0%
orders_18.vortex	100	vortex-file-compressed	180.45 MB	180.45 MB	-100.0%
partsupp_3.vortex	100	vortex-file-compressed	191.37 MB	191.37 MB	-100.0%
lineitem_13.vortex	100	vortex-file-compressed	148.26 MB	148.26 MB	-100.0%
orders_22.vortex	100	vortex-file-compressed	180.04 MB	180.04 MB	-100.0%
orders_23.vortex	100	vortex-file-compressed	179.94 MB	179.94 MB	-100.0%
lineitem_116.vortex	100	vortex-file-compressed	148.20 MB	148.20 MB	-100.0%
lineitem_114.vortex	100	vortex-file-compressed	147.46 MB	147.46 MB	-100.0%
lineitem_43.vortex	100	vortex-file-compressed	147.84 MB	147.84 MB	-100.0%
lineitem_48.vortex	100	vortex-file-compressed	148.23 MB	148.23 MB	-100.0%
part_7.vortex	100	vortex-file-compressed	28.41 MB	28.41 MB	-100.0%
lineitem_2.vortex	100	vortex-file-compressed	148.59 MB	148.59 MB	-100.0%
lineitem_49.vortex	100	vortex-file-compressed	148.47 MB	148.47 MB	-100.0%
lineitem_54.vortex	100	vortex-file-compressed	149.12 MB	149.12 MB	-100.0%
lineitem_66.vortex	100	vortex-file-compressed	148.09 MB	148.09 MB	-100.0%
lineitem_11.vortex	100	vortex-file-compressed	148.62 MB	148.62 MB	-100.0%
orders_7.vortex	100	vortex-file-compressed	180.12 MB	180.12 MB	-100.0%
part_1.vortex	100	vortex-file-compressed	28.49 MB	28.49 MB	-100.0%
customer_3.vortex	100	vortex-file-compressed	261.80 MB	261.80 MB	-100.0%
lineitem_111.vortex	100	vortex-file-compressed	147.77 MB	147.77 MB	-100.0%
lineitem_59.vortex	100	vortex-file-compressed	148.42 MB	148.42 MB	-100.0%
lineitem_76.vortex	100	vortex-file-compressed	147.35 MB	147.35 MB	-100.0%
part_12.vortex	100	vortex-file-compressed	28.43 MB	28.43 MB	-100.0%
partsupp_13.vortex	100	vortex-file-compressed	191.35 MB	191.35 MB	-100.0%
orders_2.vortex	100	vortex-file-compressed	180.35 MB	180.35 MB	-100.0%
lineitem_86.vortex	100	vortex-file-compressed	147.62 MB	147.62 MB	-100.0%
orders_3.vortex	100	vortex-file-compressed	180.12 MB	180.12 MB	-100.0%
lineitem_118.vortex	100	vortex-file-compressed	147.83 MB	147.83 MB	-100.0%
lineitem_74.vortex	100	vortex-file-compressed	147.55 MB	147.55 MB	-100.0%
lineitem_7.vortex	100	vortex-file-compressed	147.86 MB	147.86 MB	-100.0%
part_3.vortex	100	vortex-file-compressed	28.43 MB	28.43 MB	-100.0%
lineitem_28.vortex	100	vortex-file-compressed	148.66 MB	148.66 MB	-100.0%
lineitem_10.vortex	100	vortex-file-compressed	148.35 MB	148.35 MB	-100.0%
lineitem_70.vortex	100	vortex-file-compressed	147.89 MB	147.89 MB	-100.0%
lineitem_99.vortex	100	vortex-file-compressed	147.26 MB	147.26 MB	-100.0%
lineitem_67.vortex	100	vortex-file-compressed	148.84 MB	148.84 MB	-100.0%
lineitem_77.vortex	100	vortex-file-compressed	148.24 MB	148.24 MB	-100.0%
lineitem_35.vortex	100	vortex-file-compressed	148.35 MB	148.35 MB	-100.0%
orders_13.vortex	100	vortex-file-compressed	179.83 MB	179.83 MB	-100.0%
lineitem_60.vortex	100	vortex-file-compressed	148.62 MB	148.62 MB	-100.0%
orders_27.vortex	100	vortex-file-compressed	179.78 MB	179.78 MB	-100.0%
partsupp_1.vortex	100	vortex-file-compressed	191.69 MB	191.69 MB	-100.0%
lineitem_96.vortex	100	vortex-file-compressed	148.03 MB	148.03 MB	-100.0%
orders_6.vortex	100	vortex-file-compressed	179.80 MB	179.80 MB	-100.0%
lineitem_61.vortex	100	vortex-file-compressed	147.73 MB	147.73 MB	-100.0%
lineitem_109.vortex	100	vortex-file-compressed	148.03 MB	148.03 MB	-100.0%
lineitem_107.vortex	100	vortex-file-compressed	148.04 MB	148.04 MB	-100.0%
lineitem_100.vortex	100	vortex-file-compressed	148.11 MB	148.11 MB	-100.0%
lineitem_91.vortex	100	vortex-file-compressed	148.27 MB	148.27 MB	-100.0%
lineitem_71.vortex	100	vortex-file-compressed	147.94 MB	147.94 MB	-100.0%
lineitem_44.vortex	100	vortex-file-compressed	147.91 MB	147.91 MB	-100.0%
partsupp_14.vortex	100	vortex-file-compressed	191.62 MB	191.62 MB	-100.0%
lineitem_34.vortex	100	vortex-file-compressed	148.93 MB	148.93 MB	-100.0%
part_13.vortex	100	vortex-file-compressed	28.44 MB	28.44 MB	-100.0%
partsupp_18.vortex	100	vortex-file-compressed	191.38 MB	191.38 MB	-100.0%
lineitem_0.vortex	100	vortex-file-compressed	148.68 MB	148.68 MB	-100.0%
lineitem_6.vortex	100	vortex-file-compressed	147.90 MB	147.90 MB	-100.0%
lineitem_12.vortex	100	vortex-file-compressed	148.19 MB	148.19 MB	-100.0%
lineitem_102.vortex	100	vortex-file-compressed	148.14 MB	148.14 MB	-100.0%
orders_24.vortex	100	vortex-file-compressed	179.56 MB	179.56 MB	-100.0%
orders_25.vortex	100	vortex-file-compressed	179.82 MB	179.82 MB	-100.0%
lineitem_38.vortex	100	vortex-file-compressed	149.09 MB	149.09 MB	-100.0%
customer_0.vortex	100	vortex-file-compressed	261.80 MB	261.80 MB	-100.0%
lineitem_62.vortex	100	vortex-file-compressed	146.94 MB	146.94 MB	-100.0%
lineitem_82.vortex	100	vortex-file-compressed	148.37 MB	148.37 MB	-100.0%
lineitem_89.vortex	100	vortex-file-compressed	148.03 MB	148.03 MB	-100.0%
lineitem_52.vortex	100	vortex-file-compressed	146.97 MB	146.97 MB	-100.0%
partsupp_2.vortex	100	vortex-file-compressed	191.39 MB	191.39 MB	-100.0%
lineitem_9.vortex	100	vortex-file-compressed	148.87 MB	148.87 MB	-100.0%
partsupp_10.vortex	100	vortex-file-compressed	191.59 MB	191.59 MB	-100.0%
lineitem_87.vortex	100	vortex-file-compressed	147.46 MB	147.46 MB	-100.0%
lineitem_24.vortex	100	vortex-file-compressed	147.50 MB	147.50 MB	-100.0%
lineitem_50.vortex	100	vortex-file-compressed	148.88 MB	148.88 MB	-100.0%
lineitem_120.vortex	100	vortex-file-compressed	147.10 MB	147.10 MB	-100.0%
customer_2.vortex	100	vortex-file-compressed	261.69 MB	261.69 MB	-100.0%
nation_0.vortex	100	vortex-file-compressed	10.97 KB	10.97 KB	-100.0%
lineitem_45.vortex	100	vortex-file-compressed	146.88 MB	146.88 MB	-100.0%
lineitem_5.vortex	100	vortex-file-compressed	148.16 MB	148.16 MB	-100.0%
orders_17.vortex	100	vortex-file-compressed	180.01 MB	180.01 MB	-100.0%
lineitem_106.vortex	100	vortex-file-compressed	148.07 MB	148.07 MB	-100.0%
lineitem_53.vortex	100	vortex-file-compressed	148.23 MB	148.23 MB	-100.0%
lineitem_33.vortex	100	vortex-file-compressed	147.74 MB	147.74 MB	-100.0%
part_10.vortex	100	vortex-file-compressed	28.43 MB	28.43 MB	-100.0%
lineitem_69.vortex	100	vortex-file-compressed	148.10 MB	148.10 MB	-100.0%
orders_1.vortex	100	vortex-file-compressed	179.92 MB	179.92 MB	-100.0%
orders_12.vortex	100	vortex-file-compressed	180.32 MB	180.32 MB	-100.0%
lineitem_57.vortex	100	vortex-file-compressed	148.37 MB	148.37 MB	-100.0%
lineitem_16.vortex	100	vortex-file-compressed	148.03 MB	148.03 MB	-100.0%
lineitem_94.vortex	100	vortex-file-compressed	148.40 MB	148.40 MB	-100.0%
lineitem_98.vortex	100	vortex-file-compressed	148.59 MB	148.59 MB	-100.0%
lineitem_25.vortex	100	vortex-file-compressed	148.52 MB	148.52 MB	-100.0%
lineitem_104.vortex	100	vortex-file-compressed	148.59 MB	148.59 MB	-100.0%
lineitem_64.vortex	100	vortex-file-compressed	147.72 MB	147.72 MB	-100.0%
lineitem_27.vortex	100	vortex-file-compressed	148.45 MB	148.45 MB	-100.0%
lineitem_63.vortex	100	vortex-file-compressed	148.65 MB	148.65 MB	-100.0%
orders_11.vortex	100	vortex-file-compressed	180.08 MB	180.08 MB	-100.0%
part_5.vortex	100	vortex-file-compressed	28.38 MB	28.38 MB	-100.0%
lineitem_23.vortex	100	vortex-file-compressed	148.19 MB	148.19 MB	-100.0%
part_6.vortex	100	vortex-file-compressed	28.44 MB	28.44 MB	-100.0%
lineitem_112.vortex	100	vortex-file-compressed	147.42 MB	147.42 MB	-100.0%
orders_14.vortex	100	vortex-file-compressed	180.18 MB	180.18 MB	-100.0%
part_11.vortex	100	vortex-file-compressed	28.45 MB	28.45 MB	-100.0%
lineitem_19.vortex	100	vortex-file-compressed	148.77 MB	148.77 MB	-100.0%
partsupp_17.vortex	100	vortex-file-compressed	191.49 MB	191.49 MB	-100.0%
lineitem_42.vortex	100	vortex-file-compressed	148.38 MB	148.38 MB	-100.0%
lineitem_3.vortex	100	vortex-file-compressed	148.16 MB	148.16 MB	-100.0%
duckdb.db	100	vortex-file-compressed	268.00 KB	268.00 KB	-100.0%
lineitem_75.vortex	100	vortex-file-compressed	147.88 MB	147.88 MB	-100.0%
orders_9.vortex	100	vortex-file-compressed	180.11 MB	180.11 MB	-100.0%
lineitem_72.vortex	100	vortex-file-compressed	147.99 MB	147.99 MB	-100.0%
lineitem_101.vortex	100	vortex-file-compressed	148.35 MB	148.35 MB	-100.0%
lineitem_79.vortex	100	vortex-file-compressed	148.43 MB	148.43 MB	-100.0%
lineitem_31.vortex	100	vortex-file-compressed	148.50 MB	148.50 MB	-100.0%
lineitem_15.vortex	100	vortex-file-compressed	147.63 MB	147.63 MB	-100.0%
partsupp_16.vortex	100	vortex-file-compressed	191.25 MB	191.25 MB	-100.0%
lineitem_39.vortex	100	vortex-file-compressed	147.38 MB	147.38 MB	-100.0%
lineitem_51.vortex	100	vortex-file-compressed	148.42 MB	148.42 MB	-100.0%
lineitem_115.vortex	100	vortex-file-compressed	147.64 MB	147.64 MB	-100.0%
lineitem_97.vortex	100	vortex-file-compressed	148.10 MB	148.10 MB	-100.0%
lineitem_68.vortex	100	vortex-file-compressed	148.03 MB	148.03 MB	-100.0%
lineitem_85.vortex	100	vortex-file-compressed	147.92 MB	147.92 MB	-100.0%
lineitem_17.vortex	100	vortex-file-compressed	148.59 MB	148.59 MB	-100.0%
orders_0.vortex	100	vortex-file-compressed	180.00 MB	180.00 MB	-100.0%
orders_10.vortex	100	vortex-file-compressed	180.14 MB	180.14 MB	-100.0%
lineitem_14.vortex	100	vortex-file-compressed	147.79 MB	147.79 MB	-100.0%
lineitem_88.vortex	100	vortex-file-compressed	148.71 MB	148.71 MB	-100.0%
orders_15.vortex	100	vortex-file-compressed	180.19 MB	180.19 MB	-100.0%
part_8.vortex	100	vortex-file-compressed	28.43 MB	28.43 MB	-100.0%
partsupp_6.vortex	100	vortex-file-compressed	191.38 MB	191.38 MB	-100.0%
orders_19.vortex	100	vortex-file-compressed	180.04 MB	180.04 MB	-100.0%
lineitem_113.vortex	100	vortex-file-compressed	147.56 MB	147.56 MB	-100.0%
part_4.vortex	100	vortex-file-compressed	28.42 MB	28.42 MB	-100.0%
partsupp_0.vortex	100	vortex-file-compressed	191.37 MB	191.37 MB	-100.0%
part_0.vortex	100	vortex-file-compressed	28.45 MB	28.45 MB	-100.0%
partsupp_11.vortex	100	vortex-file-compressed	191.43 MB	191.43 MB	-100.0%
lineitem_46.vortex	100	vortex-file-compressed	147.77 MB	147.77 MB	-100.0%
part_16.vortex	100	vortex-file-compressed	28.42 MB	28.42 MB	-100.0%
lineitem_55.vortex	100	vortex-file-compressed	148.16 MB	148.16 MB	-100.0%
orders_20.vortex	100	vortex-file-compressed	179.85 MB	179.85 MB	-100.0%
lineitem_110.vortex	100	vortex-file-compressed	148.41 MB	148.41 MB	-100.0%
partsupp_9.vortex	100	vortex-file-compressed	191.50 MB	191.50 MB	-100.0%
lineitem_41.vortex	100	vortex-file-compressed	146.66 MB	146.66 MB	-100.0%
lineitem_58.vortex	100	vortex-file-compressed	148.72 MB	148.72 MB	-100.0%
orders_4.vortex	100	vortex-file-compressed	180.39 MB	180.39 MB	-100.0%
part_14.vortex	100	vortex-file-compressed	28.46 MB	28.46 MB	-100.0%
lineitem_29.vortex	100	vortex-file-compressed	148.75 MB	148.75 MB	-100.0%
lineitem_108.vortex	100	vortex-file-compressed	147.29 MB	147.29 MB	-100.0%
partsupp_8.vortex	100	vortex-file-compressed	191.49 MB	191.49 MB	-100.0%
lineitem_56.vortex	100	vortex-file-compressed	147.73 MB	147.73 MB	-100.0%
part_2.vortex	100	vortex-file-compressed	28.46 MB	28.46 MB	-100.0%
orders_16.vortex	100	vortex-file-compressed	179.88 MB	179.88 MB	-100.0%
orders_5.vortex	100	vortex-file-compressed	180.03 MB	180.03 MB	-100.0%
customer_1.vortex	100	vortex-file-compressed	261.77 MB	261.77 MB	-100.0%
part_9.vortex	100	vortex-file-compressed	28.41 MB	28.41 MB	-100.0%
lineitem_1.vortex	100	vortex-file-compressed	148.56 MB	148.56 MB	-100.0%
lineitem_92.vortex	100	vortex-file-compressed	148.08 MB	148.08 MB	-100.0%
lineitem_47.vortex	100	vortex-file-compressed	148.26 MB	148.26 MB	-100.0%
lineitem_22.vortex	100	vortex-file-compressed	147.32 MB	147.32 MB	-100.0%
lineitem_95.vortex	100	vortex-file-compressed	147.49 MB	147.49 MB	-100.0%
part_18.vortex	100	vortex-file-compressed	28.51 MB	28.51 MB	-100.0%
lineitem_105.vortex	100	vortex-file-compressed	147.47 MB	147.47 MB	-100.0%
lineitem_4.vortex	100	vortex-file-compressed	147.27 MB	147.27 MB	-100.0%
lineitem_20.vortex	100	vortex-file-compressed	148.78 MB	148.78 MB	-100.0%
part_17.vortex	100	vortex-file-compressed	28.41 MB	28.41 MB	-100.0%
lineitem_37.vortex	100	vortex-file-compressed	147.47 MB	147.47 MB	-100.0%

Totals:

vortex-compact: 194.82 MB → 194.82 MB (0.0%)
vortex-file-compressed: 27.85 GB → 266.60 MB (-99.1%)

github-actions · 2026-05-06T22:42:55Z

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Vortex (geomean): 0.976x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish -2.0%

datafusion / vortex-file-compressed (0.962x ➖, 3↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed	24521637	26184859	0.94
tpcds_q02/datafusion:vortex-file-compressed	45928530	47363066	0.97
tpcds_q03/datafusion:vortex-file-compressed	15262309	15380570	0.99
tpcds_q04/datafusion:vortex-file-compressed	250236421	252270791	0.99
tpcds_q05/datafusion:vortex-file-compressed	41513663	44567191	0.93
tpcds_q06/datafusion:vortex-file-compressed	58313441	61314628	0.95
tpcds_q07/datafusion:vortex-file-compressed	41169145	43484392	0.95
tpcds_q08/datafusion:vortex-file-compressed	28427747	29570475	0.96
tpcds_q09/datafusion:vortex-file-compressed	45342515	44255662	1.02
tpcds_q10/datafusion:vortex-file-compressed	39678250	39800500	1.00
tpcds_q11/datafusion:vortex-file-compressed	128455056	134352333	0.96
tpcds_q12/datafusion:vortex-file-compressed	19143776	21068444	0.91
tpcds_q13/datafusion:vortex-file-compressed	44212580	44642682	0.99
tpcds_q14/datafusion:vortex-file-compressed	169472996	170819696	0.99
tpcds_q15/datafusion:vortex-file-compressed	27255913	28563731	0.95
tpcds_q16/datafusion:vortex-file-compressed	28612174	29155338	0.98
tpcds_q17/datafusion:vortex-file-compressed	62499943	62511079	1.00
tpcds_q18/datafusion:vortex-file-compressed	69353165	71416772	0.97
tpcds_q19/datafusion:vortex-file-compressed	21471502	22355633	0.96
tpcds_q20/datafusion:vortex-file-compressed	20718679	21430841	0.97
tpcds_q21/datafusion:vortex-file-compressed	35865637	36041133	1.00
tpcds_q22/datafusion:vortex-file-compressed	111156745	121324985	0.92
tpcds_q23/datafusion:vortex-file-compressed	153568014	155080676	0.99
tpcds_q24/datafusion:vortex-file-compressed	83111866	85186085	0.98
tpcds_q25/datafusion:vortex-file-compressed	66146257	67090293	0.99
tpcds_q26/datafusion:vortex-file-compressed	33154838	34845137	0.95
tpcds_q27/datafusion:vortex-file-compressed	103417792	105264525	0.98
tpcds_q28/datafusion:vortex-file-compressed	40672743	41473317	0.98
tpcds_q29/datafusion:vortex-file-compressed	60590437	63571071	0.95
tpcds_q30/datafusion:vortex-file-compressed	22598648	23709233	0.95
tpcds_q31/datafusion:vortex-file-compressed	71379500	72998811	0.98
tpcds_q32/datafusion:vortex-file-compressed	20529912	20404640	1.01
tpcds_q33/datafusion:vortex-file-compressed	29245105	30459910	0.96
tpcds_q34/datafusion:vortex-file-compressed	23777508	24861511	0.96
tpcds_q35/datafusion:vortex-file-compressed	43260167	46343417	0.93
tpcds_q36/datafusion:vortex-file-compressed	55631065	59046052	0.94
tpcds_q37/datafusion:vortex-file-compressed	24878611	26394049	0.94
tpcds_q38/datafusion:vortex-file-compressed	41434404	43951455	0.94
tpcds_q39/datafusion:vortex-file-compressed	103736745	106337686	0.98
tpcds_q40/datafusion:vortex-file-compressed	32442542	33302288	0.97
tpcds_q41/datafusion:vortex-file-compressed	15473964	16021316	0.97
tpcds_q42/datafusion:vortex-file-compressed	13945418	14375778	0.97
tpcds_q43/datafusion:vortex-file-compressed	18380690	18952588	0.97
tpcds_q44/datafusion:vortex-file-compressed	31843405	31739030	1.00
tpcds_q45/datafusion:vortex-file-compressed	27123381	27730970	0.98
tpcds_q46/datafusion:vortex-file-compressed	34739319	34434837	1.01
tpcds_q47/datafusion:vortex-file-compressed	129636150	134377916	0.96
tpcds_q48/datafusion:vortex-file-compressed	37543471	39587364	0.95
tpcds_q49/datafusion:vortex-file-compressed	57919044	59481757	0.97
tpcds_q50/datafusion:vortex-file-compressed	38658341	39863455	0.97
tpcds_q51/datafusion:vortex-file-compressed	90437379	90441489	1.00
tpcds_q52/datafusion:vortex-file-compressed	14282859	14778182	0.97
tpcds_q53/datafusion:vortex-file-compressed	20797194	21225039	0.98
tpcds_q54/datafusion:vortex-file-compressed	34788948	35017087	0.99
tpcds_q55/datafusion:vortex-file-compressed	13503856	14087895	0.96
tpcds_q56/datafusion:vortex-file-compressed	29747230	30635804	0.97
tpcds_q57/datafusion:vortex-file-compressed	106317397	106006920	1.00
tpcds_q58/datafusion:vortex-file-compressed	52969077	54111782	0.98
tpcds_q59/datafusion:vortex-file-compressed	56397285	57328255	0.98
tpcds_q60/datafusion:vortex-file-compressed	29273997	30011972	0.98
tpcds_q61/datafusion:vortex-file-compressed	39645016	41405247	0.96
tpcds_q62/datafusion:vortex-file-compressed	21444723	22355613	0.96
tpcds_q63/datafusion:vortex-file-compressed	21053311	20904697	1.01
tpcds_q64/datafusion:vortex-file-compressed	401576488	419425398	0.96
tpcds_q65/datafusion:vortex-file-compressed	39925256	40543854	0.98
tpcds_q66/datafusion:vortex-file-compressed	71445282	73598310	0.97
tpcds_q67/datafusion:vortex-file-compressed	148805521	158788710	0.94
tpcds_q68/datafusion:vortex-file-compressed	32183411	35461742	0.91
tpcds_q69/datafusion:vortex-file-compressed	35802028	39412513	0.91
tpcds_q70/datafusion:vortex-file-compressed	83658180	91507754	0.91
tpcds_q71/datafusion:vortex-file-compressed	23133370	24187779	0.96
tpcds_q72/datafusion:vortex-file-compressed 🚀	2114026441	2545126305	0.83
tpcds_q73/datafusion:vortex-file-compressed	22855085	22612948	1.01
tpcds_q74/datafusion:vortex-file-compressed	78020880	85794339	0.91
tpcds_q75/datafusion:vortex-file-compressed	104690191	108266446	0.97
tpcds_q76/datafusion:vortex-file-compressed	22832115	24560544	0.93
tpcds_q77/datafusion:vortex-file-compressed	39401114	41221893	0.96
tpcds_q78/datafusion:vortex-file-compressed	123510567	127581766	0.97
tpcds_q79/datafusion:vortex-file-compressed	27935388	29113901	0.96
tpcds_q80/datafusion:vortex-file-compressed	91744151	99543403	0.92
tpcds_q81/datafusion:vortex-file-compressed	23357576	24455903	0.96
tpcds_q82/datafusion:vortex-file-compressed	25735921	26176525	0.98
tpcds_q83/datafusion:vortex-file-compressed	33423499	34698976	0.96
tpcds_q84/datafusion:vortex-file-compressed	12416426	12792457	0.97
tpcds_q85/datafusion:vortex-file-compressed	97430914	99960242	0.97
tpcds_q86/datafusion:vortex-file-compressed 🚀	16351627	18323783	0.89
tpcds_q87/datafusion:vortex-file-compressed	42628044	44171781	0.97
tpcds_q88/datafusion:vortex-file-compressed	54997014	59123600	0.93
tpcds_q89/datafusion:vortex-file-compressed	24644207	25220820	0.98
tpcds_q90/datafusion:vortex-file-compressed	14151555	15251941	0.93
tpcds_q91/datafusion:vortex-file-compressed	17606857	18698970	0.94
tpcds_q92/datafusion:vortex-file-compressed	18147121	18409434	0.99
tpcds_q93/datafusion:vortex-file-compressed	34066343	34433668	0.99
tpcds_q94/datafusion:vortex-file-compressed	22216959	23415869	0.95
tpcds_q95/datafusion:vortex-file-compressed	61570469	64503761	0.95
tpcds_q96/datafusion:vortex-file-compressed	14171445	14714025	0.96
tpcds_q97/datafusion:vortex-file-compressed	33194600	33924112	0.98
tpcds_q98/datafusion:vortex-file-compressed	24663568	25006660	0.99
tpcds_q99/datafusion:vortex-file-compressed 🚀	28421892	33117146	0.86

datafusion / vortex-compact (0.982x ➖, 1↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-compact	24730320	25220702	0.98
tpcds_q02/datafusion:vortex-compact	53078438	54673276	0.97
tpcds_q03/datafusion:vortex-compact	19784738	19881843	1.00
tpcds_q04/datafusion:vortex-compact	307932669	305801533	1.01
tpcds_q05/datafusion:vortex-compact	47565478	48572009	0.98
tpcds_q06/datafusion:vortex-compact	64212942	61501804	1.04
tpcds_q07/datafusion:vortex-compact	52412551	54018031	0.97
tpcds_q08/datafusion:vortex-compact	34952070	35900555	0.97
tpcds_q09/datafusion:vortex-compact	60520406	61783137	0.98
tpcds_q10/datafusion:vortex-compact	48693082	52158238	0.93
tpcds_q11/datafusion:vortex-compact	148882992	163969434	0.91
tpcds_q12/datafusion:vortex-compact	23060378	23463387	0.98
tpcds_q13/datafusion:vortex-compact	89997099	92549131	0.97
tpcds_q14/datafusion:vortex-compact	196451913	201767035	0.97
tpcds_q15/datafusion:vortex-compact	30254449	32319108	0.94
tpcds_q16/datafusion:vortex-compact	32576994	32442640	1.00
tpcds_q17/datafusion:vortex-compact	73276683	74646093	0.98
tpcds_q18/datafusion:vortex-compact	77531407	81751880	0.95
tpcds_q19/datafusion:vortex-compact	29750052	30436233	0.98
tpcds_q20/datafusion:vortex-compact	26475650	26746089	0.99
tpcds_q21/datafusion:vortex-compact	40368032	40466129	1.00
tpcds_q22/datafusion:vortex-compact	122936862	130263663	0.94
tpcds_q23/datafusion:vortex-compact	160851671	165637180	0.97
tpcds_q24/datafusion:vortex-compact	96052705	98045755	0.98
tpcds_q25/datafusion:vortex-compact	78433482	80887249	0.97
tpcds_q26/datafusion:vortex-compact	45417525	45570426	1.00
tpcds_q27/datafusion:vortex-compact	124661080	122796197	1.02
tpcds_q28/datafusion:vortex-compact	76966578	82021552	0.94
tpcds_q29/datafusion:vortex-compact	73417198	74839993	0.98
tpcds_q30/datafusion:vortex-compact	27430531	28237857	0.97
tpcds_q31/datafusion:vortex-compact	97024986	98180214	0.99
tpcds_q32/datafusion:vortex-compact	25498861	25963432	0.98
tpcds_q33/datafusion:vortex-compact	35924141	36456237	0.99
tpcds_q34/datafusion:vortex-compact	31556896	32190574	0.98
tpcds_q35/datafusion:vortex-compact	51055690	54614818	0.93
tpcds_q36/datafusion:vortex-compact	73752183	75196086	0.98
tpcds_q37/datafusion:vortex-compact	40394610	40521057	1.00
tpcds_q38/datafusion:vortex-compact	52364849	54413316	0.96
tpcds_q39/datafusion:vortex-compact	107996025	113755459	0.95
tpcds_q40/datafusion:vortex-compact	36560650	36835760	0.99
tpcds_q41/datafusion:vortex-compact	17480369	18783107	0.93
tpcds_q42/datafusion:vortex-compact	17918964	18800960	0.95
tpcds_q43/datafusion:vortex-compact	24362223	25286542	0.96
tpcds_q44/datafusion:vortex-compact	45523390	48298657	0.94
tpcds_q45/datafusion:vortex-compact	30390790	31530397	0.96
tpcds_q46/datafusion:vortex-compact	45041353	44161398	1.02
tpcds_q47/datafusion:vortex-compact	148269962	155761733	0.95
tpcds_q48/datafusion:vortex-compact	72659950	74027759	0.98
tpcds_q49/datafusion:vortex-compact	68611982	71751189	0.96
tpcds_q50/datafusion:vortex-compact	47738438	47507815	1.00
tpcds_q51/datafusion:vortex-compact	96044648	98452211	0.98
tpcds_q52/datafusion:vortex-compact	19525234	19585159	1.00
tpcds_q53/datafusion:vortex-compact	27195199	28690931	0.95
tpcds_q54/datafusion:vortex-compact	42115302	42509352	0.99
tpcds_q55/datafusion:vortex-compact	17749156	18184822	0.98
tpcds_q56/datafusion:vortex-compact	35533844	35738276	0.99
tpcds_q57/datafusion:vortex-compact	118707955	124189437	0.96
tpcds_q58/datafusion:vortex-compact	62963069	65008094	0.97
tpcds_q59/datafusion:vortex-compact	69062194	71474587	0.97
tpcds_q60/datafusion:vortex-compact	34721669	36207898	0.96
tpcds_q61/datafusion:vortex-compact	54402196	54810018	0.99
tpcds_q62/datafusion:vortex-compact	28241232	28189297	1.00
tpcds_q63/datafusion:vortex-compact	27597610	27656011	1.00
tpcds_q64/datafusion:vortex-compact	452035148	460363327	0.98
tpcds_q65/datafusion:vortex-compact	54984886	54218202	1.01
tpcds_q66/datafusion:vortex-compact	76665840	78156845	0.98
tpcds_q67/datafusion:vortex-compact	150832231	156828385	0.96
tpcds_q68/datafusion:vortex-compact	44366061	45594591	0.97
tpcds_q69/datafusion:vortex-compact	47025824	47998663	0.98
tpcds_q70/datafusion:vortex-compact	94106213	102064980	0.92
tpcds_q71/datafusion:vortex-compact	29759081	29601451	1.01
tpcds_q72/datafusion:vortex-compact	2125902080	2187087602	0.97
tpcds_q73/datafusion:vortex-compact	30136454	30595923	0.98
tpcds_q74/datafusion:vortex-compact	100726737	97283424	1.04
tpcds_q75/datafusion:vortex-compact	129911632	128516935	1.01
tpcds_q76/datafusion:vortex-compact	32120867	32218388	1.00
tpcds_q77/datafusion:vortex-compact	50366591	50789360	0.99
tpcds_q78/datafusion:vortex-compact	141788877	142172406	1.00
tpcds_q79/datafusion:vortex-compact	37517828	37418384	1.00
tpcds_q80/datafusion:vortex-compact	100522565	103079221	0.98
tpcds_q81/datafusion:vortex-compact	29106747	28785019	1.01
tpcds_q82/datafusion:vortex-compact	41778267	41873102	1.00
tpcds_q83/datafusion:vortex-compact	33686339	33279801	1.01
tpcds_q84/datafusion:vortex-compact	14666163	14693237	1.00
tpcds_q85/datafusion:vortex-compact	129110390	133196840	0.97
tpcds_q86/datafusion:vortex-compact 🚨	22250504	18465182	1.20
tpcds_q87/datafusion:vortex-compact	50700436	52474149	0.97
tpcds_q88/datafusion:vortex-compact	76461551	76668605	1.00
tpcds_q89/datafusion:vortex-compact	31254784	33214712	0.94
tpcds_q90/datafusion:vortex-compact	15076373	15084695	1.00
tpcds_q91/datafusion:vortex-compact	33582683	32521029	1.03
tpcds_q92/datafusion:vortex-compact	24655057	24570045	1.00
tpcds_q93/datafusion:vortex-compact	38343428	38491776	1.00
tpcds_q94/datafusion:vortex-compact	28829844	26602722	1.08
tpcds_q95/datafusion:vortex-compact	66000446	70368773	0.94
tpcds_q96/datafusion:vortex-compact	17309779	17204457	1.01
tpcds_q97/datafusion:vortex-compact	40421681	37656074	1.07
tpcds_q98/datafusion:vortex-compact	30597628	31485226	0.97
tpcds_q99/datafusion:vortex-compact 🚀	31438515	35691777	0.88

datafusion / parquet (0.983x ➖, 2↑ 2↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpcds_q01/datafusion:parquet	31776612	29102026	1.09
tpcds_q02/datafusion:parquet	40915848	41472011	0.99
tpcds_q03/datafusion:parquet	12628440	12917463	0.98
tpcds_q04/datafusion:parquet	262527280	267750019	0.98
tpcds_q05/datafusion:parquet	39650478	42392892	0.94
tpcds_q06/datafusion:parquet	58019902	58853463	0.99
tpcds_q07/datafusion:parquet	75722657	75226675	1.01
tpcds_q08/datafusion:parquet	25949636	26433246	0.98
tpcds_q09/datafusion:parquet	44823546	43396224	1.03
tpcds_q10/datafusion:parquet	69913165	72844662	0.96
tpcds_q11/datafusion:parquet	152935484	146257056	1.05
tpcds_q12/datafusion:parquet	17707321	18051889	0.98
tpcds_q13/datafusion:parquet	73670311	74484767	0.99
tpcds_q14/datafusion:parquet	158782922	161020757	0.99
tpcds_q15/datafusion:parquet	20326710	21774420	0.93
tpcds_q16/datafusion:parquet	23457298	23453190	1.00
tpcds_q17/datafusion:parquet	61230979	66116247	0.93
tpcds_q18/datafusion:parquet	112688589	116945719	0.96
tpcds_q19/datafusion:parquet	22001095	22469075	0.98
tpcds_q20/datafusion:parquet	16216377	16189241	1.00
tpcds_q21/datafusion:parquet	18056442	18311040	0.99
tpcds_q22/datafusion:parquet	155849836	150260212	1.04
tpcds_q23/datafusion:parquet	141549212	140791637	1.01
tpcds_q24/datafusion:parquet	87499714	89786137	0.97
tpcds_q25/datafusion:parquet	63651786	63424893	1.00
tpcds_q26/datafusion:parquet	63799675	64215500	0.99
tpcds_q27/datafusion:parquet	144620024	146597012	0.99
tpcds_q28/datafusion:parquet	43015645	44181859	0.97
tpcds_q29/datafusion:parquet	63513392	63406842	1.00
tpcds_q30/datafusion:parquet	32862748	33729755	0.97
tpcds_q31/datafusion:parquet	61252976	67901912	0.90
tpcds_q32/datafusion:parquet	17539259	17981919	0.98
tpcds_q33/datafusion:parquet	26044903	25405465	1.03
tpcds_q34/datafusion:parquet	20195921	21689952	0.93
tpcds_q35/datafusion:parquet	70026606	67120139	1.04
tpcds_q36/datafusion:parquet	55037625	56618659	0.97
tpcds_q37/datafusion:parquet	18399277	19281131	0.95
tpcds_q38/datafusion:parquet	38429311	41702472	0.92
tpcds_q39/datafusion:parquet	71778629	74125429	0.97
tpcds_q40/datafusion:parquet	24928332	25012091	1.00
tpcds_q41/datafusion:parquet	12949079	13382493	0.97
tpcds_q42/datafusion:parquet	11323102	11870782	0.95
tpcds_q43/datafusion:parquet	16191253	17982610	0.90
tpcds_q44/datafusion:parquet	32866851	33225179	0.99
tpcds_q45/datafusion:parquet	27048015	27461806	0.98
tpcds_q46/datafusion:parquet	31680326	32426967	0.98
tpcds_q47/datafusion:parquet	123483049	124457171	0.99
tpcds_q48/datafusion:parquet	67974853	68135873	1.00
tpcds_q49/datafusion:parquet	53992936	54537749	0.99
tpcds_q50/datafusion:parquet	43649975	43586383	1.00
tpcds_q51/datafusion:parquet	82836883	85143459	0.97
tpcds_q52/datafusion:parquet	11340300	11634359	0.97
tpcds_q53/datafusion:parquet	17193992	17324961	0.99
tpcds_q54/datafusion:parquet	32260582	33873463	0.95
tpcds_q55/datafusion:parquet	11250250	11454558	0.98
tpcds_q56/datafusion:parquet	25977348	27309406	0.95
tpcds_q57/datafusion:parquet	92245325	92473629	1.00
tpcds_q58/datafusion:parquet	49445059	48459265	1.02
tpcds_q59/datafusion:parquet	57203781	57490537	1.00
tpcds_q60/datafusion:parquet	26892607	26382804	1.02
tpcds_q61/datafusion:parquet	41765795	41683120	1.00
tpcds_q62/datafusion:parquet 🚨	25277792	22062873	1.15
tpcds_q63/datafusion:parquet	17657246	17482768	1.01
tpcds_q64/datafusion:parquet	509831675	522680850	0.98
tpcds_q65/datafusion:parquet	37000237	37215587	0.99
tpcds_q66/datafusion:parquet	69556012	66402968	1.05
tpcds_q67/datafusion:parquet	142411350	147618772	0.96
tpcds_q68/datafusion:parquet	31216413	31664690	0.99
tpcds_q69/datafusion:parquet	63369030	65521920	0.97
tpcds_q70/datafusion:parquet	88017112	87312711	1.01
tpcds_q71/datafusion:parquet	22295967	21918768	1.02
tpcds_q72/datafusion:parquet	608575120	612368749	0.99
tpcds_q73/datafusion:parquet	19711274	21176949	0.93
tpcds_q74/datafusion:parquet	82198214	83416349	0.99
tpcds_q75/datafusion:parquet	97074638	99977986	0.97
tpcds_q76/datafusion:parquet	29609254	31312535	0.95
tpcds_q77/datafusion:parquet	37644074	37974038	0.99
tpcds_q78/datafusion:parquet	111904521	112277427	1.00
tpcds_q79/datafusion:parquet	25658267	26227902	0.98
tpcds_q80/datafusion:parquet	78145715	79322851	0.99
tpcds_q81/datafusion:parquet	30969479	31230245	0.99
tpcds_q82/datafusion:parquet	18706083	19629755	0.95
tpcds_q83/datafusion:parquet	35247965	36433036	0.97
tpcds_q84/datafusion:parquet	37930045	39107973	0.97
tpcds_q85/datafusion:parquet	145005804	147377588	0.98
tpcds_q86/datafusion:parquet	15948962	15857817	1.01
tpcds_q87/datafusion:parquet	39477572	41277091	0.96
tpcds_q88/datafusion:parquet	58534588	59494580	0.98
tpcds_q89/datafusion:parquet	20753925	21253092	0.98
tpcds_q90/datafusion:parquet 🚀	13644834	15219419	0.90
tpcds_q91/datafusion:parquet	55314950	58167836	0.95
tpcds_q92/datafusion:parquet	17727128	18503965	0.96
tpcds_q93/datafusion:parquet	32340796	31927419	1.01
tpcds_q94/datafusion:parquet 🚀	18156078	20492078	0.89
tpcds_q95/datafusion:parquet	58932917	60792788	0.97
tpcds_q96/datafusion:parquet	11575690	12082869	0.96
tpcds_q97/datafusion:parquet	28740019	29937733	0.96
tpcds_q98/datafusion:parquet	21514212	21869730	0.98
tpcds_q99/datafusion:parquet 🚨	29767225	26653805	1.12

duckdb / vortex-file-compressed (0.981x ➖, 4↑ 2↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed	21091736	20845146	1.01
tpcds_q02/duckdb:vortex-file-compressed	32587046	34815397	0.94
tpcds_q03/duckdb:vortex-file-compressed	30681293	31888918	0.96
tpcds_q04/duckdb:vortex-file-compressed	105137730	108058616	0.97
tpcds_q05/duckdb:vortex-file-compressed	36591153	35833766	1.02
tpcds_q06/duckdb:vortex-file-compressed	31007904	31784682	0.98
tpcds_q07/duckdb:vortex-file-compressed	19137045	19404502	0.99
tpcds_q08/duckdb:vortex-file-compressed	28151271	27155907	1.04
tpcds_q09/duckdb:vortex-file-compressed	36876214	36740007	1.00
tpcds_q10/duckdb:vortex-file-compressed	40059776	40939172	0.98
tpcds_q11/duckdb:vortex-file-compressed	60796985	60529775	1.00
tpcds_q12/duckdb:vortex-file-compressed	13697130	13694891	1.00
tpcds_q13/duckdb:vortex-file-compressed	32862165	32469219	1.01
tpcds_q14/duckdb:vortex-file-compressed	102667575	102231277	1.00
tpcds_q15/duckdb:vortex-file-compressed	26187016	26214342	1.00
tpcds_q16/duckdb:vortex-file-compressed	25856782	26872111	0.96
tpcds_q17/duckdb:vortex-file-compressed	41778860	41866170	1.00
tpcds_q18/duckdb:vortex-file-compressed	45593833	46137175	0.99
tpcds_q19/duckdb:vortex-file-compressed	33582270	32314360	1.04
tpcds_q20/duckdb:vortex-file-compressed	14566182	15498051	0.94
tpcds_q21/duckdb:vortex-file-compressed	16778076	17105603	0.98
tpcds_q22/duckdb:vortex-file-compressed	74697135	76238254	0.98
tpcds_q23/duckdb:vortex-file-compressed 🚀	94004267	110015337	0.85
tpcds_q24/duckdb:vortex-file-compressed	48401863	48661777	0.99
tpcds_q25/duckdb:vortex-file-compressed	48546701	48318771	1.00
tpcds_q26/duckdb:vortex-file-compressed	38580310	38919765	0.99
tpcds_q27/duckdb:vortex-file-compressed	46599247	48189459	0.97
tpcds_q28/duckdb:vortex-file-compressed	34362472	34805916	0.99
tpcds_q29/duckdb:vortex-file-compressed	41063469	40501018	1.01
tpcds_q30/duckdb:vortex-file-compressed	22602497	23687442	0.95
tpcds_q31/duckdb:vortex-file-compressed	34479370	35040944	0.98
tpcds_q32/duckdb:vortex-file-compressed	13627787	13830038	0.99
tpcds_q33/duckdb:vortex-file-compressed	24077390	23182593	1.04
tpcds_q34/duckdb:vortex-file-compressed	22877512	23351945	0.98
tpcds_q35/duckdb:vortex-file-compressed	60862959	64628409	0.94
tpcds_q36/duckdb:vortex-file-compressed	24622744	23856915	1.03
tpcds_q37/duckdb:vortex-file-compressed	15199102	14730183	1.03
tpcds_q38/duckdb:vortex-file-compressed	35549128	38405194	0.93
tpcds_q39/duckdb:vortex-file-compressed	34090435	34186287	1.00
tpcds_q40/duckdb:vortex-file-compressed	20454922	19073796	1.07
tpcds_q41/duckdb:vortex-file-compressed	12629692	13266106	0.95
tpcds_q42/duckdb:vortex-file-compressed	12075152	12951506	0.93
tpcds_q43/duckdb:vortex-file-compressed 🚀	21285682	25010545	0.85
tpcds_q44/duckdb:vortex-file-compressed	21056492	20555229	1.02
tpcds_q45/duckdb:vortex-file-compressed	28625964	30297441	0.94
tpcds_q46/duckdb:vortex-file-compressed	51795539	51522109	1.01
tpcds_q47/duckdb:vortex-file-compressed	45838560	47395381	0.97
tpcds_q48/duckdb:vortex-file-compressed	29786121	29595418	1.01
tpcds_q49/duckdb:vortex-file-compressed 🚨	36634997	32882726	1.11
tpcds_q50/duckdb:vortex-file-compressed	33496557	33917667	0.99
tpcds_q51/duckdb:vortex-file-compressed	98304915	98072878	1.00
tpcds_q52/duckdb:vortex-file-compressed	12587039	13484662	0.93
tpcds_q53/duckdb:vortex-file-compressed	22479604	22236906	1.01
tpcds_q54/duckdb:vortex-file-compressed	27269470	27502028	0.99
tpcds_q55/duckdb:vortex-file-compressed	12322298	13204220	0.93
tpcds_q56/duckdb:vortex-file-compressed	23361957	24524168	0.95
tpcds_q57/duckdb:vortex-file-compressed	40153820	40227913	1.00
tpcds_q58/duckdb:vortex-file-compressed	30804438	30885791	1.00
tpcds_q59/duckdb:vortex-file-compressed	67548219	68640769	0.98
tpcds_q60/duckdb:vortex-file-compressed	25207093	26323926	0.96
tpcds_q61/duckdb:vortex-file-compressed 🚨	35754416	30425169	1.18
tpcds_q62/duckdb:vortex-file-compressed	16679788	16964440	0.98
tpcds_q63/duckdb:vortex-file-compressed	20907251	20780141	1.01
tpcds_q64/duckdb:vortex-file-compressed	82579435	85426383	0.97
tpcds_q65/duckdb:vortex-file-compressed	21859672	21728677	1.01
tpcds_q66/duckdb:vortex-file-compressed	29349526	29632284	0.99
tpcds_q67/duckdb:vortex-file-compressed	135570371	136511190	0.99
tpcds_q68/duckdb:vortex-file-compressed	39420760	41731127	0.94
tpcds_q69/duckdb:vortex-file-compressed	41385922	41248891	1.00
tpcds_q70/duckdb:vortex-file-compressed	26329096	25590079	1.03
tpcds_q71/duckdb:vortex-file-compressed	20790532	21026463	0.99
tpcds_q72/duckdb:vortex-file-compressed	172817785	172621230	1.00
tpcds_q73/duckdb:vortex-file-compressed	23024159	23789802	0.97
tpcds_q74/duckdb:vortex-file-compressed 🚀	74757411	96012399	0.78
tpcds_q75/duckdb:vortex-file-compressed	54523900	56100527	0.97
tpcds_q76/duckdb:vortex-file-compressed	17465923	18285039	0.96
tpcds_q77/duckdb:vortex-file-compressed	23954395	24048200	1.00
tpcds_q78/duckdb:vortex-file-compressed	75522346	72172277	1.05
tpcds_q79/duckdb:vortex-file-compressed	31422002	33195913	0.95
tpcds_q80/duckdb:vortex-file-compressed	48582966	51980409	0.93
tpcds_q81/duckdb:vortex-file-compressed	26077720	28132214	0.93
tpcds_q82/duckdb:vortex-file-compressed	16503763	17287262	0.95
tpcds_q83/duckdb:vortex-file-compressed	23206843	23953389	0.97
tpcds_q84/duckdb:vortex-file-compressed	18626118	19487121	0.96
tpcds_q85/duckdb:vortex-file-compressed	43653293	45578391	0.96
tpcds_q86/duckdb:vortex-file-compressed	16770729	16180048	1.04
tpcds_q87/duckdb:vortex-file-compressed	39109261	39693888	0.99
tpcds_q88/duckdb:vortex-file-compressed	32328192	33330774	0.97
tpcds_q89/duckdb:vortex-file-compressed	22437075	21681990	1.03
tpcds_q90/duckdb:vortex-file-compressed	12201528	13082891	0.93
tpcds_q91/duckdb:vortex-file-compressed	31001246	30451129	1.02
tpcds_q92/duckdb:vortex-file-compressed 🚀	21293335	25023181	0.85
tpcds_q93/duckdb:vortex-file-compressed	26962715	28511972	0.95
tpcds_q94/duckdb:vortex-file-compressed	22405436	23332548	0.96
tpcds_q95/duckdb:vortex-file-compressed	149638543	140763777	1.06
tpcds_q96/duckdb:vortex-file-compressed	12877010	13160108	0.98
tpcds_q97/duckdb:vortex-file-compressed	36872869	38870003	0.95
tpcds_q98/duckdb:vortex-file-compressed	17755166	17951528	0.99
tpcds_q99/duckdb:vortex-file-compressed	26793032	27594311	0.97

duckdb / vortex-compact (0.978x ➖, 0↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-compact	22675297	23030231	0.98
tpcds_q02/duckdb:vortex-compact	41502418	40125708	1.03
tpcds_q03/duckdb:vortex-compact	55997270	56522491	0.99
tpcds_q04/duckdb:vortex-compact	117665916	126940297	0.93
tpcds_q05/duckdb:vortex-compact	51672321	51741765	1.00
tpcds_q06/duckdb:vortex-compact	39391241	40064288	0.98
tpcds_q07/duckdb:vortex-compact	34684651	33854235	1.02
tpcds_q08/duckdb:vortex-compact	44913854	46052121	0.98
tpcds_q09/duckdb:vortex-compact	56743031	57228779	0.99
tpcds_q10/duckdb:vortex-compact	60008889	59790864	1.00
tpcds_q11/duckdb:vortex-compact	70176885	69121457	1.02
tpcds_q12/duckdb:vortex-compact	22832271	23676506	0.96
tpcds_q13/duckdb:vortex-compact	57725482	59775585	0.97
tpcds_q14/duckdb:vortex-compact	129446361	129674249	1.00
tpcds_q15/duckdb:vortex-compact	30330553	30891992	0.98
tpcds_q16/duckdb:vortex-compact	29950423	31881288	0.94
tpcds_q17/duckdb:vortex-compact	53989077	56403746	0.96
tpcds_q18/duckdb:vortex-compact	59852578	58138027	1.03
tpcds_q19/duckdb:vortex-compact	50775553	51702798	0.98
tpcds_q20/duckdb:vortex-compact	19328807	20227065	0.96
tpcds_q21/duckdb:vortex-compact	19105802	19586122	0.98
tpcds_q22/duckdb:vortex-compact	75613086	76756124	0.99
tpcds_q23/duckdb:vortex-compact	125557304	117431748	1.07
tpcds_q24/duckdb:vortex-compact	61596499	64944915	0.95
tpcds_q25/duckdb:vortex-compact	79280208	81971068	0.97
tpcds_q26/duckdb:vortex-compact	50153870	52393771	0.96
tpcds_q27/duckdb:vortex-compact	67063530	70769902	0.95
tpcds_q28/duckdb:vortex-compact	85141499	85929762	0.99
tpcds_q29/duckdb:vortex-compact	51628463	54594054	0.95
tpcds_q30/duckdb:vortex-compact	29233984	30222716	0.97
tpcds_q31/duckdb:vortex-compact	45538091	45547541	1.00
tpcds_q32/duckdb:vortex-compact	22308140	23503834	0.95
tpcds_q33/duckdb:vortex-compact	34474522	35808415	0.96
tpcds_q34/duckdb:vortex-compact	37909142	38653408	0.98
tpcds_q35/duckdb:vortex-compact	80574700	80865780	1.00
tpcds_q36/duckdb:vortex-compact	41343258	40505307	1.02
tpcds_q37/duckdb:vortex-compact	24077254	23285728	1.03
tpcds_q38/duckdb:vortex-compact	49758227	48677738	1.02
tpcds_q39/duckdb:vortex-compact	34762951	36690548	0.95
tpcds_q40/duckdb:vortex-compact	24077038	24641774	0.98
tpcds_q41/duckdb:vortex-compact	15768194	15566057	1.01
tpcds_q42/duckdb:vortex-compact	22030072	21977949	1.00
tpcds_q43/duckdb:vortex-compact	35881492	36980255	0.97
tpcds_q44/duckdb:vortex-compact	29939155	28980271	1.03
tpcds_q45/duckdb:vortex-compact	36967626	37829379	0.98
tpcds_q46/duckdb:vortex-compact	69675821	70841206	0.98
tpcds_q47/duckdb:vortex-compact	60899323	62007261	0.98
tpcds_q48/duckdb:vortex-compact	52335687	52535665	1.00
tpcds_q49/duckdb:vortex-compact	56288954	55110021	1.02
tpcds_q50/duckdb:vortex-compact	46645773	45805671	1.02
tpcds_q51/duckdb:vortex-compact	106364865	108603077	0.98
tpcds_q52/duckdb:vortex-compact	21802159	22185443	0.98
tpcds_q53/duckdb:vortex-compact	37039782	38504396	0.96
tpcds_q54/duckdb:vortex-compact	40777029	40643664	1.00
tpcds_q55/duckdb:vortex-compact	22038999	22189662	0.99
tpcds_q56/duckdb:vortex-compact	34207481	35008596	0.98
tpcds_q57/duckdb:vortex-compact	43192587	43783539	0.99
tpcds_q58/duckdb:vortex-compact 🚨	46007943	40987916	1.12
tpcds_q59/duckdb:vortex-compact	88838993	92856637	0.96
tpcds_q60/duckdb:vortex-compact	38257323	37902958	1.01
tpcds_q61/duckdb:vortex-compact	61125474	61468758	0.99
tpcds_q62/duckdb:vortex-compact	25795435	26078533	0.99
tpcds_q63/duckdb:vortex-compact	36810524	37653229	0.98
tpcds_q64/duckdb:vortex-compact	116090639	116965998	0.99
tpcds_q65/duckdb:vortex-compact	32645564	33194710	0.98
tpcds_q66/duckdb:vortex-compact	39106478	41297299	0.95
tpcds_q67/duckdb:vortex-compact	154560487	155582200	0.99
tpcds_q68/duckdb:vortex-compact	61349617	62197130	0.99
tpcds_q69/duckdb:vortex-compact	61275683	62740708	0.98
tpcds_q70/duckdb:vortex-compact	36905870	37448220	0.99
tpcds_q71/duckdb:vortex-compact	33769723	33819928	1.00
tpcds_q72/duckdb:vortex-compact	194950889	196687085	0.99
tpcds_q73/duckdb:vortex-compact	37440714	37759834	0.99
tpcds_q74/duckdb:vortex-compact	80555053	88359586	0.91
tpcds_q75/duckdb:vortex-compact	72498704	74586316	0.97
tpcds_q76/duckdb:vortex-compact	32987807	35038812	0.94
tpcds_q77/duckdb:vortex-compact	41475429	45256354	0.92
tpcds_q78/duckdb:vortex-compact	89767076	88801079	1.01
tpcds_q79/duckdb:vortex-compact	51834602	55107029	0.94
tpcds_q80/duckdb:vortex-compact	83236627	84349127	0.99
tpcds_q81/duckdb:vortex-compact	33304563	36771768	0.91
tpcds_q82/duckdb:vortex-compact	25069380	27097747	0.93
tpcds_q83/duckdb:vortex-compact	31836877	34469318	0.92
tpcds_q84/duckdb:vortex-compact	25522682	27749139	0.92
tpcds_q85/duckdb:vortex-compact	55068888	61139251	0.90
tpcds_q86/duckdb:vortex-compact	23815636	24421084	0.98
tpcds_q87/duckdb:vortex-compact	48614755	52117688	0.93
tpcds_q88/duckdb:vortex-compact	39081104	40046837	0.98
tpcds_q89/duckdb:vortex-compact	37616260	37955725	0.99
tpcds_q90/duckdb:vortex-compact	14747572	15391286	0.96
tpcds_q91/duckdb:vortex-compact	48868357	49578632	0.99
tpcds_q92/duckdb:vortex-compact	52617891	55814672	0.94
tpcds_q93/duckdb:vortex-compact	31195808	32023207	0.97
tpcds_q94/duckdb:vortex-compact	31191396	32547936	0.96
tpcds_q95/duckdb:vortex-compact	158935606	163665164	0.97
tpcds_q96/duckdb:vortex-compact	17608503	17708285	0.99
tpcds_q97/duckdb:vortex-compact	43307192	46720115	0.93
tpcds_q98/duckdb:vortex-compact	27876740	28204665	0.99
tpcds_q99/duckdb:vortex-compact	31187606	32015245	0.97

duckdb / parquet (0.990x ➖, 3↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpcds_q01/duckdb:parquet 🚀	27467698	30698995	0.89
tpcds_q02/duckdb:parquet	22725616	22913492	0.99
tpcds_q03/duckdb:parquet	11305168	11270820	1.00
tpcds_q04/duckdb:parquet	168900504	169572348	1.00
tpcds_q05/duckdb:parquet	25985994	27877649	0.93
tpcds_q06/duckdb:parquet	27784175	28000137	0.99
tpcds_q07/duckdb:parquet	21331786	21961999	0.97
tpcds_q08/duckdb:parquet	26664010	26607665	1.00
tpcds_q09/duckdb:parquet	39301675	39656023	0.99
tpcds_q10/duckdb:parquet	32016064	32483571	0.99
tpcds_q11/duckdb:parquet	84885982	80089036	1.06
tpcds_q12/duckdb:parquet	14254856	13726827	1.04
tpcds_q13/duckdb:parquet	33507764	33235193	1.01
tpcds_q14/duckdb:parquet	99198313	100794133	0.98
tpcds_q15/duckdb:parquet	30022084	31341219	0.96
tpcds_q16/duckdb:parquet	20174038	22070580	0.91
tpcds_q17/duckdb:parquet	36765333	38958163	0.94
tpcds_q18/duckdb:parquet	44646439	44013343	1.01
tpcds_q19/duckdb:parquet	29688296	29179710	1.02
tpcds_q20/duckdb:parquet	15304528	15134541	1.01
tpcds_q21/duckdb:parquet 🚀	9761596	11905376	0.82
tpcds_q22/duckdb:parquet	68995581	65543421	1.05
tpcds_q23/duckdb:parquet	78498723	79334251	0.99
tpcds_q24/duckdb:parquet	44566286	44895317	0.99
tpcds_q25/duckdb:parquet	32278602	32884496	0.98
tpcds_q26/duckdb:parquet	35172005	35248845	1.00
tpcds_q27/duckdb:parquet	48272820	49247175	0.98
tpcds_q28/duckdb:parquet	37318191	37092929	1.01
tpcds_q29/duckdb:parquet	35824497	36096357	0.99
tpcds_q30/duckdb:parquet	33797548	35210179	0.96
tpcds_q31/duckdb:parquet	24059421	23670215	1.02
tpcds_q32/duckdb:parquet	10546238	11695076	0.90
tpcds_q33/duckdb:parquet	20440868	20765322	0.98
tpcds_q34/duckdb:parquet	20075215	20012420	1.00
tpcds_q35/duckdb:parquet	56885841	59448795	0.96
tpcds_q36/duckdb:parquet	19318845	19566937	0.99
tpcds_q37/duckdb:parquet	11672986	12318047	0.95
tpcds_q38/duckdb:parquet	35479750	33126456	1.07
tpcds_q39/duckdb:parquet	28982474	29470331	0.98
tpcds_q40/duckdb:parquet	16980732	16992484	1.00
tpcds_q41/duckdb:parquet	7352654	7840915	0.94
tpcds_q42/duckdb:parquet	9421201	9771885	0.96
tpcds_q43/duckdb:parquet	14946185	15040258	0.99
tpcds_q44/duckdb:parquet	21826665	23123236	0.94
tpcds_q45/duckdb:parquet	26437890	26598717	0.99
tpcds_q46/duckdb:parquet	45676445	44271020	1.03
tpcds_q47/duckdb:parquet	44017180	44533644	0.99
tpcds_q48/duckdb:parquet	28612919	29007775	0.99
tpcds_q49/duckdb:parquet	24538957	23882075	1.03
tpcds_q50/duckdb:parquet	23676138	23968575	0.99
tpcds_q51/duckdb:parquet	92499337	94067148	0.98
tpcds_q52/duckdb:parquet	10210768	10074687	1.01
tpcds_q53/duckdb:parquet	14645252	14873369	0.98
tpcds_q54/duckdb:parquet	24983904	26229523	0.95
tpcds_q55/duckdb:parquet	9546070	9870986	0.97
tpcds_q56/duckdb:parquet	20454082	20175777	1.01
tpcds_q57/duckdb:parquet	34063702	34470754	0.99
tpcds_q58/duckdb:parquet	21868252	22263986	0.98
tpcds_q59/duckdb:parquet	35326519	35360132	1.00
tpcds_q60/duckdb:parquet	21628997	21778964	0.99
tpcds_q61/duckdb:parquet	29956047	30857397	0.97
tpcds_q62/duckdb:parquet 🚨	12873644	11475532	1.12
tpcds_q63/duckdb:parquet	13667472	14040654	0.97
tpcds_q64/duckdb:parquet	74513891	75160898	0.99
tpcds_q65/duckdb:parquet	19314628	19730370	0.98
tpcds_q66/duckdb:parquet	28792593	29855593	0.96
tpcds_q67/duckdb:parquet	132465703	134761470	0.98
tpcds_q68/duckdb:parquet	36028295	36475753	0.99
tpcds_q69/duckdb:parquet	35602368	36376641	0.98
tpcds_q70/duckdb:parquet	18577731	19071171	0.97
tpcds_q71/duckdb:parquet	19489530	19785132	0.99
tpcds_q72/duckdb:parquet	163235634	165982712	0.98
tpcds_q73/duckdb:parquet	17292768	17425637	0.99
tpcds_q74/duckdb:parquet	126049553	125190095	1.01
tpcds_q75/duckdb:parquet	53097589	54357861	0.98
tpcds_q76/duckdb:parquet	19258214	19138306	1.01
tpcds_q77/duckdb:parquet	20913003	21065039	0.99
tpcds_q78/duckdb:parquet	75015215	72997867	1.03
tpcds_q79/duckdb:parquet	26415211	26517895	1.00
tpcds_q80/duckdb:parquet	40994124	39458116	1.04
tpcds_q81/duckdb:parquet	31415587	31805568	0.99
tpcds_q82/duckdb:parquet	13818811	13516675	1.02
tpcds_q83/duckdb:parquet	16040581	15569703	1.03
tpcds_q84/duckdb:parquet	18933659	18319176	1.03
tpcds_q85/duckdb:parquet	37378807	38524647	0.97
tpcds_q86/duckdb:parquet	12656531	12635743	1.00
tpcds_q87/duckdb:parquet	35690745	35670240	1.00
tpcds_q88/duckdb:parquet	48277660	48888198	0.99
tpcds_q89/duckdb:parquet	17320524	15815399	1.10
tpcds_q90/duckdb:parquet	7767565	7086006	1.10
tpcds_q91/duckdb:parquet	21962244	22745000	0.97
tpcds_q92/duckdb:parquet 🚀	10861266	12162893	0.89
tpcds_q93/duckdb:parquet	29752137	28938387	1.03
tpcds_q94/duckdb:parquet	15364504	16664537	0.92
tpcds_q95/duckdb:parquet	119009689	116072897	1.03
tpcds_q96/duckdb:parquet	8579319	8397826	1.02
tpcds_q97/duckdb:parquet	35367264	34617139	1.02
tpcds_q98/duckdb:parquet	16780881	17468083	0.96
tpcds_q99/duckdb:parquet	19544732	19800593	0.99

duckdb / duckdb (0.961x ➖, 3↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpcds_q01/duckdb:duckdb	20247756	20077743	1.01
tpcds_q02/duckdb:duckdb	17982913	18427213	0.98
tpcds_q03/duckdb:duckdb	8930608	8889866	1.00
tpcds_q04/duckdb:duckdb	173141870	180966702	0.96
tpcds_q05/duckdb:duckdb	20048769	19096637	1.05
tpcds_q06/duckdb:duckdb	22246806	23333777	0.95
tpcds_q07/duckdb:duckdb	37411900	41260848	0.91
tpcds_q08/duckdb:duckdb	120567945	122277988	0.99
tpcds_q09/duckdb:duckdb	19882196	20443281	0.97
tpcds_q10/duckdb:duckdb	23397726	25182510	0.93
tpcds_q11/duckdb:duckdb	89010291	90128133	0.99
tpcds_q12/duckdb:duckdb	11592752	11728369	0.99
tpcds_q13/duckdb:duckdb	24456681	24745371	0.99
tpcds_q14/duckdb:duckdb	92971351	93985541	0.99
tpcds_q15/duckdb:duckdb	24583742	25619523	0.96
tpcds_q16/duckdb:duckdb	17752165	19232022	0.92
tpcds_q17/duckdb:duckdb	21798883	23241724	0.94
tpcds_q18/duckdb:duckdb	43883342	46116551	0.95
tpcds_q19/duckdb:duckdb	16512351	17571319	0.94
tpcds_q20/duckdb:duckdb	11671544	12869034	0.91
tpcds_q21/duckdb:duckdb	7886344	7858777	1.00
tpcds_q22/duckdb:duckdb	60689777	64724366	0.94
tpcds_q23/duckdb:duckdb	79639583	75759956	1.05
tpcds_q24/duckdb:duckdb	24413279	25484462	0.96
tpcds_q25/duckdb:duckdb 🚀	16317051	18292614	0.89
tpcds_q26/duckdb:duckdb	27320188	28057743	0.97
tpcds_q27/duckdb:duckdb	38211051	40500750	0.94
tpcds_q28/duckdb:duckdb	21746798	21722339	1.00
tpcds_q29/duckdb:duckdb	20566861	22832703	0.90
tpcds_q30/duckdb:duckdb	30474138	30306760	1.01
tpcds_q31/duckdb:duckdb	47827567	50193056	0.95
tpcds_q32/duckdb:duckdb	7332690	8145738	0.90
tpcds_q33/duckdb:duckdb	12721616	13406085	0.95
tpcds_q34/duckdb:duckdb	14925112	16435920	0.91
tpcds_q35/duckdb:duckdb	32588116	32346786	1.01
tpcds_q36/duckdb:duckdb	69945434	73181142	0.96
tpcds_q37/duckdb:duckdb	7736036	8306207	0.93
tpcds_q38/duckdb:duckdb	31507440	32504137	0.97
tpcds_q39/duckdb:duckdb	25999563	26195091	0.99
tpcds_q40/duckdb:duckdb	13804732	14116361	0.98
tpcds_q41/duckdb:duckdb	8317301	8690640	0.96
tpcds_q42/duckdb:duckdb	6558560	7287195	0.90
tpcds_q43/duckdb:duckdb	11138597	11530185	0.97
tpcds_q44/duckdb:duckdb	13395403	13905470	0.96
tpcds_q45/duckdb:duckdb	16717135	17450765	0.96
tpcds_q46/duckdb:duckdb	35442311	38381467	0.92
tpcds_q47/duckdb:duckdb	40271246	41049233	0.98
tpcds_q48/duckdb:duckdb	22006083	22237607	0.99
tpcds_q49/duckdb:duckdb	16186999	15999778	1.01
tpcds_q50/duckdb:duckdb	14211614	14758321	0.96
tpcds_q51/duckdb:duckdb	88720793	92190615	0.96
tpcds_q52/duckdb:duckdb	7484495	7688185	0.97
tpcds_q53/duckdb:duckdb	13285571	13397495	0.99
tpcds_q54/duckdb:duckdb	17031046	17424038	0.98
tpcds_q55/duckdb:duckdb	7083452	7466064	0.95
tpcds_q56/duckdb:duckdb	13297955	14402118	0.92
tpcds_q57/duckdb:duckdb	32059647	31936813	1.00
tpcds_q58/duckdb:duckdb	12516818	13424538	0.93
tpcds_q59/duckdb:duckdb	35414297	36378953	0.97
tpcds_q60/duckdb:duckdb	14701986	15826178	0.93
tpcds_q61/duckdb:duckdb	14540578	15305449	0.95
tpcds_q62/duckdb:duckdb	9349217	10162166	0.92
tpcds_q63/duckdb:duckdb	12260816	13061819	0.94
tpcds_q64/duckdb:duckdb	54868380	57734626	0.95
tpcds_q65/duckdb:duckdb	35072962	35942325	0.98
tpcds_q66/duckdb:duckdb	25137089	25713836	0.98
tpcds_q67/duckdb:duckdb	126869300	130002038	0.98
tpcds_q68/duckdb:duckdb	25309102	25699633	0.98
tpcds_q69/duckdb:duckdb	25647758	26238563	0.98
tpcds_q70/duckdb:duckdb	14054285	14824890	0.95
tpcds_q71/duckdb:duckdb	12698695	12721974	1.00
tpcds_q72/duckdb:duckdb	41164427	42454071	0.97
tpcds_q73/duckdb:duckdb	11070466	10862066	1.02
tpcds_q74/duckdb:duckdb	142497913	145030732	0.98
tpcds_q75/duckdb:duckdb	42313816	42665149	0.99
tpcds_q76/duckdb:duckdb	12273054	12294431	1.00
tpcds_q77/duckdb:duckdb	11841583	12668886	0.93
tpcds_q78/duckdb:duckdb	62202695	64806058	0.96
tpcds_q79/duckdb:duckdb	18500346	19550345	0.95
tpcds_q80/duckdb:duckdb	27002666	29117784	0.93
tpcds_q81/duckdb:duckdb	38983734	40650328	0.96
tpcds_q82/duckdb:duckdb 🚀	8177010	9323497	0.88
tpcds_q83/duckdb:duckdb	9177491	9920589	0.93
tpcds_q84/duckdb:duckdb	13797419	14877010	0.93
tpcds_q85/duckdb:duckdb	24986049	25139719	0.99
tpcds_q86/duckdb:duckdb	10340346	11023657	0.94
tpcds_q87/duckdb:duckdb	34535356	34270505	1.01
tpcds_q88/duckdb:duckdb	25856936	26502041	0.98
tpcds_q89/duckdb:duckdb	14567008	15194557	0.96
tpcds_q90/duckdb:duckdb	5676411	5943564	0.96
tpcds_q91/duckdb:duckdb	12560307	13831262	0.91
tpcds_q92/duckdb:duckdb	8500218	9151193	0.93
tpcds_q93/duckdb:duckdb	21677895	23651386	0.92
tpcds_q94/duckdb:duckdb	13028865	12792328	1.02
tpcds_q95/duckdb:duckdb	119505479	115517355	1.03
tpcds_q96/duckdb:duckdb 🚀	4356850	4960243	0.88
tpcds_q97/duckdb:duckdb	30278328	30379621	1.00
tpcds_q98/duckdb:duckdb	13719426	13404753	1.02
tpcds_q99/duckdb:duckdb	16078599	17271477	0.93

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	-1.9%	-1.2%	-0.8%	+18.9%	➖ noise
1	datafusion:vortex-file-compressed	-6.4%	-1.2%	-5.3%	+17.7%	➖ noise
1	duckdb:duckdb	+0.8%	-1.2%	+2.0%	+20.5%	➖ noise
1	duckdb:vortex-compact	-1.5%	-1.2%	-0.4%	+21.9%	➖ noise
1	duckdb:vortex-file-compressed	+1.2%	-1.2%	+2.4%	+36.7%	➖ noise
2	datafusion:vortex-compact	-2.9%	-1.1%	-1.9%	+10.0%	➖ noise
2	datafusion:vortex-file-compressed	-3.0%	-1.1%	-2.0%	+10.0%	➖ noise
2	duckdb:duckdb	-2.4%	-1.1%	-1.3%	+11.1%	➖ noise
2	duckdb:vortex-compact	+3.4%	-1.1%	+4.6%	+22.0%	➖ noise
2	duckdb:vortex-file-compressed	-6.4%	-1.1%	-5.4%	+30.4%	➖ noise
3	datafusion:vortex-compact	-0.5%	-1.0%	+0.5%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	-0.8%	-1.0%	+0.2%	+10.0%	➖ noise
3	duckdb:duckdb	+0.5%	-1.0%	+1.4%	+14.0%	➖ noise
3	duckdb:vortex-compact	-0.9%	-1.0%	+0.0%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-3.8%	-1.0%	-2.8%	+10.0%	➖ noise
4	datafusion:vortex-compact	+0.7%	-1.2%	+1.9%	+14.2%	➖ noise
4	datafusion:vortex-file-compressed	-0.8%	-1.2%	+0.4%	+10.1%	➖ noise
4	duckdb:duckdb	-4.3%	-1.2%	-3.2%	+10.8%	➖ noise
4	duckdb:vortex-compact	-7.3%	-1.2%	-6.2%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-2.7%	-1.2%	-1.5%	+11.4%	➖ noise
5	datafusion:vortex-compact	-2.1%	-6.6%	+4.9%	+16.0%	➖ noise
5	datafusion:vortex-file-compressed	-6.9%	-6.6%	-0.2%	+11.8%	➖ noise
5	duckdb:duckdb	+5.0%	-6.6%	+12.4%	+10.0%	🚨 regression
5	duckdb:vortex-compact	-0.1%	-6.6%	+7.0%	+10.8%	➖ noise
5	duckdb:vortex-file-compressed	+2.1%	-6.6%	+9.4%	+10.5%	➖ noise
6	datafusion:vortex-compact	+4.4%	-1.1%	+5.6%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-4.9%	-1.1%	-3.8%	+10.0%	➖ noise
6	duckdb:duckdb	-4.7%	-1.1%	-3.6%	+11.9%	➖ noise
6	duckdb:vortex-compact	-1.7%	-1.1%	-0.6%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-2.4%	-1.1%	-1.4%	+10.0%	➖ noise
7	datafusion:vortex-compact	-3.0%	-1.1%	-1.9%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	-5.3%	-1.1%	-4.3%	+10.4%	➖ noise
7	duckdb:duckdb	-9.3%	-1.1%	-8.3%	+20.2%	➖ noise
7	duckdb:vortex-compact	+2.5%	-1.1%	+3.6%	+12.9%	➖ noise
7	duckdb:vortex-file-compressed	-1.4%	-1.1%	-0.3%	+22.1%	➖ noise
8	datafusion:vortex-compact	-2.6%	-0.8%	-1.8%	+10.0%	➖ noise
8	datafusion:vortex-file-compressed	-3.9%	-0.8%	-3.1%	+10.0%	➖ noise
8	duckdb:duckdb	-1.4%	-0.8%	-0.6%	+10.0%	➖ noise
8	duckdb:vortex-compact	-2.5%	-0.8%	-1.7%	+14.6%	➖ noise
8	duckdb:vortex-file-compressed	+3.7%	-0.8%	+4.5%	+11.5%	➖ noise
9	datafusion:vortex-compact	-2.0%	+1.2%	-3.2%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	+2.5%	+1.2%	+1.3%	+10.0%	➖ noise
9	duckdb:duckdb	-2.7%	+1.2%	-3.9%	+10.0%	➖ noise
9	duckdb:vortex-compact	-0.8%	+1.2%	-2.0%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	+0.4%	+1.2%	-0.8%	+11.1%	➖ noise
10	datafusion:vortex-compact	-6.6%	-2.7%	-4.0%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	-0.3%	-2.7%	+2.5%	+10.0%	➖ noise
10	duckdb:duckdb	-7.1%	-2.7%	-4.5%	+10.0%	➖ noise
10	duckdb:vortex-compact	+0.4%	-2.7%	+3.2%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-2.1%	-2.7%	+0.6%	+10.0%	➖ noise
11	datafusion:vortex-compact	-9.2%	+5.3%	-13.8%	+10.0%	✅ faster
11	datafusion:vortex-file-compressed	-4.4%	+5.3%	-9.2%	+10.0%	✅ faster
11	duckdb:duckdb	-1.2%	+5.3%	-6.2%	+10.0%	➖ noise
11	duckdb:vortex-compact	+1.5%	+5.3%	-3.6%	+11.4%	➖ noise
11	duckdb:vortex-file-compressed	+0.4%	+5.3%	-4.6%	+13.5%	➖ noise
12	datafusion:vortex-compact	-1.7%	+0.9%	-2.6%	+15.8%	➖ noise
12	datafusion:vortex-file-compressed	-9.1%	+0.9%	-10.0%	+15.3%	➖ noise
12	duckdb:duckdb	-1.2%	+0.9%	-2.1%	+15.9%	➖ noise
12	duckdb:vortex-compact	-3.6%	+0.9%	-4.5%	+15.0%	➖ noise
12	duckdb:vortex-file-compressed	+0.0%	+0.9%	-0.9%	+14.6%	➖ noise
13	datafusion:vortex-compact	-2.8%	-0.1%	-2.6%	+15.1%	➖ noise
13	datafusion:vortex-file-compressed	-1.0%	-0.1%	-0.8%	+10.0%	➖ noise
13	duckdb:duckdb	-1.2%	-0.1%	-1.0%	+10.0%	➖ noise
13	duckdb:vortex-compact	-3.4%	-0.1%	-3.3%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	+1.2%	-0.1%	+1.4%	+10.0%	➖ noise
14	datafusion:vortex-compact	-2.6%	-1.5%	-1.2%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	-0.8%	-1.5%	+0.7%	+10.0%	➖ noise
14	duckdb:duckdb	-1.1%	-1.5%	+0.4%	+10.0%	➖ noise
14	duckdb:vortex-compact	-0.2%	-1.5%	+1.3%	+10.0%	➖ noise
14	duckdb:vortex-file-compressed	+0.4%	-1.5%	+1.9%	+10.0%	➖ noise
15	datafusion:vortex-compact	-6.4%	-5.4%	-1.0%	+11.6%	➖ noise
15	datafusion:vortex-file-compressed	-4.6%	-5.4%	+0.9%	+10.0%	➖ noise
15	duckdb:duckdb	-4.0%	-5.4%	+1.5%	+10.0%	➖ noise
15	duckdb:vortex-compact	-1.8%	-5.4%	+3.8%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	-0.1%	-5.4%	+5.6%	+10.0%	➖ noise
16	datafusion:vortex-compact	+0.4%	-4.4%	+5.0%	+11.6%	➖ noise
16	datafusion:vortex-file-compressed	-1.9%	-4.4%	+2.6%	+12.7%	➖ noise
16	duckdb:duckdb	-7.7%	-4.4%	-3.5%	+13.7%	➖ noise
16	duckdb:vortex-compact	-6.1%	-4.4%	-1.7%	+11.7%	➖ noise
16	duckdb:vortex-file-compressed	-3.8%	-4.4%	+0.6%	+10.0%	➖ noise
17	datafusion:vortex-compact	-1.8%	-6.5%	+5.0%	+10.8%	➖ noise
17	datafusion:vortex-file-compressed	-0.0%	-6.5%	+6.9%	+10.0%	➖ noise
17	duckdb:duckdb	-6.2%	-6.5%	+0.3%	+10.0%	➖ noise
17	duckdb:vortex-compact	-4.3%	-6.5%	+2.4%	+11.2%	➖ noise
17	duckdb:vortex-file-compressed	-0.2%	-6.5%	+6.7%	+10.0%	➖ noise
18	datafusion:vortex-compact	-5.2%	-1.1%	-4.1%	+10.0%	➖ noise
18	datafusion:vortex-file-compressed	-2.9%	-1.1%	-1.8%	+10.0%	➖ noise
18	duckdb:duckdb	-4.8%	-1.1%	-3.8%	+10.0%	➖ noise
18	duckdb:vortex-compact	+2.9%	-1.1%	+4.1%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	-1.2%	-1.1%	-0.0%	+12.9%	➖ noise
19	datafusion:vortex-compact	-2.3%	-0.2%	-2.1%	+10.0%	➖ noise
19	datafusion:vortex-file-compressed	-4.0%	-0.2%	-3.8%	+10.0%	➖ noise
19	duckdb:duckdb	-6.0%	-0.2%	-5.8%	+10.0%	➖ noise
19	duckdb:vortex-compact	-1.8%	-0.2%	-1.6%	+10.0%	➖ noise
19	duckdb:vortex-file-compressed	+3.9%	-0.2%	+4.1%	+10.0%	➖ noise
20	datafusion:vortex-compact	-1.0%	+0.6%	-1.6%	+13.7%	➖ noise
20	datafusion:vortex-file-compressed	-3.3%	+0.6%	-3.9%	+10.1%	➖ noise
20	duckdb:duckdb	-9.3%	+0.6%	-9.9%	+10.9%	✅ faster
20	duckdb:vortex-compact	-4.4%	+0.6%	-5.1%	+10.0%	➖ noise
20	duckdb:vortex-file-compressed	-6.0%	+0.6%	-6.6%	+10.0%	➖ noise
21	datafusion:vortex-compact	-0.2%	-10.1%	+10.9%	+11.8%	➖ noise
21	datafusion:vortex-file-compressed	-0.5%	-10.1%	+10.7%	+11.0%	➖ noise
21	duckdb:duckdb	+0.4%	-10.1%	+11.6%	+22.8%	➖ noise
21	duckdb:vortex-compact	-2.5%	-10.1%	+8.5%	+12.6%	➖ noise
21	duckdb:vortex-file-compressed	-1.9%	-10.1%	+9.1%	+17.3%	➖ noise
22	datafusion:vortex-compact	-5.6%	+4.5%	-9.7%	+26.3%	➖ noise
22	datafusion:vortex-file-compressed	-8.4%	+4.5%	-12.3%	+32.3%	➖ noise
22	duckdb:duckdb	-6.2%	+4.5%	-10.3%	+13.6%	➖ noise
22	duckdb:vortex-compact	-1.5%	+4.5%	-5.7%	+12.5%	➖ noise
22	duckdb:vortex-file-compressed	-2.0%	+4.5%	-6.2%	+12.6%	➖ noise
23	datafusion:vortex-compact	-2.9%	-0.3%	-2.6%	+11.1%	➖ noise
23	datafusion:vortex-file-compressed	-1.0%	-0.3%	-0.7%	+10.0%	➖ noise
23	duckdb:duckdb	+5.1%	-0.3%	+5.4%	+16.4%	➖ noise
23	duckdb:vortex-compact	+6.9%	-0.3%	+7.2%	+10.0%	➖ noise
23	duckdb:vortex-file-compressed	-14.6%	-0.3%	-14.3%	+15.7%	✅ faster
24	datafusion:vortex-compact	-2.0%	-1.6%	-0.4%	+11.3%	➖ noise
24	datafusion:vortex-file-compressed	-2.4%	-1.6%	-0.8%	+10.2%	➖ noise
24	duckdb:duckdb	-4.2%	-1.6%	-2.6%	+10.7%	➖ noise
24	duckdb:vortex-compact	-5.2%	-1.6%	-3.6%	+10.0%	➖ noise
24	duckdb:vortex-file-compressed	-0.5%	-1.6%	+1.1%	+15.5%	➖ noise
25	datafusion:vortex-compact	-3.0%	-0.7%	-2.3%	+10.5%	➖ noise
25	datafusion:vortex-file-compressed	-1.4%	-0.7%	-0.7%	+10.0%	➖ noise
25	duckdb:duckdb	-10.8%	-0.7%	-10.1%	+10.0%	✅ faster
25	duckdb:vortex-compact	-3.3%	-0.7%	-2.6%	+10.4%	➖ noise
25	duckdb:vortex-file-compressed	+0.5%	-0.7%	+1.2%	+10.0%	➖ noise
26	datafusion:vortex-compact	-0.3%	-0.4%	+0.1%	+10.8%	➖ noise
26	datafusion:vortex-file-compressed	-4.9%	-0.4%	-4.4%	+12.7%	➖ noise
26	duckdb:duckdb	-2.6%	-0.4%	-2.2%	+11.7%	➖ noise
26	duckdb:vortex-compact	-4.3%	-0.4%	-3.9%	+10.0%	➖ noise
26	duckdb:vortex-file-compressed	-0.9%	-0.4%	-0.4%	+11.3%	➖ noise
27	datafusion:vortex-compact	+1.5%	-1.7%	+3.2%	+10.7%	➖ noise
27	datafusion:vortex-file-compressed	-1.8%	-1.7%	-0.1%	+10.4%	➖ noise
27	duckdb:duckdb	-5.7%	-1.7%	-4.1%	+18.8%	➖ noise
27	duckdb:vortex-compact	-5.2%	-1.7%	-3.6%	+10.2%	➖ noise
27	duckdb:vortex-file-compressed	-3.3%	-1.7%	-1.7%	+17.5%	➖ noise
28	datafusion:vortex-compact	-6.2%	-1.0%	-5.2%	+10.0%	➖ noise
28	datafusion:vortex-file-compressed	-1.9%	-1.0%	-0.9%	+10.0%	➖ noise
28	duckdb:duckdb	+0.1%	-1.0%	+1.2%	+10.0%	➖ noise
28	duckdb:vortex-compact	-0.9%	-1.0%	+0.1%	+10.0%	➖ noise
28	duckdb:vortex-file-compressed	-1.3%	-1.0%	-0.2%	+10.0%	➖ noise
29	datafusion:vortex-compact	-1.9%	-0.3%	-1.6%	+10.0%	➖ noise
29	datafusion:vortex-file-compressed	-4.7%	-0.3%	-4.4%	+10.0%	➖ noise
29	duckdb:duckdb	-9.9%	-0.3%	-9.7%	+41.9%	➖ noise
29	duckdb:vortex-compact	-5.4%	-0.3%	-5.2%	+10.0%	➖ noise
29	duckdb:vortex-file-compressed	+1.4%	-0.3%	+1.7%	+10.2%	➖ noise
30	datafusion:vortex-compact	-2.9%	-3.3%	+0.4%	+10.0%	➖ noise
30	datafusion:vortex-file-compressed	-4.7%	-3.3%	-1.4%	+10.0%	➖ noise
30	duckdb:duckdb	+0.6%	-3.3%	+4.0%	+10.0%	➖ noise
30	duckdb:vortex-compact	-3.3%	-3.3%	+0.0%	+17.7%	➖ noise
30	duckdb:vortex-file-compressed	-4.6%	-3.3%	-1.3%	+10.0%	➖ noise
31	datafusion:vortex-compact	-1.2%	-4.2%	+3.2%	+11.7%	➖ noise
31	datafusion:vortex-file-compressed	-2.2%	-4.2%	+2.1%	+10.0%	➖ noise
31	duckdb:duckdb	-4.7%	-4.2%	-0.5%	+11.2%	➖ noise
31	duckdb:vortex-compact	-0.0%	-4.2%	+4.4%	+10.4%	➖ noise
31	duckdb:vortex-file-compressed	-1.6%	-4.2%	+2.8%	+12.2%	➖ noise
32	datafusion:vortex-compact	-1.8%	-6.2%	+4.7%	+13.7%	➖ noise
32	datafusion:vortex-file-compressed	+0.6%	-6.2%	+7.3%	+15.5%	➖ noise
32	duckdb:duckdb	-10.0%	-6.2%	-4.0%	+16.3%	➖ noise
32	duckdb:vortex-compact	-5.1%	-6.2%	+1.2%	+14.9%	➖ noise
32	duckdb:vortex-file-compressed	-1.5%	-6.2%	+5.1%	+13.9%	➖ noise
33	datafusion:vortex-compact	-1.5%	+0.5%	-1.9%	+10.0%	➖ noise
33	datafusion:vortex-file-compressed	-4.0%	+0.5%	-4.4%	+10.0%	➖ noise
33	duckdb:duckdb	-5.1%	+0.5%	-5.5%	+10.6%	➖ noise
33	duckdb:vortex-compact	-3.7%	+0.5%	-4.2%	+10.0%	➖ noise
33	duckdb:vortex-file-compressed	+3.9%	+0.5%	+3.4%	+10.0%	➖ noise
34	datafusion:vortex-compact	-2.0%	-3.4%	+1.4%	+10.0%	➖ noise
34	datafusion:vortex-file-compressed	-4.4%	-3.4%	-1.0%	+10.0%	➖ noise
34	duckdb:duckdb	-9.2%	-3.4%	-6.0%	+11.1%	➖ noise
34	duckdb:vortex-compact	-1.9%	-3.4%	+1.5%	+10.0%	➖ noise
34	duckdb:vortex-file-compressed	-2.0%	-3.4%	+1.4%	+10.0%	➖ noise
35	datafusion:vortex-compact	-6.5%	-0.1%	-6.4%	+10.0%	➖ noise
35	datafusion:vortex-file-compressed	-6.7%	-0.1%	-6.6%	+10.0%	➖ noise
35	duckdb:duckdb	+0.7%	-0.1%	+0.8%	+19.4%	➖ noise
35	duckdb:vortex-compact	-0.4%	-0.1%	-0.3%	+10.0%	➖ noise
35	duckdb:vortex-file-compressed	-5.8%	-0.1%	-5.7%	+10.0%	➖ noise
36	datafusion:vortex-compact	-1.9%	-2.0%	+0.1%	+10.0%	➖ noise
36	datafusion:vortex-file-compressed	-5.8%	-2.0%	-3.8%	+10.0%	➖ noise
36	duckdb:duckdb	-4.4%	-2.0%	-2.4%	+10.0%	➖ noise
36	duckdb:vortex-compact	+2.1%	-2.0%	+4.2%	+10.0%	➖ noise
36	duckdb:vortex-file-compressed	+3.2%	-2.0%	+5.4%	+12.4%	➖ noise
37	datafusion:vortex-compact	-0.3%	-4.9%	+4.8%	+11.6%	➖ noise
37	datafusion:vortex-file-compressed	-5.7%	-4.9%	-0.9%	+13.1%	➖ noise
37	duckdb:duckdb	-6.9%	-4.9%	-2.1%	+18.8%	➖ noise
37	duckdb:vortex-compact	+3.4%	-4.9%	+8.7%	+10.0%	➖ noise
37	duckdb:vortex-file-compressed	+3.2%	-4.9%	+8.5%	+10.0%	➖ noise
38	datafusion:vortex-compact	-3.8%	-0.7%	-3.1%	+17.8%	➖ noise
38	datafusion:vortex-file-compressed	-5.7%	-0.7%	-5.1%	+17.2%	➖ noise
38	duckdb:duckdb	-3.1%	-0.7%	-2.4%	+18.9%	➖ noise
38	duckdb:vortex-compact	+2.2%	-0.7%	+2.9%	+21.8%	➖ noise
38	duckdb:vortex-file-compressed	-7.4%	-0.7%	-6.8%	+19.4%	➖ noise
39	datafusion:vortex-compact	-5.1%	-2.4%	-2.7%	+13.4%	➖ noise
39	datafusion:vortex-file-compressed	-2.4%	-2.4%	-0.0%	+10.0%	➖ noise
39	duckdb:duckdb	-0.7%	-2.4%	+1.7%	+19.0%	➖ noise
39	duckdb:vortex-compact	-5.3%	-2.4%	-2.9%	+20.8%	➖ noise
39	duckdb:vortex-file-compressed	-0.3%	-2.4%	+2.2%	+11.1%	➖ noise
40	datafusion:vortex-compact	-0.7%	-0.2%	-0.5%	+10.0%	➖ noise
40	datafusion:vortex-file-compressed	-2.6%	-0.2%	-2.4%	+10.0%	➖ noise
40	duckdb:duckdb	-2.2%	-0.2%	-2.0%	+18.3%	➖ noise
40	duckdb:vortex-compact	-2.3%	-0.2%	-2.1%	+10.0%	➖ noise
40	duckdb:vortex-file-compressed	+7.2%	-0.2%	+7.5%	+16.8%	➖ noise
41	datafusion:vortex-compact	-6.9%	-4.7%	-2.3%	+10.0%	➖ noise
41	datafusion:vortex-file-compressed	-3.4%	-4.7%	+1.4%	+10.0%	➖ noise
41	duckdb:duckdb	-4.3%	-4.7%	+0.5%	+10.0%	➖ noise
41	duckdb:vortex-compact	+1.3%	-4.7%	+6.3%	+10.0%	➖ noise
41	duckdb:vortex-file-compressed	-4.8%	-4.7%	-0.1%	+10.0%	➖ noise
42	datafusion:vortex-compact	-4.7%	-4.1%	-0.6%	+10.0%	➖ noise
42	datafusion:vortex-file-compressed	-3.0%	-4.1%	+1.2%	+10.8%	➖ noise
42	duckdb:duckdb	-10.0%	-4.1%	-6.1%	+13.8%	➖ noise
42	duckdb:vortex-compact	+0.2%	-4.1%	+4.5%	+10.1%	➖ noise
42	duckdb:vortex-file-compressed	-6.8%	-4.1%	-2.8%	+13.3%	➖ noise
43	datafusion:vortex-compact	-3.7%	-5.4%	+1.9%	+10.0%	➖ noise
43	datafusion:vortex-file-compressed	-3.0%	-5.4%	+2.5%	+10.0%	➖ noise
43	duckdb:duckdb	-3.4%	-5.4%	+2.1%	+11.8%	➖ noise
43	duckdb:vortex-compact	-3.0%	-5.4%	+2.6%	+14.7%	➖ noise
43	duckdb:vortex-file-compressed	-14.9%	-5.4%	-10.0%	+15.8%	➖ noise
44	datafusion:vortex-compact	-5.7%	-3.4%	-2.5%	+10.0%	➖ noise
44	datafusion:vortex-file-compressed	+0.3%	-3.4%	+3.8%	+15.3%	➖ noise
44	duckdb:duckdb	-3.7%	-3.4%	-0.3%	+12.7%	➖ noise
44	duckdb:vortex-compact	+3.3%	-3.4%	+6.9%	+10.0%	➖ noise
44	duckdb:vortex-file-compressed	+2.4%	-3.4%	+6.0%	+10.0%	➖ noise
45	datafusion:vortex-compact	-3.6%	-1.1%	-2.6%	+10.0%	➖ noise
45	datafusion:vortex-file-compressed	-2.2%	-1.1%	-1.1%	+10.0%	➖ noise
45	duckdb:duckdb	-4.2%	-1.1%	-3.2%	+10.2%	➖ noise
45	duckdb:vortex-compact	-2.3%	-1.1%	-1.2%	+14.3%	➖ noise
45	duckdb:vortex-file-compressed	-5.5%	-1.1%	-4.5%	+11.2%	➖ noise
46	datafusion:vortex-compact	+2.0%	+0.4%	+1.6%	+10.0%	➖ noise
46	datafusion:vortex-file-compressed	+0.9%	+0.4%	+0.5%	+10.0%	➖ noise
46	duckdb:duckdb	-7.7%	+0.4%	-8.0%	+10.0%	➖ noise
46	duckdb:vortex-compact	-1.6%	+0.4%	-2.0%	+10.0%	➖ noise
46	duckdb:vortex-file-compressed	+0.5%	+0.4%	+0.1%	+10.0%	➖ noise
47	datafusion:vortex-compact	-4.8%	-1.0%	-3.9%	+10.0%	➖ noise
47	datafusion:vortex-file-compressed	-3.5%	-1.0%	-2.6%	+10.0%	➖ noise
47	duckdb:duckdb	-1.9%	-1.0%	-0.9%	+10.0%	➖ noise
47	duckdb:vortex-compact	-1.8%	-1.0%	-0.8%	+10.0%	➖ noise
47	duckdb:vortex-file-compressed	-3.3%	-1.0%	-2.3%	+10.0%	➖ noise
48	datafusion:vortex-compact	-1.8%	-0.8%	-1.1%	+13.2%	➖ noise
48	datafusion:vortex-file-compressed	-5.2%	-0.8%	-4.4%	+10.0%	➖ noise
48	duckdb:duckdb	-1.0%	-0.8%	-0.2%	+10.0%	➖ noise
48	duckdb:vortex-compact	-0.4%	-0.8%	+0.4%	+12.0%	➖ noise
48	duckdb:vortex-file-compressed	+0.6%	-0.8%	+1.5%	+10.0%	➖ noise
49	datafusion:vortex-compact	-4.4%	+0.9%	-5.2%	+10.0%	➖ noise
49	datafusion:vortex-file-compressed	-2.6%	+0.9%	-3.5%	+10.0%	➖ noise
49	duckdb:duckdb	+1.2%	+0.9%	+0.3%	+14.8%	➖ noise
49	duckdb:vortex-compact	+2.1%	+0.9%	+1.3%	+13.5%	➖ noise
49	duckdb:vortex-file-compressed	+11.4%	+0.9%	+10.5%	+23.1%	➖ noise
50	datafusion:vortex-compact	+0.5%	-0.5%	+1.0%	+10.0%	➖ noise
50	datafusion:vortex-file-compressed	-3.0%	-0.5%	-2.5%	+10.0%	➖ noise
50	duckdb:duckdb	-3.7%	-0.5%	-3.2%	+10.0%	➖ noise
50	duckdb:vortex-compact	+1.8%	-0.5%	+2.4%	+10.0%	➖ noise
50	duckdb:vortex-file-compressed	-1.2%	-0.5%	-0.7%	+10.0%	➖ noise
51	datafusion:vortex-compact	-2.4%	-2.2%	-0.3%	+10.0%	➖ noise
51	datafusion:vortex-file-compressed	-0.0%	-2.2%	+2.2%	+10.1%	➖ noise
51	duckdb:duckdb	-3.8%	-2.2%	-1.6%	+16.0%	➖ noise
51	duckdb:vortex-compact	-2.1%	-2.2%	+0.1%	+16.1%	➖ noise
51	duckdb:vortex-file-compressed	+0.2%	-2.2%	+2.5%	+15.7%	➖ noise
52	datafusion:vortex-compact	-0.3%	-0.6%	+0.3%	+11.9%	➖ noise
52	datafusion:vortex-file-compressed	-3.4%	-0.6%	-2.8%	+13.3%	➖ noise
52	duckdb:duckdb	-2.6%	-0.6%	-2.1%	+20.6%	➖ noise
52	duckdb:vortex-compact	-1.7%	-0.6%	-1.1%	+10.0%	➖ noise
52	duckdb:vortex-file-compressed	-6.7%	-0.6%	-6.1%	+13.6%	➖ noise
53	datafusion:vortex-compact	-5.2%	-1.1%	-4.1%	+10.0%	➖ noise
53	datafusion:vortex-file-compressed	-2.0%	-1.1%	-0.9%	+10.0%	➖ noise
53	duckdb:duckdb	-0.8%	-1.1%	+0.3%	+10.4%	➖ noise
53	duckdb:vortex-compact	-3.8%	-1.1%	-2.7%	+14.1%	➖ noise
53	duckdb:vortex-file-compressed	+1.1%	-1.1%	+2.3%	+10.0%	➖ noise
54	datafusion:vortex-compact	-0.9%	-4.8%	+4.0%	+10.0%	➖ noise
54	datafusion:vortex-file-compressed	-0.7%	-4.8%	+4.3%	+10.0%	➖ noise
54	duckdb:duckdb	-2.3%	-4.8%	+2.6%	+10.0%	➖ noise
54	duckdb:vortex-compact	+0.3%	-4.8%	+5.3%	+10.6%	➖ noise
54	duckdb:vortex-file-compressed	-0.8%	-4.8%	+4.1%	+10.0%	➖ noise
55	datafusion:vortex-compact	-2.4%	-2.5%	+0.1%	+10.7%	➖ noise
55	datafusion:vortex-file-compressed	-4.1%	-2.5%	-1.6%	+10.0%	➖ noise
55	duckdb:duckdb	-5.1%	-2.5%	-2.7%	+16.0%	➖ noise
55	duckdb:vortex-compact	-0.7%	-2.5%	+1.9%	+10.0%	➖ noise
55	duckdb:vortex-file-compressed	-6.7%	-2.5%	-4.2%	+14.2%	➖ noise
56	datafusion:vortex-compact	-0.6%	-1.8%	+1.2%	+10.0%	➖ noise
56	datafusion:vortex-file-compressed	-2.9%	-1.8%	-1.1%	+10.0%	➖ noise
56	duckdb:duckdb	-7.7%	-1.8%	-6.0%	+10.7%	➖ noise
56	duckdb:vortex-compact	-2.3%	-1.8%	-0.5%	+10.0%	➖ noise
56	duckdb:vortex-file-compressed	-4.7%	-1.8%	-3.0%	+19.5%	➖ noise
57	datafusion:vortex-compact	-4.4%	-0.7%	-3.7%	+10.0%	➖ noise
57	datafusion:vortex-file-compressed	+0.3%	-0.7%	+1.0%	+10.0%	➖ noise
57	duckdb:duckdb	+0.4%	-0.7%	+1.1%	+10.0%	➖ noise
57	duckdb:vortex-compact	-1.3%	-0.7%	-0.6%	+11.2%	➖ noise
57	duckdb:vortex-file-compressed	-0.2%	-0.7%	+0.5%	+10.0%	➖ noise
58	datafusion:vortex-compact	-3.1%	+0.1%	-3.3%	+10.0%	➖ noise
58	datafusion:vortex-file-compressed	-2.1%	+0.1%	-2.2%	+12.4%	➖ noise
58	duckdb:duckdb	-6.8%	+0.1%	-6.9%	+17.2%	➖ noise
58	duckdb:vortex-compact	+12.2%	+0.1%	+12.1%	+16.0%	➖ noise
58	duckdb:vortex-file-compressed	-0.3%	+0.1%	-0.4%	+10.0%	➖ noise
59	datafusion:vortex-compact	-3.4%	-0.3%	-3.1%	+10.0%	➖ noise
59	datafusion:vortex-file-compressed	-1.6%	-0.3%	-1.3%	+11.0%	➖ noise
59	duckdb:duckdb	-2.7%	-0.3%	-2.4%	+10.0%	➖ noise
59	duckdb:vortex-compact	-4.3%	-0.3%	-4.0%	+11.7%	➖ noise
59	duckdb:vortex-file-compressed	-1.6%	-0.3%	-1.3%	+10.0%	➖ noise
60	datafusion:vortex-compact	-4.1%	+0.6%	-4.7%	+10.0%	➖ noise
60	datafusion:vortex-file-compressed	-2.5%	+0.6%	-3.1%	+10.0%	➖ noise
60	duckdb:duckdb	-7.1%	+0.6%	-7.7%	+10.6%	➖ noise
60	duckdb:vortex-compact	+0.9%	+0.6%	+0.3%	+13.0%	➖ noise
60	duckdb:vortex-file-compressed	-4.2%	+0.6%	-4.8%	+14.7%	➖ noise
61	datafusion:vortex-compact	-0.7%	-1.4%	+0.6%	+10.0%	➖ noise
61	datafusion:vortex-file-compressed	-4.3%	-1.4%	-2.9%	+10.0%	➖ noise
61	duckdb:duckdb	-5.0%	-1.4%	-3.7%	+10.0%	➖ noise
61	duckdb:vortex-compact	-0.6%	-1.4%	+0.8%	+12.0%	➖ noise
61	duckdb:vortex-file-compressed	+17.5%	-1.4%	+19.2%	+17.9%	🚨 regression
62	datafusion:vortex-compact	+0.2%	+13.4%	-11.6%	+26.7%	➖ noise
62	datafusion:vortex-file-compressed	-4.1%	+13.4%	-15.4%	+27.6%	➖ noise
62	duckdb:duckdb	-8.0%	+13.4%	-18.9%	+16.5%	✅ faster
62	duckdb:vortex-compact	-1.1%	+13.4%	-12.8%	+20.8%	➖ noise
62	duckdb:vortex-file-compressed	-1.7%	+13.4%	-13.3%	+18.2%	➖ noise
63	datafusion:vortex-compact	-0.2%	-0.8%	+0.6%	+12.4%	➖ noise
63	datafusion:vortex-file-compressed	+0.7%	-0.8%	+1.6%	+10.8%	➖ noise
63	duckdb:duckdb	-6.1%	-0.8%	-5.3%	+10.0%	➖ noise
63	duckdb:vortex-compact	-2.2%	-0.8%	-1.4%	+10.0%	➖ noise
63	duckdb:vortex-file-compressed	+0.6%	-0.8%	+1.5%	+10.0%	➖ noise
64	datafusion:vortex-compact	-1.8%	-1.7%	-0.1%	+10.0%	➖ noise
64	datafusion:vortex-file-compressed	-4.3%	-1.7%	-2.6%	+10.0%	➖ noise
64	duckdb:duckdb	-5.0%	-1.7%	-3.4%	+10.0%	➖ noise
64	duckdb:vortex-compact	-0.7%	-1.7%	+0.9%	+10.0%	➖ noise
64	duckdb:vortex-file-compressed	-3.3%	-1.7%	-1.7%	+10.1%	➖ noise
65	datafusion:vortex-compact	+1.4%	-1.3%	+2.8%	+10.0%	➖ noise
65	datafusion:vortex-file-compressed	-1.5%	-1.3%	-0.2%	+22.2%	➖ noise
65	duckdb:duckdb	-2.4%	-1.3%	-1.1%	+14.5%	➖ noise
65	duckdb:vortex-compact	-1.7%	-1.3%	-0.3%	+12.6%	➖ noise
65	duckdb:vortex-file-compressed	+0.6%	-1.3%	+2.0%	+36.8%	➖ noise
66	datafusion:vortex-compact	-1.9%	+0.5%	-2.4%	+10.0%	➖ noise
66	datafusion:vortex-file-compressed	-2.9%	+0.5%	-3.4%	+10.0%	➖ noise
66	duckdb:duckdb	-2.2%	+0.5%	-2.7%	+11.2%	➖ noise
66	duckdb:vortex-compact	-5.3%	+0.5%	-5.8%	+15.0%	➖ noise
66	duckdb:vortex-file-compressed	-1.0%	+0.5%	-1.5%	+10.2%	➖ noise
67	datafusion:vortex-compact	-3.8%	-2.6%	-1.2%	+10.8%	➖ noise
67	datafusion:vortex-file-compressed	-6.3%	-2.6%	-3.8%	+10.0%	➖ noise
67	duckdb:duckdb	-2.4%	-2.6%	+0.2%	+10.0%	➖ noise
67	duckdb:vortex-compact	-0.7%	-2.6%	+2.0%	+10.0%	➖ noise
67	duckdb:vortex-file-compressed	-0.7%	-2.6%	+2.0%	+10.0%	➖ noise
68	datafusion:vortex-compact	-2.7%	-1.3%	-1.4%	+10.0%	➖ noise
68	datafusion:vortex-file-compressed	-9.2%	-1.3%	-8.0%	+10.0%	➖ noise
68	duckdb:duckdb	-1.5%	-1.3%	-0.2%	+10.0%	➖ noise
68	duckdb:vortex-compact	-1.4%	-1.3%	-0.0%	+10.0%	➖ noise
68	duckdb:vortex-file-compressed	-5.5%	-1.3%	-4.3%	+11.1%	➖ noise
69	datafusion:vortex-compact	-2.0%	-2.7%	+0.7%	+15.9%	➖ noise
69	datafusion:vortex-file-compressed	-9.2%	-2.7%	-6.6%	+10.0%	➖ noise
69	duckdb:duckdb	-2.3%	-2.7%	+0.5%	+10.1%	➖ noise
69	duckdb:vortex-compact	-2.3%	-2.7%	+0.4%	+10.0%	➖ noise
69	duckdb:vortex-file-compressed	+0.3%	-2.7%	+3.1%	+10.7%	➖ noise
70	datafusion:vortex-compact	-7.8%	-0.9%	-7.0%	+10.0%	➖ noise
70	datafusion:vortex-file-compressed	-8.6%	-0.9%	-7.7%	+10.0%	➖ noise
70	duckdb:duckdb	-5.2%	-0.9%	-4.3%	+11.2%	➖ noise
70	duckdb:vortex-compact	-1.4%	-0.9%	-0.5%	+10.0%	➖ noise
70	duckdb:vortex-file-compressed	+2.9%	-0.9%	+3.8%	+10.3%	➖ noise
71	datafusion:vortex-compact	+0.5%	+0.1%	+0.4%	+10.0%	➖ noise
71	datafusion:vortex-file-compressed	-4.4%	+0.1%	-4.5%	+21.0%	➖ noise
71	duckdb:duckdb	-0.2%	+0.1%	-0.3%	+16.5%	➖ noise
71	duckdb:vortex-compact	-0.1%	+0.1%	-0.2%	+10.4%	➖ noise
71	duckdb:vortex-file-compressed	-1.1%	+0.1%	-1.2%	+10.0%	➖ noise
72	datafusion:vortex-compact	-2.8%	-1.1%	-1.7%	+10.0%	➖ noise
72	datafusion:vortex-file-compressed	-16.9%	-1.1%	-16.0%	+10.6%	✅ faster
72	duckdb:duckdb	-3.0%	-1.1%	-1.9%	+11.1%	➖ noise
72	duckdb:vortex-compact	-0.9%	-1.1%	+0.3%	+10.0%	➖ noise
72	duckdb:vortex-file-compressed	+0.1%	-1.1%	+1.3%	+10.0%	➖ noise
73	datafusion:vortex-compact	-1.5%	-3.9%	+2.5%	+10.0%	➖ noise
73	datafusion:vortex-file-compressed	+1.1%	-3.9%	+5.2%	+18.8%	➖ noise
73	duckdb:duckdb	+1.9%	-3.9%	+6.0%	+13.5%	➖ noise
73	duckdb:vortex-compact	-0.8%	-3.9%	+3.2%	+10.7%	➖ noise
73	duckdb:vortex-file-compressed	-3.2%	-3.9%	+0.7%	+24.7%	➖ noise
74	datafusion:vortex-compact	+3.5%	-0.4%	+3.9%	+13.2%	➖ noise
74	datafusion:vortex-file-compressed	-9.1%	-0.4%	-8.7%	+10.0%	➖ noise
74	duckdb:duckdb	-1.7%	-0.4%	-1.4%	+10.0%	➖ noise
74	duckdb:vortex-compact	-8.8%	-0.4%	-8.5%	+27.2%	➖ noise
74	duckdb:vortex-file-compressed	-22.1%	-0.4%	-21.8%	+22.7%	✅ faster
75	datafusion:vortex-compact	+1.1%	-2.6%	+3.8%	+10.0%	➖ noise
75	datafusion:vortex-file-compressed	-3.3%	-2.6%	-0.7%	+10.0%	➖ noise
75	duckdb:duckdb	-0.8%	-2.6%	+1.8%	+10.4%	➖ noise
75	duckdb:vortex-compact	-2.8%	-2.6%	-0.2%	+10.0%	➖ noise
75	duckdb:vortex-file-compressed	-2.8%	-2.6%	-0.2%	+13.6%	➖ noise
76	datafusion:vortex-compact	-0.3%	-2.5%	+2.2%	+11.1%	➖ noise
76	datafusion:vortex-file-compressed	-7.0%	-2.5%	-4.7%	+22.6%	➖ noise
76	duckdb:duckdb	-0.2%	-2.5%	+2.3%	+15.1%	➖ noise
76	duckdb:vortex-compact	-5.9%	-2.5%	-3.5%	+10.3%	➖ noise
76	duckdb:vortex-file-compressed	-4.5%	-2.5%	-2.1%	+10.1%	➖ noise
77	datafusion:vortex-compact	-0.8%	-0.8%	-0.0%	+12.2%	➖ noise
77	datafusion:vortex-file-compressed	-4.4%	-0.8%	-3.7%	+16.2%	➖ noise
77	duckdb:duckdb	-6.5%	-0.8%	-5.8%	+12.4%	➖ noise
77	duckdb:vortex-compact	-8.4%	-0.8%	-7.6%	+14.4%	➖ noise
77	duckdb:vortex-file-compressed	-0.4%	-0.8%	+0.4%	+18.7%	➖ noise
78	datafusion:vortex-compact	-0.3%	+1.2%	-1.5%	+10.0%	➖ noise
78	datafusion:vortex-file-compressed	-3.2%	+1.2%	-4.3%	+10.0%	➖ noise
78	duckdb:duckdb	-4.0%	+1.2%	-5.2%	+10.0%	➖ noise
78	duckdb:vortex-compact	+1.1%	+1.2%	-0.1%	+11.8%	➖ noise
78	duckdb:vortex-file-compressed	+4.6%	+1.2%	+3.4%	+10.0%	➖ noise
79	datafusion:vortex-compact	+0.3%	-1.3%	+1.6%	+10.9%	➖ noise
79	datafusion:vortex-file-compressed	-4.0%	-1.3%	-2.8%	+10.0%	➖ noise
79	duckdb:duckdb	-5.4%	-1.3%	-4.1%	+10.0%	➖ noise
79	duckdb:vortex-compact	-5.9%	-1.3%	-4.7%	+10.0%	➖ noise
79	duckdb:vortex-file-compressed	-5.3%	-1.3%	-4.1%	+17.6%	➖ noise
80	datafusion:vortex-compact	-2.5%	+1.2%	-3.6%	+10.0%	➖ noise
80	datafusion:vortex-file-compressed	-7.8%	+1.2%	-8.9%	+10.3%	➖ noise
80	duckdb:duckdb	-7.3%	+1.2%	-8.3%	+11.4%	➖ noise
80	duckdb:vortex-compact	-1.3%	+1.2%	-2.5%	+15.8%	➖ noise
80	duckdb:vortex-file-compressed	-6.5%	+1.2%	-7.6%	+17.1%	➖ noise
81	datafusion:vortex-compact	+1.1%	-1.0%	+2.2%	+17.2%	➖ noise
81	datafusion:vortex-file-compressed	-4.5%	-1.0%	-3.5%	+10.0%	➖ noise
81	duckdb:duckdb	-4.1%	-1.0%	-3.1%	+10.1%	➖ noise
81	duckdb:vortex-compact	-9.4%	-1.0%	-8.5%	+14.7%	➖ noise
81	duckdb:vortex-file-compressed	-7.3%	-1.0%	-6.3%	+10.7%	➖ noise
82	datafusion:vortex-compact	-0.2%	-1.3%	+1.1%	+10.0%	➖ noise
82	datafusion:vortex-file-compressed	-1.7%	-1.3%	-0.4%	+10.0%	➖ noise
82	duckdb:duckdb	-12.3%	-1.3%	-11.1%	+12.9%	➖ noise
82	duckdb:vortex-compact	-7.5%	-1.3%	-6.3%	+10.0%	➖ noise
82	duckdb:vortex-file-compressed	-4.5%	-1.3%	-3.3%	+10.0%	➖ noise
83	datafusion:vortex-compact	+1.2%	-0.2%	+1.4%	+10.0%	➖ noise
83	datafusion:vortex-file-compressed	-3.7%	-0.2%	-3.5%	+12.7%	➖ noise
83	duckdb:duckdb	-7.5%	-0.2%	-7.3%	+13.2%	➖ noise
83	duckdb:vortex-compact	-7.6%	-0.2%	-7.5%	+22.4%	➖ noise
83	duckdb:vortex-file-compressed	-3.1%	-0.2%	-3.0%	+11.6%	➖ noise
84	datafusion:vortex-compact	-0.2%	+0.1%	-0.3%	+10.0%	➖ noise
84	datafusion:vortex-file-compressed	-2.9%	+0.1%	-3.1%	+10.0%	➖ noise
84	duckdb:duckdb	-7.3%	+0.1%	-7.4%	+10.0%	➖ noise
84	duckdb:vortex-compact	-8.0%	+0.1%	-8.1%	+12.8%	➖ noise
84	duckdb:vortex-file-compressed	-4.4%	+0.1%	-4.5%	+10.0%	➖ noise
85	datafusion:vortex-compact	-3.1%	-2.3%	-0.8%	+11.7%	➖ noise
85	datafusion:vortex-file-compressed	-2.5%	-2.3%	-0.2%	+10.0%	➖ noise
85	duckdb:duckdb	-0.6%	-2.3%	+1.7%	+10.0%	➖ noise
85	duckdb:vortex-compact	-9.9%	-2.3%	-7.8%	+10.4%	➖ noise
85	duckdb:vortex-file-compressed	-4.2%	-2.3%	-2.0%	+10.0%	➖ noise
86	datafusion:vortex-compact	+20.5%	+0.4%	+20.1%	+17.5%	🚨 regression
86	datafusion:vortex-file-compressed	-10.8%	+0.4%	-11.1%	+13.5%	➖ noise
86	duckdb:duckdb	-6.2%	+0.4%	-6.5%	+10.9%	➖ noise
86	duckdb:vortex-compact	-2.5%	+0.4%	-2.8%	+10.0%	➖ noise
86	duckdb:vortex-file-compressed	+3.7%	+0.4%	+3.3%	+11.3%	➖ noise
87	datafusion:vortex-compact	-3.4%	-2.2%	-1.2%	+10.0%	➖ noise
87	datafusion:vortex-file-compressed	-3.5%	-2.2%	-1.3%	+10.0%	➖ noise
87	duckdb:duckdb	+0.8%	-2.2%	+3.0%	+10.0%	➖ noise
87	duckdb:vortex-compact	-6.7%	-2.2%	-4.6%	+13.1%	➖ noise
87	duckdb:vortex-file-compressed	-1.5%	-2.2%	+0.7%	+11.9%	➖ noise
88	datafusion:vortex-compact	-0.3%	-1.4%	+1.2%	+10.0%	➖ noise
88	datafusion:vortex-file-compressed	-7.0%	-1.4%	-5.6%	+10.0%	➖ noise
88	duckdb:duckdb	-2.4%	-1.4%	-1.0%	+10.0%	➖ noise
88	duckdb:vortex-compact	-2.4%	-1.4%	-1.0%	+10.0%	➖ noise
88	duckdb:vortex-file-compressed	-3.0%	-1.4%	-1.6%	+10.0%	➖ noise
89	datafusion:vortex-compact	-5.9%	+3.4%	-9.0%	+15.6%	➖ noise
89	datafusion:vortex-file-compressed	-2.3%	+3.4%	-5.5%	+14.3%	➖ noise
89	duckdb:duckdb	-4.1%	+3.4%	-7.3%	+12.8%	➖ noise
89	duckdb:vortex-compact	-0.9%	+3.4%	-4.2%	+10.0%	➖ noise
89	duckdb:vortex-file-compressed	+3.5%	+3.4%	+0.1%	+12.5%	➖ noise
90	datafusion:vortex-compact	-0.1%	-0.9%	+0.8%	+10.0%	➖ noise
90	datafusion:vortex-file-compressed	-7.2%	-0.9%	-6.4%	+10.0%	➖ noise
90	duckdb:duckdb	-4.5%	-0.9%	-3.7%	+13.6%	➖ noise
90	duckdb:vortex-compact	-4.2%	-0.9%	-3.3%	+11.3%	➖ noise
90	duckdb:vortex-file-compressed	-6.7%	-0.9%	-5.9%	+11.2%	➖ noise
91	datafusion:vortex-compact	+3.3%	-4.2%	+7.8%	+10.0%	➖ noise
91	datafusion:vortex-file-compressed	-5.8%	-4.2%	-1.7%	+10.0%	➖ noise
91	duckdb:duckdb	-9.2%	-4.2%	-5.2%	+10.0%	➖ noise
91	duckdb:vortex-compact	-1.4%	-4.2%	+2.9%	+10.0%	➖ noise
91	duckdb:vortex-file-compressed	+1.8%	-4.2%	+6.2%	+10.0%	➖ noise
92	datafusion:vortex-compact	+0.3%	-7.5%	+8.5%	+17.6%	➖ noise
92	datafusion:vortex-file-compressed	-1.4%	-7.5%	+6.6%	+11.0%	➖ noise
92	duckdb:duckdb	-7.1%	-7.5%	+0.4%	+12.8%	➖ noise
92	duckdb:vortex-compact	-5.7%	-7.5%	+1.9%	+19.8%	➖ noise
92	duckdb:vortex-file-compressed	-14.9%	-7.5%	-8.0%	+23.1%	➖ noise
93	datafusion:vortex-compact	-0.4%	+2.1%	-2.4%	+10.0%	➖ noise
93	datafusion:vortex-file-compressed	-1.1%	+2.1%	-3.1%	+10.0%	➖ noise
93	duckdb:duckdb	-8.3%	+2.1%	-10.2%	+10.7%	✅ faster
93	duckdb:vortex-compact	-2.6%	+2.1%	-4.5%	+11.6%	➖ noise
93	duckdb:vortex-file-compressed	-5.4%	+2.1%	-7.3%	+14.2%	➖ noise
94	datafusion:vortex-compact	+8.4%	-9.6%	+19.9%	+10.7%	🚨 regression
94	datafusion:vortex-file-compressed	-5.1%	-9.6%	+5.0%	+10.4%	➖ noise
94	duckdb:duckdb	+1.8%	-9.6%	+12.7%	+11.0%	🚨 regression
94	duckdb:vortex-compact	-4.2%	-9.6%	+6.0%	+13.7%	➖ noise
94	duckdb:vortex-file-compressed	-4.0%	-9.6%	+6.2%	+13.5%	➖ noise
95	datafusion:vortex-compact	-6.2%	-0.3%	-5.9%	+12.3%	➖ noise
95	datafusion:vortex-file-compressed	-4.5%	-0.3%	-4.3%	+13.0%	➖ noise
95	duckdb:duckdb	+3.5%	-0.3%	+3.8%	+20.8%	➖ noise
95	duckdb:vortex-compact	-2.9%	-0.3%	-2.6%	+15.1%	➖ noise
95	duckdb:vortex-file-compressed	+6.3%	-0.3%	+6.6%	+17.2%	➖ noise
96	datafusion:vortex-compact	+0.6%	-1.1%	+1.7%	+10.0%	➖ noise
96	datafusion:vortex-file-compressed	-3.7%	-1.1%	-2.6%	+12.5%	➖ noise
96	duckdb:duckdb	-12.2%	-1.1%	-11.2%	+13.8%	➖ noise
96	duckdb:vortex-compact	-0.6%	-1.1%	+0.5%	+15.6%	➖ noise
96	duckdb:vortex-file-compressed	-2.2%	-1.1%	-1.1%	+18.7%	➖ noise
97	datafusion:vortex-compact	+7.3%	-1.0%	+8.4%	+10.0%	➖ noise
97	datafusion:vortex-file-compressed	-2.2%	-1.0%	-1.2%	+10.0%	➖ noise
97	duckdb:duckdb	-0.3%	-1.0%	+0.6%	+16.6%	➖ noise
97	duckdb:vortex-compact	-7.3%	-1.0%	-6.4%	+11.6%	➖ noise
97	duckdb:vortex-file-compressed	-5.1%	-1.0%	-4.2%	+12.5%	➖ noise
98	datafusion:vortex-compact	-2.8%	-2.8%	-0.0%	+10.0%	➖ noise
98	datafusion:vortex-file-compressed	-1.4%	-2.8%	+1.5%	+10.0%	➖ noise
98	duckdb:duckdb	+2.3%	-2.8%	+5.3%	+15.1%	➖ noise
98	duckdb:vortex-compact	-1.2%	-2.8%	+1.7%	+10.0%	➖ noise
98	duckdb:vortex-file-compressed	-1.1%	-2.8%	+1.7%	+10.0%	➖ noise
99	datafusion:vortex-compact	-11.9%	+5.0%	-16.1%	+25.5%	➖ noise
99	datafusion:vortex-file-compressed	-14.2%	+5.0%	-18.3%	+24.9%	➖ noise
99	duckdb:duckdb	-6.9%	+5.0%	-11.3%	+18.6%	➖ noise
99	duckdb:vortex-compact	-2.6%	+5.0%	-7.2%	+24.5%	➖ noise
99	duckdb:vortex-file-compressed	-2.9%	+5.0%	-7.5%	+26.0%	➖ noise

github-actions · 2026-05-06T22:42:58Z

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

github-actions · 2026-05-06T22:46:09Z

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.9%
Vortex (geomean): 1.027x ➖
Parquet (geomean): 0.943x ➖
Shifts: Parquet (control) -5.7% · Median polish +0.9%

datafusion / vortex-file-compressed (0.976x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed	32749156	39770585	0.82
fineweb_q01/datafusion:vortex-file-compressed	582703521	576462037	1.01
fineweb_q02/datafusion:vortex-file-compressed	492076174	487461392	1.01
fineweb_q03/datafusion:vortex-file-compressed	1380136402	1397919483	0.99
fineweb_q04/datafusion:vortex-file-compressed	1381916609	1372760924	1.01
fineweb_q05/datafusion:vortex-file-compressed	1356103425	1416250750	0.96
fineweb_q06/datafusion:vortex-file-compressed	1506063674	1535539363	0.98
fineweb_q07/datafusion:vortex-file-compressed	1344114350	1403939983	0.96
fineweb_q08/datafusion:vortex-file-compressed	536126780	501067459	1.07

datafusion / vortex-compact (1.115x ➖, 0↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact	36352224	35479616	1.02
fineweb_q01/datafusion:vortex-compact 🚨	834935479	517095390	1.61
fineweb_q02/datafusion:vortex-compact	627463416	513413174	1.22
fineweb_q03/datafusion:vortex-compact	1501697190	1497333743	1.00
fineweb_q04/datafusion:vortex-compact	1803344852	1722511149	1.05
fineweb_q05/datafusion:vortex-compact	1488170930	1430143086	1.04
fineweb_q06/datafusion:vortex-compact	1371867898	1389300519	0.99
fineweb_q07/datafusion:vortex-compact	1340493250	1134328004	1.18
fineweb_q08/datafusion:vortex-compact	410685326	398432520	1.03

datafusion / parquet (0.910x ➖, 1↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	1330870257	1652969514	0.81
fineweb_q01/datafusion:parquet	1926092974	1841362594	1.05
fineweb_q02/datafusion:parquet	1878934686	1767989932	1.06
fineweb_q03/datafusion:parquet	1901257235	1779915853	1.07
fineweb_q04/datafusion:parquet	1825648377	1991414785	0.92
fineweb_q05/datafusion:parquet	1754672096	2258548474	0.78
fineweb_q06/datafusion:parquet	1877472116	1950534654	0.96
fineweb_q07/datafusion:parquet 🚀	1845665631	2673025061	0.69
fineweb_q08/datafusion:parquet	1859007268	1974993484	0.94

duckdb / vortex-file-compressed (0.970x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	87217194	84656123	1.03
fineweb_q01/duckdb:vortex-file-compressed	564828399	587505540	0.96
fineweb_q02/duckdb:vortex-file-compressed	447773976	611856046	0.73
fineweb_q03/duckdb:vortex-file-compressed	1534281108	1451420057	1.06
fineweb_q04/duckdb:vortex-file-compressed	1564955281	1526194833	1.03
fineweb_q05/duckdb:vortex-file-compressed	1572922126	1445895730	1.09
fineweb_q06/duckdb:vortex-file-compressed	1723545699	1646146636	1.05
fineweb_q07/duckdb:vortex-file-compressed	1449564248	1414215592	1.02
fineweb_q08/duckdb:vortex-file-compressed	609043716	736725821	0.83

duckdb / vortex-compact (1.056x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact	89033866	85895370	1.04
fineweb_q01/duckdb:vortex-compact	599810938	554288184	1.08
fineweb_q02/duckdb:vortex-compact	576393267	570980971	1.01
fineweb_q03/duckdb:vortex-compact	1716029572	1580337661	1.09
fineweb_q04/duckdb:vortex-compact	1887693059	1748557591	1.08
fineweb_q05/duckdb:vortex-compact	1597516976	1449960215	1.10
fineweb_q06/duckdb:vortex-compact	1550903451	1408594959	1.10
fineweb_q07/duckdb:vortex-compact	1434826671	1340544358	1.07
fineweb_q08/duckdb:vortex-compact	473356543	497500808	0.95

duckdb / parquet (0.978x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	1122745703	1178489125	0.95
fineweb_q01/duckdb:parquet	1305690331	1434803290	0.91
fineweb_q02/duckdb:parquet	1341271345	1353057758	0.99
fineweb_q03/duckdb:parquet	3732926575	3946915358	0.95
fineweb_q04/duckdb:parquet	1923423591	1871136269	1.03
fineweb_q05/duckdb:parquet	2140742488	2088846129	1.02
fineweb_q06/duckdb:parquet	4286505340	4525604815	0.95
fineweb_q07/duckdb:parquet	2651805917	2578457445	1.03
fineweb_q08/duckdb:parquet	1106809151	1122949480	0.99

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	+2.5%	-12.4%	+17.0%	+166.7%	➖ noise
0	datafusion:vortex-file-compressed	-17.7%	-12.4%	-6.0%	+138.5%	➖ noise
0	duckdb:vortex-compact	+3.7%	-12.4%	+18.4%	+83.1%	➖ noise
0	duckdb:vortex-file-compressed	+3.0%	-12.4%	+17.6%	+40.9%	➖ noise
1	datafusion:vortex-compact	+61.5%	-2.4%	+65.5%	+64.8%	🚨 regression
1	datafusion:vortex-file-compressed	+1.1%	-2.4%	+3.6%	+69.5%	➖ noise
1	duckdb:vortex-compact	+8.2%	-2.4%	+10.9%	+30.0%	➖ noise
1	duckdb:vortex-file-compressed	-3.9%	-2.4%	-1.5%	+45.6%	➖ noise
2	datafusion:vortex-compact	+22.2%	+2.6%	+19.1%	+62.6%	➖ noise
2	datafusion:vortex-file-compressed	+0.9%	+2.6%	-1.6%	+30.0%	➖ noise
2	duckdb:vortex-compact	+0.9%	+2.6%	-1.6%	+30.0%	➖ noise
2	duckdb:vortex-file-compressed	-26.8%	+2.6%	-28.7%	+53.1%	➖ noise
3	datafusion:vortex-compact	+0.3%	+0.5%	-0.2%	+30.0%	➖ noise
3	datafusion:vortex-file-compressed	-1.3%	+0.5%	-1.8%	+30.0%	➖ noise
3	duckdb:vortex-compact	+8.6%	+0.5%	+8.0%	+30.0%	➖ noise
3	duckdb:vortex-file-compressed	+5.7%	+0.5%	+5.2%	+30.0%	➖ noise
4	datafusion:vortex-compact	+4.7%	-2.9%	+7.8%	+30.0%	➖ noise
4	datafusion:vortex-file-compressed	+0.7%	-2.9%	+3.7%	+30.0%	➖ noise
4	duckdb:vortex-compact	+8.0%	-2.9%	+11.2%	+30.0%	➖ noise
4	duckdb:vortex-file-compressed	+2.5%	-2.9%	+5.6%	+30.0%	➖ noise
5	datafusion:vortex-compact	+4.1%	-10.8%	+16.6%	+30.0%	➖ noise
5	datafusion:vortex-file-compressed	-4.2%	-10.8%	+7.3%	+30.0%	➖ noise
5	duckdb:vortex-compact	+10.2%	-10.8%	+23.5%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	+8.8%	-10.8%	+21.9%	+30.0%	➖ noise
6	datafusion:vortex-compact	-1.3%	-4.5%	+3.4%	+30.0%	➖ noise
6	datafusion:vortex-file-compressed	-1.9%	-4.5%	+2.7%	+30.0%	➖ noise
6	duckdb:vortex-compact	+10.1%	-4.5%	+15.3%	+30.0%	➖ noise
6	duckdb:vortex-file-compressed	+4.7%	-4.5%	+9.7%	+30.0%	➖ noise
7	datafusion:vortex-compact	+18.2%	-15.7%	+40.2%	+30.0%	🚨 regression
7	datafusion:vortex-file-compressed	-4.3%	-15.7%	+13.6%	+30.0%	➖ noise
7	duckdb:vortex-compact	+7.0%	-15.7%	+27.0%	+30.0%	➖ noise
7	duckdb:vortex-file-compressed	+2.5%	-15.7%	+21.6%	+30.0%	➖ noise
8	datafusion:vortex-compact	+3.1%	-3.7%	+7.0%	+30.0%	➖ noise
8	datafusion:vortex-file-compressed	+7.0%	-3.7%	+11.1%	+30.0%	➖ noise
8	duckdb:vortex-compact	-4.9%	-3.7%	-1.2%	+37.4%	➖ noise
8	duckdb:vortex-file-compressed	-17.3%	-3.7%	-14.2%	+61.6%	➖ noise

github-actions · 2026-05-06T22:48:37Z

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.992x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

duckdb / vortex-file-compressed (0.999x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed	12290828	12155742	1.01
statpopgen_q01/duckdb:vortex-file-compressed	21126668	20585092	1.03
statpopgen_q02/duckdb:vortex-file-compressed	1415798846	1382684632	1.02
statpopgen_q03/duckdb:vortex-file-compressed	3166265187	3183435289	0.99
statpopgen_q04/duckdb:vortex-file-compressed	3143444076	3174305647	0.99
statpopgen_q05/duckdb:vortex-file-compressed	1444670754	1477776320	0.98
statpopgen_q06/duckdb:vortex-file-compressed	2172745758	2163023512	1.00
statpopgen_q07/duckdb:vortex-file-compressed	215995342	222711028	0.97
statpopgen_q08/duckdb:vortex-file-compressed	257713417	255355837	1.01
statpopgen_q09/duckdb:vortex-file-compressed	2941602707	2975226827	0.99
statpopgen_q10/duckdb:vortex-file-compressed	4794183807	4811791996	1.00

duckdb / vortex-compact (0.984x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact	11399225	11882043	0.96
statpopgen_q01/duckdb:vortex-compact	167522465	170691405	0.98
statpopgen_q02/duckdb:vortex-compact	1851888279	1854079475	1.00
statpopgen_q03/duckdb:vortex-compact	3569910942	3570080758	1.00
statpopgen_q04/duckdb:vortex-compact	3642275282	3759199222	0.97
statpopgen_q05/duckdb:vortex-compact	1863892696	1999783659	0.93
statpopgen_q06/duckdb:vortex-compact	2733788120	2770316413	0.99
statpopgen_q07/duckdb:vortex-compact	903870080	905914802	1.00
statpopgen_q08/duckdb:vortex-compact	929910410	939857914	0.99
statpopgen_q09/duckdb:vortex-compact	3366938810	3350946604	1.00
statpopgen_q10/duckdb:vortex-compact	5501021286	5449429268	1.01

duckdb / parquet (0.999x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:parquet	326006115	331856786	0.98
statpopgen_q01/duckdb:parquet	414773441	415391731	1.00
statpopgen_q02/duckdb:parquet	1000004121	1013110197	0.99
statpopgen_q03/duckdb:parquet	1501435140	1505040485	1.00
statpopgen_q04/duckdb:parquet	1537971870	1510645216	1.02
statpopgen_q05/duckdb:parquet	1012443225	1032059514	0.98
statpopgen_q06/duckdb:parquet	1502459125	1508123916	1.00
statpopgen_q07/duckdb:parquet	1319070558	1309195977	1.01
statpopgen_q08/duckdb:parquet	1327936788	1316224538	1.01
statpopgen_q09/duckdb:parquet	1413857131	1397885578	1.01
statpopgen_q10/duckdb:parquet	2724326338	2721057817	1.00

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	duckdb:vortex-compact	-4.1%	-1.8%	-2.3%	+10.0%	➖ noise
0	duckdb:vortex-file-compressed	+1.1%	-1.8%	+2.9%	+11.2%	➖ noise
1	duckdb:vortex-compact	-1.9%	-0.1%	-1.7%	+10.0%	➖ noise
1	duckdb:vortex-file-compressed	+2.6%	-0.1%	+2.8%	+204.1%	➖ noise
2	duckdb:vortex-compact	-0.1%	-1.3%	+1.2%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	+2.4%	-1.3%	+3.7%	+10.0%	➖ noise
3	duckdb:vortex-compact	-0.0%	-0.2%	+0.2%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-0.5%	-0.2%	-0.3%	+10.0%	➖ noise
4	duckdb:vortex-compact	-3.1%	+1.8%	-4.8%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-1.0%	+1.8%	-2.7%	+10.0%	➖ noise
5	duckdb:vortex-compact	-6.8%	-1.9%	-5.0%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-2.2%	-1.9%	-0.3%	+10.0%	➖ noise
6	duckdb:vortex-compact	-1.3%	-0.4%	-0.9%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	+0.4%	-0.4%	+0.8%	+10.0%	➖ noise
7	duckdb:vortex-compact	-0.2%	+0.8%	-1.0%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-3.0%	+0.8%	-3.7%	+10.0%	➖ noise
8	duckdb:vortex-compact	-1.1%	+0.9%	-1.9%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	+0.9%	+0.9%	+0.0%	+10.0%	➖ noise
9	duckdb:vortex-compact	+0.5%	+1.1%	-0.7%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-1.1%	+1.1%	-2.2%	+10.0%	➖ noise
10	duckdb:vortex-compact	+0.9%	+0.1%	+0.8%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-0.4%	+0.1%	-0.5%	+10.0%	➖ noise

github-actions · 2026-05-06T22:48:39Z

File Sizes: Statistical and Population Genetics

No file size changes detected.

github-actions · 2026-05-06T22:48:44Z

Benchmarks: Random Access

Vortex (geomean): 0.949x ➖
Parquet (geomean): 0.989x ➖

unknown / unknown (0.972x ➖, 4↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk	2372092	2409363	0.98
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer	1467749	1489314	0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk	8203785353	8451898736	0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	8231708420	8377197276	0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk	7627077	7884408	0.97
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer	6576504	7206443	0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk	5740031	5795105	0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer	6549600	6579455	1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk	8230592601	8345008431	0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	8330674633	8429648060	0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk	12920787	13263220	0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	12680891	13126572	0.97
random-access/lance-tokio-local-disk	764348	763691	1.00
random-access/lance-tokio-local-disk-footer	1313485	1322630	0.99
random-access/nested-lists/correlated/lance-tokio-local-disk	247127	250175	0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	620375	626559	0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk	127771724	128112427	1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	129680462	128154950	1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk	551680	592779	0.93
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	556861	561644	0.99
random-access/nested-lists/uniform/lance-tokio-local-disk	1084800	1124302	0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1465444	1500752	0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk	130098044	128109909	1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	129671393	127729601	1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk	2064542	2092909	0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer	2063898	2092742	0.99
random-access/nested-structs/correlated/lance-tokio-local-disk	393279	399044	0.99
random-access/nested-structs/correlated/lance-tokio-local-disk-footer	590527	598415	0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk	20143632	21211885	0.95
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	20201492	20616655	0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk	718708	751824	0.96
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	721930	766326	0.94
random-access/nested-structs/uniform/lance-tokio-local-disk	2699578	2783982	0.97
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	2911363	2998310	0.97
random-access/nested-structs/uniform/parquet-tokio-local-disk	20164854	20565742	0.98
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	20173122	21188953	0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk	1609516	1587028	1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	1610346	1658564	0.97
random-access/parquet-tokio-local-disk	165579269	165289419	1.00
random-access/parquet-tokio-local-disk-footer	165695370	165533078	1.00
random-access/taxi/correlated/lance-tokio-local-disk	951483	952004	1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer	1594852	1598348	1.00
random-access/taxi/correlated/parquet-tokio-local-disk	247723209	251566709	0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer	248217540	248488268	1.00
random-access/taxi/correlated/vortex-tokio-local-disk 🚀	1550404	1777352	0.87
random-access/taxi/correlated/vortex-tokio-local-disk-footer	1686673	1789668	0.94
random-access/taxi/uniform/lance-tokio-local-disk	9413812	9950049	0.95
random-access/taxi/uniform/lance-tokio-local-disk-footer 🚀	10002581	11336563	0.88
random-access/taxi/uniform/parquet-tokio-local-disk	263478857	267216492	0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer	264363404	265241109	1.00
random-access/taxi/uniform/vortex-tokio-local-disk	4485814	4610144	0.97
random-access/taxi/uniform/vortex-tokio-local-disk-footer	4472874	4601600	0.97
random-access/vortex-tokio-local-disk 🚀	1166060	1358686	0.86
random-access/vortex-tokio-local-disk-footer 🚀	1193250	1350856	0.88

github-actions · 2026-05-06T22:48:54Z

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Vortex (geomean): 0.940x ➖
Parquet (geomean): 0.954x ➖
Shifts: Parquet (control) -4.6% · Median polish -4.5%

datafusion / vortex-file-compressed (0.924x ➖, 9↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	411397475	425130260	0.97
tpch_q02/datafusion:vortex-file-compressed 🚀	109580838	122093590	0.90
tpch_q03/datafusion:vortex-file-compressed 🚀	222300002	255249811	0.87
tpch_q04/datafusion:vortex-file-compressed 🚀	117726154	133336017	0.88
tpch_q05/datafusion:vortex-file-compressed 🚀	378618794	442338765	0.86
tpch_q06/datafusion:vortex-file-compressed 🚀	45250067	51093469	0.89
tpch_q07/datafusion:vortex-file-compressed 🚀	518070640	610015758	0.85
tpch_q08/datafusion:vortex-file-compressed 🚀	365876558	420593387	0.87
tpch_q09/datafusion:vortex-file-compressed	677540635	737353632	0.92
tpch_q10/datafusion:vortex-file-compressed	257671772	268752030	0.96
tpch_q11/datafusion:vortex-file-compressed	90388967	94171963	0.96
tpch_q12/datafusion:vortex-file-compressed	130430157	141227813	0.92
tpch_q13/datafusion:vortex-file-compressed	232061999	248449094	0.93
tpch_q14/datafusion:vortex-file-compressed	60965962	63096306	0.97
tpch_q15/datafusion:vortex-file-compressed	114541781	120678960	0.95
tpch_q16/datafusion:vortex-file-compressed	81736962	83391468	0.98
tpch_q17/datafusion:vortex-file-compressed 🚀	666380430	743251538	0.90
tpch_q18/datafusion:vortex-file-compressed	923888991	982740091	0.94
tpch_q19/datafusion:vortex-file-compressed	98131359	97388719	1.01
tpch_q20/datafusion:vortex-file-compressed	187928335	193806147	0.97
tpch_q21/datafusion:vortex-file-compressed 🚀	687998471	767761046	0.90
tpch_q22/datafusion:vortex-file-compressed	68234055	70421687	0.97

datafusion / vortex-compact (0.915x ➖, 8↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀	442698889	497270805	0.89
tpch_q02/datafusion:vortex-compact	115357965	127912585	0.90
tpch_q03/datafusion:vortex-compact 🚀	227685539	258240617	0.88
tpch_q04/datafusion:vortex-compact	129036300	135454593	0.95
tpch_q05/datafusion:vortex-compact 🚀	384057641	442100325	0.87
tpch_q06/datafusion:vortex-compact	65832384	72039721	0.91
tpch_q07/datafusion:vortex-compact 🚀	536667922	623271283	0.86
tpch_q08/datafusion:vortex-compact	403062584	417996378	0.96
tpch_q09/datafusion:vortex-compact	691250629	754389088	0.92
tpch_q10/datafusion:vortex-compact	273921607	286721809	0.96
tpch_q11/datafusion:vortex-compact	90425839	95951583	0.94
tpch_q12/datafusion:vortex-compact	184554108	189732498	0.97
tpch_q13/datafusion:vortex-compact	283865977	295067542	0.96
tpch_q14/datafusion:vortex-compact	76632913	84799734	0.90
tpch_q15/datafusion:vortex-compact	172705243	181196994	0.95
tpch_q16/datafusion:vortex-compact	83275071	91581268	0.91
tpch_q17/datafusion:vortex-compact	697769869	775157120	0.90
tpch_q18/datafusion:vortex-compact 🚀	884202255	988383277	0.89
tpch_q19/datafusion:vortex-compact	135229200	141325660	0.96
tpch_q20/datafusion:vortex-compact 🚀	195583898	219271903	0.89
tpch_q21/datafusion:vortex-compact 🚀	675023276	791440657	0.85
tpch_q22/datafusion:vortex-compact 🚀	73006673	81129850	0.90

datafusion / parquet (0.938x ➖, 2↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	504070692	519225678	0.97
tpch_q02/datafusion:parquet	180486215	187680335	0.96
tpch_q03/datafusion:parquet	298648969	318197000	0.94
tpch_q04/datafusion:parquet	131314356	137456728	0.96
tpch_q05/datafusion:parquet	464960931	509821286	0.91
tpch_q06/datafusion:parquet	125735595	131703017	0.95
tpch_q07/datafusion:parquet	655601627	705023472	0.93
tpch_q08/datafusion:parquet	469881175	519378938	0.90
tpch_q09/datafusion:parquet 🚀	754151781	853448316	0.88
tpch_q10/datafusion:parquet	507522988	554329133	0.92
tpch_q11/datafusion:parquet	120123610	130551723	0.92
tpch_q12/datafusion:parquet	199651571	204039116	0.98
tpch_q13/datafusion:parquet	334171170	355858814	0.94
tpch_q14/datafusion:parquet 🚀	154814385	172901914	0.90
tpch_q15/datafusion:parquet	249126404	275911659	0.90
tpch_q16/datafusion:parquet	132070245	137893939	0.96
tpch_q17/datafusion:parquet	737685112	777447642	0.95
tpch_q18/datafusion:parquet	959616509	1005905653	0.95
tpch_q19/datafusion:parquet	260585349	280644967	0.93
tpch_q20/datafusion:parquet	304387451	319682014	0.95
tpch_q21/datafusion:parquet	751935092	789503668	0.95
tpch_q22/datafusion:parquet	221169803	221639315	1.00

datafusion / arrow (0.914x ➖, 8↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow	647973108	675053666	0.96
tpch_q02/datafusion:arrow	172396288	185995091	0.93
tpch_q03/datafusion:arrow	499891503	551477519	0.91
tpch_q04/datafusion:arrow	366161139	401487323	0.91
tpch_q05/datafusion:arrow	1010695852	1067000413	0.95
tpch_q06/datafusion:arrow 🚀	293491301	330194074	0.89
tpch_q07/datafusion:arrow 🚀	1192322450	1402678116	0.85
tpch_q08/datafusion:arrow 🚀	1159971757	1312007315	0.88
tpch_q09/datafusion:arrow	1428356812	1547313941	0.92
tpch_q10/datafusion:arrow 🚀	626385866	710958898	0.88
tpch_q11/datafusion:arrow	143057311	150783624	0.95
tpch_q12/datafusion:arrow	906055227	883241441	1.03
tpch_q13/datafusion:arrow	506411162	543202532	0.93
tpch_q14/datafusion:arrow 🚀	332525642	382819226	0.87
tpch_q15/datafusion:arrow 🚀	726299968	846196998	0.86
tpch_q16/datafusion:arrow	107456397	116859374	0.92
tpch_q17/datafusion:arrow 🚀	1357207249	1526852131	0.89
tpch_q18/datafusion:arrow	2028988884	2204053104	0.92
tpch_q19/datafusion:arrow	545151200	575396168	0.95
tpch_q20/datafusion:arrow 🚀	522006800	582903821	0.90
tpch_q21/datafusion:arrow	3067681322	3349100250	0.92
tpch_q22/datafusion:arrow	134773240	147182136	0.92

duckdb / vortex-file-compressed (0.965x ➖, 2↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	173248983	180931842	0.96
tpch_q02/duckdb:vortex-file-compressed	52948704	56536467	0.94
tpch_q03/duckdb:vortex-file-compressed 🚀	127545736	145047977	0.88
tpch_q04/duckdb:vortex-file-compressed 🚀	155607416	178439691	0.87
tpch_q05/duckdb:vortex-file-compressed	136444982	142500477	0.96
tpch_q06/duckdb:vortex-file-compressed	51738556	53300661	0.97
tpch_q07/duckdb:vortex-file-compressed	158196306	167196288	0.95
tpch_q08/duckdb:vortex-file-compressed	189305451	198823340	0.95
tpch_q09/duckdb:vortex-file-compressed	338808190	354092187	0.96
tpch_q10/duckdb:vortex-file-compressed	157142473	159764460	0.98
tpch_q11/duckdb:vortex-file-compressed	36913503	35846487	1.03
tpch_q12/duckdb:vortex-file-compressed	103839057	104334091	1.00
tpch_q13/duckdb:vortex-file-compressed	245326333	249344206	0.98
tpch_q14/duckdb:vortex-file-compressed	73117089	72985738	1.00
tpch_q15/duckdb:vortex-file-compressed	93508322	95756951	0.98
tpch_q16/duckdb:vortex-file-compressed	81786552	85500513	0.96
tpch_q17/duckdb:vortex-file-compressed	105959837	107873747	0.98
tpch_q18/duckdb:vortex-file-compressed	306391788	316009226	0.97
tpch_q19/duckdb:vortex-file-compressed	89255374	89565604	1.00
tpch_q20/duckdb:vortex-file-compressed	179022652	173863251	1.03
tpch_q21/duckdb:vortex-file-compressed	612382298	648504501	0.94
tpch_q22/duckdb:vortex-file-compressed	73424137	76047894	0.97

duckdb / vortex-compact (0.956x ➖, 1↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	230836608	238963860	0.97
tpch_q02/duckdb:vortex-compact	57234611	59605854	0.96
tpch_q03/duckdb:vortex-compact	141531986	154491190	0.92
tpch_q04/duckdb:vortex-compact	175555739	189464465	0.93
tpch_q05/duckdb:vortex-compact	147307733	158822091	0.93
tpch_q06/duckdb:vortex-compact	84095609	87571767	0.96
tpch_q07/duckdb:vortex-compact	201158843	212738451	0.95
tpch_q08/duckdb:vortex-compact 🚀	188524575	210964127	0.89
tpch_q09/duckdb:vortex-compact	353823185	383115453	0.92
tpch_q10/duckdb:vortex-compact	181026643	195039313	0.93
tpch_q11/duckdb:vortex-compact	41233385	44087028	0.94
tpch_q12/duckdb:vortex-compact	205876094	221372640	0.93
tpch_q13/duckdb:vortex-compact	293781118	305643177	0.96
tpch_q14/duckdb:vortex-compact	113666350	109139690	1.04
tpch_q15/duckdb:vortex-compact	125205477	122910690	1.02
tpch_q16/duckdb:vortex-compact	87429884	89493906	0.98
tpch_q17/duckdb:vortex-compact	118211143	124573029	0.95
tpch_q18/duckdb:vortex-compact	306940250	315849624	0.97
tpch_q19/duckdb:vortex-compact	112592665	113403957	0.99
tpch_q20/duckdb:vortex-compact	224374265	225291586	1.00
tpch_q21/duckdb:vortex-compact	659189028	686154411	0.96
tpch_q22/duckdb:vortex-compact	88810568	91485918	0.97

duckdb / parquet (0.970x ➖, 1↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	256012766	260882398	0.98
tpch_q02/duckdb:parquet 🚀	95466986	106147619	0.90
tpch_q03/duckdb:parquet	209917433	223022370	0.94
tpch_q04/duckdb:parquet	133300528	139896416	0.95
tpch_q05/duckdb:parquet	215974636	228911755	0.94
tpch_q06/duckdb:parquet	68594959	68245128	1.01
tpch_q07/duckdb:parquet	187345564	189698648	0.99
tpch_q08/duckdb:parquet	262719689	273392724	0.96
tpch_q09/duckdb:parquet	499846684	531966282	0.94
tpch_q10/duckdb:parquet	628589655	643478520	0.98
tpch_q11/duckdb:parquet	59425185	61659793	0.96
tpch_q12/duckdb:parquet	125238248	129525894	0.97
tpch_q13/duckdb:parquet	460876041	470613367	0.98
tpch_q14/duckdb:parquet	181671957	181720736	1.00
tpch_q15/duckdb:parquet	104371803	99990888	1.04
tpch_q16/duckdb:parquet	167824027	169967229	0.99
tpch_q17/duckdb:parquet	177849144	178917615	0.99
tpch_q18/duckdb:parquet	355940459	372585648	0.96
tpch_q19/duckdb:parquet	287795542	297507360	0.97
tpch_q20/duckdb:parquet	231080506	233081606	0.99
tpch_q21/duckdb:parquet	572214751	607247423	0.94
tpch_q22/duckdb:parquet	292630219	300237002	0.97

duckdb / duckdb (0.963x ➖, 1↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb	117348455	120712854	0.97
tpch_q02/duckdb:duckdb 🚀	45291556	52419945	0.86
tpch_q03/duckdb:duckdb	98460292	106372195	0.93
tpch_q04/duckdb:duckdb	134288672	144613391	0.93
tpch_q05/duckdb:duckdb	112677575	117971275	0.96
tpch_q06/duckdb:duckdb	37654374	40757822	0.92
tpch_q07/duckdb:duckdb	87689101	91130549	0.96
tpch_q08/duckdb:duckdb	112700133	117767503	0.96
tpch_q09/duckdb:duckdb	283399088	298852629	0.95
tpch_q10/duckdb:duckdb	208175762	225841015	0.92
tpch_q11/duckdb:duckdb	15807862	15975803	0.99
tpch_q12/duckdb:duckdb	86416519	89737366	0.96
tpch_q13/duckdb:duckdb	224318263	244391638	0.92
tpch_q14/duckdb:duckdb	72558578	75807235	0.96
tpch_q15/duckdb:duckdb	82519252	82311674	1.00
tpch_q16/duckdb:duckdb	79182606	79812186	0.99
tpch_q17/duckdb:duckdb	89535442	87861546	1.02
tpch_q18/duckdb:duckdb	222147247	225870026	0.98
tpch_q19/duckdb:duckdb	125072643	122984522	1.02
tpch_q20/duckdb:duckdb	119190831	117818721	1.01
tpch_q21/duckdb:duckdb	309465597	324041678	0.96
tpch_q22/duckdb:duckdb	72680822	70016389	1.04

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-4.0%	-2.4%	-1.7%	+10.0%	➖ noise
1	datafusion:vortex-compact	-11.0%	-2.4%	-8.8%	+10.0%	➖ noise
1	datafusion:vortex-file-compressed	-3.2%	-2.4%	-0.9%	+10.0%	➖ noise
1	duckdb:duckdb	-2.8%	-2.4%	-0.4%	+10.0%	➖ noise
1	duckdb:vortex-compact	-3.4%	-2.4%	-1.0%	+10.0%	➖ noise
1	duckdb:vortex-file-compressed	-4.2%	-2.4%	-1.9%	+10.0%	➖ noise
2	datafusion:arrow	-7.3%	-7.0%	-0.3%	+10.0%	➖ noise
2	datafusion:vortex-compact	-9.8%	-7.0%	-3.0%	+10.0%	➖ noise
2	datafusion:vortex-file-compressed	-10.2%	-7.0%	-3.5%	+10.0%	➖ noise
2	duckdb:duckdb	-13.6%	-7.0%	-7.1%	+10.0%	➖ noise
2	duckdb:vortex-compact	-4.0%	-7.0%	+3.2%	+10.3%	➖ noise
2	duckdb:vortex-file-compressed	-6.3%	-7.0%	+0.7%	+13.3%	➖ noise
3	datafusion:arrow	-9.4%	-6.0%	-3.6%	+10.0%	➖ noise
3	datafusion:vortex-compact	-11.8%	-6.0%	-6.2%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	-12.9%	-6.0%	-7.3%	+10.0%	➖ noise
3	duckdb:duckdb	-7.4%	-6.0%	-1.5%	+10.0%	➖ noise
3	duckdb:vortex-compact	-8.4%	-6.0%	-2.5%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-12.1%	-6.0%	-6.4%	+10.0%	➖ noise
4	datafusion:arrow	-8.8%	-4.6%	-4.4%	+10.0%	➖ noise
4	datafusion:vortex-compact	-4.7%	-4.6%	-0.2%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	-11.7%	-4.6%	-7.5%	+10.0%	➖ noise
4	duckdb:duckdb	-7.1%	-4.6%	-2.7%	+10.0%	➖ noise
4	duckdb:vortex-compact	-7.3%	-4.6%	-2.9%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-12.8%	-4.6%	-8.6%	+10.0%	➖ noise
5	datafusion:arrow	-5.3%	-7.2%	+2.1%	+10.0%	➖ noise
5	datafusion:vortex-compact	-13.1%	-7.2%	-6.3%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	-14.4%	-7.2%	-7.7%	+10.0%	➖ noise
5	duckdb:duckdb	-4.5%	-7.2%	+3.0%	+10.0%	➖ noise
5	duckdb:vortex-compact	-7.2%	-7.2%	-0.0%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-4.2%	-7.2%	+3.2%	+10.0%	➖ noise
6	datafusion:arrow	-11.1%	-2.0%	-9.3%	+10.0%	✅ faster
6	datafusion:vortex-compact	-8.6%	-2.0%	-6.7%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-11.4%	-2.0%	-9.6%	+10.0%	✅ faster
6	duckdb:duckdb	-7.6%	-2.0%	-5.7%	+10.0%	➖ noise
6	duckdb:vortex-compact	-4.0%	-2.0%	-2.0%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-2.9%	-2.0%	-0.9%	+12.0%	➖ noise
7	datafusion:arrow	-15.0%	-4.2%	-11.3%	+10.0%	✅ faster
7	datafusion:vortex-compact	-13.9%	-4.2%	-10.1%	+10.0%	✅ faster
7	datafusion:vortex-file-compressed	-15.1%	-4.2%	-11.4%	+10.0%	✅ faster
7	duckdb:duckdb	-3.8%	-4.2%	+0.4%	+10.0%	➖ noise
7	duckdb:vortex-compact	-5.4%	-4.2%	-1.3%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-5.4%	-4.2%	-1.3%	+10.0%	➖ noise
8	datafusion:arrow	-11.6%	-6.8%	-5.2%	+10.0%	➖ noise
8	datafusion:vortex-compact	-3.6%	-6.8%	+3.4%	+10.0%	➖ noise
8	datafusion:vortex-file-compressed	-13.0%	-6.8%	-6.7%	+10.0%	➖ noise
8	duckdb:duckdb	-4.3%	-6.8%	+2.6%	+10.0%	➖ noise
8	duckdb:vortex-compact	-10.6%	-6.8%	-4.2%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-4.8%	-6.8%	+2.1%	+10.0%	➖ noise
9	datafusion:arrow	-7.7%	-8.9%	+1.3%	+10.0%	➖ noise
9	datafusion:vortex-compact	-8.4%	-8.9%	+0.6%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	-8.1%	-8.9%	+0.8%	+10.0%	➖ noise
9	duckdb:duckdb	-5.2%	-8.9%	+4.1%	+10.0%	➖ noise
9	duckdb:vortex-compact	-7.6%	-8.9%	+1.4%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-4.3%	-8.9%	+5.0%	+10.0%	➖ noise
10	datafusion:arrow	-11.9%	-5.4%	-6.8%	+10.0%	➖ noise
10	datafusion:vortex-compact	-4.5%	-5.4%	+1.0%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	-4.1%	-5.4%	+1.4%	+10.0%	➖ noise
10	duckdb:duckdb	-7.8%	-5.4%	-2.5%	+10.0%	➖ noise
10	duckdb:vortex-compact	-7.2%	-5.4%	-1.9%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-1.6%	-5.4%	+4.0%	+10.0%	➖ noise
11	datafusion:arrow	-5.1%	-5.8%	+0.8%	+10.0%	➖ noise
11	datafusion:vortex-compact	-5.8%	-5.8%	+0.1%	+10.0%	➖ noise
11	datafusion:vortex-file-compressed	-4.0%	-5.8%	+1.9%	+10.0%	➖ noise
11	duckdb:duckdb	-1.1%	-5.8%	+5.1%	+10.5%	➖ noise
11	duckdb:vortex-compact	-6.5%	-5.8%	-0.7%	+10.6%	➖ noise
11	duckdb:vortex-file-compressed	+3.0%	-5.8%	+9.4%	+14.8%	➖ noise
12	datafusion:arrow	+2.6%	-2.7%	+5.5%	+33.0%	➖ noise
12	datafusion:vortex-compact	-2.7%	-2.7%	+0.0%	+10.0%	➖ noise
12	datafusion:vortex-file-compressed	-7.6%	-2.7%	-5.1%	+10.0%	➖ noise
12	duckdb:duckdb	-3.7%	-2.7%	-1.0%	+10.0%	➖ noise
12	duckdb:vortex-compact	-7.0%	-2.7%	-4.4%	+10.0%	➖ noise
12	duckdb:vortex-file-compressed	-0.5%	-2.7%	+2.3%	+10.0%	➖ noise
13	datafusion:arrow	-6.8%	-4.1%	-2.8%	+10.0%	➖ noise
13	datafusion:vortex-compact	-3.8%	-4.1%	+0.3%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	-6.6%	-4.1%	-2.6%	+10.0%	➖ noise
13	duckdb:duckdb	-8.2%	-4.1%	-4.3%	+10.0%	➖ noise
13	duckdb:vortex-compact	-3.9%	-4.1%	+0.2%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	-1.6%	-4.1%	+2.6%	+10.0%	➖ noise
14	datafusion:arrow	-13.1%	-5.4%	-8.2%	+10.0%	➖ noise
14	datafusion:vortex-compact	-9.6%	-5.4%	-4.5%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	-3.4%	-5.4%	+2.1%	+10.0%	➖ noise
14	duckdb:duckdb	-4.3%	-5.4%	+1.2%	+10.0%	➖ noise
14	duckdb:vortex-compact	+4.1%	-5.4%	+10.1%	+10.0%	🚨 regression
14	duckdb:vortex-file-compressed	+0.2%	-5.4%	+5.9%	+10.0%	➖ noise
15	datafusion:arrow	-14.2%	-2.9%	-11.6%	+10.0%	✅ faster
15	datafusion:vortex-compact	-4.7%	-2.9%	-1.8%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	-5.1%	-2.9%	-2.2%	+10.0%	➖ noise
15	duckdb:duckdb	+0.3%	-2.9%	+3.3%	+10.0%	➖ noise
15	duckdb:vortex-compact	+1.9%	-2.9%	+4.9%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	-2.3%	-2.9%	+0.6%	+10.0%	➖ noise
16	datafusion:arrow	-8.0%	-2.8%	-5.4%	+10.0%	➖ noise
16	datafusion:vortex-compact	-9.1%	-2.8%	-6.5%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	-2.0%	-2.8%	+0.8%	+10.0%	➖ noise
16	duckdb:duckdb	-0.8%	-2.8%	+2.0%	+10.0%	➖ noise
16	duckdb:vortex-compact	-2.3%	-2.8%	+0.5%	+10.0%	➖ noise
16	duckdb:vortex-file-compressed	-4.3%	-2.8%	-1.6%	+10.0%	➖ noise
17	datafusion:arrow	-11.1%	-2.9%	-8.5%	+10.0%	➖ noise
17	datafusion:vortex-compact	-10.0%	-2.9%	-7.3%	+10.0%	➖ noise
17	datafusion:vortex-file-compressed	-10.3%	-2.9%	-7.7%	+10.0%	➖ noise
17	duckdb:duckdb	+1.9%	-2.9%	+4.9%	+10.0%	➖ noise
17	duckdb:vortex-compact	-5.1%	-2.9%	-2.3%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	-1.8%	-2.9%	+1.1%	+10.0%	➖ noise
18	datafusion:arrow	-7.9%	-4.5%	-3.6%	+10.0%	➖ noise
18	datafusion:vortex-compact	-10.5%	-4.5%	-6.3%	+10.0%	➖ noise
18	datafusion:vortex-file-compressed	-6.0%	-4.5%	-1.5%	+10.0%	➖ noise
18	duckdb:duckdb	-1.6%	-4.5%	+3.0%	+10.0%	➖ noise
18	duckdb:vortex-compact	-2.8%	-4.5%	+1.8%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	-3.0%	-4.5%	+1.6%	+10.0%	➖ noise
19	datafusion:arrow	-5.3%	-5.2%	-0.0%	+10.0%	➖ noise
19	datafusion:vortex-compact	-4.3%	-5.2%	+1.0%	+10.0%	➖ noise
19	datafusion:vortex-file-compressed	+0.8%	-5.2%	+6.3%	+10.0%	➖ noise
19	duckdb:duckdb	+1.7%	-5.2%	+7.3%	+10.0%	➖ noise
19	duckdb:vortex-compact	-0.7%	-5.2%	+4.8%	+10.0%	➖ noise
19	duckdb:vortex-file-compressed	-0.3%	-5.2%	+5.1%	+10.0%	➖ noise
20	datafusion:arrow	-10.4%	-2.8%	-7.8%	+10.0%	➖ noise
20	datafusion:vortex-compact	-10.8%	-2.8%	-8.2%	+10.0%	➖ noise
20	datafusion:vortex-file-compressed	-3.0%	-2.8%	-0.2%	+10.0%	➖ noise
20	duckdb:duckdb	+1.2%	-2.8%	+4.1%	+10.0%	➖ noise
20	duckdb:vortex-compact	-0.4%	-2.8%	+2.5%	+10.0%	➖ noise
20	duckdb:vortex-file-compressed	+3.0%	-2.8%	+6.0%	+10.0%	➖ noise
21	datafusion:arrow	-8.4%	-5.3%	-3.3%	+10.0%	➖ noise
21	datafusion:vortex-compact	-14.7%	-5.3%	-10.0%	+10.0%	✅ faster
21	datafusion:vortex-file-compressed	-10.4%	-5.3%	-5.4%	+10.0%	➖ noise
21	duckdb:duckdb	-4.5%	-5.3%	+0.8%	+10.0%	➖ noise
21	duckdb:vortex-compact	-3.9%	-5.3%	+1.4%	+10.0%	➖ noise
21	duckdb:vortex-file-compressed	-5.6%	-5.3%	-0.3%	+10.0%	➖ noise
22	datafusion:arrow	-8.4%	-1.4%	-7.2%	+10.0%	➖ noise
22	datafusion:vortex-compact	-10.0%	-1.4%	-8.8%	+10.0%	➖ noise
22	datafusion:vortex-file-compressed	-3.1%	-1.4%	-1.8%	+10.0%	➖ noise
22	duckdb:duckdb	+3.8%	-1.4%	+5.3%	+10.0%	➖ noise
22	duckdb:vortex-compact	-2.9%	-1.4%	-1.6%	+10.0%	➖ noise
22	duckdb:vortex-file-compressed	-3.5%	-1.4%	-2.1%	+11.2%	➖ noise

github-actions · 2026-05-06T22:48:56Z

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

github-actions · 2026-05-06T22:51:38Z

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Vortex (geomean): 0.958x ➖
Parquet (geomean): 0.964x ➖
Shifts: Parquet (control) -3.6% · Median polish -4.1%

datafusion / vortex-file-compressed (0.957x ➖, 1↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed	1618391	1712410	0.95
clickbench_q01/datafusion:vortex-file-compressed	19782128	19907930	0.99
clickbench_q02/datafusion:vortex-file-compressed	39713444	39567920	1.00
clickbench_q03/datafusion:vortex-file-compressed	43989241	43911729	1.00
clickbench_q04/datafusion:vortex-file-compressed	292494276	310773146	0.94
clickbench_q05/datafusion:vortex-file-compressed	308343251	330484595	0.93
clickbench_q06/datafusion:vortex-file-compressed 🚀	1631199	1907795	0.86
clickbench_q07/datafusion:vortex-file-compressed	24104773	22465777	1.07
clickbench_q08/datafusion:vortex-file-compressed	354477331	372748320	0.95
clickbench_q09/datafusion:vortex-file-compressed	547404118	585196971	0.94
clickbench_q10/datafusion:vortex-file-compressed	78143660	77404346	1.01
clickbench_q11/datafusion:vortex-file-compressed	85514675	90809724	0.94
clickbench_q12/datafusion:vortex-file-compressed	271179993	284100343	0.95
clickbench_q13/datafusion:vortex-file-compressed	414287876	440807416	0.94
clickbench_q14/datafusion:vortex-file-compressed	255029446	276776855	0.92
clickbench_q15/datafusion:vortex-file-compressed	329513146	346028390	0.95
clickbench_q16/datafusion:vortex-file-compressed	648992880	691281136	0.94
clickbench_q17/datafusion:vortex-file-compressed	643441974	682925931	0.94
clickbench_q18/datafusion:vortex-file-compressed	1306310443	1396288933	0.94
clickbench_q19/datafusion:vortex-file-compressed 🚨	34787923	31163744	1.12
clickbench_q20/datafusion:vortex-file-compressed	333939671	342671199	0.97
clickbench_q21/datafusion:vortex-file-compressed	369336852	395423746	0.93
clickbench_q22/datafusion:vortex-file-compressed	445471018	469868314	0.95
clickbench_q23/datafusion:vortex-file-compressed	697128953	702822132	0.99
clickbench_q24/datafusion:vortex-file-compressed	45247326	47029112	0.96
clickbench_q25/datafusion:vortex-file-compressed	70780062	75851027	0.93
clickbench_q26/datafusion:vortex-file-compressed	46273642	48850958	0.95
clickbench_q27/datafusion:vortex-file-compressed	745077640	730268408	1.02
clickbench_q28/datafusion:vortex-file-compressed	6696741004	6830418456	0.98
clickbench_q29/datafusion:vortex-file-compressed	239694100	240915693	0.99
clickbench_q30/datafusion:vortex-file-compressed	219475403	233661403	0.94
clickbench_q31/datafusion:vortex-file-compressed	255539980	275188022	0.93
clickbench_q32/datafusion:vortex-file-compressed	1124923205	1195931248	0.94
clickbench_q33/datafusion:vortex-file-compressed	1280969270	1367890391	0.94
clickbench_q34/datafusion:vortex-file-compressed	1294682756	1386964227	0.93
clickbench_q35/datafusion:vortex-file-compressed	457520665	472091560	0.97
clickbench_q36/datafusion:vortex-file-compressed	72873733	75946105	0.96
clickbench_q37/datafusion:vortex-file-compressed	35455101	38162846	0.93
clickbench_q38/datafusion:vortex-file-compressed	19382756	19751821	0.98
clickbench_q39/datafusion:vortex-file-compressed	128564220	137418156	0.94
clickbench_q40/datafusion:vortex-file-compressed	15978319	17169585	0.93
clickbench_q41/datafusion:vortex-file-compressed	14916449	16344442	0.91
clickbench_q42/datafusion:vortex-file-compressed	16866304	18038228	0.94

datafusion / parquet (0.958x ➖, 1↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
clickbench_q00/datafusion:parquet	1561808	1552967	1.01
clickbench_q01/datafusion:parquet	19216541	19195112	1.00
clickbench_q02/datafusion:parquet	47330405	48430563	0.98
clickbench_q03/datafusion:parquet	38499135	39565777	0.97
clickbench_q04/datafusion:parquet 🚀	294404602	328884679	0.90
clickbench_q05/datafusion:parquet	363116531	366982573	0.99
clickbench_q06/datafusion:parquet	1585005	1580351	1.00
clickbench_q07/datafusion:parquet	22651269	23169250	0.98
clickbench_q08/datafusion:parquet	376517304	395878246	0.95
clickbench_q09/datafusion:parquet	612669693	642875763	0.95
clickbench_q10/datafusion:parquet	104830540	110375578	0.95
clickbench_q11/datafusion:parquet	131556771	138234157	0.95
clickbench_q12/datafusion:parquet	348631677	356192329	0.98
clickbench_q13/datafusion:parquet	482679540	530887287	0.91
clickbench_q14/datafusion:parquet	340203072	361685664	0.94
clickbench_q15/datafusion:parquet	341119754	355572472	0.96
clickbench_q16/datafusion:parquet	657132401	703603268	0.93
clickbench_q17/datafusion:parquet	648734510	685528801	0.95
clickbench_q18/datafusion:parquet	1311410770	1406620162	0.93
clickbench_q19/datafusion:parquet	29242877	30002159	0.97
clickbench_q20/datafusion:parquet	597022013	634798229	0.94
clickbench_q21/datafusion:parquet	656900215	696237095	0.94
clickbench_q22/datafusion:parquet	964937197	1015171172	0.95
clickbench_q23/datafusion:parquet	3664815238	3851036985	0.95
clickbench_q24/datafusion:parquet	83711885	87719341	0.95
clickbench_q25/datafusion:parquet	131859716	140302613	0.94
clickbench_q26/datafusion:parquet	85609145	84847557	1.01
clickbench_q27/datafusion:parquet	1052235750	1112830637	0.95
clickbench_q28/datafusion:parquet	6652045081	6801845309	0.98
clickbench_q29/datafusion:parquet	239049045	246892916	0.97
clickbench_q30/datafusion:parquet	325802375	342747513	0.95
clickbench_q31/datafusion:parquet	364406637	384853084	0.95
clickbench_q32/datafusion:parquet	1220492300	1287988119	0.95
clickbench_q33/datafusion:parquet	1461057326	1596191479	0.92
clickbench_q34/datafusion:parquet	1491611453	1552278511	0.96
clickbench_q35/datafusion:parquet	466749671	492591066	0.95
clickbench_q36/datafusion:parquet	138755523	146399284	0.95
clickbench_q37/datafusion:parquet	57573704	58798981	0.98
clickbench_q38/datafusion:parquet	84341829	91014970	0.93
clickbench_q39/datafusion:parquet	258455112	268202816	0.96
clickbench_q40/datafusion:parquet	30489885	30934663	0.99
clickbench_q41/datafusion:parquet	28710507	28650994	1.00
clickbench_q42/datafusion:parquet	29643275	31403961	0.94

duckdb / vortex-file-compressed (0.959x ➖, 4↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀	5975795	6869342	0.87
clickbench_q01/duckdb:vortex-file-compressed	13243128	13999478	0.95
clickbench_q02/duckdb:vortex-file-compressed	25396324	27076370	0.94
clickbench_q03/duckdb:vortex-file-compressed	29427912	30574173	0.96
clickbench_q04/duckdb:vortex-file-compressed	180176792	189053813	0.95
clickbench_q05/duckdb:vortex-file-compressed	168727961	180065997	0.94
clickbench_q06/duckdb:vortex-file-compressed	19291155	20853482	0.93
clickbench_q07/duckdb:vortex-file-compressed	14593097	14610591	1.00
clickbench_q08/duckdb:vortex-file-compressed	256123210	262083139	0.98
clickbench_q09/duckdb:vortex-file-compressed	329651122	351486799	0.94
clickbench_q10/duckdb:vortex-file-compressed	67706048	69034942	0.98
clickbench_q11/duckdb:vortex-file-compressed	77855182	80217252	0.97
clickbench_q12/duckdb:vortex-file-compressed	194125473	204634084	0.95
clickbench_q13/duckdb:vortex-file-compressed	391510471	412432035	0.95
clickbench_q14/duckdb:vortex-file-compressed	230989987	242181075	0.95
clickbench_q15/duckdb:vortex-file-compressed	238447384	252879162	0.94
clickbench_q16/duckdb:vortex-file-compressed	585317461	608771671	0.96
clickbench_q17/duckdb:vortex-file-compressed	480213380	492092882	0.98
clickbench_q18/duckdb:vortex-file-compressed	987759459	1020889480	0.97
clickbench_q19/duckdb:vortex-file-compressed	21081411	22028543	0.96
clickbench_q20/duckdb:vortex-file-compressed	321346610	355617259	0.90
clickbench_q21/duckdb:vortex-file-compressed	362179370	392756276	0.92
clickbench_q22/duckdb:vortex-file-compressed 🚀	486221933	616024958	0.79
clickbench_q23/duckdb:vortex-file-compressed 🚨	407022987	359456569	1.13
clickbench_q24/duckdb:vortex-file-compressed 🚀	35237942	41151948	0.86
clickbench_q25/duckdb:vortex-file-compressed	74666952	74265830	1.01
clickbench_q26/duckdb:vortex-file-compressed 🚀	45921835	52443180	0.88
clickbench_q27/duckdb:vortex-file-compressed	460898975	485740450	0.95
clickbench_q28/duckdb:vortex-file-compressed	2983820973	3066283219	0.97
clickbench_q29/duckdb:vortex-file-compressed	28032567	28375112	0.99
clickbench_q30/duckdb:vortex-file-compressed	190466225	196892981	0.97
clickbench_q31/duckdb:vortex-file-compressed	277743067	293874132	0.95
clickbench_q32/duckdb:vortex-file-compressed	1159983251	1166809941	0.99
clickbench_q33/duckdb:vortex-file-compressed	1177280870	1222934085	0.96
clickbench_q34/duckdb:vortex-file-compressed	1220645833	1272123994	0.96
clickbench_q35/duckdb:vortex-file-compressed	373972109	397608974	0.94
clickbench_q36/duckdb:vortex-file-compressed	28659060	28166211	1.02
clickbench_q37/duckdb:vortex-file-compressed	22736931	20938583	1.09
clickbench_q38/duckdb:vortex-file-compressed	23835134	22513923	1.06
clickbench_q39/duckdb:vortex-file-compressed	40174265	43662889	0.92
clickbench_q40/duckdb:vortex-file-compressed	21926797	21248452	1.03
clickbench_q41/duckdb:vortex-file-compressed	20836012	21282156	0.98
clickbench_q42/duckdb:vortex-file-compressed	23138051	23617669	0.98

duckdb / parquet (0.971x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
clickbench_q00/duckdb:parquet	25125677	26288269	0.96
clickbench_q01/duckdb:parquet	27032483	28210552	0.96
clickbench_q02/duckdb:parquet	48904525	49668587	0.98
clickbench_q03/duckdb:parquet	38392781	38969048	0.99
clickbench_q04/duckdb:parquet	202663348	210467253	0.96
clickbench_q05/duckdb:parquet	269042601	275573512	0.98
clickbench_q06/duckdb:parquet	46710656	46568642	1.00
clickbench_q07/duckdb:parquet	29456079	30227481	0.97
clickbench_q08/duckdb:parquet	264675970	274537791	0.96
clickbench_q09/duckdb:parquet	398094766	410253362	0.97
clickbench_q10/duckdb:parquet	82462069	83292420	0.99
clickbench_q11/duckdb:parquet	99733985	100514522	0.99
clickbench_q12/duckdb:parquet	288501298	297639084	0.97
clickbench_q13/duckdb:parquet	483881543	508476367	0.95
clickbench_q14/duckdb:parquet	325499362	331231296	0.98
clickbench_q15/duckdb:parquet	253518894	275367460	0.92
clickbench_q16/duckdb:parquet	648726110	673686444	0.96
clickbench_q17/duckdb:parquet	533681230	572234716	0.93
clickbench_q18/duckdb:parquet	1072353031	1136648169	0.94
clickbench_q19/duckdb:parquet	26427562	26395637	1.00
clickbench_q20/duckdb:parquet	423410434	442727390	0.96
clickbench_q21/duckdb:parquet	548374273	559288547	0.98
clickbench_q22/duckdb:parquet	927922643	959428104	0.97
clickbench_q23/duckdb:parquet	297381068	317741229	0.94
clickbench_q24/duckdb:parquet	69212757	68797715	1.01
clickbench_q25/duckdb:parquet	158491133	158502482	1.00
clickbench_q26/duckdb:parquet	49255718	49820549	0.99
clickbench_q27/duckdb:parquet	642877626	665386216	0.97
clickbench_q28/duckdb:parquet	4849064057	4957172498	0.98
clickbench_q29/duckdb:parquet	40883339	41081567	1.00
clickbench_q30/duckdb:parquet	302234329	311423833	0.97
clickbench_q31/duckdb:parquet	360980202	383161626	0.94
clickbench_q32/duckdb:parquet	1145576657	1175729173	0.97
clickbench_q33/duckdb:parquet	1321357750	1355208438	0.98
clickbench_q34/duckdb:parquet	1313676398	1387738183	0.95
clickbench_q35/duckdb:parquet	364147749	374036673	0.97
clickbench_q36/duckdb:parquet	46943237	48685040	0.96
clickbench_q37/duckdb:parquet	31670826	33513449	0.95
clickbench_q38/duckdb:parquet	33800681	33498550	1.01
clickbench_q39/duckdb:parquet	87788519	87512339	1.00
clickbench_q40/duckdb:parquet	18740716	19817914	0.95
clickbench_q41/duckdb:parquet	17144765	18429399	0.93
clickbench_q42/duckdb:parquet	21392082	20788853	1.03

duckdb / duckdb (0.979x ➖, 1↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
clickbench_q00/duckdb:duckdb	17619973	17623014	1.00
clickbench_q01/duckdb:duckdb	32567783	32825705	0.99
clickbench_q02/duckdb:duckdb	45646087	45516257	1.00
clickbench_q03/duckdb:duckdb	47413103	46724959	1.01
clickbench_q04/duckdb:duckdb	188863275	197434524	0.96
clickbench_q05/duckdb:duckdb	262177289	271517227	0.97
clickbench_q06/duckdb:duckdb 🚀	29303775	36051335	0.81
clickbench_q07/duckdb:duckdb	37086530	35074383	1.06
clickbench_q08/duckdb:duckdb	248261176	251455160	0.99
clickbench_q09/duckdb:duckdb	368395354	376505546	0.98
clickbench_q10/duckdb:duckdb	99183013	100363608	0.99
clickbench_q11/duckdb:duckdb	107864450	109298953	0.99
clickbench_q12/duckdb:duckdb	238442478	247650339	0.96
clickbench_q13/duckdb:duckdb	472635157	492072631	0.96
clickbench_q14/duckdb:duckdb	279396061	284912162	0.98
clickbench_q15/duckdb:duckdb	218032232	233626348	0.93
clickbench_q16/duckdb:duckdb	646656674	655985797	0.99
clickbench_q17/duckdb:duckdb	543620129	560960924	0.97
clickbench_q18/duckdb:duckdb	1177998159	1204368333	0.98
clickbench_q19/duckdb:duckdb	34919617	34868293	1.00
clickbench_q20/duckdb:duckdb	989450848	927338772	1.07
clickbench_q21/duckdb:duckdb	1013891698	1002931107	1.01
clickbench_q22/duckdb:duckdb	1012281249	1107920266	0.91
clickbench_q23/duckdb:duckdb	253707057	269769189	0.94
clickbench_q24/duckdb:duckdb	62161169	60943400	1.02
clickbench_q25/duckdb:duckdb	141662539	145442984	0.97
clickbench_q26/duckdb:duckdb	57749474	61158254	0.94
clickbench_q27/duckdb:duckdb	1019315319	1085611629	0.94
clickbench_q28/duckdb:duckdb	4648652603	4704742252	0.99
clickbench_q29/duckdb:duckdb	49482944	48841352	1.01
clickbench_q30/duckdb:duckdb	262197983	272041897	0.96
clickbench_q31/duckdb:duckdb	423323524	424751533	1.00
clickbench_q32/duckdb:duckdb	1451056540	1565210509	0.93
clickbench_q33/duckdb:duckdb	1923468583	2072398458	0.93
clickbench_q34/duckdb:duckdb	2178178854	2215795421	0.98
clickbench_q35/duckdb:duckdb	285358092	284579128	1.00
clickbench_q36/duckdb:duckdb	42717824	42627592	1.00
clickbench_q37/duckdb:duckdb	31875071	31381492	1.02
clickbench_q38/duckdb:duckdb	31288116	31249610	1.00
clickbench_q39/duckdb:duckdb	66902768	71673739	0.93
clickbench_q40/duckdb:duckdb	32596535	31668446	1.03
clickbench_q41/duckdb:duckdb	30620110	30672268	1.00
clickbench_q42/duckdb:duckdb	32149754	31691568	1.01

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-file-compressed	-5.5%	-2.0%	-3.6%	+784.5%	➖ noise
0	duckdb:duckdb	-0.0%	-2.0%	+2.0%	+287.9%	➖ noise
0	duckdb:vortex-file-compressed	-13.0%	-2.0%	-11.3%	+483.8%	➖ noise
1	datafusion:vortex-file-compressed	-0.6%	-2.1%	+1.5%	+25.0%	➖ noise
1	duckdb:duckdb	-0.8%	-2.1%	+1.3%	+58.8%	➖ noise
1	duckdb:vortex-file-compressed	-5.4%	-2.1%	-3.4%	+24.5%	➖ noise
2	datafusion:vortex-file-compressed	+0.4%	-1.9%	+2.3%	+12.6%	➖ noise
2	duckdb:duckdb	+0.3%	-1.9%	+2.2%	+19.6%	➖ noise
2	duckdb:vortex-file-compressed	-6.2%	-1.9%	-4.4%	+12.8%	➖ noise
3	datafusion:vortex-file-compressed	+0.2%	-2.1%	+2.3%	+140.2%	➖ noise
3	duckdb:duckdb	+1.5%	-2.1%	+3.6%	+38.3%	➖ noise
3	duckdb:vortex-file-compressed	-3.7%	-2.1%	-1.7%	+31.3%	➖ noise
4	datafusion:vortex-file-compressed	-5.9%	-7.2%	+1.4%	+10.0%	➖ noise
4	duckdb:duckdb	-4.3%	-7.2%	+3.0%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-4.7%	-7.2%	+2.7%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	-6.7%	-1.7%	-5.1%	+10.0%	➖ noise
5	duckdb:duckdb	-3.4%	-1.7%	-1.8%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-6.3%	-1.7%	-4.7%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-14.5%	+0.3%	-14.8%	+36.1%	➖ noise
6	duckdb:duckdb	-18.7%	+0.3%	-19.0%	+27.9%	➖ noise
6	duckdb:vortex-file-compressed	-7.5%	+0.3%	-7.8%	+17.9%	➖ noise
7	datafusion:vortex-file-compressed	+7.3%	-2.4%	+9.9%	+18.9%	➖ noise
7	duckdb:duckdb	+5.7%	-2.4%	+8.3%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-0.1%	-2.4%	+2.3%	+12.3%	➖ noise
8	datafusion:vortex-file-compressed	-4.9%	-4.2%	-0.7%	+10.0%	➖ noise
8	duckdb:duckdb	-1.3%	-4.2%	+3.1%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-2.3%	-4.2%	+2.1%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	-6.5%	-3.8%	-2.7%	+10.0%	➖ noise
9	duckdb:duckdb	-2.2%	-3.8%	+1.7%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-6.2%	-3.8%	-2.5%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	+1.0%	-3.0%	+4.1%	+10.0%	➖ noise
10	duckdb:duckdb	-1.2%	-3.0%	+1.9%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-1.9%	-3.0%	+1.1%	+10.0%	➖ noise
11	datafusion:vortex-file-compressed	-5.8%	-2.8%	-3.1%	+10.0%	➖ noise
11	duckdb:duckdb	-1.3%	-2.8%	+1.6%	+10.0%	➖ noise
11	duckdb:vortex-file-compressed	-2.9%	-2.8%	-0.1%	+10.0%	➖ noise
12	datafusion:vortex-file-compressed	-4.5%	-2.6%	-2.0%	+10.0%	➖ noise
12	duckdb:duckdb	-3.7%	-2.6%	-1.2%	+10.0%	➖ noise
12	duckdb:vortex-file-compressed	-5.1%	-2.6%	-2.6%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	-6.0%	-7.0%	+1.0%	+10.0%	➖ noise
13	duckdb:duckdb	-4.0%	-7.0%	+3.3%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	-5.1%	-7.0%	+2.1%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	-7.9%	-3.9%	-4.2%	+10.0%	➖ noise
14	duckdb:duckdb	-1.9%	-3.9%	+2.0%	+10.0%	➖ noise
14	duckdb:vortex-file-compressed	-4.6%	-3.9%	-0.8%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	-4.8%	-6.0%	+1.3%	+10.0%	➖ noise
15	duckdb:duckdb	-6.7%	-6.0%	-0.7%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	-5.7%	-6.0%	+0.3%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	-6.1%	-5.2%	-1.0%	+10.0%	➖ noise
16	duckdb:duckdb	-1.4%	-5.2%	+3.9%	+10.0%	➖ noise
16	duckdb:vortex-file-compressed	-3.9%	-5.2%	+1.4%	+10.0%	➖ noise
17	datafusion:vortex-file-compressed	-5.8%	-6.1%	+0.3%	+10.0%	➖ noise
17	duckdb:duckdb	-3.1%	-6.1%	+3.2%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	-2.4%	-6.1%	+3.9%	+10.0%	➖ noise
18	datafusion:vortex-file-compressed	-6.4%	-6.2%	-0.2%	+10.0%	➖ noise
18	duckdb:duckdb	-2.2%	-6.2%	+4.3%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	-3.2%	-6.2%	+3.2%	+10.0%	➖ noise
19	datafusion:vortex-file-compressed	+11.6%	-1.2%	+13.0%	+25.0%	➖ noise
19	duckdb:duckdb	+0.1%	-1.2%	+1.4%	+16.9%	➖ noise
19	duckdb:vortex-file-compressed	-4.3%	-1.2%	-3.1%	+20.7%	➖ noise
20	datafusion:vortex-file-compressed	-2.5%	-5.2%	+2.8%	+210.0%	➖ noise
20	duckdb:duckdb	+6.7%	-5.2%	+12.5%	+24.2%	➖ noise
20	duckdb:vortex-file-compressed	-9.6%	-5.2%	-4.7%	+38.6%	➖ noise
21	datafusion:vortex-file-compressed	-6.6%	-3.8%	-2.9%	+10.0%	➖ noise
21	duckdb:duckdb	+1.1%	-3.8%	+5.1%	+15.2%	➖ noise
21	duckdb:vortex-file-compressed	-7.8%	-3.8%	-4.1%	+10.0%	➖ noise
22	datafusion:vortex-file-compressed	-5.2%	-4.1%	-1.1%	+13.7%	➖ noise
22	duckdb:duckdb	-8.6%	-4.1%	-4.7%	+12.9%	➖ noise
22	duckdb:vortex-file-compressed	-21.1%	-4.1%	-17.7%	+17.4%	✅ faster
23	datafusion:vortex-file-compressed	-0.8%	-5.6%	+5.1%	+42.0%	➖ noise
23	duckdb:duckdb	-6.0%	-5.6%	-0.3%	+10.0%	➖ noise
23	duckdb:vortex-file-compressed	+13.2%	-5.6%	+20.0%	+10.0%	🚨 regression
24	datafusion:vortex-file-compressed	-3.8%	-2.0%	-1.8%	+10.0%	➖ noise
24	duckdb:duckdb	+2.0%	-2.0%	+4.1%	+13.2%	➖ noise
24	duckdb:vortex-file-compressed	-14.4%	-2.0%	-12.6%	+17.4%	➖ noise
25	datafusion:vortex-file-compressed	-6.7%	-3.1%	-3.7%	+10.0%	➖ noise
25	duckdb:duckdb	-2.6%	-3.1%	+0.5%	+10.0%	➖ noise
25	duckdb:vortex-file-compressed	+0.5%	-3.1%	+3.7%	+11.1%	➖ noise
26	datafusion:vortex-file-compressed	-5.3%	-0.1%	-5.2%	+10.2%	➖ noise
26	duckdb:duckdb	-5.6%	-0.1%	-5.5%	+10.3%	➖ noise
26	duckdb:vortex-file-compressed	-12.4%	-0.1%	-12.3%	+12.9%	✅ faster
27	datafusion:vortex-file-compressed	+2.0%	-4.4%	+6.7%	+10.0%	➖ noise
27	duckdb:duckdb	-6.1%	-4.4%	-1.8%	+14.3%	➖ noise
27	duckdb:vortex-file-compressed	-5.1%	-4.4%	-0.7%	+10.0%	➖ noise
28	datafusion:vortex-file-compressed	-2.0%	-2.2%	+0.2%	+10.0%	➖ noise
28	duckdb:duckdb	-1.2%	-2.2%	+1.0%	+10.0%	➖ noise
28	duckdb:vortex-file-compressed	-2.7%	-2.2%	-0.5%	+10.0%	➖ noise
29	datafusion:vortex-file-compressed	-0.5%	-1.8%	+1.4%	+10.0%	➖ noise
29	duckdb:duckdb	+1.3%	-1.8%	+3.2%	+10.0%	➖ noise
29	duckdb:vortex-file-compressed	-1.2%	-1.8%	+0.6%	+10.0%	➖ noise
30	datafusion:vortex-file-compressed	-6.1%	-4.0%	-2.2%	+10.0%	➖ noise
30	duckdb:duckdb	-3.6%	-4.0%	+0.3%	+10.0%	➖ noise
30	duckdb:vortex-file-compressed	-3.3%	-4.0%	+0.7%	+10.0%	➖ noise
31	datafusion:vortex-file-compressed	-7.1%	-5.6%	-1.7%	+10.0%	➖ noise
31	duckdb:duckdb	-0.3%	-5.6%	+5.5%	+10.0%	➖ noise
31	duckdb:vortex-file-compressed	-5.5%	-5.6%	+0.1%	+10.0%	➖ noise
32	datafusion:vortex-file-compressed	-5.9%	-3.9%	-2.1%	+10.0%	➖ noise
32	duckdb:duckdb	-7.3%	-3.9%	-3.5%	+10.0%	➖ noise
32	duckdb:vortex-file-compressed	-0.6%	-3.9%	+3.5%	+10.0%	➖ noise
33	datafusion:vortex-file-compressed	-6.4%	-5.5%	-0.9%	+10.0%	➖ noise
33	duckdb:duckdb	-7.2%	-5.5%	-1.8%	+10.0%	➖ noise
33	duckdb:vortex-file-compressed	-3.7%	-5.5%	+1.9%	+10.0%	➖ noise
34	datafusion:vortex-file-compressed	-6.7%	-4.6%	-2.1%	+10.0%	➖ noise
34	duckdb:duckdb	-1.7%	-4.6%	+3.1%	+10.0%	➖ noise
34	duckdb:vortex-file-compressed	-4.0%	-4.6%	+0.6%	+10.0%	➖ noise
35	datafusion:vortex-file-compressed	-3.1%	-4.0%	+0.9%	+10.0%	➖ noise
35	duckdb:duckdb	+0.3%	-4.0%	+4.4%	+10.0%	➖ noise
35	duckdb:vortex-file-compressed	-5.9%	-4.0%	-2.1%	+10.0%	➖ noise
36	datafusion:vortex-file-compressed	-4.0%	-4.4%	+0.4%	+10.0%	➖ noise
36	duckdb:duckdb	+0.2%	-4.4%	+4.8%	+11.4%	➖ noise
36	duckdb:vortex-file-compressed	+1.7%	-4.4%	+6.4%	+10.5%	➖ noise
37	datafusion:vortex-file-compressed	-7.1%	-3.8%	-3.4%	+10.0%	➖ noise
37	duckdb:duckdb	+1.6%	-3.8%	+5.6%	+10.0%	➖ noise
37	duckdb:vortex-file-compressed	+8.6%	-3.8%	+12.9%	+12.5%	🚨 regression
38	datafusion:vortex-file-compressed	-1.9%	-3.3%	+1.5%	+11.0%	➖ noise
38	duckdb:duckdb	+0.1%	-3.3%	+3.5%	+11.8%	➖ noise
38	duckdb:vortex-file-compressed	+5.9%	-3.3%	+9.5%	+15.6%	➖ noise
39	datafusion:vortex-file-compressed	-6.4%	-1.7%	-4.8%	+10.0%	➖ noise
39	duckdb:duckdb	-6.7%	-1.7%	-5.1%	+13.7%	➖ noise
39	duckdb:vortex-file-compressed	-8.0%	-1.7%	-6.4%	+10.0%	➖ noise
40	datafusion:vortex-file-compressed	-6.9%	-3.5%	-3.6%	+10.3%	➖ noise
40	duckdb:duckdb	+2.9%	-3.5%	+6.6%	+10.8%	➖ noise
40	duckdb:vortex-file-compressed	+3.2%	-3.5%	+6.9%	+16.1%	➖ noise
41	datafusion:vortex-file-compressed	-8.7%	-3.4%	-5.5%	+10.1%	➖ noise
41	duckdb:duckdb	-0.2%	-3.4%	+3.4%	+10.8%	➖ noise
41	duckdb:vortex-file-compressed	-2.1%	-3.4%	+1.4%	+12.3%	➖ noise
42	datafusion:vortex-file-compressed	-6.5%	-1.4%	-5.1%	+10.7%	➖ noise
42	duckdb:duckdb	+1.4%	-1.4%	+2.9%	+10.7%	➖ noise
42	duckdb:vortex-file-compressed	-2.0%	-1.4%	-0.6%	+12.1%	➖ noise

github-actions · 2026-05-06T22:51:40Z

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)

File	Scale	Format	Base	HEAD	Change	%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%

Totals:

vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

github-actions · 2026-05-06T22:52:11Z

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.0%
Vortex (geomean): 0.934x ➖
Parquet (geomean): 0.925x ➖
Shifts: Parquet (control) -7.5% · Median polish -6.2%

datafusion / vortex-file-compressed (0.940x ➖, 1↑ 1↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	242371660	255958942	0.95
tpch_q02/datafusion:vortex-file-compressed	477314308	415420846	1.15
tpch_q03/datafusion:vortex-file-compressed	536157323	490899488	1.09
tpch_q04/datafusion:vortex-file-compressed	247682930	341807490	0.72
tpch_q05/datafusion:vortex-file-compressed	400391248	457966971	0.87
tpch_q06/datafusion:vortex-file-compressed	343164588	405040450	0.85
tpch_q07/datafusion:vortex-file-compressed	405843876	463481715	0.88
tpch_q08/datafusion:vortex-file-compressed	696756658	646491709	1.08
tpch_q09/datafusion:vortex-file-compressed	466238711	425662910	1.10
tpch_q10/datafusion:vortex-file-compressed	458501115	486795047	0.94
tpch_q11/datafusion:vortex-file-compressed	269907037	308161031	0.88
tpch_q12/datafusion:vortex-file-compressed	644840800	554962023	1.16
tpch_q13/datafusion:vortex-file-compressed 🚨	287097092	212122722	1.35
tpch_q14/datafusion:vortex-file-compressed	284094914	288233330	0.99
tpch_q15/datafusion:vortex-file-compressed	535120196	543078385	0.99
tpch_q16/datafusion:vortex-file-compressed 🚀	195256152	300408567	0.65
tpch_q17/datafusion:vortex-file-compressed	472644377	464107818	1.02
tpch_q18/datafusion:vortex-file-compressed	344714477	385172005	0.89
tpch_q19/datafusion:vortex-file-compressed	493464613	524706375	0.94
tpch_q20/datafusion:vortex-file-compressed	432450833	514447995	0.84
tpch_q21/datafusion:vortex-file-compressed	574171692	614034993	0.94
tpch_q22/datafusion:vortex-file-compressed	116282793	164302793	0.71

datafusion / vortex-compact (0.895x ➖, 2↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	255913552	257458158	0.99
tpch_q02/datafusion:vortex-compact	418307748	458007683	0.91
tpch_q03/datafusion:vortex-compact	387074169	439320518	0.88
tpch_q04/datafusion:vortex-compact	373488722	462503389	0.81
tpch_q05/datafusion:vortex-compact 🚀	383919400	750538260	0.51
tpch_q06/datafusion:vortex-compact	340848519	426398480	0.80
tpch_q07/datafusion:vortex-compact	372208731	417289327	0.89
tpch_q08/datafusion:vortex-compact	579640345	613853528	0.94
tpch_q09/datafusion:vortex-compact	481868908	486526050	0.99
tpch_q10/datafusion:vortex-compact 🚀	410293119	680148223	0.60
tpch_q11/datafusion:vortex-compact	239040335	326060158	0.73
tpch_q12/datafusion:vortex-compact	618364022	487432071	1.27
tpch_q13/datafusion:vortex-compact	236528277	255596306	0.93
tpch_q14/datafusion:vortex-compact	267670396	291628844	0.92
tpch_q15/datafusion:vortex-compact	524408161	440326483	1.19
tpch_q16/datafusion:vortex-compact	178768980	185633100	0.96
tpch_q17/datafusion:vortex-compact	337621140	423925717	0.80
tpch_q18/datafusion:vortex-compact	314870345	310002429	1.02
tpch_q19/datafusion:vortex-compact	478832539	462164322	1.04
tpch_q20/datafusion:vortex-compact	440602357	479351205	0.92
tpch_q21/datafusion:vortex-compact	504730423	574341609	0.88
tpch_q22/datafusion:vortex-compact	105454697	97712211	1.08

datafusion / parquet (0.889x ➖, 1↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	220886810	224625995	0.98
tpch_q02/datafusion:parquet	409886532	414015172	0.99
tpch_q03/datafusion:parquet	343267819	308850612	1.11
tpch_q04/datafusion:parquet	164779053	164342477	1.00
tpch_q05/datafusion:parquet	451911102	481541217	0.94
tpch_q06/datafusion:parquet	155953184	165975058	0.94
tpch_q07/datafusion:parquet	449780905	498744603	0.90
tpch_q08/datafusion:parquet	525740498	572016952	0.92
tpch_q09/datafusion:parquet	462363520	473878299	0.98
tpch_q10/datafusion:parquet	477247784	521350889	0.92
tpch_q11/datafusion:parquet	309808016	436614200	0.71
tpch_q12/datafusion:parquet	216662313	275003899	0.79
tpch_q13/datafusion:parquet	426885653	455205985	0.94
tpch_q14/datafusion:parquet	171984018	206764986	0.83
tpch_q15/datafusion:parquet	291354276	338003205	0.86
tpch_q16/datafusion:parquet	157947133	194589339	0.81
tpch_q17/datafusion:parquet	365244364	371186313	0.98
tpch_q18/datafusion:parquet	428495224	465734529	0.92
tpch_q19/datafusion:parquet	291789623	366527535	0.80
tpch_q20/datafusion:parquet	290270849	318347806	0.91
tpch_q21/datafusion:parquet	458478448	586543601	0.78
tpch_q22/datafusion:parquet 🚀	112283610	166657703	0.67

duckdb / vortex-file-compressed (0.945x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	262155303	297913860	0.88
tpch_q02/duckdb:vortex-file-compressed	963050396	993101434	0.97
tpch_q03/duckdb:vortex-file-compressed	639485546	734220457	0.87
tpch_q04/duckdb:vortex-file-compressed	363596958	398305330	0.91
tpch_q05/duckdb:vortex-file-compressed	874642685	1033810854	0.85
tpch_q06/duckdb:vortex-file-compressed	419899761	402253018	1.04
tpch_q07/duckdb:vortex-file-compressed	758554640	831931167	0.91
tpch_q08/duckdb:vortex-file-compressed	946947781	1003093781	0.94
tpch_q09/duckdb:vortex-file-compressed	790339633	872320013	0.91
tpch_q10/duckdb:vortex-file-compressed	726750521	787693370	0.92
tpch_q11/duckdb:vortex-file-compressed	496633808	524231270	0.95
tpch_q12/duckdb:vortex-file-compressed	455442378	520420294	0.88
tpch_q13/duckdb:vortex-file-compressed	472484182	481575789	0.98
tpch_q14/duckdb:vortex-file-compressed	486391704	536513724	0.91
tpch_q15/duckdb:vortex-file-compressed	315691134	288169330	1.10
tpch_q16/duckdb:vortex-file-compressed	369615032	396346088	0.93
tpch_q17/duckdb:vortex-file-compressed	668893078	686629348	0.97
tpch_q18/duckdb:vortex-file-compressed	532774990	528410614	1.01
tpch_q19/duckdb:vortex-file-compressed	442569323	443879445	1.00
tpch_q20/duckdb:vortex-file-compressed	871501531	851752891	1.02
tpch_q21/duckdb:vortex-file-compressed	1052460060	1113926803	0.94
tpch_q22/duckdb:vortex-file-compressed	370852799	393650314	0.94

duckdb / vortex-compact (0.958x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	319534316	285732369	1.12
tpch_q02/duckdb:vortex-compact	947875776	932143922	1.02
tpch_q03/duckdb:vortex-compact	588085985	653287287	0.90
tpch_q04/duckdb:vortex-compact	380219418	392770302	0.97
tpch_q05/duckdb:vortex-compact	893490361	923177413	0.97
tpch_q06/duckdb:vortex-compact	402082229	448028499	0.90
tpch_q07/duckdb:vortex-compact	723812171	861465639	0.84
tpch_q08/duckdb:vortex-compact	963661715	968135484	1.00
tpch_q09/duckdb:vortex-compact	887028900	970732780	0.91
tpch_q10/duckdb:vortex-compact	689425498	679775642	1.01
tpch_q11/duckdb:vortex-compact	517743725	457795192	1.13
tpch_q12/duckdb:vortex-compact	484628411	483940815	1.00
tpch_q13/duckdb:vortex-compact	482994494	448926207	1.08
tpch_q14/duckdb:vortex-compact	460298485	500230979	0.92
tpch_q15/duckdb:vortex-compact	259619270	306908140	0.85
tpch_q16/duckdb:vortex-compact	379985880	410500228	0.93
tpch_q17/duckdb:vortex-compact	636232812	653548143	0.97
tpch_q18/duckdb:vortex-compact	493558682	514183106	0.96
tpch_q19/duckdb:vortex-compact	453075635	561347957	0.81
tpch_q20/duckdb:vortex-compact	787496449	867965940	0.91
tpch_q21/duckdb:vortex-compact	1118313799	1127667947	0.99
tpch_q22/duckdb:vortex-compact	365225007	371143342	0.98

duckdb / parquet (0.962x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	454697726	479271499	0.95
tpch_q02/duckdb:parquet	1098259785	1146445615	0.96
tpch_q03/duckdb:parquet	991284847	1058153226	0.94
tpch_q04/duckdb:parquet	646795750	646942683	1.00
tpch_q05/duckdb:parquet	1225493304	1276672447	0.96
tpch_q06/duckdb:parquet	407808399	486895208	0.84
tpch_q07/duckdb:parquet	1159378971	1103721461	1.05
tpch_q08/duckdb:parquet	1489581928	1644767166	0.91
tpch_q09/duckdb:parquet	1406408153	1576431913	0.89
tpch_q10/duckdb:parquet	1235435196	1316196403	0.94
tpch_q11/duckdb:parquet	759080164	744961074	1.02
tpch_q12/duckdb:parquet	709948435	729556978	0.97
tpch_q13/duckdb:parquet	890865058	929506567	0.96
tpch_q14/duckdb:parquet	713134764	653190782	1.09
tpch_q15/duckdb:parquet	481142936	515897297	0.93
tpch_q16/duckdb:parquet	673494943	689163067	0.98
tpch_q17/duckdb:parquet	750261308	826561335	0.91
tpch_q18/duckdb:parquet	878276428	865198795	1.02
tpch_q19/duckdb:parquet	792670077	813154953	0.97
tpch_q20/duckdb:parquet	1070820369	1124536815	0.95
tpch_q21/duckdb:parquet	1038590007	1066407864	0.97
tpch_q22/duckdb:parquet	568464397	566369906	1.00

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	-0.6%	-3.4%	+2.9%	+67.6%	➖ noise
1	datafusion:vortex-file-compressed	-5.3%	-3.4%	-2.0%	+67.1%	➖ noise
1	duckdb:vortex-compact	+11.8%	-3.4%	+15.8%	+37.6%	➖ noise
1	duckdb:vortex-file-compressed	-12.0%	-3.4%	-8.9%	+46.6%	➖ noise
2	datafusion:vortex-compact	-8.7%	-2.6%	-6.2%	+38.5%	➖ noise
2	datafusion:vortex-file-compressed	+14.9%	-2.6%	+18.0%	+30.0%	➖ noise
2	duckdb:vortex-compact	+1.7%	-2.6%	+4.4%	+30.0%	➖ noise
2	duckdb:vortex-file-compressed	-3.0%	-2.6%	-0.4%	+30.0%	➖ noise
3	datafusion:vortex-compact	-11.9%	+2.0%	-13.7%	+55.8%	➖ noise
3	datafusion:vortex-file-compressed	+9.2%	+2.0%	+7.0%	+47.3%	➖ noise
3	duckdb:vortex-compact	-10.0%	+2.0%	-11.8%	+30.0%	➖ noise
3	duckdb:vortex-file-compressed	-12.9%	+2.0%	-14.6%	+30.0%	➖ noise
4	datafusion:vortex-compact	-19.2%	+0.1%	-19.3%	+54.9%	➖ noise
4	datafusion:vortex-file-compressed	-27.5%	+0.1%	-27.6%	+47.4%	➖ noise
4	duckdb:vortex-compact	-3.2%	+0.1%	-3.3%	+30.0%	➖ noise
4	duckdb:vortex-file-compressed	-8.7%	+0.1%	-8.8%	+30.0%	➖ noise
5	datafusion:vortex-compact	-48.8%	-5.1%	-46.1%	+32.8%	✅ faster
5	datafusion:vortex-file-compressed	-12.6%	-5.1%	-7.9%	+30.0%	➖ noise
5	duckdb:vortex-compact	-3.2%	-5.1%	+2.0%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	-15.4%	-5.1%	-10.9%	+30.0%	➖ noise
6	datafusion:vortex-compact	-20.1%	-11.3%	-9.9%	+30.0%	➖ noise
6	datafusion:vortex-file-compressed	-15.3%	-11.3%	-4.5%	+30.0%	➖ noise
6	duckdb:vortex-compact	-10.3%	-11.3%	+1.2%	+30.0%	➖ noise
6	duckdb:vortex-file-compressed	+4.4%	-11.3%	+17.7%	+34.4%	➖ noise
7	datafusion:vortex-compact	-10.8%	-2.7%	-8.4%	+30.0%	➖ noise
7	datafusion:vortex-file-compressed	-12.4%	-2.7%	-10.0%	+30.0%	➖ noise
7	duckdb:vortex-compact	-16.0%	-2.7%	-13.7%	+30.0%	➖ noise
7	duckdb:vortex-file-compressed	-8.8%	-2.7%	-6.3%	+30.0%	➖ noise
8	datafusion:vortex-compact	-5.6%	-8.8%	+3.5%	+30.0%	➖ noise
8	datafusion:vortex-file-compressed	+7.8%	-8.8%	+18.1%	+30.6%	➖ noise
8	duckdb:vortex-compact	-0.5%	-8.8%	+9.1%	+30.0%	➖ noise
8	duckdb:vortex-file-compressed	-5.6%	-8.8%	+3.5%	+30.0%	➖ noise
9	datafusion:vortex-compact	-1.0%	-6.7%	+6.2%	+32.7%	➖ noise
9	datafusion:vortex-file-compressed	+9.5%	-6.7%	+17.4%	+39.4%	➖ noise
9	duckdb:vortex-compact	-8.6%	-6.7%	-2.1%	+30.0%	➖ noise
9	duckdb:vortex-file-compressed	-9.4%	-6.7%	-2.9%	+30.0%	➖ noise
10	datafusion:vortex-compact	-39.7%	-7.3%	-34.9%	+30.0%	✅ faster
10	datafusion:vortex-file-compressed	-5.8%	-7.3%	+1.6%	+30.0%	➖ noise
10	duckdb:vortex-compact	+1.4%	-7.3%	+9.4%	+30.0%	➖ noise
10	duckdb:vortex-file-compressed	-7.7%	-7.3%	-0.5%	+30.0%	➖ noise
11	datafusion:vortex-compact	-26.7%	-15.0%	-13.8%	+30.0%	➖ noise
11	datafusion:vortex-file-compressed	-12.4%	-15.0%	+3.0%	+30.0%	➖ noise
11	duckdb:vortex-compact	+13.1%	-15.0%	+33.0%	+30.0%	🚨 regression
11	duckdb:vortex-file-compressed	-5.3%	-15.0%	+11.4%	+30.0%	➖ noise
12	datafusion:vortex-compact	+26.9%	-12.4%	+44.9%	+39.2%	🚨 regression
12	datafusion:vortex-file-compressed	+16.2%	-12.4%	+32.7%	+36.8%	➖ noise
12	duckdb:vortex-compact	+0.1%	-12.4%	+14.4%	+30.0%	➖ noise
12	duckdb:vortex-file-compressed	-12.5%	-12.4%	-0.1%	+30.0%	➖ noise
13	datafusion:vortex-compact	-7.5%	-5.2%	-2.4%	+63.7%	➖ noise
13	datafusion:vortex-file-compressed	+35.3%	-5.2%	+42.8%	+54.9%	➖ noise
13	duckdb:vortex-compact	+7.6%	-5.2%	+13.5%	+30.0%	➖ noise
13	duckdb:vortex-file-compressed	-1.9%	-5.2%	+3.5%	+30.0%	➖ noise
14	datafusion:vortex-compact	-8.2%	-4.7%	-3.7%	+36.4%	➖ noise
14	datafusion:vortex-file-compressed	-1.4%	-4.7%	+3.4%	+30.0%	➖ noise
14	duckdb:vortex-compact	-8.0%	-4.7%	-3.4%	+30.0%	➖ noise
14	duckdb:vortex-file-compressed	-9.3%	-4.7%	-4.9%	+30.0%	➖ noise
15	datafusion:vortex-compact	+19.1%	-10.3%	+32.8%	+30.0%	🚨 regression
15	datafusion:vortex-file-compressed	-1.5%	-10.3%	+9.9%	+30.0%	➖ noise
15	duckdb:vortex-compact	-15.4%	-10.3%	-5.7%	+30.0%	➖ noise
15	duckdb:vortex-file-compressed	+9.6%	-10.3%	+22.2%	+30.0%	➖ noise
16	datafusion:vortex-compact	-3.7%	-10.9%	+8.1%	+30.0%	➖ noise
16	datafusion:vortex-file-compressed	-35.0%	-10.9%	-27.0%	+67.1%	➖ noise
16	duckdb:vortex-compact	-7.4%	-10.9%	+3.9%	+30.0%	➖ noise
16	duckdb:vortex-file-compressed	-6.7%	-10.9%	+4.7%	+30.0%	➖ noise
17	datafusion:vortex-compact	-20.4%	-5.5%	-15.7%	+38.1%	➖ noise
17	datafusion:vortex-file-compressed	+1.8%	-5.5%	+7.8%	+39.9%	➖ noise
17	duckdb:vortex-compact	-2.6%	-5.5%	+3.0%	+30.0%	➖ noise
17	duckdb:vortex-file-compressed	-2.6%	-5.5%	+3.1%	+30.0%	➖ noise
18	datafusion:vortex-compact	+1.6%	-3.4%	+5.1%	+30.6%	➖ noise
18	datafusion:vortex-file-compressed	-10.5%	-3.4%	-7.4%	+36.6%	➖ noise
18	duckdb:vortex-compact	-4.0%	-3.4%	-0.7%	+30.0%	➖ noise
18	duckdb:vortex-file-compressed	+0.8%	-3.4%	+4.3%	+30.0%	➖ noise
19	datafusion:vortex-compact	+3.6%	-11.9%	+17.6%	+30.0%	➖ noise
19	datafusion:vortex-file-compressed	-6.0%	-11.9%	+6.8%	+30.0%	➖ noise
19	duckdb:vortex-compact	-19.3%	-11.9%	-8.4%	+30.0%	➖ noise
19	duckdb:vortex-file-compressed	-0.3%	-11.9%	+13.2%	+30.0%	➖ noise
20	datafusion:vortex-compact	-8.1%	-6.8%	-1.4%	+30.0%	➖ noise
20	datafusion:vortex-file-compressed	-15.9%	-6.8%	-9.8%	+30.0%	➖ noise
20	duckdb:vortex-compact	-9.3%	-6.8%	-2.6%	+30.0%	➖ noise
20	duckdb:vortex-file-compressed	+2.3%	-6.8%	+9.8%	+30.0%	➖ noise
21	datafusion:vortex-compact	-12.1%	-12.7%	+0.7%	+30.0%	➖ noise
21	datafusion:vortex-file-compressed	-6.5%	-12.7%	+7.2%	+30.0%	➖ noise
21	duckdb:vortex-compact	-0.8%	-12.7%	+13.7%	+30.0%	➖ noise
21	duckdb:vortex-file-compressed	-5.5%	-12.7%	+8.3%	+30.0%	➖ noise
22	datafusion:vortex-compact	+7.9%	-17.8%	+31.2%	+30.0%	🚨 regression
22	datafusion:vortex-file-compressed	-29.2%	-17.8%	-13.9%	+34.9%	➖ noise
22	duckdb:vortex-compact	-1.6%	-17.8%	+19.7%	+30.0%	➖ noise
22	duckdb:vortex-file-compressed	-5.8%	-17.8%	+14.6%	+30.0%	➖ noise

github-actions · 2026-05-06T22:55:55Z

Benchmarks: Compression

Vortex (geomean): 1.006x ➖
Parquet (geomean): 1.003x ➖

unknown / unknown (1.004x ➖, 2↑ 5↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
compress time/Arade	1122760167	1132211167	0.99
compress time/Bimbo	6707266807	6905971377	0.97
compress time/CMSprovider	2796997994	2854572254	0.98
compress time/Euro2016	417254899	432244538	0.97
compress time/Food	384536568	395309946	0.97
compress time/HashTags	791620176	827735538	0.96
compress time/TPC-H l_comment canonical	1283388069	1309547144	0.98
compress time/TPC-H l_comment chunked	1300712881	1307406556	0.99
compress time/taxi	701874011	717188510	0.98
compress time/wide table cols=100 chunks=1 rows=1000	11455543	11708979	0.98
compress time/wide table cols=100 chunks=50 rows=1000 🚨	13499443	11942692	1.13
compress time/wide table cols=1000 chunks=1 rows=1000	128789502	132720428	0.97
compress time/wide table cols=1000 chunks=50 rows=1000	128556953	129759097	0.99
compress time/wide table cols=10000 chunks=1 rows=1000	1442089326	1427418785	1.01
compress time/wide table cols=10000 chunks=50 rows=1000	1456073159	1462705500	1.00
decompress time/Arade	27600847	25660918	1.08
decompress time/Bimbo	78684586	81003277	0.97
decompress time/CMSprovider	77603786	74153567	1.05
decompress time/Euro2016	18524587	18315572	1.01
decompress time/Food	8095912	7949861	1.02
decompress time/HashTags	71682262	69710959	1.03
decompress time/TPC-H l_comment canonical	40073459	39080444	1.03
decompress time/TPC-H l_comment chunked	39633038	39227947	1.01
decompress time/taxi 🚀	14420890	16906881	0.85
decompress time/wide table cols=100 chunks=1 rows=1000	2537358	2380075	1.07
decompress time/wide table cols=100 chunks=50 rows=1000 🚨	2679230	2422821	1.11
decompress time/wide table cols=1000 chunks=1 rows=1000	24597443	22614972	1.09
decompress time/wide table cols=1000 chunks=50 rows=1000	24321403	22709462	1.07
decompress time/wide table cols=10000 chunks=1 rows=1000	268465671	252205106	1.06
decompress time/wide table cols=10000 chunks=50 rows=1000	259185475	261694312	0.99
parquet size/Arade	258014282	258014282	1.00
parquet size/Bimbo	384517292	384517292	1.00
parquet size/CMSprovider	376885545	376885545	1.00
parquet size/Euro2016	122975499	122975499	1.00
parquet size/Food	35699500	35699500	1.00
parquet size/HashTags	133510943	133510943	1.00
parquet size/TPC-H l_comment canonical	158358238	158358238	1.00
parquet size/TPC-H l_comment chunked	158358238	158358238	1.00
parquet size/taxi	55283635	55283635	1.00
parquet size/wide table cols=100 chunks=1 rows=1000	932404	932404	1.00
parquet size/wide table cols=100 chunks=50 rows=1000	932404	932404	1.00
parquet size/wide table cols=1000 chunks=1 rows=1000	9324004	9324004	1.00
parquet size/wide table cols=1000 chunks=50 rows=1000	9324004	9324004	1.00
parquet size/wide table cols=10000 chunks=1 rows=1000	93240004	93240004	1.00
parquet size/wide table cols=10000 chunks=50 rows=1000	93240004	93240004	1.00
parquet_rs-zstd compress time/Arade	2562883827	2635948553	0.97
parquet_rs-zstd compress time/Bimbo	12642222567	12623939810	1.00
parquet_rs-zstd compress time/CMSprovider	6812886895	6777851624	1.01
parquet_rs-zstd compress time/Euro2016	1296955512	1295501878	1.00
parquet_rs-zstd compress time/Food	797198489	789518088	1.01
parquet_rs-zstd compress time/HashTags	2178074826	2124649174	1.03
parquet_rs-zstd compress time/TPC-H l_comment canonical	3145681372	3161765521	0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked	3155225263	3138465573	1.01
parquet_rs-zstd compress time/taxi	1205788330	1203645132	1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000	5928896	6020093	0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000	6016261	6141940	0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000	74031533	73759588	1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000	74633608	73424143	1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000	783764735	789082101	0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000	777062754	806014981	0.96
parquet_rs-zstd decompress time/Arade	611185687	629557428	0.97
parquet_rs-zstd decompress time/Bimbo	1673432390	1679079170	1.00
parquet_rs-zstd decompress time/CMSprovider	1693681555	1689325886	1.00
parquet_rs-zstd decompress time/Euro2016	372068716	372475899	1.00
parquet_rs-zstd decompress time/Food	195330711	197295756	0.99
parquet_rs-zstd decompress time/HashTags	621307292	616511702	1.01
parquet_rs-zstd decompress time/TPC-H l_comment canonical	582989859	589301567	0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked	584569190	584158824	1.00
parquet_rs-zstd decompress time/taxi	245200759	247148674	0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000	2745162	2777299	0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000	2742028	2855851	0.96
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000	32386911	32118713	1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000	32800830	32731332	1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000	343623782	345497896	0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000	350188594	342171710	1.02
vortex-file-compressed size/Arade	145363796	145363796	1.00
vortex-file-compressed size/Bimbo	468763332	468763332	1.00
vortex-file-compressed size/CMSprovider	417907812	417907812	1.00
vortex-file-compressed size/Euro2016	163599156	163757340	1.00
vortex-file-compressed size/Food	41926936	41926936	1.00
vortex-file-compressed size/HashTags	195647828	195647828	1.00
vortex-file-compressed size/TPC-H l_comment canonical	179087360	179087360	1.00
vortex-file-compressed size/TPC-H l_comment chunked	179087360	179087360	1.00
vortex-file-compressed size/taxi	52363948	52363948	1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000	930848	930848	1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000	930848	930848	1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000	9293648	9293648	1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000	9293648	9293648	1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000	92957648	92957648	1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000	92957648	92957648	1.00
vortex:parquet-zstd ratio compress time/Arade	0	0	1.02
vortex:parquet-zstd ratio compress time/Bimbo	0	0	0.97
vortex:parquet-zstd ratio compress time/CMSprovider	0	0	0.97
vortex:parquet-zstd ratio compress time/Euro2016	0	0	0.96
vortex:parquet-zstd ratio compress time/Food	0	0	0.96
vortex:parquet-zstd ratio compress time/HashTags	0	0	0.93
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical	0	0	0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked	0	0	0.99
vortex:parquet-zstd ratio compress time/taxi	0	0	0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000	1	1	0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚨	2	1	1.15
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000	1	1	0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000	1	1	0.97
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000	1	1	1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000	1	1	1.03
vortex:parquet-zstd ratio decompress time/Arade 🚨	0	0	1.11
vortex:parquet-zstd ratio decompress time/Bimbo	0	0	0.97
vortex:parquet-zstd ratio decompress time/CMSprovider	0	0	1.04
vortex:parquet-zstd ratio decompress time/Euro2016	0	0	1.01
vortex:parquet-zstd ratio decompress time/Food	0	0	1.03
vortex:parquet-zstd ratio decompress time/HashTags	0	0	1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical	0	0	1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked	0	0	1.01
vortex:parquet-zstd ratio decompress time/taxi 🚀	0	0	0.86
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000	0	0	1.08
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨	0	0	1.15
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0	0	1.08
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0	0	1.07
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0	0	1.07
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0	0	0.97
vortex:parquet-zstd size/Arade	0	0	1.00
vortex:parquet-zstd size/Bimbo	1	1	1.00
vortex:parquet-zstd size/CMSprovider	1	1	1.00
vortex:parquet-zstd size/Euro2016	1	1	1.00
vortex:parquet-zstd size/Food	1	1	1.00
vortex:parquet-zstd size/HashTags	1	1	1.00
vortex:parquet-zstd size/TPC-H l_comment canonical	1	1	1.00
vortex:parquet-zstd size/TPC-H l_comment chunked	1	1	1.00
vortex:parquet-zstd size/taxi	0	0	1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000	0	0	1.00

robert3005 · 2026-05-06T23:03:24Z

looks like microbenchmark wise this is a win since we no longer have indirect vec allocation and we batch it in the owner arc

github-actions · 2026-05-06T23:04:25Z

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.4%
Vortex (geomean): 0.911x ➖
Parquet (geomean): 0.907x ➖
Shifts: Parquet (control) -9.3% · Median polish -8.8%

datafusion / vortex-file-compressed (0.910x ➖, 1↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	675251101	710578820	0.95
tpch_q02/datafusion:vortex-file-compressed 🚀	700308781	1005959440	0.70
tpch_q03/datafusion:vortex-file-compressed	809507094	940542210	0.86
tpch_q04/datafusion:vortex-file-compressed	586138839	665134733	0.88
tpch_q05/datafusion:vortex-file-compressed	1045741641	1074317600	0.97
tpch_q06/datafusion:vortex-file-compressed	694464559	637932696	1.09
tpch_q07/datafusion:vortex-file-compressed	1063823160	1223297894	0.87
tpch_q08/datafusion:vortex-file-compressed	1148869497	1270243522	0.90
tpch_q09/datafusion:vortex-file-compressed	1237667523	1363208132	0.91
tpch_q10/datafusion:vortex-file-compressed	921345214	984671498	0.94
tpch_q11/datafusion:vortex-file-compressed	473157784	589575953	0.80
tpch_q12/datafusion:vortex-file-compressed	893873219	897197788	1.00
tpch_q13/datafusion:vortex-file-compressed	435090456	456672103	0.95
tpch_q14/datafusion:vortex-file-compressed	581471535	633888938	0.92
tpch_q15/datafusion:vortex-file-compressed	1091920025	1102093783	0.99
tpch_q16/datafusion:vortex-file-compressed	347368717	371485422	0.94
tpch_q17/datafusion:vortex-file-compressed	1172684645	1291664093	0.91
tpch_q18/datafusion:vortex-file-compressed	1224189490	1459751237	0.84
tpch_q19/datafusion:vortex-file-compressed	828318428	900738360	0.92
tpch_q20/datafusion:vortex-file-compressed	1237758623	1083919314	1.14
tpch_q21/datafusion:vortex-file-compressed	1752871314	2052670875	0.85
tpch_q22/datafusion:vortex-file-compressed	323105356	404076140	0.80

datafusion / vortex-compact (0.923x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	672976112	738888855	0.91
tpch_q02/datafusion:vortex-compact	621909280	672005175	0.93
tpch_q03/datafusion:vortex-compact	763665061	719828402	1.06
tpch_q04/datafusion:vortex-compact	555396905	676875876	0.82
tpch_q05/datafusion:vortex-compact	864660141	1000663841	0.86
tpch_q06/datafusion:vortex-compact	637676984	676877744	0.94
tpch_q07/datafusion:vortex-compact	922445361	952389302	0.97
tpch_q08/datafusion:vortex-compact	1083704752	1205736733	0.90
tpch_q09/datafusion:vortex-compact	1142242620	1299868876	0.88
tpch_q10/datafusion:vortex-compact	863789400	856868524	1.01
tpch_q11/datafusion:vortex-compact	395056466	425691668	0.93
tpch_q12/datafusion:vortex-compact	776224290	1080367488	0.72
tpch_q13/datafusion:vortex-compact	410843317	468562009	0.88
tpch_q14/datafusion:vortex-compact	588717220	673351296	0.87
tpch_q15/datafusion:vortex-compact	1033381737	1063259474	0.97
tpch_q16/datafusion:vortex-compact	374259024	349098190	1.07
tpch_q17/datafusion:vortex-compact	1153761249	1201462358	0.96
tpch_q18/datafusion:vortex-compact	1063392161	1086300962	0.98
tpch_q19/datafusion:vortex-compact	737203802	747929996	0.99
tpch_q20/datafusion:vortex-compact	810608371	998586759	0.81
tpch_q21/datafusion:vortex-compact	1386920688	1605052996	0.86
tpch_q22/datafusion:vortex-compact	399361747	368949074	1.08

datafusion / parquet (0.923x ➖, 1↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	815103821	834701096	0.98
tpch_q02/datafusion:parquet	835805332	911777214	0.92
tpch_q03/datafusion:parquet	922148177	882703025	1.04
tpch_q04/datafusion:parquet	453007550	412745119	1.10
tpch_q05/datafusion:parquet	1108304674	1174878105	0.94
tpch_q06/datafusion:parquet	519632950	533322306	0.97
tpch_q07/datafusion:parquet	1177198642	1321446200	0.89
tpch_q08/datafusion:parquet	1425322110	1554723453	0.92
tpch_q09/datafusion:parquet	1770645207	2109542347	0.84
tpch_q10/datafusion:parquet	1942885034	2002092475	0.97
tpch_q11/datafusion:parquet	489340927	532749638	0.92
tpch_q12/datafusion:parquet	612622970	699445254	0.88
tpch_q13/datafusion:parquet	683393338	700810513	0.98
tpch_q14/datafusion:parquet	767845537	798268669	0.96
tpch_q15/datafusion:parquet	1272832971	1256878174	1.01
tpch_q16/datafusion:parquet	323335583	367591963	0.88
tpch_q17/datafusion:parquet	1343750195	1321300705	1.02
tpch_q18/datafusion:parquet	1564590890	1513006784	1.03
tpch_q19/datafusion:parquet	861682545	924728675	0.93
tpch_q20/datafusion:parquet	1083332004	1252239192	0.87
tpch_q21/datafusion:parquet	1646558897	2105498822	0.78
tpch_q22/datafusion:parquet 🚀	680474910	1102589224	0.62

duckdb / vortex-file-compressed (0.851x ➖, 2↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	622223333	611815368	1.02
tpch_q02/duckdb:vortex-file-compressed	1104434125	1251056466	0.88
tpch_q03/duckdb:vortex-file-compressed	914546073	967299787	0.95
tpch_q04/duckdb:vortex-file-compressed	638739335	594355356	1.07
tpch_q05/duckdb:vortex-file-compressed	1056841401	1133745639	0.93
tpch_q06/duckdb:vortex-file-compressed	788320212	805145430	0.98
tpch_q07/duckdb:vortex-file-compressed	1153394273	1236491643	0.93
tpch_q08/duckdb:vortex-file-compressed	1392683685	1406769643	0.99
tpch_q09/duckdb:vortex-file-compressed	1369986944	1549001884	0.88
tpch_q10/duckdb:vortex-file-compressed	1072540929	1207733501	0.89
tpch_q11/duckdb:vortex-file-compressed	603950044	704900083	0.86
tpch_q12/duckdb:vortex-file-compressed	711448341	855396361	0.83
tpch_q13/duckdb:vortex-file-compressed	866504915	968384239	0.89
tpch_q14/duckdb:vortex-file-compressed 🚀	837902747	1217100576	0.69
tpch_q15/duckdb:vortex-file-compressed	533591874	753437053	0.71
tpch_q16/duckdb:vortex-file-compressed	448362402	614693423	0.73
tpch_q17/duckdb:vortex-file-compressed	977601018	1311221723	0.75
tpch_q18/duckdb:vortex-file-compressed	883513725	1155384942	0.76
tpch_q19/duckdb:vortex-file-compressed 🚀	754008837	1092291131	0.69
tpch_q20/duckdb:vortex-file-compressed	1253867071	1528688067	0.82
tpch_q21/duckdb:vortex-file-compressed	2120361112	2598090665	0.82
tpch_q22/duckdb:vortex-file-compressed	600095234	758220576	0.79

duckdb / vortex-compact (0.963x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	583561015	617245671	0.95
tpch_q02/duckdb:vortex-compact	1179364732	1242955113	0.95
tpch_q03/duckdb:vortex-compact	826914595	923782307	0.90
tpch_q04/duckdb:vortex-compact	507730589	552740511	0.92
tpch_q05/duckdb:vortex-compact	1023069992	1115611381	0.92
tpch_q06/duckdb:vortex-compact	713235584	761481439	0.94
tpch_q07/duckdb:vortex-compact	1111942381	1107913158	1.00
tpch_q08/duckdb:vortex-compact	1394982405	1462401258	0.95
tpch_q09/duckdb:vortex-compact	1287994161	1396542513	0.92
tpch_q10/duckdb:vortex-compact	1155636110	1188643279	0.97
tpch_q11/duckdb:vortex-compact	705346920	713408669	0.99
tpch_q12/duckdb:vortex-compact	722413697	749745445	0.96
tpch_q13/duckdb:vortex-compact	849161655	918538856	0.92
tpch_q14/duckdb:vortex-compact	851828447	859419546	0.99
tpch_q15/duckdb:vortex-compact	553601478	538852789	1.03
tpch_q16/duckdb:vortex-compact	500901162	487683491	1.03
tpch_q17/duckdb:vortex-compact	964337266	921974414	1.05
tpch_q18/duckdb:vortex-compact	750085632	816038690	0.92
tpch_q19/duckdb:vortex-compact	759681052	770015439	0.99
tpch_q20/duckdb:vortex-compact	1287199364	1266194783	1.02
tpch_q21/duckdb:vortex-compact	1718436932	1753098067	0.98
tpch_q22/duckdb:vortex-compact	659482740	713556051	0.92

duckdb / parquet (0.892x ➖, 0↑ 0↓)

name	PR `14e3931` (ns)	base `eda8c2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	837144791	941961363	0.89
tpch_q02/duckdb:parquet	1247959346	1373577673	0.91
tpch_q03/duckdb:parquet	1578418880	1984291345	0.80
tpch_q04/duckdb:parquet	981496803	998351848	0.98
tpch_q05/duckdb:parquet	1711083423	1976965731	0.87
tpch_q06/duckdb:parquet	697516824	851855909	0.82
tpch_q07/duckdb:parquet	1691912195	2008213702	0.84
tpch_q08/duckdb:parquet	2239815751	2536193258	0.88
tpch_q09/duckdb:parquet	2492171868	2770095559	0.90
tpch_q10/duckdb:parquet	2941667285	3070738385	0.96
tpch_q11/duckdb:parquet	916646225	1020424392	0.90
tpch_q12/duckdb:parquet	1041640885	1285637869	0.81
tpch_q13/duckdb:parquet	1175546405	1477139066	0.80
tpch_q14/duckdb:parquet	1209696884	1272682087	0.95
tpch_q15/duckdb:parquet	874702279	957040699	0.91
tpch_q16/duckdb:parquet	829748383	906773200	0.92
tpch_q17/duckdb:parquet	1207245979	1349637194	0.89
tpch_q18/duckdb:parquet	1415925220	1438901499	0.98
tpch_q19/duckdb:parquet	1369279438	1494651931	0.92
tpch_q20/duckdb:parquet	1718615410	1969927935	0.87
tpch_q21/duckdb:parquet	1681349152	1840905975	0.91
tpch_q22/duckdb:parquet	1071124973	1129717925	0.95

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	-8.9%	-6.8%	-2.2%	+38.8%	➖ noise
1	datafusion:vortex-file-compressed	-5.0%	-6.8%	+2.0%	+46.9%	➖ noise
1	duckdb:vortex-compact	-5.5%	-6.8%	+1.5%	+33.1%	➖ noise
1	duckdb:vortex-file-compressed	+1.7%	-6.8%	+9.2%	+30.0%	➖ noise
2	datafusion:vortex-compact	-7.5%	-8.7%	+1.4%	+32.5%	➖ noise
2	datafusion:vortex-file-compressed	-30.4%	-8.7%	-23.7%	+35.1%	➖ noise
2	duckdb:vortex-compact	-5.1%	-8.7%	+4.0%	+30.0%	➖ noise
2	duckdb:vortex-file-compressed	-11.7%	-8.7%	-3.3%	+30.0%	➖ noise
3	datafusion:vortex-compact	+6.1%	-8.8%	+16.4%	+42.0%	➖ noise
3	datafusion:vortex-file-compressed	-13.9%	-8.8%	-5.6%	+46.7%	➖ noise
3	duckdb:vortex-compact	-10.5%	-8.8%	-1.8%	+36.0%	➖ noise
3	duckdb:vortex-file-compressed	-5.5%	-8.8%	+3.7%	+37.3%	➖ noise
4	datafusion:vortex-compact	-17.9%	+3.9%	-21.0%	+30.0%	➖ noise
4	datafusion:vortex-file-compressed	-11.9%	+3.9%	-15.2%	+30.0%	➖ noise
4	duckdb:vortex-compact	-8.1%	+3.9%	-11.6%	+30.0%	➖ noise
4	duckdb:vortex-file-compressed	+7.5%	+3.9%	+3.5%	+30.0%	➖ noise
5	datafusion:vortex-compact	-13.6%	-9.6%	-4.4%	+30.0%	➖ noise
5	datafusion:vortex-file-compressed	-2.7%	-9.6%	+7.7%	+30.0%	➖ noise
5	duckdb:vortex-compact	-8.3%	-9.6%	+1.5%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	-6.8%	-9.6%	+3.2%	+30.0%	➖ noise
6	datafusion:vortex-compact	-5.8%	-10.7%	+5.5%	+30.0%	➖ noise
6	datafusion:vortex-file-compressed	+8.9%	-10.7%	+21.9%	+30.0%	➖ noise
6	duckdb:vortex-compact	-6.3%	-10.7%	+4.9%	+30.0%	➖ noise
6	duckdb:vortex-file-compressed	-2.1%	-10.7%	+9.6%	+30.0%	➖ noise
7	datafusion:vortex-compact	-3.1%	-13.4%	+11.8%	+39.4%	➖ noise
7	datafusion:vortex-file-compressed	-13.0%	-13.4%	+0.4%	+40.9%	➖ noise
7	duckdb:vortex-compact	+0.4%	-13.4%	+15.8%	+40.8%	➖ noise
7	duckdb:vortex-file-compressed	-6.7%	-13.4%	+7.7%	+40.1%	➖ noise
8	datafusion:vortex-compact	-10.1%	-10.0%	-0.1%	+30.0%	➖ noise
8	datafusion:vortex-file-compressed	-9.6%	-10.0%	+0.5%	+30.0%	➖ noise
8	duckdb:vortex-compact	-4.6%	-10.0%	+6.0%	+30.0%	➖ noise
8	duckdb:vortex-file-compressed	-1.0%	-10.0%	+10.0%	+30.0%	➖ noise
9	datafusion:vortex-compact	-12.1%	-13.1%	+1.1%	+30.0%	➖ noise
9	datafusion:vortex-file-compressed	-9.2%	-13.1%	+4.5%	+30.0%	➖ noise
9	duckdb:vortex-compact	-7.8%	-13.1%	+6.1%	+30.0%	➖ noise
9	duckdb:vortex-file-compressed	-11.6%	-13.1%	+1.8%	+30.0%	➖ noise
10	datafusion:vortex-compact	+0.8%	-3.6%	+4.6%	+30.0%	➖ noise
10	datafusion:vortex-file-compressed	-6.4%	-3.6%	-3.0%	+30.0%	➖ noise
10	duckdb:vortex-compact	-2.8%	-3.6%	+0.8%	+30.0%	➖ noise
10	duckdb:vortex-file-compressed	-11.2%	-3.6%	-7.9%	+30.0%	➖ noise
11	datafusion:vortex-compact	-7.2%	-9.2%	+2.2%	+30.0%	➖ noise
11	datafusion:vortex-file-compressed	-19.7%	-9.2%	-11.6%	+30.0%	➖ noise
11	duckdb:vortex-compact	-1.1%	-9.2%	+8.8%	+30.0%	➖ noise
11	duckdb:vortex-file-compressed	-14.3%	-9.2%	-5.7%	+30.0%	➖ noise
12	datafusion:vortex-compact	-28.2%	-15.8%	-14.7%	+30.0%	➖ noise
12	datafusion:vortex-file-compressed	-0.4%	-15.8%	+18.3%	+30.0%	➖ noise
12	duckdb:vortex-compact	-3.6%	-15.8%	+14.4%	+30.0%	➖ noise
12	duckdb:vortex-file-compressed	-16.8%	-15.8%	-1.3%	+30.0%	➖ noise
13	datafusion:vortex-compact	-12.3%	-11.9%	-0.5%	+32.5%	➖ noise
13	datafusion:vortex-file-compressed	-4.7%	-11.9%	+8.2%	+31.8%	➖ noise
13	duckdb:vortex-compact	-7.6%	-11.9%	+4.9%	+49.3%	➖ noise
13	duckdb:vortex-file-compressed	-10.5%	-11.9%	+1.6%	+36.6%	➖ noise
14	datafusion:vortex-compact	-12.6%	-4.4%	-8.6%	+30.0%	➖ noise
14	datafusion:vortex-file-compressed	-8.3%	-4.4%	-4.1%	+30.0%	➖ noise
14	duckdb:vortex-compact	-0.9%	-4.4%	+3.7%	+30.0%	➖ noise
14	duckdb:vortex-file-compressed	-31.2%	-4.4%	-28.0%	+30.0%	✅ faster
15	datafusion:vortex-compact	-2.8%	-3.8%	+1.0%	+30.0%	➖ noise
15	datafusion:vortex-file-compressed	-0.9%	-3.8%	+3.0%	+30.0%	➖ noise
15	duckdb:vortex-compact	+2.7%	-3.8%	+6.8%	+30.0%	➖ noise
15	duckdb:vortex-file-compressed	-29.2%	-3.8%	-26.4%	+30.0%	✅ faster
16	datafusion:vortex-compact	+7.2%	-10.3%	+19.5%	+30.0%	➖ noise
16	datafusion:vortex-file-compressed	-6.5%	-10.3%	+4.2%	+30.0%	➖ noise
16	duckdb:vortex-compact	+2.7%	-10.3%	+14.5%	+30.0%	➖ noise
16	duckdb:vortex-file-compressed	-27.1%	-10.3%	-18.7%	+30.0%	➖ noise
17	datafusion:vortex-compact	-4.0%	-4.6%	+0.7%	+30.0%	➖ noise
17	datafusion:vortex-file-compressed	-9.2%	-4.6%	-4.8%	+30.0%	➖ noise
17	duckdb:vortex-compact	+4.6%	-4.6%	+9.7%	+30.0%	➖ noise
17	duckdb:vortex-file-compressed	-25.4%	-4.6%	-21.8%	+30.0%	➖ noise
18	datafusion:vortex-compact	-2.1%	+0.9%	-3.0%	+30.0%	➖ noise
18	datafusion:vortex-file-compressed	-16.1%	+0.9%	-16.9%	+30.0%	➖ noise
18	duckdb:vortex-compact	-8.1%	+0.9%	-8.9%	+30.0%	➖ noise
18	duckdb:vortex-file-compressed	-23.5%	+0.9%	-24.2%	+30.0%	✅ faster
19	datafusion:vortex-compact	-1.4%	-7.6%	+6.7%	+30.0%	➖ noise
19	datafusion:vortex-file-compressed	-8.0%	-7.6%	-0.5%	+30.0%	➖ noise
19	duckdb:vortex-compact	-1.3%	-7.6%	+6.8%	+30.0%	➖ noise
19	duckdb:vortex-file-compressed	-31.0%	-7.6%	-25.3%	+30.0%	✅ faster
20	datafusion:vortex-compact	-18.8%	-13.1%	-6.6%	+30.0%	➖ noise
20	datafusion:vortex-file-compressed	+14.2%	-13.1%	+31.4%	+30.0%	🚨 regression
20	duckdb:vortex-compact	+1.7%	-13.1%	+17.0%	+30.0%	➖ noise
20	duckdb:vortex-file-compressed	-18.0%	-13.1%	-5.6%	+30.0%	➖ noise
21	datafusion:vortex-compact	-13.6%	-15.5%	+2.2%	+30.0%	➖ noise
21	datafusion:vortex-file-compressed	-14.6%	-15.5%	+1.0%	+30.0%	➖ noise
21	duckdb:vortex-compact	-2.0%	-15.5%	+16.0%	+30.0%	➖ noise
21	duckdb:vortex-file-compressed	-18.4%	-15.5%	-3.4%	+30.0%	➖ noise
22	datafusion:vortex-compact	+8.2%	-23.5%	+41.5%	+30.0%	🚨 regression
22	datafusion:vortex-file-compressed	-20.0%	-23.5%	+4.5%	+36.2%	➖ noise
22	duckdb:vortex-compact	-7.6%	-23.5%	+20.8%	+30.0%	➖ noise
22	duckdb:vortex-file-compressed	-20.9%	-23.5%	+3.5%	+30.0%	➖ noise

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 · 2026-05-07T13:06:03Z

I made the smallvec be 4 elements in size. empirically we only ever populate more if we write or if there's multiple operations

a10y approved these changes May 6, 2026

View reviewed changes

robert3005 added the action/benchmark Trigger full benchmarks to run on this PR label May 6, 2026

github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 6, 2026

joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 7, 2026

github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 7, 2026

joseph-isaacs requested changes May 7, 2026

View reviewed changes

Comment thread vortex-array/src/stats/stats_set.rs Outdated

Comment thread vortex-array/src/stats/stats_set.rs Outdated

Try out smallvec for statset

61368fb

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 added 2 commits May 7, 2026 13:56

less

7a7d662

Signed-off-by: Robert Kruszewski <github@robertk.io>

more

3881650

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 force-pushed the rk/statssmallvec branch from 14e3931 to 3881650 Compare May 7, 2026 12:57

robert3005 added the changelog/chore A trivial change label May 7, 2026

robert3005 changed the title ~~Try out smallvec for statset~~ Use smallvec for internal stats storage May 7, 2026

lock

dbd087e

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 requested a review from joseph-isaacs May 7, 2026 13:04

joseph-isaacs approved these changes May 7, 2026

View reviewed changes

robert3005 merged commit 6331959 into develop May 7, 2026
65 of 66 checks passed

robert3005 deleted the rk/statssmallvec branch May 7, 2026 15:30

Conversation

robert3005 commented May 6, 2026

Uh oh!

a10y left a comment

Choose a reason for hiding this comment

Uh oh!

robert3005 commented May 6, 2026

Uh oh!

codspeed-hq Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will degrade performance by 23.06%

Performance Changes

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling

Uh oh!

github-actions Bot commented May 6, 2026

File Sizes: PolarSignals Profiling

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe

Uh oh!

github-actions Bot commented May 6, 2026

File Sizes: FineWeb NVMe

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

File Sizes: TPC-H SF=1 on NVME

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME

Uh oh!

github-actions Bot commented May 6, 2026

File Sizes: TPC-DS SF=1 on NVME

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Statistical and Population Genetics

Uh oh!

github-actions Bot commented May 6, 2026

File Sizes: Statistical and Population Genetics

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Random Access

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME

Uh oh!

github-actions Bot commented May 6, 2026

File Sizes: TPC-H SF=10 on NVME

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

File Sizes: Clickbench on NVME

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on S3

codspeed-hq Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading