Speed up V2 scans and default datafusion-bench to V2 for TPC-DS and ClickBench by joseph-isaacs · Pull Request #10799 · vortex-data/vortex

joseph-isaacs · 2026-10-26T14:06:13Z

Summary

Enable scan v2 for tpc-ds and clickbench

codspeed · 2026-10-26T14:11:38Z

Merging this PR will degrade performance by 16.7%

3 warnings, 1 note

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ Unable to measure the execution of 2 benchmarks

These benchmarks measured no execution time, so their results are not comparable and count as unchanged. This usually happens when the compiler removes the code under test.

Prevent compiler optimizations

See affected benchmarks

⚠️ 21 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

ℹ️ 40 benchmarks have no flamegraph

The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.

See affected benchmarks

❌ 1 regressed benchmark
✅ 2438 untouched benchmarks
⏩ 116 skipped benchmarks¹

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
❌	CPU Simulation	`missing_stats[16]`	70.8 µs	85 µs	-16.7%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing ji/scan-v2-clickbench-tpcds (65bf7e9) with develop (cd45524)}

116 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

github-actions · 2026-10-26T14:11:39Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`65bf7e9`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`65bf7e9`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`65bf7e9`	polarsignals	1	Explore Profiling Data
🟢 Done	`65bf7e9`	fineweb	1	Explore Profiling Data
🟢 Done	`65bf7e9`	tpch-s3	1	Explore Profiling Data
🟢 Done	`65bf7e9`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`65bf7e9`	tpcds-nvme	1	Explore Profiling Data

Previous Runs (56)

Status	Commit	Job	Attempt	Link
🟢 Done	`9847c99`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`9847c99`	polarsignals	1	Explore Profiling Data
🟢 Done	`9847c99`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`9847c99`	fineweb	1	Explore Profiling Data
🟢 Done	`9847c99`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`9847c99`	tpch-s3	1	Explore Profiling Data
🟢 Done	`9847c99`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`eb87fcd`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`eb87fcd`	polarsignals	1	Explore Profiling Data
🟢 Done	`eb87fcd`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`eb87fcd`	tpch-s3	1	Explore Profiling Data
🟢 Done	`eb87fcd`	fineweb	1	Explore Profiling Data
🟢 Done	`eb87fcd`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`eb87fcd`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`eedd5bf`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`eedd5bf`	polarsignals	1	Explore Profiling Data
🟢 Done	`eedd5bf`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`eedd5bf`	fineweb	1	Explore Profiling Data
🟢 Done	`eedd5bf`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`eedd5bf`	tpch-s3	1	Explore Profiling Data
🟢 Done	`eedd5bf`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`bef7c23`	fineweb	1	Explore Profiling Data
🟢 Done	`bef7c23`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`bef7c23`	polarsignals	1	Explore Profiling Data
🟢 Done	`bef7c23`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`bef7c23`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`bef7c23`	tpch-s3	1	Explore Profiling Data
🟢 Done	`bef7c23`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`06c0701`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`06c0701`	fineweb	1	Explore Profiling Data
🟢 Done	`06c0701`	tpch-s3	1	Explore Profiling Data
🟢 Done	`06c0701`	polarsignals	1	Explore Profiling Data
🟢 Done	`06c0701`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`06c0701`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`06c0701`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`ba0fb42`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`ba0fb42`	polarsignals	1	Explore Profiling Data
🟢 Done	`ba0fb42`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`ba0fb42`	fineweb	1	Explore Profiling Data
🟢 Done	`ba0fb42`	tpch-s3	1	Explore Profiling Data
🟢 Done	`ba0fb42`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`ba0fb42`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`02d9b08`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`02d9b08`	polarsignals	1	Explore Profiling Data
🟢 Done	`02d9b08`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`02d9b08`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`02d9b08`	fineweb	1	Explore Profiling Data
🟢 Done	`02d9b08`	tpch-s3	1	Explore Profiling Data
🟢 Done	`02d9b08`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`b971253`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`b971253`	polarsignals	1	Explore Profiling Data
🟢 Done	`b971253`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`b971253`	tpch-s3	1	Explore Profiling Data
🟢 Done	`b971253`	fineweb	1	Explore Profiling Data
🟢 Done	`b971253`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`b971253`	tpcds-nvme	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-10-26T14:11:40Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟡 In Progress	`b971253`	fineweb	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-10-26T14:13:05Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR 65bf7e98 vs base cd455247
Vortex (geomean): hot 0.998x ➖ · cold 0.991x ➖

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	44481618 / 45048511 / -1.3%	85775792 / 87988802 / -2.5%	0.52 / 0.51 / +1.3%
polarsignals_q01/datafusion:vortex-file-compressed	50498584 / 50635931 / -0.3%	110373717 / 112294391 / -1.7%	0.46 / 0.45 / +1.5%
polarsignals_q02/datafusion:vortex-file-compressed	43686366 / 43566835 / +0.3%	85644341 / 85023365 / +0.7%	0.51 / 0.51 / -0.5%
polarsignals_q03/datafusion:vortex-file-compressed	54861224 / 54687226 / +0.3%	112288734 / 110650330 / +1.5%	0.49 / 0.49 / -1.1%
polarsignals_q04/datafusion:vortex-file-compressed	9287584 / 9443857 / -1.7%	41874223 / 41810601 / +0.2%	0.22 / 0.23 / -1.8%
polarsignals_q05/datafusion:vortex-file-compressed	11831364 / 11733653 / +0.8%	43753616 / 45235966 / -3.3%	0.27 / 0.26 / +4.2%
polarsignals_q06/datafusion:vortex-file-compressed	23513162 / 23168290 / +1.5%	57413684 / 56952117 / +0.8%	0.41 / 0.41 / +0.7%
polarsignals_q07/datafusion:vortex-file-compressed	11062607 / 11339008 / -2.4%	45234459 / 45584503 / -0.8%	0.24 / 0.25 / -1.7%
polarsignals_q08/datafusion:vortex-file-compressed	97329224 / 97216370 / +0.1%	164064959 / 160768629 / +2.1%	0.59 / 0.60 / -1.9%
polarsignals_q09/datafusion:vortex-file-compressed	10032650 / 9968534 / +0.6%	39439850 / 41668754 / -5.3%	0.25 / 0.24 / +6.3%

No file size changes detected.

github-actions · 2026-10-26T14:13:18Z

Benchmarks: FineWeb NVMe 📖

Commits: PR 65bf7e98 vs base cd455247
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (+2.0%, low confidence) · DuckDB No clear signal (-3.7%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.072x ➖
Parquet (geomean): hot 1.016x ➖ · cold 1.028x ➖
Shifts: Parquet (control) +1.6% · Median polish +0.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.019x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	7013348 / 7023478 / -0.1%	17565082 / 15543584 / +13.0% 🔴	0.40 / 0.45 / -11.6%
fineweb_q01/datafusion:vortex-file-compressed	7102341 / 7577830 / -6.3%	44948841 / 40162345 / +11.9% 🔴	0.16 / 0.19 / -16.3%
fineweb_q02/datafusion:vortex-file-compressed	9807509 / 9729588 / +0.8%	50234042 / 44961319 / +11.7% 🔴	0.20 / 0.22 / -9.8%
fineweb_q03/datafusion:vortex-file-compressed	20213328 / 20067727 / +0.7%	115426927 / 110198173 / +4.7%	0.18 / 0.18 / -3.8%
fineweb_q04/datafusion:vortex-file-compressed	68064177 / 68268674 / -0.3%	153624814 / 153176823 / +0.3%	0.44 / 0.45 / -0.6%
fineweb_q05/datafusion:vortex-file-compressed	66615753 / 66658682 / -0.1%	156073982 / 151399807 / +3.1%	0.43 / 0.44 / -3.1%
fineweb_q06/datafusion:vortex-file-compressed	19096924 / 18680738 / +2.2%	116881713 / 112151636 / +4.2%	0.16 / 0.17 / -1.9%
fineweb_q07/datafusion:vortex-file-compressed	17970486 / 18281434 / -1.7%	115571997 / 111443214 / +3.7%	0.16 / 0.16 / -5.2%
fineweb_q08/datafusion:vortex-file-compressed	10353338 / 8301587 / +24.7% 🔴	51128515 / 42006306 / +21.7% 🔴	0.20 / 0.20 / +2.5%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9208131 / 9375822 / -1.8%	32801535 / 32099477 / +2.2%	0.28 / 0.29 / -3.9%
fineweb_q01/datafusion:parquet	74406992 / 76507582 / -2.7%	161397457 / 153146427 / +5.4%	0.46 / 0.50 / -7.7%
fineweb_q02/datafusion:parquet	74821110 / 74202806 / +0.8%	158865115 / 154892565 / +2.6%	0.47 / 0.48 / -1.7%
fineweb_q03/datafusion:parquet	75225942 / 73710474 / +2.1%	159131314 / 151861779 / +4.8%	0.47 / 0.49 / -2.6%
fineweb_q04/datafusion:parquet	82655942 / 82509871 / +0.2%	166873296 / 161213821 / +3.5%	0.50 / 0.51 / -3.2%
fineweb_q05/datafusion:parquet	80852448 / 80159148 / +0.9%	167515891 / 158821140 / +5.5%	0.48 / 0.50 / -4.4%
fineweb_q06/datafusion:parquet	75334270 / 76411112 / -1.4%	162001910 / 161587144 / +0.3%	0.47 / 0.47 / -1.7%
fineweb_q07/datafusion:parquet	74183550 / 73604316 / +0.8%	161079473 / 148917649 / +8.2%	0.46 / 0.49 / -6.8%
fineweb_q08/datafusion:parquet	74550173 / 73831932 / +1.0%	162486653 / 157565941 / +3.1%	0.46 / 0.47 / -2.1%

duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	1998451 / 2108327 / -5.2%	6999175 / 7444748 / -6.0%	0.29 / 0.28 / +0.8%
fineweb_q01/duckdb:vortex-file-compressed	9597672 / 9227883 / +4.0%	38181863 / 34558335 / +10.5% 🔴	0.25 / 0.27 / -5.9%
fineweb_q02/duckdb:vortex-file-compressed	10585284 / 10761200 / -1.6%	37969019 / 33323687 / +13.9% 🔴	0.28 / 0.32 / -13.7%
fineweb_q03/duckdb:vortex-file-compressed	19117464 / 18973581 / +0.8%	105240953 / 98800868 / +6.5%	0.18 / 0.19 / -5.4%
fineweb_q04/duckdb:vortex-file-compressed	66535296 / 65747476 / +1.2%	123667866 / 112784460 / +9.6%	0.54 / 0.58 / -7.7%
fineweb_q05/duckdb:vortex-file-compressed	66438964 / 66034543 / +0.6%	116808021 / 111363274 / +4.9%	0.57 / 0.59 / -4.1%
fineweb_q06/duckdb:vortex-file-compressed	19060559 / 19175461 / -0.6%	111481591 / 98513554 / +13.2% 🔴	0.17 / 0.19 / -12.2%
fineweb_q07/duckdb:vortex-file-compressed	18007316 / 18600382 / -3.2%	103179287 / 95380856 / +8.2%	0.17 / 0.20 / -10.5%
fineweb_q08/duckdb:vortex-file-compressed	5269453 / 5268490 / +0.0%	13806471 / 14175105 / -2.6%	0.38 / 0.37 / +2.7%

duckdb / parquet / ns (1.033x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	23931016 / 23215440 / +3.1%	27910268 / 27437913 / +1.7%	0.86 / 0.85 / +1.3%
fineweb_q01/duckdb:parquet	60109091 / 54417079 / +10.5% 🔴	79159386 / 79281131 / -0.2%	0.76 / 0.69 / +10.6%
fineweb_q02/duckdb:parquet	60101037 / 58749524 / +2.3%	83248107 / 80245755 / +3.7%	0.72 / 0.73 / -1.4%
fineweb_q03/duckdb:parquet	121630846 / 118493566 / +2.6%	190783611 / 176266105 / +8.2%	0.64 / 0.67 / -5.2%
fineweb_q04/duckdb:parquet	163100024 / 159785678 / +2.1%	215524116 / 221782499 / -2.8%	0.76 / 0.72 / +5.0%
fineweb_q05/duckdb:parquet	158620817 / 158461516 / +0.1%	213764204 / 207283704 / +3.1%	0.74 / 0.76 / -2.9%
fineweb_q06/duckdb:parquet	89793578 / 86252152 / +4.1%	157788532 / 157750182 / +0.0%	0.57 / 0.55 / +4.1%
fineweb_q07/duckdb:parquet	92348916 / 91028374 / +1.5%	152997788 / 155478276 / -1.6%	0.60 / 0.59 / +3.1%
fineweb_q08/duckdb:parquet	29957154 / 28880886 / +3.7%	31287386 / 30351291 / +3.1%	0.96 / 0.95 / +0.6%

No file size changes detected.

github-actions · 2026-10-26T14:14:09Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 65bf7e98 vs base 92bee27d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -6.3%
Engines: DataFusion Likely improvement (-11.9%, medium confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.936x ➖ · cold 0.985x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.881x ✅, 10↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	15292707 / 17210390 / -11.1% 🟢	42664347 / 43207287 / -1.3%	0.36 / 0.40 / -10.0%
tpch_q02/datafusion:vortex-file-compressed	16500855 / 17294756 / -4.6%	34534957 / 36317135 / -4.9%	0.48 / 0.48 / +0.3%
tpch_q03/datafusion:vortex-file-compressed	19718896 / 22356427 / -11.8% 🟢	52125485 / 50792773 / +2.6%	0.38 / 0.44 / -14.1%
tpch_q04/datafusion:vortex-file-compressed	11229163 / 13249012 / -15.2% 🟢	33729333 / 35423481 / -4.8%	0.33 / 0.37 / -11.0%
tpch_q05/datafusion:vortex-file-compressed	37067615 / 39712413 / -6.7%	66350337 / 66130805 / +0.3%	0.56 / 0.60 / -7.0%
tpch_q06/datafusion:vortex-file-compressed	5916371 / 8674621 / -31.8% 🟢	26859683 / 28466483 / -5.6%	0.22 / 0.30 / -27.7%
tpch_q07/datafusion:vortex-file-compressed	50674296 / 55213151 / -8.2%	81286260 / 76725124 / +5.9%	0.62 / 0.72 / -13.4%
tpch_q08/datafusion:vortex-file-compressed	51559382 / 56015434 / -8.0%	79320067 / 84489759 / -6.1%	0.65 / 0.66 / -2.0%
tpch_q09/datafusion:vortex-file-compressed	47458563 / 49279571 / -3.7%	75946465 / 82714087 / -8.2%	0.62 / 0.60 / +4.9%
tpch_q10/datafusion:vortex-file-compressed	17073263 / 20866520 / -18.2% 🟢	52058421 / 51498261 / +1.1%	0.33 / 0.41 / -19.1%
tpch_q11/datafusion:vortex-file-compressed	14493333 / 15593660 / -7.1%	33693508 / 33671177 / +0.1%	0.43 / 0.46 / -7.1%
tpch_q12/datafusion:vortex-file-compressed	18313432 / 25423412 / -28.0% 🟢	42059835 / 44905780 / -6.3%	0.44 / 0.57 / -23.1%
tpch_q13/datafusion:vortex-file-compressed	19439223 / 20203904 / -3.8%	38497335 / 39791980 / -3.3%	0.50 / 0.51 / -0.5%
tpch_q14/datafusion:vortex-file-compressed	14545363 / 15357145 / -5.3%	37968403 / 39173140 / -3.1%	0.38 / 0.39 / -2.3%
tpch_q15/datafusion:vortex-file-compressed	18520981 / 21187669 / -12.6% 🟢	43367947 / 45056302 / -3.7%	0.43 / 0.47 / -9.2%
tpch_q16/datafusion:vortex-file-compressed	18196956 / 18474192 / -1.5%	40677496 / 38434340 / +5.8%	0.45 / 0.48 / -6.9%
tpch_q17/datafusion:vortex-file-compressed	28176866 / 29718537 / -5.2%	58067893 / 60411393 / -3.9%	0.49 / 0.49 / -1.4%
tpch_q18/datafusion:vortex-file-compressed	36148804 / 37835788 / -4.5%	58125996 / 59389397 / -2.1%	0.62 / 0.64 / -2.4%
tpch_q19/datafusion:vortex-file-compressed	12060844 / 18322379 / -34.2% 🟢	39885526 / 40109781 / -0.6%	0.30 / 0.46 / -33.8%
tpch_q20/datafusion:vortex-file-compressed	20365171 / 23298550 / -12.6% 🟢	45839257 / 47349295 / -3.2%	0.44 / 0.49 / -9.7%
tpch_q21/datafusion:vortex-file-compressed	39152596 / 45017949 / -13.0% 🟢	71361235 / 73807973 / -3.3%	0.55 / 0.61 / -10.0%
tpch_q22/datafusion:vortex-file-compressed	10753410 / 11203277 / -4.0%	30323166 / 30546614 / -0.7%	0.35 / 0.37 / -3.3%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	72422027 / 71876615 / +0.8%	89355841 / 89084627 / +0.3%	0.81 / 0.81 / +0.5%
tpch_q02/datafusion:parquet	75434751 / 76235548 / -1.1%	92525787 / 93087590 / -0.6%	0.82 / 0.82 / -0.4%
tpch_q03/datafusion:parquet	83486029 / 83784899 / -0.4%	106204136 / 108982972 / -2.5%	0.79 / 0.77 / +2.3%
tpch_q04/datafusion:parquet	40433200 / 40859462 / -1.0%	60045439 / 61627433 / -2.6%	0.67 / 0.66 / +1.6%
tpch_q05/datafusion:parquet	112917085 / 111782412 / +1.0%	142366449 / 140250251 / +1.5%	0.79 / 0.80 / -0.5%
tpch_q06/datafusion:parquet	31955824 / 31905521 / +0.2%	49355871 / 49969499 / -1.2%	0.65 / 0.64 / +1.4%
tpch_q07/datafusion:parquet	115430671 / 115246664 / +0.2%	141275775 / 140780963 / +0.4%	0.82 / 0.82 / -0.2%
tpch_q08/datafusion:parquet	119171877 / 120060231 / -0.7%	147805926 / 147922116 / -0.1%	0.81 / 0.81 / -0.7%
tpch_q09/datafusion:parquet	139633598 / 140250437 / -0.4%	168726510 / 168996082 / -0.2%	0.83 / 0.83 / -0.3%
tpch_q10/datafusion:parquet	106728564 / 107209122 / -0.4%	133191883 / 131750548 / +1.1%	0.80 / 0.81 / -1.5%
tpch_q11/datafusion:parquet	61790771 / 61288420 / +0.8%	83849901 / 83039883 / +1.0%	0.74 / 0.74 / -0.2%
tpch_q12/datafusion:parquet	65245666 / 65369727 / -0.2%	87476084 / 88928250 / -1.6%	0.75 / 0.74 / +1.5%
tpch_q13/datafusion:parquet	146981305 / 147333205 / -0.2%	167944739 / 167002896 / +0.6%	0.88 / 0.88 / -0.8%
tpch_q14/datafusion:parquet	48000820 / 47882754 / +0.2%	70721284 / 74641758 / -5.3%	0.68 / 0.64 / +5.8%
tpch_q15/datafusion:parquet	76143235 / 75589022 / +0.7%	97719541 / 95920938 / +1.9%	0.78 / 0.79 / -1.1%
tpch_q16/datafusion:parquet	44053907 / 43443002 / +1.4%	60929519 / 62864875 / -3.1%	0.72 / 0.69 / +4.6%
tpch_q17/datafusion:parquet	124190550 / 124212073 / -0.0%	148427867 / 148725381 / -0.2%	0.84 / 0.84 / +0.2%
tpch_q18/datafusion:parquet	123972909 / 124025926 / -0.0%	144805977 / 146410214 / -1.1%	0.86 / 0.85 / +1.1%
tpch_q19/datafusion:parquet	57786076 / 58674600 / -1.5%	85128117 / 86595193 / -1.7%	0.68 / 0.68 / +0.2%
tpch_q20/datafusion:parquet	79735314 / 79318361 / +0.5%	104261360 / 104356830 / -0.1%	0.76 / 0.76 / +0.6%
tpch_q21/datafusion:parquet	117093452 / 117284997 / -0.2%	140647384 / 142148762 / -1.1%	0.83 / 0.83 / +0.9%
tpch_q22/datafusion:parquet	51875119 / 52103734 / -0.4%	70200525 / 69791296 / +0.6%	0.74 / 0.75 / -1.0%

duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	8724931 / 9256442 / -5.7%	19854204 / 19490558 / +1.9%	0.44 / 0.47 / -7.5%
tpch_q02/duckdb:vortex-file-compressed	15044082 / 15364414 / -2.1%	23957093 / 24049393 / -0.4%	0.63 / 0.64 / -1.7%
tpch_q03/duckdb:vortex-file-compressed	18255066 / 18125190 / +0.7%	34169761 / 34411070 / -0.7%	0.53 / 0.53 / +1.4%
tpch_q04/duckdb:vortex-file-compressed	12093995 / 12410058 / -2.5%	25028396 / 25419494 / -1.5%	0.48 / 0.49 / -1.0%
tpch_q05/duckdb:vortex-file-compressed	20451298 / 20252833 / +1.0%	33314577 / 33453320 / -0.4%	0.61 / 0.61 / +1.4%
tpch_q06/duckdb:vortex-file-compressed	4525773 / 4574098 / -1.1%	13751131 / 13600649 / +1.1%	0.33 / 0.34 / -2.1%
tpch_q07/duckdb:vortex-file-compressed	23613068 / 23910471 / -1.2%	36724131 / 40115970 / -8.5%	0.64 / 0.60 / +7.9%
tpch_q08/duckdb:vortex-file-compressed	20944472 / 20787126 / +0.8%	37695652 / 36554705 / +3.1%	0.56 / 0.57 / -2.3%
tpch_q09/duckdb:vortex-file-compressed	21098105 / 21113460 / -0.1%	36147938 / 36927802 / -2.1%	0.58 / 0.57 / +2.1%
tpch_q10/duckdb:vortex-file-compressed	26991106 / 27018065 / -0.1%	41752371 / 42413753 / -1.6%	0.65 / 0.64 / +1.5%
tpch_q11/duckdb:vortex-file-compressed	8015830 / 8013541 / +0.0%	15222852 / 15954841 / -4.6%	0.53 / 0.50 / +4.8%
tpch_q12/duckdb:vortex-file-compressed	13784203 / 14057448 / -1.9%	26189470 / 26450546 / -1.0%	0.53 / 0.53 / -1.0%
tpch_q13/duckdb:vortex-file-compressed	23332441 / 23347504 / -0.1%	32783240 / 32383640 / +1.2%	0.71 / 0.72 / -1.3%
tpch_q14/duckdb:vortex-file-compressed	11418323 / 11527413 / -0.9%	22691626 / 23135169 / -1.9%	0.50 / 0.50 / +1.0%
tpch_q15/duckdb:vortex-file-compressed	8543432 / 8610481 / -0.8%	19766444 / 19446847 / +1.6%	0.43 / 0.44 / -2.4%
tpch_q16/duckdb:vortex-file-compressed	16549728 / 16508479 / +0.2%	23275229 / 23202767 / +0.3%	0.71 / 0.71 / -0.1%
tpch_q17/duckdb:vortex-file-compressed	12243460 / 11922953 / +2.7%	25613315 / 25143198 / +1.9%	0.48 / 0.47 / +0.8%
tpch_q18/duckdb:vortex-file-compressed	24254340 / 23939236 / +1.3%	34545314 / 34105563 / +1.3%	0.70 / 0.70 / +0.0%
tpch_q19/duckdb:vortex-file-compressed	10227730 / 10340747 / -1.1%	21183838 / 22811450 / -7.1%	0.48 / 0.45 / +6.5%
tpch_q20/duckdb:vortex-file-compressed	13748931 / 13760434 / -0.1%	29259797 / 29009450 / +0.9%	0.47 / 0.47 / -0.9%
tpch_q21/duckdb:vortex-file-compressed	36729922 / 36661256 / +0.2%	54806075 / 54147921 / +1.2%	0.67 / 0.68 / -1.0%
tpch_q22/duckdb:vortex-file-compressed	19032070 / 19042335 / -0.1%	28651825 / 29522589 / -2.9%	0.66 / 0.65 / +3.0%

duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	48256050 / 48489626 / -0.5%	55392026 / 55445810 / -0.1%	0.87 / 0.87 / -0.4%
tpch_q02/duckdb:parquet	48961673 / 49194696 / -0.5%	56518065 / 57212408 / -1.2%	0.87 / 0.86 / +0.7%
tpch_q03/duckdb:parquet	60638555 / 60997304 / -0.6%	69237653 / 70142473 / -1.3%	0.88 / 0.87 / +0.7%
tpch_q04/duckdb:parquet	35339454 / 35265419 / +0.2%	44489661 / 44473835 / +0.0%	0.79 / 0.79 / +0.2%
tpch_q05/duckdb:parquet	67786936 / 67726901 / +0.1%	78833174 / 78039173 / +1.0%	0.86 / 0.87 / -0.9%
tpch_q06/duckdb:parquet	22101675 / 22372247 / -1.2%	28585941 / 27806750 / +2.8%	0.77 / 0.80 / -3.9%
tpch_q07/duckdb:parquet	64597014 / 64397402 / +0.3%	74754048 / 74794713 / -0.1%	0.86 / 0.86 / +0.4%
tpch_q08/duckdb:parquet	76248215 / 76324736 / -0.1%	88616399 / 88315217 / +0.3%	0.86 / 0.86 / -0.4%
tpch_q09/duckdb:parquet	108253959 / 108776179 / -0.5%	120716525 / 121054409 / -0.3%	0.90 / 0.90 / -0.2%
tpch_q10/duckdb:parquet	106671253 / 106707264 / -0.0%	119971624 / 118334324 / +1.4%	0.89 / 0.90 / -1.4%
tpch_q11/duckdb:parquet	29809664 / 30032075 / -0.7%	35777256 / 35701417 / +0.2%	0.83 / 0.84 / -1.0%
tpch_q12/duckdb:parquet	38068621 / 38182500 / -0.3%	44940247 / 45256973 / -0.7%	0.85 / 0.84 / +0.4%
tpch_q13/duckdb:parquet	176598130 / 176447890 / +0.1%	182573180 / 184355800 / -1.0%	0.97 / 0.96 / +1.1%
tpch_q14/duckdb:parquet	42996308 / 42758106 / +0.6%	51708081 / 51097453 / +1.2%	0.83 / 0.84 / -0.6%
tpch_q15/duckdb:parquet	32925270 / 32993432 / -0.2%	42356318 / 42279550 / +0.2%	0.78 / 0.78 / -0.4%
tpch_q16/duckdb:parquet	48103295 / 48159928 / -0.1%	53777786 / 54141902 / -0.7%	0.89 / 0.89 / +0.6%
tpch_q17/duckdb:parquet	48276360 / 48235139 / +0.1%	58106880 / 58163421 / -0.1%	0.83 / 0.83 / +0.2%
tpch_q18/duckdb:parquet	75020188 / 75293387 / -0.4%	82031992 / 82005948 / +0.0%	0.91 / 0.92 / -0.4%
tpch_q19/duckdb:parquet	49889286 / 49058919 / +1.7%	55530423 / 57765480 / -3.9%	0.90 / 0.85 / +5.8%
tpch_q20/duckdb:parquet	63959067 / 64132313 / -0.3%	76180271 / 75350477 / +1.1%	0.84 / 0.85 / -1.4%
tpch_q21/duckdb:parquet	107773890 / 107746001 / +0.0%	118243611 / 117033027 / +1.0%	0.91 / 0.92 / -1.0%
tpch_q22/duckdb:parquet	51322412 / 51438705 / -0.2%	60443067 / 59916313 / +0.9%	0.85 / 0.86 / -1.1%

No file size changes detected.

github-actions · 2026-10-26T14:15:32Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 65bf7e98 vs base 92bee27d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Engines: DataFusion No clear signal (-3.8%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.979x ➖ · cold 1.036x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.013x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.959x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	89015507 / 91057959 / -2.2%	143941044 / 146149921 / -1.5%	0.62 / 0.62 / -0.7%
tpch_q02/datafusion:vortex-file-compressed	64849523 / 66521429 / -2.5%	96277859 / 98663061 / -2.4%	0.67 / 0.67 / -0.1%
tpch_q03/datafusion:vortex-file-compressed	64868487 / 67745375 / -4.2%	121856337 / 122581871 / -0.6%	0.53 / 0.55 / -3.7%
tpch_q04/datafusion:vortex-file-compressed	34833542 / 36279594 / -4.0%	72772054 / 67450814 / +7.9%	0.48 / 0.54 / -11.0%
tpch_q05/datafusion:vortex-file-compressed	118806386 / 120058038 / -1.0%	183731173 / 173105253 / +6.1%	0.65 / 0.69 / -6.8%
tpch_q06/datafusion:vortex-file-compressed	10220194 / 11230560 / -9.0%	57442406 / 55839614 / +2.9%	0.18 / 0.20 / -11.5%
tpch_q07/datafusion:vortex-file-compressed	135909029 / 136475260 / -0.4%	199123592 / 193615927 / +2.8%	0.68 / 0.70 / -3.2%
tpch_q08/datafusion:vortex-file-compressed	145590419 / 144405750 / +0.8%	210863816 / 210110443 / +0.4%	0.69 / 0.69 / +0.5%
tpch_q09/datafusion:vortex-file-compressed	184349273 / 189414386 / -2.7%	252078389 / 262999129 / -4.2%	0.73 / 0.72 / +1.5%
tpch_q10/datafusion:vortex-file-compressed	72070982 / 75021369 / -3.9%	131916982 / 132460479 / -0.4%	0.55 / 0.57 / -3.5%
tpch_q11/datafusion:vortex-file-compressed	43302866 / 45835888 / -5.5%	67154882 / 72565080 / -7.5%	0.64 / 0.63 / +2.1%
tpch_q12/datafusion:vortex-file-compressed	35620158 / 38507424 / -7.5%	81825778 / 82843853 / -1.2%	0.44 / 0.46 / -6.3%
tpch_q13/datafusion:vortex-file-compressed	40996881 / 41935769 / -2.2%	78981125 / 80679678 / -2.1%	0.52 / 0.52 / -0.1%
tpch_q14/datafusion:vortex-file-compressed	22497203 / 23256801 / -3.3%	88483397 / 83477780 / +6.0%	0.25 / 0.28 / -8.7%
tpch_q15/datafusion:vortex-file-compressed	35327031 / 35563209 / -0.7%	90500354 / 92183412 / -1.8%	0.39 / 0.39 / +1.2%
tpch_q16/datafusion:vortex-file-compressed	37349609 / 40480262 / -7.7%	68484225 / 69650059 / -1.7%	0.55 / 0.58 / -6.2%
tpch_q17/datafusion:vortex-file-compressed	174338781 / 179984692 / -3.1%	249065849 / 224014205 / +11.2% 🔴	0.70 / 0.80 / -12.9%
tpch_q18/datafusion:vortex-file-compressed	211833131 / 207037691 / +2.3%	278530623 / 271592786 / +2.6%	0.76 / 0.76 / -0.2%
tpch_q19/datafusion:vortex-file-compressed	30601219 / 36081718 / -15.2% 🟢	89578564 / 90979419 / -1.5%	0.34 / 0.40 / -13.9%
tpch_q20/datafusion:vortex-file-compressed	60494036 / 63992915 / -5.5%	120234678 / 120481925 / -0.2%	0.50 / 0.53 / -5.3%
tpch_q21/datafusion:vortex-file-compressed	181720012 / 184043844 / -1.3%	239428905 / 245236618 / -2.4%	0.76 / 0.75 / +1.1%
tpch_q22/datafusion:vortex-file-compressed	25149096 / 27609437 / -8.9%	51989934 / 53377635 / -2.6%	0.48 / 0.52 / -6.5%

datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	87683543 / 88186302 / -0.6%	131873554 / 128875592 / +2.3%	0.66 / 0.68 / -2.8%
tpch_q02/datafusion:parquet	177044664 / 175096164 / +1.1%	206784381 / 199912666 / +3.4%	0.86 / 0.88 / -2.2%
tpch_q03/datafusion:parquet	137448464 / 138779470 / -1.0%	189064079 / 179299730 / +5.4%	0.73 / 0.77 / -6.1%
tpch_q04/datafusion:parquet	59319997 / 59522444 / -0.3%	97638618 / 93169288 / +4.8%	0.61 / 0.64 / -4.9%
tpch_q05/datafusion:parquet	169300305 / 170642342 / -0.8%	233204947 / 226242494 / +3.1%	0.73 / 0.75 / -3.7%
tpch_q06/datafusion:parquet	37177090 / 37268389 / -0.2%	83015345 / 75341322 / +10.2% 🔴	0.45 / 0.49 / -9.5%
tpch_q07/datafusion:parquet	218175212 / 220424303 / -1.0%	282120304 / 268759518 / +5.0%	0.77 / 0.82 / -5.7%
tpch_q08/datafusion:parquet	221189545 / 222422442 / -0.6%	302820828 / 285894695 / +5.9%	0.73 / 0.78 / -6.1%
tpch_q09/datafusion:parquet	315340290 / 315586100 / -0.1%	397402873 / 377435052 / +5.3%	0.79 / 0.84 / -5.1%
tpch_q10/datafusion:parquet	322340954 / 321597394 / +0.2%	390767980 / 374330909 / +4.4%	0.82 / 0.86 / -4.0%
tpch_q11/datafusion:parquet	126182638 / 126228217 / -0.0%	154610159 / 148842733 / +3.9%	0.82 / 0.85 / -3.8%
tpch_q12/datafusion:parquet	84459177 / 84707915 / -0.3%	128267705 / 117389329 / +9.3%	0.66 / 0.72 / -8.7%
tpch_q13/datafusion:parquet	216578086 / 216676146 / -0.0%	248373307 / 246714778 / +0.7%	0.87 / 0.88 / -0.7%
tpch_q14/datafusion:parquet	87743330 / 89297405 / -1.7%	190991714 / 190412012 / +0.3%	0.46 / 0.47 / -2.0%
tpch_q15/datafusion:parquet	105976449 / 107128769 / -1.1%	156872590 / 155938386 / +0.6%	0.68 / 0.69 / -1.7%
tpch_q16/datafusion:parquet	99102474 / 96610870 / +2.6%	124330421 / 122342730 / +1.6%	0.80 / 0.79 / +0.9%
tpch_q17/datafusion:parquet	212555727 / 215082108 / -1.2%	267409166 / 259516540 / +3.0%	0.79 / 0.83 / -4.1%
tpch_q18/datafusion:parquet	272390544 / 272781197 / -0.1%	316676504 / 321917885 / -1.6%	0.86 / 0.85 / +1.5%
tpch_q19/datafusion:parquet	108513320 / 108029153 / +0.4%	165940375 / 167923070 / -1.2%	0.65 / 0.64 / +1.6%
tpch_q20/datafusion:parquet	189551988 / 189248677 / +0.2%	253244005 / 246373373 / +2.8%	0.75 / 0.77 / -2.6%
tpch_q21/datafusion:parquet	246294990 / 248555898 / -0.9%	306660214 / 313109220 / -2.1%	0.80 / 0.79 / +1.2%
tpch_q22/datafusion:parquet	153605989 / 153622089 / -0.0%	178859892 / 176691602 / +1.2%	0.86 / 0.87 / -1.2%

duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	32634603 / 33080571 / -1.3%	72606737 / 58403271 / +24.3% 🔴	0.45 / 0.57 / -20.6%
tpch_q02/duckdb:vortex-file-compressed	31355242 / 31150326 / +0.7%	44363494 / 45222811 / -1.9%	0.71 / 0.69 / +2.6%
tpch_q03/duckdb:vortex-file-compressed	52364112 / 53259593 / -1.7%	102615654 / 96625305 / +6.2%	0.51 / 0.55 / -7.4%
tpch_q04/duckdb:vortex-file-compressed	51260059 / 51455833 / -0.4%	91436337 / 80562000 / +13.5% 🔴	0.56 / 0.64 / -12.2%
tpch_q05/duckdb:vortex-file-compressed	68147719 / 68626923 / -0.7%	107913124 / 101171938 / +6.7%	0.63 / 0.68 / -6.9%
tpch_q06/duckdb:vortex-file-compressed	14557335 / 14561616 / -0.0%	53065057 / 50705096 / +4.7%	0.27 / 0.29 / -4.5%
tpch_q07/duckdb:vortex-file-compressed	54871298 / 54847571 / +0.0%	110437995 / 102323107 / +7.9%	0.50 / 0.54 / -7.3%
tpch_q08/duckdb:vortex-file-compressed	86608689 / 86601435 / +0.0%	132041405 / 125050189 / +5.6%	0.66 / 0.69 / -5.3%
tpch_q09/duckdb:vortex-file-compressed	98168131 / 98298685 / -0.1%	165050570 / 146365683 / +12.8% 🔴	0.59 / 0.67 / -11.4%
tpch_q10/duckdb:vortex-file-compressed	87414469 / 86875282 / +0.6%	141677896 / 133797545 / +5.9%	0.62 / 0.65 / -5.0%
tpch_q11/duckdb:vortex-file-compressed	14152160 / 14109639 / +0.3%	29045979 / 26270458 / +10.6% 🔴	0.49 / 0.54 / -9.3%
tpch_q12/duckdb:vortex-file-compressed	43345266 / 43122309 / +0.5%	83755776 / 77605297 / +7.9%	0.52 / 0.56 / -6.9%
tpch_q13/duckdb:vortex-file-compressed	67181452 / 66261504 / +1.4%	85923191 / 84799950 / +1.3%	0.78 / 0.78 / +0.1%
tpch_q14/duckdb:vortex-file-compressed	27977301 / 27734989 / +0.9%	72340588 / 66445399 / +8.9%	0.39 / 0.42 / -7.3%
tpch_q15/duckdb:vortex-file-compressed	24745745 / 24968263 / -0.9%	62970680 / 60600106 / +3.9%	0.39 / 0.41 / -4.6%
tpch_q16/duckdb:vortex-file-compressed	49153884 / 50051875 / -1.8%	58499249 / 57218280 / +2.2%	0.84 / 0.87 / -3.9%
tpch_q17/duckdb:vortex-file-compressed	34664977 / 34536315 / +0.4%	67144045 / 64640243 / +3.9%	0.52 / 0.53 / -3.4%
tpch_q18/duckdb:vortex-file-compressed	99939710 / 97862013 / +2.1%	118859813 / 119418526 / -0.5%	0.84 / 0.82 / +2.6%
tpch_q19/duckdb:vortex-file-compressed	24730077 / 24609920 / +0.5%	75482899 / 67481690 / +11.9% 🔴	0.33 / 0.36 / -10.2%
tpch_q20/duckdb:vortex-file-compressed	39210768 / 39470046 / -0.7%	95495915 / 84154155 / +13.5% 🔴	0.41 / 0.47 / -12.5%
tpch_q21/duckdb:vortex-file-compressed	93884951 / 95093433 / -1.3%	146785865 / 137831395 / +6.5%	0.64 / 0.69 / -7.3%
tpch_q22/duckdb:vortex-file-compressed	34600257 / 35425161 / -2.3%	51543371 / 51529526 / +0.0%	0.67 / 0.69 / -2.4%

duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	68634422 / 68529649 / +0.2%	88155982 / 90362115 / -2.4%	0.78 / 0.76 / +2.7%
tpch_q02/duckdb:parquet	87463675 / 87934995 / -0.5%	98682924 / 100640360 / -1.9%	0.89 / 0.87 / +1.4%
tpch_q03/duckdb:parquet	110459114 / 111565215 / -1.0%	140132758 / 140868296 / -0.5%	0.79 / 0.79 / -0.5%
tpch_q04/duckdb:parquet	77262172 / 77862844 / -0.8%	98683794 / 98569254 / +0.1%	0.78 / 0.79 / -0.9%
tpch_q05/duckdb:parquet	123232672 / 126689475 / -2.7%	153744455 / 157499816 / -2.4%	0.80 / 0.80 / -0.4%
tpch_q06/duckdb:parquet	36077042 / 35956249 / +0.3%	59593796 / 57188332 / +4.2%	0.61 / 0.63 / -3.7%
tpch_q07/duckdb:parquet	118021915 / 117941710 / +0.1%	154587032 / 155215689 / -0.4%	0.76 / 0.76 / +0.5%
tpch_q08/duckdb:parquet	149026049 / 149556808 / -0.4%	189701451 / 188590226 / +0.6%	0.79 / 0.79 / -0.9%
tpch_q09/duckdb:parquet	237592445 / 237523807 / +0.0%	274769663 / 279060594 / -1.5%	0.86 / 0.85 / +1.6%
tpch_q10/duckdb:parquet	315810263 / 316345838 / -0.2%	341040020 / 336742003 / +1.3%	0.93 / 0.94 / -1.4%
tpch_q11/duckdb:parquet	43992593 / 43971252 / +0.0%	52135922 / 51626367 / +1.0%	0.84 / 0.85 / -0.9%
tpch_q12/duckdb:parquet	73535011 / 72687244 / +1.2%	92612809 / 92181930 / +0.5%	0.79 / 0.79 / +0.7%
tpch_q13/duckdb:parquet	293429959 / 294952576 / -0.5%	311215271 / 310639611 / +0.2%	0.94 / 0.95 / -0.7%
tpch_q14/duckdb:parquet	103262246 / 102037510 / +1.2%	138805833 / 137533459 / +0.9%	0.74 / 0.74 / +0.3%
tpch_q15/duckdb:parquet	57865073 / 58218506 / -0.6%	86283239 / 89496263 / -3.6%	0.67 / 0.65 / +3.1%
tpch_q16/duckdb:parquet	100766315 / 102023098 / -1.2%	108728917 / 110328840 / -1.5%	0.93 / 0.92 / +0.2%
tpch_q17/duckdb:parquet	82945067 / 83429553 / -0.6%	123154136 / 129829721 / -5.1%	0.67 / 0.64 / +4.8%
tpch_q18/duckdb:parquet	158515354 / 161521372 / -1.9%	169557428 / 173265432 / -2.1%	0.93 / 0.93 / +0.3%
tpch_q19/duckdb:parquet	99505132 / 101469079 / -1.9%	135932778 / 132687421 / +2.4%	0.73 / 0.76 / -4.3%
tpch_q20/duckdb:parquet	147615742 / 148643741 / -0.7%	184509475 / 186748793 / -1.2%	0.80 / 0.80 / +0.5%
tpch_q21/duckdb:parquet	256647197 / 258353969 / -0.7%	281938574 / 278987597 / +1.1%	0.91 / 0.93 / -1.7%
tpch_q22/duckdb:parquet	169555690 / 169480444 / +0.0%	184438553 / 183890550 / +0.3%	0.92 / 0.92 / -0.3%

No file size changes detected.

github-actions · 2026-10-26T14:16:49Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 65bf7e98 vs base 92bee27d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.8%
Engines: DataFusion No clear signal (-5.5%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.970x ➖ · cold 1.014x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.947x ➖, 23↑ 5↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	21039248 / 25081378 / -16.1% 🟢	39109906 / 40962991 / -4.5%	0.54 / 0.61 / -12.1%
tpcds_q02/datafusion:vortex-file-compressed	44990518 / 47101178 / -4.5%	65159354 / 63243108 / +3.0%	0.69 / 0.74 / -7.3%
tpcds_q03/datafusion:vortex-file-compressed	11292658 / 11493863 / -1.8%	28116876 / 27375884 / +2.7%	0.40 / 0.42 / -4.3%
tpcds_q04/datafusion:vortex-file-compressed	87651699 / 124137635 / -29.4% 🟢	120492898 / 153262115 / -21.4% 🟢	0.73 / 0.81 / -10.2%
tpcds_q05/datafusion:vortex-file-compressed	57412946 / 60483432 / -5.1%	79932654 / 78822804 / +1.4%	0.72 / 0.77 / -6.4%
tpcds_q06/datafusion:vortex-file-compressed	22422879 / 22588038 / -0.7%	40804024 / 41136389 / -0.8%	0.55 / 0.55 / +0.1%
tpcds_q07/datafusion:vortex-file-compressed	28816102 / 31546345 / -8.7%	51092988 / 54373388 / -6.0%	0.56 / 0.58 / -2.8%
tpcds_q08/datafusion:vortex-file-compressed	23972538 / 24699964 / -2.9%	42784718 / 40657118 / +5.2%	0.56 / 0.61 / -7.8%
tpcds_q09/datafusion:vortex-file-compressed	20563843 / 17208616 / +19.5% 🔴	35831088 / 31244899 / +14.7% 🔴	0.57 / 0.55 / +4.2%
tpcds_q10/datafusion:vortex-file-compressed	26411227 / 27201636 / -2.9%	47693261 / 47298938 / +0.8%	0.55 / 0.58 / -3.7%
tpcds_q11/datafusion:vortex-file-compressed	52983888 / 64942252 / -18.4% 🟢	80615965 / 91279512 / -11.7% 🟢	0.66 / 0.71 / -7.6%
tpcds_q12/datafusion:vortex-file-compressed	14843218 / 16713967 / -11.2% 🟢	33048442 / 33456933 / -1.2%	0.45 / 0.50 / -10.1%
tpcds_q13/datafusion:vortex-file-compressed	31527534 / 31635210 / -0.3%	56655040 / 51161845 / +10.7% 🔴	0.56 / 0.62 / -10.0%
tpcds_q14/datafusion:vortex-file-compressed	490559964 / 498278880 / -1.5%	548401700 / 554858366 / -1.2%	0.89 / 0.90 / -0.4%
tpcds_q15/datafusion:vortex-file-compressed	12383565 / 15735968 / -21.3% 🟢	33122117 / 34885776 / -5.1%	0.37 / 0.45 / -17.1%
tpcds_q16/datafusion:vortex-file-compressed	18643636 / 20041250 / -7.0%	36023777 / 35493120 / +1.5%	0.52 / 0.56 / -8.3%
tpcds_q17/datafusion:vortex-file-compressed	50845098 / 58573680 / -13.2% 🟢	80472088 / 79912085 / +0.7%	0.63 / 0.73 / -13.8%
tpcds_q18/datafusion:vortex-file-compressed	63677238 / 68363327 / -6.9%	87963823 / 90305785 / -2.6%	0.72 / 0.76 / -4.4%
tpcds_q19/datafusion:vortex-file-compressed	17054632 / 16933435 / +0.7%	37486432 / 36049950 / +4.0%	0.45 / 0.47 / -3.1%
tpcds_q20/datafusion:vortex-file-compressed	16198490 / 18030137 / -10.2% 🟢	35526422 / 34781193 / +2.1%	0.46 / 0.52 / -12.0%
tpcds_q21/datafusion:vortex-file-compressed	16330064 / 16141545 / +1.2%	38578966 / 36342933 / +6.2%	0.42 / 0.44 / -4.7%
tpcds_q22/datafusion:vortex-file-compressed	49512728 / 58632726 / -15.6% 🟢	72388156 / 80255037 / -9.8%	0.68 / 0.73 / -6.4%
tpcds_q23/datafusion:vortex-file-compressed	71286656 / 72402549 / -1.5%	96471633 / 97392292 / -0.9%	0.74 / 0.74 / -0.6%
tpcds_q24/datafusion:vortex-file-compressed	64969426 / 67726870 / -4.1%	85503006 / 90308049 / -5.3%	0.76 / 0.75 / +1.3%
tpcds_q25/datafusion:vortex-file-compressed	48332928 / 54233678 / -10.9% 🟢	74189710 / 74394751 / -0.3%	0.65 / 0.73 / -10.6%
tpcds_q26/datafusion:vortex-file-compressed	25859500 / 30198731 / -14.4% 🟢	48470117 / 48509837 / -0.1%	0.53 / 0.62 / -14.3%
tpcds_q27/datafusion:vortex-file-compressed	60099492 / 61515149 / -2.3%	80753343 / 85059359 / -5.1%	0.74 / 0.72 / +2.9%
tpcds_q28/datafusion:vortex-file-compressed	25179096 / 17833440 / +41.2% 🔴	38055739 / 33697964 / +12.9% 🔴	0.66 / 0.53 / +25.0%
tpcds_q29/datafusion:vortex-file-compressed	53792490 / 58679676 / -8.3%	82367896 / 81454084 / +1.1%	0.65 / 0.72 / -9.3%
tpcds_q30/datafusion:vortex-file-compressed	25980528 / 27239319 / -4.6%	43131753 / 43955941 / -1.9%	0.60 / 0.62 / -2.8%
tpcds_q31/datafusion:vortex-file-compressed	57457319 / 59000681 / -2.6%	82722611 / 82237678 / +0.6%	0.69 / 0.72 / -3.2%
tpcds_q32/datafusion:vortex-file-compressed	12385458 / 13600324 / -8.9%	28862483 / 28603698 / +0.9%	0.43 / 0.48 / -9.7%
tpcds_q33/datafusion:vortex-file-compressed	27403405 / 27739394 / -1.2%	52106570 / 48566314 / +7.3%	0.53 / 0.57 / -7.9%
tpcds_q34/datafusion:vortex-file-compressed	17322748 / 17309654 / +0.1%	36525661 / 35753325 / +2.2%	0.47 / 0.48 / -2.0%
tpcds_q35/datafusion:vortex-file-compressed	30543652 / 34541316 / -11.6% 🟢	54326181 / 55678327 / -2.4%	0.56 / 0.62 / -9.4%
tpcds_q36/datafusion:vortex-file-compressed	47104584 / 48608292 / -3.1%	72294742 / 70564174 / +2.5%	0.65 / 0.69 / -5.4%
tpcds_q37/datafusion:vortex-file-compressed	11461198 / 12844496 / -10.8% 🟢	32955791 / 31992303 / +3.0%	0.35 / 0.40 / -13.4%
tpcds_q38/datafusion:vortex-file-compressed	25978185 / 30140535 / -13.8% 🟢	46845680 / 49194037 / -4.8%	0.55 / 0.61 / -9.5%
tpcds_q39/datafusion:vortex-file-compressed	64734162 / 60788110 / +6.5%	90329625 / 86293306 / +4.7%	0.72 / 0.70 / +1.7%
tpcds_q40/datafusion:vortex-file-compressed	22776494 / 24301394 / -6.3%	41640220 / 43203194 / -3.6%	0.55 / 0.56 / -2.8%
tpcds_q41/datafusion:vortex-file-compressed	20550269 / 17470650 / +17.6% 🔴	34032062 / 31799010 / +7.0%	0.60 / 0.55 / +9.9%
tpcds_q42/datafusion:vortex-file-compressed	10855431 / 11346914 / -4.3%	26581758 / 25258259 / +5.2%	0.41 / 0.45 / -9.1%
tpcds_q43/datafusion:vortex-file-compressed	12591966 / 12906304 / -2.4%	31089057 / 28883337 / +7.6%	0.41 / 0.45 / -9.4%
tpcds_q44/datafusion:vortex-file-compressed	29165170 / 26075622 / +11.8% 🔴	51423521 / 47446669 / +8.4%	0.57 / 0.55 / +3.2%
tpcds_q45/datafusion:vortex-file-compressed	16449310 / 18409859 / -10.6% 🟢	35622584 / 35879052 / -0.7%	0.46 / 0.51 / -10.0%
tpcds_q46/datafusion:vortex-file-compressed	23260860 / 23449813 / -0.8%	46983296 / 46242129 / +1.6%	0.50 / 0.51 / -2.4%
tpcds_q47/datafusion:vortex-file-compressed	75408890 / 78543169 / -4.0%	104834591 / 104837149 / -0.0%	0.72 / 0.75 / -4.0%
tpcds_q48/datafusion:vortex-file-compressed	28173954 / 29544272 / -4.6%	49912342 / 48377060 / +3.2%	0.56 / 0.61 / -7.6%
tpcds_q49/datafusion:vortex-file-compressed	61928404 / 57114778 / +8.4%	81244223 / 77381261 / +5.0%	0.76 / 0.74 / +3.3%
tpcds_q50/datafusion:vortex-file-compressed	30641354 / 32945907 / -7.0%	48901480 / 50867548 / -3.9%	0.63 / 0.65 / -3.3%
tpcds_q51/datafusion:vortex-file-compressed	66211554 / 66885748 / -1.0%	86796834 / 87425511 / -0.7%	0.76 / 0.77 / -0.3%
tpcds_q52/datafusion:vortex-file-compressed	11282423 / 12016462 / -6.1%	27660552 / 28308869 / -2.3%	0.41 / 0.42 / -3.9%
tpcds_q53/datafusion:vortex-file-compressed	17720612 / 18030158 / -1.7%	39880053 / 37531183 / +6.3%	0.44 / 0.48 / -7.5%
tpcds_q54/datafusion:vortex-file-compressed	31138381 / 33620694 / -7.4%	54158199 / 54974031 / -1.5%	0.57 / 0.61 / -6.0%
tpcds_q55/datafusion:vortex-file-compressed	10723662 / 11346584 / -5.5%	27501928 / 25123780 / +9.5%	0.39 / 0.45 / -13.7%
tpcds_q56/datafusion:vortex-file-compressed	26146466 / 26929244 / -2.9%	48282341 / 47597664 / +1.4%	0.54 / 0.57 / -4.3%
tpcds_q57/datafusion:vortex-file-compressed	62982577 / 77669862 / -18.9% 🟢	86379146 / 101104751 / -14.6% 🟢	0.73 / 0.77 / -5.1%
tpcds_q58/datafusion:vortex-file-compressed	38281939 / 41151703 / -7.0%	61675084 / 63991549 / -3.6%	0.62 / 0.64 / -3.5%
tpcds_q59/datafusion:vortex-file-compressed	29461350 / 31153301 / -5.4%	55808154 / 52437247 / +6.4%	0.53 / 0.59 / -11.1%
tpcds_q60/datafusion:vortex-file-compressed	25870684 / 26750546 / -3.3%	47441060 / 46291705 / +2.5%	0.55 / 0.58 / -5.6%
tpcds_q61/datafusion:vortex-file-compressed	21474708 / 23771466 / -9.7%	42620232 / 44159550 / -3.5%	0.50 / 0.54 / -6.4%
tpcds_q62/datafusion:vortex-file-compressed	16313000 / 18151656 / -10.1% 🟢	33891852 / 32684357 / +3.7%	0.48 / 0.56 / -13.3%
tpcds_q63/datafusion:vortex-file-compressed	17699743 / 18793363 / -5.8%	38498187 / 37088002 / +3.8%	0.46 / 0.51 / -9.3%
tpcds_q64/datafusion:vortex-file-compressed	211829172 / 225012482 / -5.9%	245845066 / 262263912 / -6.3%	0.86 / 0.86 / +0.4%
tpcds_q65/datafusion:vortex-file-compressed	73750928 / 74967432 / -1.6%	93692225 / 95477805 / -1.9%	0.79 / 0.79 / +0.3%
tpcds_q66/datafusion:vortex-file-compressed	51171860 / 53239504 / -3.9%	72455533 / 71718653 / +1.0%	0.71 / 0.74 / -4.9%
tpcds_q67/datafusion:vortex-file-compressed	51243601 / 58154431 / -11.9% 🟢	80801013 / 86736157 / -6.8%	0.63 / 0.67 / -5.4%
tpcds_q68/datafusion:vortex-file-compressed	22566938 / 22391589 / +0.8%	49539950 / 47079831 / +5.2%	0.46 / 0.48 / -4.2%
tpcds_q69/datafusion:vortex-file-compressed	25236918 / 27148716 / -7.0%	45971402 / 47756844 / -3.7%	0.55 / 0.57 / -3.4%
tpcds_q70/datafusion:vortex-file-compressed	70789698 / 70726580 / +0.1%	92030793 / 88487422 / +4.0%	0.77 / 0.80 / -3.8%
tpcds_q71/datafusion:vortex-file-compressed	18110778 / 19080336 / -5.1%	37664830 / 35870692 / +5.0%	0.48 / 0.53 / -9.6%
tpcds_q72/datafusion:vortex-file-compressed	366178612 / 360707148 / +1.5%	416465150 / 394060771 / +5.7%	0.88 / 0.92 / -3.9%
tpcds_q73/datafusion:vortex-file-compressed	15949784 / 16399950 / -2.7%	35512586 / 34245944 / +3.7%	0.45 / 0.48 / -6.2%
tpcds_q74/datafusion:vortex-file-compressed	40074446 / 45432306 / -11.8% 🟢	67402599 / 71103135 / -5.2%	0.59 / 0.64 / -7.0%
tpcds_q75/datafusion:vortex-file-compressed	140297267 / 136707124 / +2.6%	165146344 / 167948213 / -1.7%	0.85 / 0.81 / +4.4%
tpcds_q76/datafusion:vortex-file-compressed	29871630 / 26504089 / +12.7% 🔴	51632388 / 43588546 / +18.5% 🔴	0.58 / 0.61 / -4.9%
tpcds_q77/datafusion:vortex-file-compressed	44896750 / 46200786 / -2.8%	65410951 / 67303462 / -2.8%	0.69 / 0.69 / -0.0%
tpcds_q78/datafusion:vortex-file-compressed	64250899 / 68243050 / -5.8%	91387133 / 96009849 / -4.8%	0.70 / 0.71 / -1.1%
tpcds_q79/datafusion:vortex-file-compressed	19660343 / 19616188 / +0.2%	41483086 / 39963170 / +3.8%	0.47 / 0.49 / -3.4%
tpcds_q80/datafusion:vortex-file-compressed	73022952 / 75229789 / -2.9%	102201183 / 106340856 / -3.9%	0.71 / 0.71 / +1.0%
tpcds_q81/datafusion:vortex-file-compressed	25840664 / 27345826 / -5.5%	44875228 / 44314993 / +1.3%	0.58 / 0.62 / -6.7%
tpcds_q82/datafusion:vortex-file-compressed	12012803 / 12606490 / -4.7%	33201827 / 31834658 / +4.3%	0.36 / 0.40 / -8.6%
tpcds_q83/datafusion:vortex-file-compressed	32881200 / 36075294 / -8.9%	51393539 / 55589303 / -7.5%	0.64 / 0.65 / -1.4%
tpcds_q84/datafusion:vortex-file-compressed	10015170 / 11978054 / -16.4% 🟢	26116928 / 25726544 / +1.5%	0.38 / 0.47 / -17.6%
tpcds_q85/datafusion:vortex-file-compressed	53278610 / 57835898 / -7.9%	82297726 / 80291933 / +2.5%	0.65 / 0.72 / -10.1%
tpcds_q86/datafusion:vortex-file-compressed	15961995 / 16857806 / -5.3%	34485038 / 32845127 / +5.0%	0.46 / 0.51 / -9.8%
tpcds_q87/datafusion:vortex-file-compressed	25442486 / 29831194 / -14.7% 🟢	47297632 / 48585842 / -2.7%	0.54 / 0.61 / -12.4%
tpcds_q88/datafusion:vortex-file-compressed	31886318 / 32279251 / -1.2%	49896692 / 60033951 / -16.9% 🟢	0.64 / 0.54 / +18.9%
tpcds_q89/datafusion:vortex-file-compressed	20940050 / 20563188 / +1.8%	43293400 / 38812535 / +11.5% 🔴	0.48 / 0.53 / -8.7%
tpcds_q90/datafusion:vortex-file-compressed	10049947 / 10579965 / -5.0%	25505101 / 24691375 / +3.3%	0.39 / 0.43 / -8.0%
tpcds_q91/datafusion:vortex-file-compressed	16554206 / 15752042 / +5.1%	34794764 / 33489425 / +3.9%	0.48 / 0.47 / +1.1%
tpcds_q92/datafusion:vortex-file-compressed	12667717 / 13692120 / -7.5%	29255479 / 28568624 / +2.4%	0.43 / 0.48 / -9.7%
tpcds_q93/datafusion:vortex-file-compressed	20485882 / 22380594 / -8.5%	39815303 / 40798107 / -2.4%	0.51 / 0.55 / -6.2%
tpcds_q94/datafusion:vortex-file-compressed	17901296 / 19395874 / -7.7%	36258388 / 34756790 / +4.3%	0.49 / 0.56 / -11.5%
tpcds_q95/datafusion:vortex-file-compressed	42538272 / 44848690 / -5.2%	62047331 / 63247410 / -1.9%	0.69 / 0.71 / -3.3%
tpcds_q96/datafusion:vortex-file-compressed	7525094 / 8553736 / -12.0% 🟢	23050305 / 20782713 / +10.9% 🔴	0.33 / 0.41 / -20.7%
tpcds_q97/datafusion:vortex-file-compressed	17450551 / 21212548 / -17.7% 🟢	35653066 / 39427238 / -9.6%	0.49 / 0.54 / -9.0%
tpcds_q98/datafusion:vortex-file-compressed	16295912 / 17030335 / -4.3%	36569340 / 35042031 / +4.4%	0.45 / 0.49 / -8.3%
tpcds_q99/datafusion:vortex-file-compressed	15775619 / 20933564 / -24.6% 🟢	33168363 / 35097985 / -5.5%	0.48 / 0.60 / -20.3%

datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	44053170 / 42978244 / +2.5%	59280049 / 62349548 / -4.9%	0.74 / 0.69 / +7.8%
tpcds_q02/datafusion:parquet	55820703 / 56048406 / -0.4%	70935284 / 71014454 / -0.1%	0.79 / 0.79 / -0.3%
tpcds_q03/datafusion:parquet	19081682 / 19381807 / -1.5%	32002408 / 32108998 / -0.3%	0.60 / 0.60 / -1.2%
tpcds_q04/datafusion:parquet	184380186 / 181833248 / +1.4%	205521682 / 205038914 / +0.2%	0.90 / 0.89 / +1.2%
tpcds_q05/datafusion:parquet	68315226 / 68655934 / -0.5%	90157805 / 88605159 / +1.8%	0.76 / 0.77 / -2.2%
tpcds_q06/datafusion:parquet	34217644 / 33681056 / +1.6%	47098021 / 50191893 / -6.2%	0.73 / 0.67 / +8.3%
tpcds_q07/datafusion:parquet	47505870 / 46856478 / +1.4%	63163444 / 67479674 / -6.4%	0.75 / 0.69 / +8.3%
tpcds_q08/datafusion:parquet	31495008 / 31233140 / +0.8%	47731163 / 47909545 / -0.4%	0.66 / 0.65 / +1.2%
tpcds_q09/datafusion:parquet	33773902 / 32775722 / +3.0%	44855017 / 37189773 / +20.6% 🔴	0.75 / 0.88 / -14.6%
tpcds_q10/datafusion:parquet	43485732 / 43155566 / +0.8%	59542274 / 58099501 / +2.5%	0.73 / 0.74 / -1.7%
tpcds_q11/datafusion:parquet	100690910 / 98707581 / +2.0%	120205410 / 118879283 / +1.1%	0.84 / 0.83 / +0.9%
tpcds_q12/datafusion:parquet	23897696 / 23991071 / -0.4%	35758679 / 37020189 / -3.4%	0.67 / 0.65 / +3.1%
tpcds_q13/datafusion:parquet	46847566 / 46384430 / +1.0%	67812380 / 68050028 / -0.3%	0.69 / 0.68 / +1.4%
tpcds_q14/datafusion:parquet	539200374 / 538367774 / +0.2%	583552287 / 585841632 / -0.4%	0.92 / 0.92 / +0.5%
tpcds_q15/datafusion:parquet	23797814 / 23924352 / -0.5%	38647106 / 37164820 / +4.0%	0.62 / 0.64 / -4.3%
tpcds_q16/datafusion:parquet	36877004 / 37107461 / -0.6%	49833343 / 50206970 / -0.7%	0.74 / 0.74 / +0.1%
tpcds_q17/datafusion:parquet	76165723 / 75021170 / +1.5%	97328241 / 97223566 / +0.1%	0.78 / 0.77 / +1.4%
tpcds_q18/datafusion:parquet	66256836 / 68776256 / -3.7%	89997659 / 89975076 / +0.0%	0.74 / 0.76 / -3.7%
tpcds_q19/datafusion:parquet	29776824 / 29631786 / +0.5%	43867772 / 43687221 / +0.4%	0.68 / 0.68 / +0.1%
tpcds_q20/datafusion:parquet	25054773 / 25738686 / -2.7%	37662822 / 37510340 / +0.4%	0.67 / 0.69 / -3.1%
tpcds_q21/datafusion:parquet	20100300 / 20382164 / -1.4%	31756571 / 32563347 / -2.5%	0.63 / 0.63 / +1.1%
tpcds_q22/datafusion:parquet	77657385 / 77471116 / +0.2%	89732557 / 90579442 / -0.9%	0.87 / 0.86 / +1.2%
tpcds_q23/datafusion:parquet	90646076 / 94304804 / -3.9%	114053154 / 114301850 / -0.2%	0.79 / 0.83 / -3.7%
tpcds_q24/datafusion:parquet	91687610 / 91331090 / +0.4%	117117880 / 115269699 / +1.6%	0.78 / 0.79 / -1.2%
tpcds_q25/datafusion:parquet	81489922 / 82499845 / -1.2%	100377013 / 100702149 / -0.3%	0.81 / 0.82 / -0.9%
tpcds_q26/datafusion:parquet	43069624 / 43686642 / -1.4%	59244287 / 60274088 / -1.7%	0.73 / 0.72 / +0.3%
tpcds_q27/datafusion:parquet	77742279 / 76168654 / +2.1%	98392892 / 99312870 / -0.9%	0.79 / 0.77 / +3.0%
tpcds_q28/datafusion:parquet	28334972 / 28935864 / -2.1%	42807444 / 42807696 / -0.0%	0.66 / 0.68 / -2.1%
tpcds_q29/datafusion:parquet	76349634 / 75234712 / +1.5%	97233956 / 101422271 / -4.1%	0.79 / 0.74 / +5.9%
tpcds_q30/datafusion:parquet	46277216 / 44633949 / +3.7%	58837810 / 59433476 / -1.0%	0.79 / 0.75 / +4.7%
tpcds_q31/datafusion:parquet	77800300 / 83099556 / -6.4%	98825050 / 96548176 / +2.4%	0.79 / 0.86 / -8.5%
tpcds_q32/datafusion:parquet	26018437 / 26517110 / -1.9%	39370974 / 43972919 / -10.5% 🟢	0.66 / 0.60 / +9.6%
tpcds_q33/datafusion:parquet	37773614 / 37706042 / +0.2%	54860200 / 54988859 / -0.2%	0.69 / 0.69 / +0.4%
tpcds_q34/datafusion:parquet	24575026 / 24758066 / -0.7%	36112559 / 36888746 / -2.1%	0.68 / 0.67 / +1.4%
tpcds_q35/datafusion:parquet	50082892 / 52308578 / -4.3%	62867216 / 63077922 / -0.3%	0.80 / 0.83 / -3.9%
tpcds_q36/datafusion:parquet	52180389 / 53396698 / -2.3%	69997165 / 72083853 / -2.9%	0.75 / 0.74 / +0.6%
tpcds_q37/datafusion:parquet	21038281 / 21649271 / -2.8%	33004454 / 33230870 / -0.7%	0.64 / 0.65 / -2.2%
tpcds_q38/datafusion:parquet	44784879 / 43259085 / +3.5%	65155764 / 59034278 / +10.4% 🔴	0.69 / 0.73 / -6.2%
tpcds_q39/datafusion:parquet	67861862 / 68607492 / -1.1%	84469532 / 84414993 / +0.1%	0.80 / 0.81 / -1.2%
tpcds_q40/datafusion:parquet	30751350 / 29954924 / +2.7%	49570235 / 49978748 / -0.8%	0.62 / 0.60 / +3.5%
tpcds_q41/datafusion:parquet	19923095 / 19683914 / +1.2%	31412857 / 31984107 / -1.8%	0.63 / 0.62 / +3.1%
tpcds_q42/datafusion:parquet	18430002 / 18407238 / +0.1%	29220582 / 29140175 / +0.3%	0.63 / 0.63 / -0.2%
tpcds_q43/datafusion:parquet	19192731 / 19729286 / -2.7%	31396792 / 31884258 / -1.5%	0.61 / 0.62 / -1.2%
tpcds_q44/datafusion:parquet	36821470 / 35592412 / +3.5%	50481226 / 51837977 / -2.6%	0.73 / 0.69 / +6.2%
tpcds_q45/datafusion:parquet	27422302 / 26486827 / +3.5%	41153984 / 40667271 / +1.2%	0.67 / 0.65 / +2.3%
tpcds_q46/datafusion:parquet	29575145 / 29318382 / +0.9%	46400800 / 45861872 / +1.2%	0.64 / 0.64 / -0.3%
tpcds_q47/datafusion:parquet	98576645 / 98325623 / +0.3%	122027318 / 120269604 / +1.5%	0.81 / 0.82 / -1.2%
tpcds_q48/datafusion:parquet	41760321 / 42406388 / -1.5%	61369819 / 57295943 / +7.1%	0.68 / 0.74 / -8.1%
tpcds_q49/datafusion:parquet	74119586 / 72087236 / +2.8%	94328278 / 97854435 / -3.6%	0.79 / 0.74 / +6.7%
tpcds_q50/datafusion:parquet	47759358 / 48185600 / -0.9%	66607934 / 69818804 / -4.6%	0.72 / 0.69 / +3.9%
tpcds_q51/datafusion:parquet	76045026 / 76439736 / -0.5%	95595525 / 94125452 / +1.6%	0.80 / 0.81 / -2.0%
tpcds_q52/datafusion:parquet	18507857 / 18674516 / -0.9%	30738146 / 31188450 / -1.4%	0.60 / 0.60 / +0.6%
tpcds_q53/datafusion:parquet	23009930 / 22544812 / +2.1%	38993602 / 38072537 / +2.4%	0.59 / 0.59 / -0.3%
tpcds_q54/datafusion:parquet	52434275 / 52409662 / +0.0%	64801862 / 67779757 / -4.4%	0.81 / 0.77 / +4.6%
tpcds_q55/datafusion:parquet	18590872 / 18286962 / +1.7%	30102087 / 29950596 / +0.5%	0.62 / 0.61 / +1.2%
tpcds_q56/datafusion:parquet	39959854 / 42921421 / -6.9%	56996957 / 55141344 / +3.4%	0.70 / 0.78 / -9.9%
tpcds_q57/datafusion:parquet	101507678 / 102428108 / -0.9%	118885774 / 122554151 / -3.0%	0.85 / 0.84 / +2.2%
tpcds_q58/datafusion:parquet	65363291 / 65297522 / +0.1%	85210344 / 83208031 / +2.4%	0.77 / 0.78 / -2.3%
tpcds_q59/datafusion:parquet	48604115 / 46926640 / +3.6%	65498407 / 64044115 / +2.3%	0.74 / 0.73 / +1.3%
tpcds_q60/datafusion:parquet	40825605 / 39831420 / +2.5%	56027226 / 53214086 / +5.3%	0.73 / 0.75 / -2.7%
tpcds_q61/datafusion:parquet	36799540 / 35405752 / +3.9%	52262315 / 51221870 / +2.0%	0.70 / 0.69 / +1.9%
tpcds_q62/datafusion:parquet	25566146 / 25241106 / +1.3%	37961637 / 38473117 / -1.3%	0.67 / 0.66 / +2.7%
tpcds_q63/datafusion:parquet	22341361 / 22726709 / -1.7%	37568846 / 38240189 / -1.8%	0.59 / 0.59 / +0.1%
tpcds_q64/datafusion:parquet	288211512 / 289200816 / -0.3%	331440121 / 328997752 / +0.7%	0.87 / 0.88 / -1.1%
tpcds_q65/datafusion:parquet	120327790 / 118662896 / +1.4%	140844676 / 138659546 / +1.6%	0.85 / 0.86 / -0.2%
tpcds_q66/datafusion:parquet	61653133 / 60273846 / +2.3%	78021264 / 75680196 / +3.1%	0.79 / 0.80 / -0.8%
tpcds_q67/datafusion:parquet	68637277 / 68969874 / -0.5%	93247551 / 92804574 / +0.5%	0.74 / 0.74 / -1.0%
tpcds_q68/datafusion:parquet	30112185 / 29590473 / +1.8%	47739443 / 48131077 / -0.8%	0.63 / 0.61 / +2.6%
tpcds_q69/datafusion:parquet	43682686 / 43956679 / -0.6%	56845723 / 58802481 / -3.3%	0.77 / 0.75 / +2.8%
tpcds_q70/datafusion:parquet	80703028 / 81235804 / -0.7%	97982870 / 98125867 / -0.1%	0.82 / 0.83 / -0.5%
tpcds_q71/datafusion:parquet	24891505 / 26581725 / -6.4%	36924527 / 37125611 / -0.5%	0.67 / 0.72 / -5.8%
tpcds_q72/datafusion:parquet	516170284 / 520274398 / -0.8%	551287037 / 563751282 / -2.2%	0.94 / 0.92 / +1.5%
tpcds_q73/datafusion:parquet	24299940 / 23918058 / +1.6%	36025422 / 35651015 / +1.1%	0.67 / 0.67 / +0.5%
tpcds_q74/datafusion:parquet	70283501 / 71023096 / -1.0%	90446665 / 90032733 / +0.5%	0.78 / 0.79 / -1.5%
tpcds_q75/datafusion:parquet	153607972 / 154604053 / -0.6%	177487111 / 177588664 / -0.1%	0.87 / 0.87 / -0.6%
tpcds_q76/datafusion:parquet	34311240 / 33944858 / +1.1%	47408854 / 47632182 / -0.5%	0.72 / 0.71 / +1.6%
tpcds_q77/datafusion:parquet	57096223 / 57225324 / -0.2%	74259273 / 74950906 / -0.9%	0.77 / 0.76 / +0.7%
tpcds_q78/datafusion:parquet	86140920 / 85719581 / +0.5%	121376622 / 116502783 / +4.2%	0.71 / 0.74 / -3.5%
tpcds_q79/datafusion:parquet	27305444 / 27509512 / -0.7%	42096747 / 41936248 / +0.4%	0.65 / 0.66 / -1.1%
tpcds_q80/datafusion:parquet	82498054 / 81550116 / +1.2%	113487987 / 112533786 / +0.8%	0.73 / 0.72 / +0.3%
tpcds_q81/datafusion:parquet	39936488 / 38057320 / +4.9%	52077184 / 51187544 / +1.7%	0.77 / 0.74 / +3.1%
tpcds_q82/datafusion:parquet	22888666 / 22358518 / +2.4%	34685562 / 34247453 / +1.3%	0.66 / 0.65 / +1.1%
tpcds_q83/datafusion:parquet	59453948 / 59689310 / -0.4%	74254917 / 77351737 / -4.0%	0.80 / 0.77 / +3.8%
tpcds_q84/datafusion:parquet	28001720 / 26809388 / +4.4%	39703123 / 38911519 / +2.0%	0.71 / 0.69 / +2.4%
tpcds_q85/datafusion:parquet	81859834 / 81207994 / +0.8%	103467650 / 100760923 / +2.7%	0.79 / 0.81 / -1.8%
tpcds_q86/datafusion:parquet	20966356 / 21183260 / -1.0%	33497256 / 33061439 / +1.3%	0.63 / 0.64 / -2.3%
tpcds_q87/datafusion:parquet	45138624 / 46028570 / -1.9%	63797329 / 60628473 / +5.2%	0.71 / 0.76 / -6.8%
tpcds_q88/datafusion:parquet	37112580 / 37502346 / -1.0%	50908605 / 50485139 / +0.8%	0.73 / 0.74 / -1.9%
tpcds_q89/datafusion:parquet	26412628 / 26139226 / +1.0%	41424937 / 41509899 / -0.2%	0.64 / 0.63 / +1.3%
tpcds_q90/datafusion:parquet	15460622 / 14735711 / +4.9%	26744957 / 26505229 / +0.9%	0.58 / 0.56 / +4.0%
tpcds_q91/datafusion:parquet	32718262 / 31830840 / +2.8%	46168438 / 46825135 / -1.4%	0.71 / 0.68 / +4.2%
tpcds_q92/datafusion:parquet	27361892 / 26722473 / +2.4%	41753964 / 40826035 / +2.3%	0.66 / 0.65 / +0.1%
tpcds_q93/datafusion:parquet	27700022 / 27333436 / +1.3%	46862639 / 45585468 / +2.8%	0.59 / 0.60 / -1.4%
tpcds_q94/datafusion:parquet	35657068 / 35613925 / +0.1%	47599010 / 48830652 / -2.5%	0.75 / 0.73 / +2.7%
tpcds_q95/datafusion:parquet	65417263 / 64726173 / +1.1%	78493898 / 75654999 / +3.8%	0.83 / 0.86 / -2.6%
tpcds_q96/datafusion:parquet	12561842 / 12460034 / +0.8%	23917618 / 23944647 / -0.1%	0.53 / 0.52 / +0.9%
tpcds_q97/datafusion:parquet	35776466 / 35788868 / -0.0%	50949506 / 51453974 / -1.0%	0.70 / 0.70 / +1.0%
tpcds_q98/datafusion:parquet	24859865 / 24994566 / -0.5%	38585296 / 36616029 / +5.4%	0.64 / 0.68 / -5.6%
tpcds_q99/datafusion:parquet	29989072 / 29970888 / +0.1%	42151882 / 42682004 / -1.2%	0.71 / 0.70 / +1.3%

duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	15619627 / 15812349 / -1.2%	24251205 / 24288603 / -0.2%	0.64 / 0.65 / -1.1%
tpcds_q02/duckdb:vortex-file-compressed	15315310 / 15348732 / -0.2%	22384642 / 22167575 / +1.0%	0.68 / 0.69 / -1.2%
tpcds_q03/duckdb:vortex-file-compressed	6838602 / 7107824 / -3.8%	15264557 / 14907232 / +2.4%	0.45 / 0.48 / -6.0%
tpcds_q04/duckdb:vortex-file-compressed	44865978 / 45215538 / -0.8%	53868823 / 54000461 / -0.2%	0.83 / 0.84 / -0.5%
tpcds_q05/duckdb:vortex-file-compressed	22461382 / 22741588 / -1.2%	30610505 / 30909585 / -1.0%	0.73 / 0.74 / -0.3%
tpcds_q06/duckdb:vortex-file-compressed	23236477 / 23488198 / -1.1%	36464220 / 36366800 / +0.3%	0.64 / 0.65 / -1.3%
tpcds_q07/duckdb:vortex-file-compressed	13684486 / 13769964 / -0.6%	24369588 / 24210406 / +0.7%	0.56 / 0.57 / -1.3%
tpcds_q08/duckdb:vortex-file-compressed	17239237 / 17095829 / +0.8%	24485825 / 24100630 / +1.6%	0.70 / 0.71 / -0.7%
tpcds_q09/duckdb:vortex-file-compressed	19033458 / 18229098 / +4.4%	29674746 / 26662093 / +11.3% 🔴	0.64 / 0.68 / -6.2%
tpcds_q10/duckdb:vortex-file-compressed	26573100 / 26813549 / -0.9%	40171877 / 39220787 / +2.4%	0.66 / 0.68 / -3.2%
tpcds_q11/duckdb:vortex-file-compressed	36035506 / 36194046 / -0.4%	43893448 / 43868681 / +0.1%	0.82 / 0.83 / -0.5%
tpcds_q12/duckdb:vortex-file-compressed	9686718 / 9801800 / -1.2%	16290237 / 16003955 / +1.8%	0.59 / 0.61 / -2.9%
tpcds_q13/duckdb:vortex-file-compressed	20732533 / 20612700 / +0.6%	33453730 / 33283228 / +0.5%	0.62 / 0.62 / +0.1%
tpcds_q14/duckdb:vortex-file-compressed	54002775 / 54719090 / -1.3%	65348836 / 64574321 / +1.2%	0.83 / 0.85 / -2.5%
tpcds_q15/duckdb:vortex-file-compressed	10742942 / 10973687 / -2.1%	18077289 / 17180421 / +5.2%	0.59 / 0.64 / -7.0%
tpcds_q16/duckdb:vortex-file-compressed	23900928 / 23891924 / +0.0%	34750533 / 33873851 / +2.6%	0.69 / 0.71 / -2.5%
tpcds_q17/duckdb:vortex-file-compressed	25030170 / 25431216 / -1.6%	39931768 / 37891844 / +5.4%	0.63 / 0.67 / -6.6%
tpcds_q18/duckdb:vortex-file-compressed	30704354 / 30399308 / +1.0%	40712314 / 40108956 / +1.5%	0.75 / 0.76 / -0.5%
tpcds_q19/duckdb:vortex-file-compressed	76658912 / 77957722 / -1.7%	89655680 / 88018579 / +1.9%	0.86 / 0.89 / -3.5%
tpcds_q20/duckdb:vortex-file-compressed	10589787 / 10536390 / +0.5%	17995139 / 17415883 / +3.3%	0.59 / 0.60 / -2.7%
tpcds_q21/duckdb:vortex-file-compressed	10770390 / 10025145 / +7.4%	22253645 / 21115652 / +5.4%	0.48 / 0.47 / +1.9%
tpcds_q22/duckdb:vortex-file-compressed	17711614 / 17854158 / -0.8%	28236605 / 27946306 / +1.0%	0.63 / 0.64 / -1.8%
tpcds_q23/duckdb:vortex-file-compressed	36636377 / 37331922 / -1.9%	48481200 / 47922041 / +1.2%	0.76 / 0.78 / -3.0%
tpcds_q24/duckdb:vortex-file-compressed	26749870 / 27077140 / -1.2%	39037392 / 37512686 / +4.1%	0.69 / 0.72 / -5.1%
tpcds_q25/duckdb:vortex-file-compressed	23232896 / 23505611 / -1.2%	36213439 / 35447364 / +2.2%	0.64 / 0.66 / -3.3%
tpcds_q26/duckdb:vortex-file-compressed	12756802 / 12969307 / -1.6%	20942387 / 20467290 / +2.3%	0.61 / 0.63 / -3.9%
tpcds_q27/duckdb:vortex-file-compressed	16099676 / 16238035 / -0.9%	26528829 / 26375917 / +0.6%	0.61 / 0.62 / -1.4%
tpcds_q28/duckdb:vortex-file-compressed	14792332 / 14716370 / +0.5%	23589299 / 23129566 / +2.0%	0.63 / 0.64 / -1.4%
tpcds_q29/duckdb:vortex-file-compressed	23136367 / 23459198 / -1.4%	36717695 / 35050522 / +4.8%	0.63 / 0.67 / -5.9%
tpcds_q30/duckdb:vortex-file-compressed	15508088 / 15973668 / -2.9%	23187954 / 23147891 / +0.2%	0.67 / 0.69 / -3.1%
tpcds_q31/duckdb:vortex-file-compressed	17481558 / 17761160 / -1.6%	25626982 / 25441966 / +0.7%	0.68 / 0.70 / -2.3%
tpcds_q32/duckdb:vortex-file-compressed	11154590 / 11578927 / -3.7%	21720434 / 19754891 / +9.9%	0.51 / 0.59 / -12.4%
tpcds_q33/duckdb:vortex-file-compressed	17579373 / 17841716 / -1.5%	26175733 / 25762176 / +1.6%	0.67 / 0.69 / -3.0%
tpcds_q34/duckdb:vortex-file-compressed	12390716 / 12261280 / +1.1%	21934837 / 21009601 / +4.4%	0.56 / 0.58 / -3.2%
tpcds_q35/duckdb:vortex-file-compressed	27542827 / 28109308 / -2.0%	39935198 / 38306029 / +4.3%	0.69 / 0.73 / -6.0%
tpcds_q36/duckdb:vortex-file-compressed	14451370 / 14572046 / -0.8%	23780523 / 24259922 / -2.0%	0.61 / 0.60 / +1.2%
tpcds_q37/duckdb:vortex-file-compressed	9217799 / 9153772 / +0.7%	22518059 / 21211544 / +6.2%	0.41 / 0.43 / -5.1%
tpcds_q38/duckdb:vortex-file-compressed	23749620 / 23937350 / -0.8%	30845414 / 29971763 / +2.9%	0.77 / 0.80 / -3.6%
tpcds_q39/duckdb:vortex-file-compressed	19424142 / 20713854 / -6.2%	31639865 / 32217469 / -1.8%	0.61 / 0.64 / -4.5%
tpcds_q40/duckdb:vortex-file-compressed	13528326 / 13907733 / -2.7%	21462157 / 20993061 / +2.2%	0.63 / 0.66 / -4.9%
tpcds_q41/duckdb:vortex-file-compressed	14479183 / 14460774 / +0.1%	21176041 / 21606879 / -2.0%	0.68 / 0.67 / +2.2%
tpcds_q42/duckdb:vortex-file-compressed	6942573 / 7000333 / -0.8%	15875288 / 14711420 / +7.9%	0.44 / 0.48 / -8.1%
tpcds_q43/duckdb:vortex-file-compressed	9872628 / 9857861 / +0.1%	18352429 / 18269823 / +0.5%	0.54 / 0.54 / -0.3%
tpcds_q44/duckdb:vortex-file-compressed	14986200 / 15208966 / -1.5%	25673839 / 24579836 / +4.5%	0.58 / 0.62 / -5.7%
tpcds_q45/duckdb:vortex-file-compressed	23119200 / 23225846 / -0.5%	31053418 / 30734910 / +1.0%	0.74 / 0.76 / -1.5%
tpcds_q46/duckdb:vortex-file-compressed	18790986 / 19147798 / -1.9%	26794781 / 26976084 / -0.7%	0.70 / 0.71 / -1.2%
tpcds_q47/duckdb:vortex-file-compressed	33846053 / 33591739 / +0.8%	44295757 / 42806325 / +3.5%	0.76 / 0.78 / -2.6%
tpcds_q48/duckdb:vortex-file-compressed	23262790 / 23223844 / +0.2%	36900222 / 35964289 / +2.6%	0.63 / 0.65 / -2.4%
tpcds_q49/duckdb:vortex-file-compressed	19904259 / 19806280 / +0.5%	33410021 / 31814691 / +5.0%	0.60 / 0.62 / -4.3%
tpcds_q50/duckdb:vortex-file-compressed	17341062 / 17348206 / -0.0%	28483567 / 28077192 / +1.4%	0.61 / 0.62 / -1.5%
tpcds_q51/duckdb:vortex-file-compressed	48267956 / 48654946 / -0.8%	57967716 / 57803344 / +0.3%	0.83 / 0.84 / -1.1%
tpcds_q52/duckdb:vortex-file-compressed	6887686 / 6977702 / -1.3%	15936043 / 14949587 / +6.6%	0.43 / 0.47 / -7.4%
tpcds_q53/duckdb:vortex-file-compressed	11279020 / 11338155 / -0.5%	19928595 / 19138298 / +4.1%	0.57 / 0.59 / -4.5%
tpcds_q54/duckdb:vortex-file-compressed	19922406 / 19875562 / +0.2%	29862967 / 29062613 / +2.8%	0.67 / 0.68 / -2.5%
tpcds_q55/duckdb:vortex-file-compressed	6854219 / 6937354 / -1.2%	15169315 / 14470022 / +4.8%	0.45 / 0.48 / -5.8%
tpcds_q56/duckdb:vortex-file-compressed	18002992 / 17905998 / +0.5%	26849869 / 25571196 / +5.0%	0.67 / 0.70 / -4.2%
tpcds_q57/duckdb:vortex-file-compressed	25271094 / 25335496 / -0.3%	33405215 / 33640536 / -0.7%	0.76 / 0.75 / +0.4%
tpcds_q58/duckdb:vortex-file-compressed	19732153 / 19719092 / +0.1%	29371023 / 28240124 / +4.0%	0.67 / 0.70 / -3.8%
tpcds_q59/duckdb:vortex-file-compressed	19168640 / 19462613 / -1.5%	26917113 / 26666451 / +0.9%	0.71 / 0.73 / -2.4%
tpcds_q60/duckdb:vortex-file-compressed	18275870 / 18484990 / -1.1%	27442703 / 27244233 / +0.7%	0.67 / 0.68 / -1.8%
tpcds_q61/duckdb:vortex-file-compressed	23512965 / 23500298 / +0.1%	34166671 / 33590210 / +1.7%	0.69 / 0.70 / -1.6%
tpcds_q62/duckdb:vortex-file-compressed	12009184 / 11883877 / +1.1%	18882044 / 18594693 / +1.5%	0.64 / 0.64 / -0.5%
tpcds_q63/duckdb:vortex-file-compressed	10705818 / 10786763 / -0.8%	20174552 / 18933316 / +6.6%	0.53 / 0.57 / -6.9%
tpcds_q64/duckdb:vortex-file-compressed	49219536 / 49381741 / -0.3%	68084411 / 66939762 / +1.7%	0.72 / 0.74 / -2.0%
tpcds_q65/duckdb:vortex-file-compressed	14682142 / 15210768 / -3.5%	24829366 / 24554507 / +1.1%	0.59 / 0.62 / -4.5%
tpcds_q66/duckdb:vortex-file-compressed	29462366 / 31551284 / -6.6%	39233621 / 37592215 / +4.4%	0.75 / 0.84 / -10.5%
tpcds_q67/duckdb:vortex-file-compressed	57736081 / 58199580 / -0.8%	66699074 / 66601873 / +0.1%	0.87 / 0.87 / -0.9%
tpcds_q68/duckdb:vortex-file-compressed	18825181 / 18878023 / -0.3%	27114950 / 27047384 / +0.2%	0.69 / 0.70 / -0.5%
tpcds_q69/duckdb:vortex-file-compressed	21781400 / 21904135 / -0.6%	36560780 / 35821713 / +2.1%	0.60 / 0.61 / -2.6%
tpcds_q70/duckdb:vortex-file-compressed	15204082 / 15278904 / -0.5%	24268245 / 23311131 / +4.1%	0.63 / 0.66 / -4.4%
tpcds_q71/duckdb:vortex-file-compressed	12764532 / 13109101 / -2.6%	22638132 / 21863944 / +3.5%	0.56 / 0.60 / -6.0%
tpcds_q72/duckdb:vortex-file-compressed	54478250 / 55047342 / -1.0%	69988604 / 67962338 / +3.0%	0.78 / 0.81 / -3.9%
tpcds_q73/duckdb:vortex-file-compressed	11423826 / 11328457 / +0.8%	20232109 / 19649008 / +3.0%	0.56 / 0.58 / -2.1%
tpcds_q74/duckdb:vortex-file-compressed	25886048 / 26080660 / -0.7%	32710478 / 32976279 / -0.8%	0.79 / 0.79 / +0.1%
tpcds_q75/duckdb:vortex-file-compressed	28525158 / 28669632 / -0.5%	39020585 / 38371413 / +1.7%	0.73 / 0.75 / -2.2%
tpcds_q76/duckdb:vortex-file-compressed	12536514 / 12886790 / -2.7%	22286492 / 21983897 / +1.4%	0.56 / 0.59 / -4.0%
tpcds_q77/duckdb:vortex-file-compressed	21282474 / 20688760 / +2.9%	30577628 / 29156885 / +4.9%	0.70 / 0.71 / -1.9%
tpcds_q78/duckdb:vortex-file-compressed	42774096 / 43247262 / -1.1%	53653465 / 51770150 / +3.6%	0.80 / 0.84 / -4.6%
tpcds_q79/duckdb:vortex-file-compressed	12862926 / 12837402 / +0.2%	21113192 / 20971335 / +0.7%	0.61 / 0.61 / -0.5%
tpcds_q80/duckdb:vortex-file-compressed	36429436 / 36876144 / -1.2%	50203477 / 49255122 / +1.9%	0.73 / 0.75 / -3.1%
tpcds_q81/duckdb:vortex-file-compressed	20302480 / 21338582 / -4.9%	28904259 / 27677065 / +4.4%	0.70 / 0.77 / -8.9%
tpcds_q82/duckdb:vortex-file-compressed	9148332 / 9618028 / -4.9%	23295794 / 21287053 / +9.4%	0.39 / 0.45 / -13.1%
tpcds_q83/duckdb:vortex-file-compressed	17323583 / 17396941 / -0.4%	24128151 / 23846397 / +1.2%	0.72 / 0.73 / -1.6%
tpcds_q84/duckdb:vortex-file-compressed	15517038 / 15509991 / +0.0%	22662714 / 22419158 / +1.1%	0.68 / 0.69 / -1.0%
tpcds_q85/duckdb:vortex-file-compressed	24031227 / 23945822 / +0.4%	37891196 / 36016994 / +5.2%	0.63 / 0.66 / -4.6%
tpcds_q86/duckdb:vortex-file-compressed	9370912 / 9414756 / -0.5%	16757623 / 16692661 / +0.4%	0.56 / 0.56 / -0.9%
tpcds_q87/duckdb:vortex-file-compressed	25210110 / 25544466 / -1.3%	31294660 / 31866016 / -1.8%	0.81 / 0.80 / +0.5%
tpcds_q88/duckdb:vortex-file-compressed	37304130 / 37259277 / +0.1%	47921575 / 46987977 / +2.0%	0.78 / 0.79 / -1.8%
tpcds_q89/duckdb:vortex-file-compressed	11934700 / 11900514 / +0.3%	21024082 / 20980755 / +0.2%	0.57 / 0.57 / +0.1%
tpcds_q90/duckdb:vortex-file-compressed	8710269 / 8689886 / +0.2%	14391177 / 15404743 / -6.6%	0.61 / 0.56 / +7.3%
tpcds_q91/duckdb:vortex-file-compressed	13993182 / 13677722 / +2.3%	21542481 / 21217723 / +1.5%	0.65 / 0.64 / +0.8%
tpcds_q92/duckdb:vortex-file-compressed	11789822 / 11646538 / +1.2%	20383801 / 19878946 / +2.5%	0.58 / 0.59 / -1.3%
tpcds_q93/duckdb:vortex-file-compressed	10447881 / 10426908 / +0.2%	24411897 / 23569784 / +3.6%	0.43 / 0.44 / -3.3%
tpcds_q94/duckdb:vortex-file-compressed	21636672 / 21913950 / -1.3%	31655241 / 31116183 / +1.7%	0.68 / 0.70 / -2.9%
tpcds_q95/duckdb:vortex-file-compressed	39752844 / 40350594 / -1.5%	51983138 / 50479114 / +3.0%	0.76 / 0.80 / -4.3%
tpcds_q96/duckdb:vortex-file-compressed	6653618 / 6727946 / -1.1%	15919280 / 14831428 / +7.3%	0.42 / 0.45 / -7.9%
tpcds_q97/duckdb:vortex-file-compressed	23260771 / 23050618 / +0.9%	30530511 / 30944443 / -1.3%	0.76 / 0.74 / +2.3%
tpcds_q98/duckdb:vortex-file-compressed	11049650 / 11074374 / -0.2%	19419696 / 18562592 / +4.6%	0.57 / 0.60 / -4.6%
tpcds_q99/duckdb:vortex-file-compressed	14543454 / 14745162 / -1.4%	22266314 / 22058787 / +0.9%	0.65 / 0.67 / -2.3%

duckdb / parquet / ns (0.993x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	23937181 / 24368061 / -1.8%	30935726 / 30887319 / +0.2%	0.77 / 0.79 / -1.9%
tpcds_q02/duckdb:parquet	18119232 / 18256806 / -0.8%	24277772 / 24448602 / -0.7%	0.75 / 0.75 / -0.1%
tpcds_q03/duckdb:parquet	9858035 / 10034960 / -1.8%	15544000 / 15781642 / -1.5%	0.63 / 0.64 / -0.3%
tpcds_q04/duckdb:parquet	117034940 / 118991734 / -1.6%	126987974 / 125031259 / +1.6%	0.92 / 0.95 / -3.2%
tpcds_q05/duckdb:parquet	28845679 / 29176425 / -1.1%	32968924 / 33463442 / -1.5%	0.87 / 0.87 / +0.3%
tpcds_q06/duckdb:parquet	26284758 / 26887356 / -2.2%	36022278 / 35968925 / +0.1%	0.73 / 0.75 / -2.4%
tpcds_q07/duckdb:parquet	31720270 / 31436535 / +0.9%	40157460 / 39415018 / +1.9%	0.79 / 0.80 / -1.0%
tpcds_q08/duckdb:parquet	19866866 / 20276572 / -2.0%	25383583 / 24884350 / +2.0%	0.78 / 0.81 / -3.9%
tpcds_q09/duckdb:parquet	27447044 / 27809440 / -1.3%	32494681 / 31902772 / +1.9%	0.84 / 0.87 / -3.1%
tpcds_q10/duckdb:parquet	33128652 / 33039182 / +0.3%	40873304 / 40382761 / +1.2%	0.81 / 0.82 / -0.9%
tpcds_q11/duckdb:parquet	68945937 / 69473145 / -0.8%	75272655 / 76246180 / -1.3%	0.92 / 0.91 / +0.5%
tpcds_q12/duckdb:parquet	14056705 / 14301102 / -1.7%	19145574 / 19185996 / -0.2%	0.73 / 0.75 / -1.5%
tpcds_q13/duckdb:parquet	31053216 / 31177516 / -0.4%	40719386 / 40974924 / -0.6%	0.76 / 0.76 / +0.2%
tpcds_q14/duckdb:parquet	64708366 / 64394206 / +0.5%	70369056 / 69339881 / +1.5%	0.92 / 0.93 / -1.0%
tpcds_q15/duckdb:parquet	16743948 / 16868978 / -0.7%	23205444 / 22586354 / +2.7%	0.72 / 0.75 / -3.4%
tpcds_q16/duckdb:parquet	30657292 / 30855152 / -0.6%	37227014 / 37031119 / +0.5%	0.82 / 0.83 / -1.2%
tpcds_q17/duckdb:parquet	34979376 / 35013632 / -0.1%	40536409 / 40738363 / -0.5%	0.86 / 0.86 / +0.4%
tpcds_q18/duckdb:parquet	47798435 / 47966941 / -0.4%	55283113 / 56078341 / -1.4%	0.86 / 0.86 / +1.1%
tpcds_q19/duckdb:parquet	19042574 / 19266934 / -1.2%	26072021 / 26243216 / -0.7%	0.73 / 0.73 / -0.5%
tpcds_q20/duckdb:parquet	15123248 / 15134876 / -0.1%	20014180 / 20316814 / -1.5%	0.76 / 0.74 / +1.4%
tpcds_q21/duckdb:parquet	10901382 / 10975608 / -0.7%	16699940 / 17243409 / -3.2%	0.65 / 0.64 / +2.6%
tpcds_q22/duckdb:parquet	20669760 / 21000556 / -1.6%	26716922 / 26432022 / +1.1%	0.77 / 0.79 / -2.6%
tpcds_q23/duckdb:parquet	48478911 / 42830730 / +13.2% 🔴	48563286 / 48248501 / +0.7%	1.00 / 0.89 / +12.5%
tpcds_q24/duckdb:parquet	30577309 / 30562957 / +0.0%	37694635 / 36281545 / +3.9%	0.81 / 0.84 / -3.7%
tpcds_q25/duckdb:parquet	30630298 / 31136421 / -1.6%	37932841 / 37086871 / +2.3%	0.81 / 0.84 / -3.8%
tpcds_q26/duckdb:parquet	29016620 / 29451672 / -1.5%	35442909 / 35681555 / -0.7%	0.82 / 0.83 / -0.8%
tpcds_q27/duckdb:parquet	34496538 / 33687512 / +2.4%	42013310 / 41039635 / +2.4%	0.82 / 0.82 / +0.0%
tpcds_q28/duckdb:parquet	27187704 / 27280410 / -0.3%	35551522 / 33144030 / +7.3%	0.76 / 0.82 / -7.1%
tpcds_q29/duckdb:parquet	33683291 / 33096354 / +1.8%	39341152 / 39356667 / -0.0%	0.86 / 0.84 / +1.8%
tpcds_q30/duckdb:parquet	36084602 / 36006312 / +0.2%	44765774 / 44353394 / +0.9%	0.81 / 0.81 / -0.7%
tpcds_q31/duckdb:parquet	35702028 / 35877806 / -0.5%	43127019 / 43085996 / +0.1%	0.83 / 0.83 / -0.6%
tpcds_q32/duckdb:parquet	14390350 / 14401900 / -0.1%	21145432 / 21017247 / +0.6%	0.68 / 0.69 / -0.7%
tpcds_q33/duckdb:parquet	25371770 / 25420418 / -0.2%	29570225 / 29441667 / +0.4%	0.86 / 0.86 / -0.6%
tpcds_q34/duckdb:parquet	17300905 / 18680544 / -7.4%	24824214 / 24785987 / +0.2%	0.70 / 0.75 / -7.5%
tpcds_q35/duckdb:parquet	35723989 / 35290647 / +1.2%	44445076 / 44848103 / -0.9%	0.80 / 0.79 / +2.1%
tpcds_q36/duckdb:parquet	40324004 / 40462820 / -0.3%	48678661 / 48650890 / +0.1%	0.83 / 0.83 / -0.4%
tpcds_q37/duckdb:parquet	13000366 / 13022974 / -0.2%	20000517 / 18951301 / +5.5%	0.65 / 0.69 / -5.4%
tpcds_q38/duckdb:parquet	29796321 / 30069369 / -0.9%	34207758 / 35024507 / -2.3%	0.87 / 0.86 / +1.5%
tpcds_q39/duckdb:parquet	23368962 / 23620332 / -1.1%	30028045 / 29371904 / +2.2%	0.78 / 0.80 / -3.2%
tpcds_q40/duckdb:parquet	16155926 / 16426259 / -1.6%	21879006 / 21767600 / +0.5%	0.74 / 0.75 / -2.1%
tpcds_q41/duckdb:parquet	12223990 / 12333208 / -0.9%	18717432 / 18592037 / +0.7%	0.65 / 0.66 / -1.5%
tpcds_q42/duckdb:parquet	9627277 / 9999468 / -3.7%	15589762 / 15450281 / +0.9%	0.62 / 0.65 / -4.6%
tpcds_q43/duckdb:parquet	12385764 / 12632390 / -2.0%	18479972 / 18945821 / -2.5%	0.67 / 0.67 / +0.5%
tpcds_q44/duckdb:parquet	22322171 / 20432582 / +9.2%	26778602 / 28420295 / -5.8%	0.83 / 0.72 / +15.9%
tpcds_q45/duckdb:parquet	21327235 / 21607447 / -1.3%	28161841 / 28181957 / -0.1%	0.76 / 0.77 / -1.2%
tpcds_q46/duckdb:parquet	37042018 / 37186736 / -0.4%	44731108 / 45017247 / -0.6%	0.83 / 0.83 / +0.2%
tpcds_q47/duckdb:parquet	34737471 / 35017544 / -0.8%	40534746 / 40652192 / -0.3%	0.86 / 0.86 / -0.5%
tpcds_q48/duckdb:parquet	29179448 / 30010340 / -2.8%	37001154 / 39204139 / -5.6%	0.79 / 0.77 / +3.0%
tpcds_q49/duckdb:parquet	30331524 / 30467557 / -0.4%	36719237 / 36884643 / -0.4%	0.83 / 0.83 / +0.0%
tpcds_q50/duckdb:parquet	19837502 / 19872450 / -0.2%	25990875 / 25822824 / +0.7%	0.76 / 0.77 / -0.8%
tpcds_q51/duckdb:parquet	52102918 / 52177722 / -0.1%	61026456 / 59991330 / +1.7%	0.85 / 0.87 / -1.8%
tpcds_q52/duckdb:parquet	9731848 / 9883032 / -1.5%	16222647 / 15538559 / +4.4%	0.60 / 0.64 / -5.7%
tpcds_q53/duckdb:parquet	13971050 / 13988219 / -0.1%	21041032 / 20898950 / +0.7%	0.66 / 0.67 / -0.8%
tpcds_q54/duckdb:parquet	24950202 / 25261474 / -1.2%	32602215 / 32541348 / +0.2%	0.77 / 0.78 / -1.4%
tpcds_q55/duckdb:parquet	9484750 / 9680304 / -2.0%	15402533 / 15925524 / -3.3%	0.62 / 0.61 / +1.3%
tpcds_q56/duckdb:parquet	25331444 / 25729752 / -1.5%	31235051 / 30209293 / +3.4%	0.81 / 0.85 / -4.8%
tpcds_q57/duckdb:parquet	30870626 / 30913514 / -0.1%	36643391 / 35758059 / +2.5%	0.84 / 0.86 / -2.6%
tpcds_q58/duckdb:parquet	24270871 / 25124922 / -3.4%	30526073 / 30603536 / -0.3%	0.80 / 0.82 / -3.2%
tpcds_q59/duckdb:parquet	23338472 / 23361234 / -0.1%	29270092 / 29247827 / +0.1%	0.80 / 0.80 / -0.2%
tpcds_q60/duckdb:parquet	26586563 / 27034754 / -1.7%	32914025 / 33364255 / -1.3%	0.81 / 0.81 / -0.3%
tpcds_q61/duckdb:parquet	25184151 / 24567295 / +2.5%	29463862 / 29623766 / -0.5%	0.85 / 0.83 / +3.1%
tpcds_q62/duckdb:parquet	13211360 / 13167674 / +0.3%	18714536 / 18227598 / +2.7%	0.71 / 0.72 / -2.3%
tpcds_q63/duckdb:parquet	13466366 / 14848563 / -9.3%	20059704 / 19973084 / +0.4%	0.67 / 0.74 / -9.7%
tpcds_q64/duckdb:parquet	71074397 / 71405058 / -0.5%	81874524 / 81778893 / +0.1%	0.87 / 0.87 / -0.6%
tpcds_q65/duckdb:parquet	20446192 / 20520746 / -0.4%	24966405 / 24915883 / +0.2%	0.82 / 0.82 / -0.6%
tpcds_q66/duckdb:parquet	35436286 / 35838221 / -1.1%	42363778 / 41659483 / +1.7%	0.84 / 0.86 / -2.8%
tpcds_q67/duckdb:parquet	60856780 / 60920838 / -0.1%	67537407 / 69212779 / -2.4%	0.90 / 0.88 / +2.4%
tpcds_q68/duckdb:parquet	29520479 / 29524156 / -0.0%	36885491 / 36326079 / +1.5%	0.80 / 0.81 / -1.5%
tpcds_q69/duckdb:parquet	26420544 / 26366896 / +0.2%	34856685 / 34283015 / +1.7%	0.76 / 0.77 / -1.4%
tpcds_q70/duckdb:parquet	19551218 / 19603310 / -0.3%	26564313 / 27037606 / -1.8%	0.74 / 0.73 / +1.5%
tpcds_q71/duckdb:parquet	17037478 / 17225545 / -1.1%	24428858 / 23906577 / +2.2%	0.70 / 0.72 / -3.2%
tpcds_q72/duckdb:parquet	55572070 / 54915050 / +1.2%	62014002 / 61223296 / +1.3%	0.90 / 0.90 / -0.1%
tpcds_q73/duckdb:parquet	16228276 / 16334782 / -0.7%	21852661 / 22012653 / -0.7%	0.74 / 0.74 / +0.1%
tpcds_q74/duckdb:parquet	84297543 / 84517692 / -0.3%	92586757 / 91200409 / +1.5%	0.91 / 0.93 / -1.8%
tpcds_q75/duckdb:parquet	43776474 / 45684788 / -4.2%	51257811 / 51215889 / +0.1%	0.85 / 0.89 / -4.3%
tpcds_q76/duckdb:parquet	18120372 / 18708936 / -3.1%	23825909 / 24329656 / -2.1%	0.76 / 0.77 / -1.1%
tpcds_q77/duckdb:parquet	25229450 / 27194415 / -7.2%	32198691 / 31156282 / +3.3%	0.78 / 0.87 / -10.2%
tpcds_q78/duckdb:parquet	78580240 / 78429492 / +0.2%	86689033 / 85334538 / +1.6%	0.91 / 0.92 / -1.4%
tpcds_q79/duckdb:parquet	22475874 / 21882434 / +2.7%	29407555 / 29112959 / +1.0%	0.76 / 0.75 / +1.7%
tpcds_q80/duckdb:parquet	37777696 / 37579830 / +0.5%	44263884 / 43535486 / +1.7%	0.85 / 0.86 / -1.1%
tpcds_q81/duckdb:parquet	36869594 / 36704614 / +0.4%	45594457 / 45120726 / +1.0%	0.81 / 0.81 / -0.6%
tpcds_q82/duckdb:parquet	13655992 / 14135768 / -3.4%	20813727 / 20713600 / +0.5%	0.66 / 0.68 / -3.9%
tpcds_q83/duckdb:parquet	20520063 / 20580187 / -0.3%	25716044 / 25538065 / +0.7%	0.80 / 0.81 / -1.0%
tpcds_q84/duckdb:parquet	23327106 / 23303746 / +0.1%	29228606 / 28901497 / +1.1%	0.80 / 0.81 / -1.0%
tpcds_q85/duckdb:parquet	32719656 / 33102492 / -1.2%	40294355 / 40093786 / +0.5%	0.81 / 0.83 / -1.6%
tpcds_q86/duckdb:parquet	11979112 / 12076133 / -0.8%	18045524 / 17026136 / +6.0%	0.66 / 0.71 / -6.4%
tpcds_q87/duckdb:parquet	31511544 / 31450326 / +0.2%	35638330 / 35450699 / +0.5%	0.88 / 0.89 / -0.3%
tpcds_q88/duckdb:parquet	39421894 / 39412772 / +0.0%	42904577 / 47017045 / -8.7%	0.92 / 0.84 / +9.6%
tpcds_q89/duckdb:parquet	14345178 / 14437881 / -0.6%	21474904 / 21332104 / +0.7%	0.67 / 0.68 / -1.3%
tpcds_q90/duckdb:parquet	10282812 / 10181238 / +1.0%	15528054 / 15631396 / -0.7%	0.66 / 0.65 / +1.7%
tpcds_q91/duckdb:parquet	21390602 / 21357922 / +0.2%	29508283 / 29450059 / +0.2%	0.72 / 0.73 / -0.0%
tpcds_q92/duckdb:parquet	15757962 / 15800426 / -0.3%	22575929 / 22090969 / +2.2%	0.70 / 0.72 / -2.4%
tpcds_q93/duckdb:parquet	14338228 / 14352786 / -0.1%	21120588 / 20279814 / +4.1%	0.68 / 0.71 / -4.1%
tpcds_q94/duckdb:parquet	25706183 / 25941000 / -0.9%	32880752 / 32935867 / -0.2%	0.78 / 0.79 / -0.7%
tpcds_q95/duckdb:parquet	43943324 / 44097548 / -0.3%	49672345 / 49912668 / -0.5%	0.88 / 0.88 / +0.1%
tpcds_q96/duckdb:parquet	8336045 / 8523766 / -2.2%	14168193 / 14253246 / -0.6%	0.59 / 0.60 / -1.6%
tpcds_q97/duckdb:parquet	27773808 / 27917258 / -0.5%	33570115 / 34357849 / -2.3%	0.83 / 0.81 / +1.8%
tpcds_q98/duckdb:parquet	16487404 / 16574593 / -0.5%	23373493 / 23363299 / +0.0%	0.71 / 0.71 / -0.6%
tpcds_q99/duckdb:parquet	19082270 / 19551015 / -2.4%	24418840 / 24236872 / +0.8%	0.78 / 0.81 / -3.1%

No file size changes detected.

github-actions · 2026-10-26T14:17:05Z

Benchmarks: Clickbench on NVME 📖

Commits: PR 65bf7e98 vs base cd455247
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.8%
Engines: DataFusion Likely regression (+13.9%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.063x ➖ · cold 1.011x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.986x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.136x ❌, 0↑ 12↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1238336 / 1220232 / +1.5%	22459905 / 23048266 / -2.6%	0.06 / 0.05 / +4.1%
clickbench_q01/datafusion:vortex-file-compressed	6358439 / 5885008 / +8.0%	29530684 / 35151314 / -16.0% 🟢	0.22 / 0.17 / +28.6%
clickbench_q02/datafusion:vortex-file-compressed	10791964 / 9281130 / +16.3% 🔴	42254213 / 35065642 / +20.5% 🔴	0.26 / 0.26 / -3.5%
clickbench_q03/datafusion:vortex-file-compressed	12913708 / 10896448 / +18.5% 🔴	51915789 / 54220855 / -4.3%	0.25 / 0.20 / +23.8%
clickbench_q04/datafusion:vortex-file-compressed	59869478 / 55277536 / +8.3%	100441344 / 93260293 / +7.7%	0.60 / 0.59 / +0.6%
clickbench_q05/datafusion:vortex-file-compressed	76697179 / 76535697 / +0.2%	122699616 / 118673587 / +3.4%	0.63 / 0.64 / -3.1%
clickbench_q06/datafusion:vortex-file-compressed	1236230 / 1215275 / +1.7%	22248192 / 23310451 / -4.6%	0.06 / 0.05 / +6.6%
clickbench_q07/datafusion:vortex-file-compressed	9472104 / 9059660 / +4.6%	34014879 / 35820780 / -5.0%	0.28 / 0.25 / +10.1%
clickbench_q08/datafusion:vortex-file-compressed	80665484 / 74367862 / +8.5%	126394033 / 120622890 / +4.8%	0.64 / 0.62 / +3.5%
clickbench_q09/datafusion:vortex-file-compressed	170966179 / 170246562 / +0.4%	215639613 / 204706367 / +5.3%	0.79 / 0.83 / -4.7%
clickbench_q10/datafusion:vortex-file-compressed	24558594 / 22648622 / +8.4%	65061507 / 67319532 / -3.4%	0.38 / 0.34 / +12.2%
clickbench_q11/datafusion:vortex-file-compressed	27758682 / 25412050 / +9.2%	68866489 / 70698930 / -2.6%	0.40 / 0.36 / +12.1%
clickbench_q12/datafusion:vortex-file-compressed	73444450 / 71747128 / +2.4%	119558409 / 116018487 / +3.1%	0.61 / 0.62 / -0.7%
clickbench_q13/datafusion:vortex-file-compressed	117482932 / 118792577 / -1.1%	180218893 / 175561156 / +2.7%	0.65 / 0.68 / -3.7%
clickbench_q14/datafusion:vortex-file-compressed	77878606 / 73863168 / +5.4%	122692660 / 120287918 / +2.0%	0.63 / 0.61 / +3.4%
clickbench_q15/datafusion:vortex-file-compressed	63488850 / 61180558 / +3.8%	99512356 / 96335387 / +3.3%	0.64 / 0.64 / +0.5%
clickbench_q16/datafusion:vortex-file-compressed	151918669 / 151232242 / +0.5%	213628075 / 211176884 / +1.2%	0.71 / 0.72 / -0.7%
clickbench_q17/datafusion:vortex-file-compressed	155797134 / 147115737 / +5.9%	224658593 / 229362708 / -2.1%	0.69 / 0.64 / +8.1%
clickbench_q18/datafusion:vortex-file-compressed	296233558 / 284618970 / +4.1%	384139458 / 381536506 / +0.7%	0.77 / 0.75 / +3.4%
clickbench_q19/datafusion:vortex-file-compressed	8246209 / 7427256 / +11.0% 🔴	45210511 / 48290561 / -6.4%	0.18 / 0.15 / +18.6%
clickbench_q20/datafusion:vortex-file-compressed	85901650 / 60788302 / +41.3% 🔴	281022987 / 226673958 / +24.0% 🔴	0.31 / 0.27 / +14.0%
clickbench_q21/datafusion:vortex-file-compressed	100809806 / 87577535 / +15.1% 🔴	319376319 / 271704799 / +17.5% 🔴	0.32 / 0.32 / -2.1%
clickbench_q22/datafusion:vortex-file-compressed	141273170 / 95800617 / +47.5% 🔴	467756122 / 343337959 / +36.2% 🔴	0.30 / 0.28 / +8.2%
clickbench_q23/datafusion:vortex-file-compressed	686064652 / 196999956 / +248.3% 🔴	994251258 / 415644377 / +139.2% 🔴	0.69 / 0.47 / +45.6%
clickbench_q24/datafusion:vortex-file-compressed	23553164 / 15902190 / +48.1% 🔴	68729222 / 67712192 / +1.5%	0.34 / 0.23 / +45.9%
clickbench_q25/datafusion:vortex-file-compressed	22018726 / 17919359 / +22.9% 🔴	62063813 / 60325048 / +2.9%	0.35 / 0.30 / +19.4%
clickbench_q26/datafusion:vortex-file-compressed	23424121 / 15869005 / +47.6% 🔴	69628436 / 65468767 / +6.4%	0.34 / 0.24 / +38.8%
clickbench_q27/datafusion:vortex-file-compressed	120157640 / 95748572 / +25.5% 🔴	296869620 / 243608429 / +21.9% 🔴	0.40 / 0.39 / +3.0%
clickbench_q28/datafusion:vortex-file-compressed	549932091 / 555228154 / -1.0%	665070019 / 618251242 / +7.6%	0.83 / 0.90 / -7.9%
clickbench_q29/datafusion:vortex-file-compressed	24462764 / 22959850 / +6.5%	51278728 / 50437924 / +1.7%	0.48 / 0.46 / +4.8%
clickbench_q30/datafusion:vortex-file-compressed	58227340 / 56023128 / +3.9%	105302596 / 110213944 / -4.5%	0.55 / 0.51 / +8.8%
clickbench_q31/datafusion:vortex-file-compressed	68415870 / 67274259 / +1.7%	155863936 / 153286424 / +1.7%	0.44 / 0.44 / +0.0%
clickbench_q32/datafusion:vortex-file-compressed	288310538 / 279852818 / +3.0%	383586668 / 382512285 / +0.3%	0.75 / 0.73 / +2.7%
clickbench_q33/datafusion:vortex-file-compressed	326832596 / 315228356 / +3.7%	429386171 / 421911660 / +1.8%	0.76 / 0.75 / +1.9%
clickbench_q34/datafusion:vortex-file-compressed	325163521 / 319122092 / +1.9%	431050014 / 430301441 / +0.2%	0.75 / 0.74 / +1.7%
clickbench_q35/datafusion:vortex-file-compressed	56571634 / 55049204 / +2.8%	92884235 / 86745599 / +7.1%	0.61 / 0.63 / -4.0%
clickbench_q36/datafusion:vortex-file-compressed	40091117 / 37711562 / +6.3%	69508652 / 66932735 / +3.8%	0.58 / 0.56 / +2.4%
clickbench_q37/datafusion:vortex-file-compressed	22194135 / 21731677 / +2.1%	47930120 / 48401271 / -1.0%	0.46 / 0.45 / +3.1%
clickbench_q38/datafusion:vortex-file-compressed	19079490 / 11407912 / +67.2% 🔴	47419769 / 39311619 / +20.6% 🔴	0.40 / 0.29 / +38.7%
clickbench_q39/datafusion:vortex-file-compressed	83424584 / 77620412 / +7.5%	116024815 / 111297142 / +4.2%	0.72 / 0.70 / +3.1%
clickbench_q40/datafusion:vortex-file-compressed	11681473 / 10944932 / +6.7%	36270471 / 38362115 / -5.5%	0.32 / 0.29 / +12.9%
clickbench_q41/datafusion:vortex-file-compressed	11401052 / 10874686 / +4.8%	35301001 / 37614694 / -6.2%	0.32 / 0.29 / +11.7%
clickbench_q42/datafusion:vortex-file-compressed	11044204 / 10933218 / +1.0%	35295305 / 37275684 / -5.3%	0.31 / 0.29 / +6.7%

datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1260312 / 1328523 / -5.1%	48809383 / 51059519 / -4.4%	0.03 / 0.03 / -0.8%
clickbench_q01/datafusion:parquet	16064549 / 15946638 / +0.7%	70447576 / 67133894 / +4.9%	0.23 / 0.24 / -4.0%
clickbench_q02/datafusion:parquet	18883700 / 18512216 / +2.0%	78886515 / 81419463 / -3.1%	0.24 / 0.23 / +5.3%
clickbench_q03/datafusion:parquet	16702536 / 17382100 / -3.9%	74967514 / 80184643 / -6.5%	0.22 / 0.22 / +2.8%
clickbench_q04/datafusion:parquet	63551264 / 64010338 / -0.7%	126269089 / 125126783 / +0.9%	0.50 / 0.51 / -1.6%
clickbench_q05/datafusion:parquet	88160981 / 87978920 / +0.2%	153548049 / 156610718 / -2.0%	0.57 / 0.56 / +2.2%
clickbench_q06/datafusion:parquet	1284170 / 1267490 / +1.3%	48486151 / 49553629 / -2.2%	0.03 / 0.03 / +3.5%
clickbench_q07/datafusion:parquet	16633999 / 16754462 / -0.7%	66693906 / 68074014 / -2.0%	0.25 / 0.25 / +1.3%
clickbench_q08/datafusion:parquet	84837746 / 85008314 / -0.2%	153612199 / 163636971 / -6.1%	0.55 / 0.52 / +6.3%
clickbench_q09/datafusion:parquet	187358050 / 189188646 / -1.0%	258459765 / 268806794 / -3.8%	0.72 / 0.70 / +3.0%
clickbench_q10/datafusion:parquet	36631903 / 35700365 / +2.6%	97329214 / 102163418 / -4.7%	0.38 / 0.35 / +7.7%
clickbench_q11/datafusion:parquet	42114256 / 42203857 / -0.2%	107760516 / 110711999 / -2.7%	0.39 / 0.38 / +2.5%
clickbench_q12/datafusion:parquet	95405694 / 94991858 / +0.4%	159447604 / 162137751 / -1.7%	0.60 / 0.59 / +2.1%
clickbench_q13/datafusion:parquet	148382510 / 147582450 / +0.5%	223745861 / 229782354 / -2.6%	0.66 / 0.64 / +3.3%
clickbench_q14/datafusion:parquet	102021948 / 100756697 / +1.3%	169561061 / 172552528 / -1.7%	0.60 / 0.58 / +3.0%
clickbench_q15/datafusion:parquet	74613108 / 71917008 / +3.7%	129343727 / 134563015 / -3.9%	0.58 / 0.53 / +7.9%
clickbench_q16/datafusion:parquet	156583464 / 156041006 / +0.3%	231300510 / 234344064 / -1.3%	0.68 / 0.67 / +1.7%
clickbench_q17/datafusion:parquet	155973202 / 154969828 / +0.6%	234484745 / 235178430 / -0.3%	0.67 / 0.66 / +0.9%
clickbench_q18/datafusion:parquet	309120535 / 309286158 / -0.1%	411344574 / 421779098 / -2.5%	0.75 / 0.73 / +2.5%
clickbench_q19/datafusion:parquet	18710936 / 18861830 / -0.8%	73253616 / 76898806 / -4.7%	0.26 / 0.25 / +4.1%
clickbench_q20/datafusion:parquet	177986532 / 178305263 / -0.2%	274964948 / 287794980 / -4.5%	0.65 / 0.62 / +4.5%
clickbench_q21/datafusion:parquet	171153488 / 174810739 / -2.1%	289078935 / 301156385 / -4.0%	0.59 / 0.58 / +2.0%
clickbench_q22/datafusion:parquet	257470158 / 261562452 / -1.6%	415313478 / 425338410 / -2.4%	0.62 / 0.61 / +0.8%
clickbench_q23/datafusion:parquet	1015865554 / 1012748236 / +0.3%	1186320062 / 1197005854 / -0.9%	0.86 / 0.85 / +1.2%
clickbench_q24/datafusion:parquet	30148450 / 30344264 / -0.6%	85669903 / 89440624 / -4.2%	0.35 / 0.34 / +3.7%
clickbench_q25/datafusion:parquet	36650348 / 37819492 / -3.1%	97629693 / 105090018 / -7.1%	0.38 / 0.36 / +4.3%
clickbench_q26/datafusion:parquet	30605341 / 30817071 / -0.7%	86776785 / 89083370 / -2.6%	0.35 / 0.35 / +2.0%
clickbench_q27/datafusion:parquet	192193839 / 194175218 / -1.0%	284754561 / 293521905 / -3.0%	0.67 / 0.66 / +2.0%
clickbench_q28/datafusion:parquet	616845658 / 618599561 / -0.3%	706726339 / 704106254 / +0.4%	0.87 / 0.88 / -0.7%
clickbench_q29/datafusion:parquet	29175174 / 29433332 / -0.9%	88629199 / 90364886 / -1.9%	0.33 / 0.33 / +1.1%
clickbench_q30/datafusion:parquet	89631658 / 89320896 / +0.3%	165525853 / 173996206 / -4.9%	0.54 / 0.51 / +5.5%
clickbench_q31/datafusion:parquet	101880035 / 102278070 / -0.4%	190478277 / 198654528 / -4.1%	0.53 / 0.51 / +3.9%
clickbench_q32/datafusion:parquet	308204196 / 308579350 / -0.1%	422317186 / 436366917 / -3.2%	0.73 / 0.71 / +3.2%
clickbench_q33/datafusion:parquet	376586431 / 376725840 / -0.0%	478344226 / 472442865 / +1.2%	0.79 / 0.80 / -1.3%
clickbench_q34/datafusion:parquet	376389082 / 377823472 / -0.4%	471115928 / 480448951 / -1.9%	0.80 / 0.79 / +1.6%
clickbench_q35/datafusion:parquet	65052238 / 65833078 / -1.2%	121342496 / 125040572 / -3.0%	0.54 / 0.53 / +1.8%
clickbench_q36/datafusion:parquet	73557155 / 73847162 / -0.4%	133679986 / 136224770 / -1.9%	0.55 / 0.54 / +1.5%
clickbench_q37/datafusion:parquet	35056178 / 35315510 / -0.7%	90441086 / 91963489 / -1.7%	0.39 / 0.38 / +0.9%
clickbench_q38/datafusion:parquet	47681224 / 47367153 / +0.7%	106254192 / 108233158 / -1.8%	0.45 / 0.44 / +2.5%
clickbench_q39/datafusion:parquet	143005558 / 142998998 / +0.0%	207092387 / 212605165 / -2.6%	0.69 / 0.67 / +2.7%
clickbench_q40/datafusion:parquet	20085311 / 19917884 / +0.8%	76388364 / 78195012 / -2.3%	0.26 / 0.25 / +3.2%
clickbench_q41/datafusion:parquet	18877218 / 18819222 / +0.3%	75517716 / 76527126 / -1.3%	0.25 / 0.25 / +1.6%
clickbench_q42/datafusion:parquet	19318886 / 19418624 / -0.5%	73691923 / 75644401 / -2.6%	0.26 / 0.26 / +2.1%

duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	2171054 / 2281094 / -4.8%	24217507 / 24801959 / -2.4%	0.09 / 0.09 / -2.5%
clickbench_q01/duckdb:vortex-file-compressed	6926233 / 7203615 / -3.9%	28464569 / 25723378 / +10.7% 🔴	0.24 / 0.28 / -13.1%
clickbench_q02/duckdb:vortex-file-compressed	7917420 / 8076126 / -2.0%	33664025 / 35601028 / -5.4%	0.24 / 0.23 / +3.7%
clickbench_q03/duckdb:vortex-file-compressed	14038493 / 14272888 / -1.6%	50828595 / 57708285 / -11.9% 🟢	0.28 / 0.25 / +11.7%
clickbench_q04/duckdb:vortex-file-compressed	56065474 / 57006182 / -1.7%	94246603 / 96631921 / -2.5%	0.59 / 0.59 / +0.8%
clickbench_q05/duckdb:vortex-file-compressed	63511225 / 63922245 / -0.6%	92382642 / 92618468 / -0.3%	0.69 / 0.69 / -0.4%
clickbench_q06/duckdb:vortex-file-compressed	2603199 / 2876218 / -9.5%	31900596 / 33437488 / -4.6%	0.08 / 0.09 / -5.1%
clickbench_q07/duckdb:vortex-file-compressed	8569059 / 8384461 / +2.2%	28820088 / 28833645 / -0.0%	0.30 / 0.29 / +2.2%
clickbench_q08/duckdb:vortex-file-compressed	67652764 / 67839722 / -0.3%	105066229 / 111802903 / -6.0%	0.64 / 0.61 / +6.1%
clickbench_q09/duckdb:vortex-file-compressed	87927752 / 90520441 / -2.9%	126909344 / 134371160 / -5.6%	0.69 / 0.67 / +2.8%
clickbench_q10/duckdb:vortex-file-compressed	26067582 / 26020867 / +0.2%	63539394 / 70351009 / -9.7%	0.41 / 0.37 / +10.9%
clickbench_q11/duckdb:vortex-file-compressed	28497808 / 28623598 / -0.4%	66720937 / 73950219 / -9.8%	0.43 / 0.39 / +10.3%
clickbench_q12/duckdb:vortex-file-compressed	70087948 / 70599652 / -0.7%	99029949 / 102256435 / -3.2%	0.71 / 0.69 / +2.5%
clickbench_q13/duckdb:vortex-file-compressed	121007036 / 124107988 / -2.5%	158800817 / 163386338 / -2.8%	0.76 / 0.76 / +0.3%
clickbench_q14/duckdb:vortex-file-compressed	74180836 / 74927146 / -1.0%	102329820 / 103501317 / -1.1%	0.72 / 0.72 / +0.1%
clickbench_q15/duckdb:vortex-file-compressed	75689065 / 74919959 / +1.0%	111460308 / 115772542 / -3.7%	0.68 / 0.65 / +4.9%
clickbench_q16/duckdb:vortex-file-compressed	134087951 / 136634964 / -1.9%	177052863 / 185834641 / -4.7%	0.76 / 0.74 / +3.0%
clickbench_q17/duckdb:vortex-file-compressed	138814708 / 141325059 / -1.8%	174812892 / 175336420 / -0.3%	0.79 / 0.81 / -1.5%
clickbench_q18/duckdb:vortex-file-compressed	256727726 / 257843995 / -0.4%	311789593 / 323091018 / -3.5%	0.82 / 0.80 / +3.2%
clickbench_q19/duckdb:vortex-file-compressed	9137550 / 9204404 / -0.7%	41767896 / 45384250 / -8.0%	0.22 / 0.20 / +7.9%
clickbench_q20/duckdb:vortex-file-compressed	65938748 / 63901341 / +3.2%	167091486 / 165238933 / +1.1%	0.39 / 0.39 / +2.0%
clickbench_q21/duckdb:vortex-file-compressed	97664700 / 96121052 / +1.6%	270865608 / 284019037 / -4.6%	0.36 / 0.34 / +6.5%
clickbench_q22/duckdb:vortex-file-compressed	170842136 / 175154205 / -2.5%	394577928 / 438006150 / -9.9%	0.43 / 0.40 / +8.3%
clickbench_q23/duckdb:vortex-file-compressed	34463503 / 34699314 / -0.7%	84302552 / 87708175 / -3.9%	0.41 / 0.40 / +3.3%
clickbench_q24/duckdb:vortex-file-compressed	13723720 / 14100690 / -2.7%	35742038 / 33542866 / +6.6%	0.38 / 0.42 / -8.7%
clickbench_q25/duckdb:vortex-file-compressed	18639851 / 18325700 / +1.7%	48312884 / 47469429 / +1.8%	0.39 / 0.39 / -0.1%
clickbench_q26/duckdb:vortex-file-compressed	11303477 / 11069426 / +2.1%	34581705 / 34483210 / +0.3%	0.33 / 0.32 / +1.8%
clickbench_q27/duckdb:vortex-file-compressed	53411786 / 53555214 / -0.3%	219012225 / 222185406 / -1.4%	0.24 / 0.24 / +1.2%
clickbench_q28/duckdb:vortex-file-compressed	509747334 / 508376522 / +0.3%	565419736 / 576518891 / -1.9%	0.90 / 0.88 / +2.2%
clickbench_q29/duckdb:vortex-file-compressed	17086302 / 17451039 / -2.1%	42763690 / 45412768 / -5.8%	0.40 / 0.38 / +4.0%
clickbench_q30/duckdb:vortex-file-compressed	59057697 / 58739169 / +0.5%	102615403 / 111271770 / -7.8%	0.58 / 0.53 / +9.0%
clickbench_q31/duckdb:vortex-file-compressed	109643896 / 99954524 / +9.7%	187490190 / 197318071 / -5.0%	0.58 / 0.51 / +15.4%
clickbench_q32/duckdb:vortex-file-compressed	384524102 / 381481519 / +0.8%	416978191 / 414133654 / +0.7%	0.92 / 0.92 / +0.1%
clickbench_q33/duckdb:vortex-file-compressed	343976318 / 345357520 / -0.4%	427841912 / 445842420 / -4.0%	0.80 / 0.77 / +3.8%
clickbench_q34/duckdb:vortex-file-compressed	360100592 / 356601237 / +1.0%	456275317 / 463158388 / -1.5%	0.79 / 0.77 / +2.5%
clickbench_q35/duckdb:vortex-file-compressed	57923323 / 56448913 / +2.6%	87434904 / 90696871 / -3.6%	0.66 / 0.62 / +6.4%
clickbench_q36/duckdb:vortex-file-compressed	11530258 / 11450122 / +0.7%	32326160 / 32326667 / -0.0%	0.36 / 0.35 / +0.7%
clickbench_q37/duckdb:vortex-file-compressed	8276194 / 7849573 / +5.4%	30819017 / 28440582 / +8.4%	0.27 / 0.28 / -2.7%
clickbench_q38/duckdb:vortex-file-compressed	8603090 / 8613249 / -0.1%	29387214 / 31760271 / -7.5%	0.29 / 0.27 / +7.9%
clickbench_q39/duckdb:vortex-file-compressed	19231036 / 19566106 / -1.7%	40950170 / 39312726 / +4.2%	0.47 / 0.50 / -5.6%
clickbench_q40/duckdb:vortex-file-compressed	6849364 / 7008066 / -2.3%	29639192 / 29455917 / +0.6%	0.23 / 0.24 / -2.9%
clickbench_q41/duckdb:vortex-file-compressed	7733480 / 7727614 / +0.1%	30189621 / 30640456 / -1.5%	0.26 / 0.25 / +1.6%
clickbench_q42/duckdb:vortex-file-compressed	7015866 / 7119382 / -1.5%	29297549 / 30447974 / -3.8%	0.24 / 0.23 / +2.4%

duckdb / parquet / ns (0.994x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	10469830 / 12066522 / -13.2% 🟢	18779258 / 18474842 / +1.6%	0.56 / 0.65 / -14.6%
clickbench_q01/duckdb:parquet	16720134 / 16502610 / +1.3%	24939703 / 24563405 / +1.5%	0.67 / 0.67 / -0.2%
clickbench_q02/duckdb:parquet	23667178 / 23926914 / -1.1%	35528246 / 34302978 / +3.6%	0.67 / 0.70 / -4.5%
clickbench_q03/duckdb:parquet	24841210 / 24649016 / +0.8%	38518281 / 38564219 / -0.1%	0.64 / 0.64 / +0.9%
clickbench_q04/duckdb:parquet	63279406 / 63372851 / -0.1%	78943691 / 78212876 / +0.9%	0.80 / 0.81 / -1.1%
clickbench_q05/duckdb:parquet	84911308 / 85258602 / -0.4%	99253516 / 104214414 / -4.8%	0.86 / 0.82 / +4.6%
clickbench_q06/duckdb:parquet	22509341 / 22563814 / -0.2%	34692707 / 32211249 / +7.7%	0.65 / 0.70 / -7.4%
clickbench_q07/duckdb:parquet	18623072 / 19674024 / -5.3%	26333031 / 27465541 / -4.1%	0.71 / 0.72 / -1.3%
clickbench_q08/duckdb:parquet	76312861 / 77759100 / -1.9%	95025845 / 91467423 / +3.9%	0.80 / 0.85 / -5.5%
clickbench_q09/duckdb:parquet	104230296 / 106806264 / -2.4%	121070105 / 123717694 / -2.1%	0.86 / 0.86 / -0.3%
clickbench_q10/duckdb:parquet	41562673 / 42134567 / -1.4%	57402534 / 59254222 / -3.1%	0.72 / 0.71 / +1.8%
clickbench_q11/duckdb:parquet	47471836 / 47516353 / -0.1%	64488743 / 64074075 / +0.6%	0.74 / 0.74 / -0.7%
clickbench_q12/duckdb:parquet	92755408 / 94918433 / -2.3%	110197381 / 112783657 / -2.3%	0.84 / 0.84 / +0.0%
clickbench_q13/duckdb:parquet	150200694 / 154141530 / -2.6%	174237315 / 178069810 / -2.2%	0.86 / 0.87 / -0.4%
clickbench_q14/duckdb:parquet	104626484 / 102830551 / +1.7%	124826887 / 120329224 / +3.7%	0.84 / 0.85 / -1.9%
clickbench_q15/duckdb:parquet	88583852 / 90371671 / -2.0%	106068205 / 103991591 / +2.0%	0.84 / 0.87 / -3.9%
clickbench_q16/duckdb:parquet	178154148 / 178739000 / -0.3%	183754998 / 185375702 / -0.9%	0.97 / 0.96 / +0.6%
clickbench_q17/duckdb:parquet	182739486 / 178412532 / +2.4%	195439676 / 189746552 / +3.0%	0.94 / 0.94 / -0.6%
clickbench_q18/duckdb:parquet	313332977 / 306325460 / +2.3%	333724696 / 334695742 / -0.3%	0.94 / 0.92 / +2.6%
clickbench_q19/duckdb:parquet	22100126 / 22779310 / -3.0%	31523104 / 30410233 / +3.7%	0.70 / 0.75 / -6.4%
clickbench_q20/duckdb:parquet	187217044 / 179489644 / +4.3%	227019485 / 235731267 / -3.7%	0.82 / 0.76 / +8.3%
clickbench_q21/duckdb:parquet	229364632 / 224865343 / +2.0%	276503016 / 271098364 / +2.0%	0.83 / 0.83 / +0.0%
clickbench_q22/duckdb:parquet	317755190 / 309185320 / +2.8%	354841414 / 362166086 / -2.0%	0.90 / 0.85 / +4.9%
clickbench_q23/duckdb:parquet	174858645 / 167464942 / +4.4%	236125432 / 249379284 / -5.3%	0.74 / 0.67 / +10.3%
clickbench_q24/duckdb:parquet	31820558 / 32101646 / -0.9%	45301356 / 46161867 / -1.9%	0.70 / 0.70 / +1.0%
clickbench_q25/duckdb:parquet	43733314 / 43615180 / +0.3%	60222960 / 60907941 / -1.1%	0.73 / 0.72 / +1.4%
clickbench_q26/duckdb:parquet	33218631 / 32925656 / +0.9%	48452736 / 51407314 / -5.7%	0.69 / 0.64 / +7.0%
clickbench_q27/duckdb:parquet	193164241 / 196080596 / -1.5%	232698804 / 234582029 / -0.8%	0.83 / 0.84 / -0.7%
clickbench_q28/duckdb:parquet	976735217 / 998686802 / -2.2%	968669274 / 973142555 / -0.5%	1.01 / 1.03 / -1.7%
clickbench_q29/duckdb:parquet	25912577 / 26419016 / -1.9%	36014635 / 36522258 / -1.4%	0.72 / 0.72 / -0.5%
clickbench_q30/duckdb:parquet	107125336 / 107890509 / -0.7%	134923173 / 142441591 / -5.3%	0.79 / 0.76 / +4.8%
clickbench_q31/duckdb:parquet	159964202 / 150179232 / +6.5%	181345624 / 182303333 / -0.5%	0.88 / 0.82 / +7.1%
clickbench_q32/duckdb:parquet	401163328 / 407309702 / -1.5%	428350614 / 428746308 / -0.1%	0.94 / 0.95 / -1.4%
clickbench_q33/duckdb:parquet	476372357 / 495580228 / -3.9%	476982244 / 455014974 / +4.8%	1.00 / 1.09 / -8.3%
clickbench_q34/duckdb:parquet	476709604 / 482506773 / -1.2%	478480170 / 474718470 / +0.8%	1.00 / 1.02 / -2.0%
clickbench_q35/duckdb:parquet	63072925 / 63769546 / -1.1%	76382297 / 74666123 / +2.3%	0.83 / 0.85 / -3.3%
clickbench_q36/duckdb:parquet	32325724 / 31665786 / +2.1%	41508517 / 40070347 / +3.6%	0.78 / 0.79 / -1.5%
clickbench_q37/duckdb:parquet	24747472 / 25398499 / -2.6%	34810641 / 34869061 / -0.2%	0.71 / 0.73 / -2.4%
clickbench_q38/duckdb:parquet	25784798 / 26664508 / -3.3%	34678892 / 34835900 / -0.5%	0.74 / 0.77 / -2.9%
clickbench_q39/duckdb:parquet	54773050 / 53753457 / +1.9%	63943082 / 64881013 / -1.4%	0.86 / 0.83 / +3.4%
clickbench_q40/duckdb:parquet	16093224 / 15754516 / +2.1%	24705448 / 24449689 / +1.0%	0.65 / 0.64 / +1.1%
clickbench_q41/duckdb:parquet	16451500 / 16182554 / +1.7%	25580577 / 24272254 / +5.4%	0.64 / 0.67 / -3.5%
clickbench_q42/duckdb:parquet	15858424 / 16705278 / -5.1%	25335733 / 27239945 / -7.0%	0.63 / 0.61 / +2.1%

No file size changes detected.

github-actions · 2026-10-26T14:19:47Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 65bf7e98 vs base 92bee27d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.7%
Engines: DataFusion No clear signal (+15.0%, environment too noisy confidence) · DuckDB No clear signal (+6.5%, environment too noisy confidence)
Vortex (geomean): hot 1.124x ➖ · cold 1.071x ➖
Parquet (geomean): hot 1.015x ➖ · cold 1.065x ➖
Shifts: Parquet (control) +1.5% · Median polish +7.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.123x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	238812883 / 249340726 / -4.2%	922732447 / 691748640 / +33.4% 🔴	0.26 / 0.36 / -28.2%
tpch_q02/datafusion:vortex-file-compressed	520217536 / 326735442 / +59.2% 🔴	694222020 / 581898731 / +19.3%	0.75 / 0.56 / +33.5%
tpch_q03/datafusion:vortex-file-compressed	377544831 / 353849072 / +6.7%	857960629 / 957125182 / -10.4%	0.44 / 0.37 / +19.0%
tpch_q04/datafusion:vortex-file-compressed	195295549 / 191112934 / +2.2%	434490634 / 379833902 / +14.4%	0.45 / 0.50 / -10.7%
tpch_q05/datafusion:vortex-file-compressed	395270853 / 394792850 / +0.1%	720904257 / 674422022 / +6.9%	0.55 / 0.59 / -6.3%
tpch_q06/datafusion:vortex-file-compressed	162836201 / 135141027 / +20.5%	327080886 / 280817056 / +16.5%	0.50 / 0.48 / +3.5%
tpch_q07/datafusion:vortex-file-compressed	442782591 / 410024029 / +8.0%	651415029 / 544579520 / +19.6%	0.68 / 0.75 / -9.7%
tpch_q08/datafusion:vortex-file-compressed	457122583 / 419838900 / +8.9%	815136274 / 603552300 / +35.1% 🔴	0.56 / 0.70 / -19.4%
tpch_q09/datafusion:vortex-file-compressed	332294533 / 258968809 / +28.3%	470060031 / 527883399 / -11.0%	0.71 / 0.49 / +44.1%
tpch_q10/datafusion:vortex-file-compressed	354866546 / 350745860 / +1.2%	554935496 / 563128727 / -1.5%	0.64 / 0.62 / +2.7%
tpch_q11/datafusion:vortex-file-compressed	291959178 / 253382628 / +15.2%	407356333 / 405212390 / +0.5%	0.72 / 0.63 / +14.6%
tpch_q12/datafusion:vortex-file-compressed	225329086 / 199829820 / +12.8%	479085367 / 377578367 / +26.9%	0.47 / 0.53 / -11.1%
tpch_q13/datafusion:vortex-file-compressed	216236458 / 123762223 / +74.7% 🔴	360486539 / 317808768 / +13.4%	0.60 / 0.39 / +54.0%
tpch_q14/datafusion:vortex-file-compressed	202789464 / 173372313 / +17.0%	320067686 / 302958679 / +5.6%	0.63 / 0.57 / +10.7%
tpch_q15/datafusion:vortex-file-compressed	306817543 / 324191385 / -5.4%	468322123 / 575883041 / -18.7%	0.66 / 0.56 / +16.4%
tpch_q16/datafusion:vortex-file-compressed	152630516 / 141433357 / +7.9%	300422210 / 276839248 / +8.5%	0.51 / 0.51 / -0.6%
tpch_q17/datafusion:vortex-file-compressed	250531285 / 345024862 / -27.4%	445094938 / 565890777 / -21.3%	0.56 / 0.61 / -7.7%
tpch_q18/datafusion:vortex-file-compressed	640538462 / 254912657 / +151.3% 🔴	600006426 / 529025241 / +13.4%	1.07 / 0.48 / +121.6%
tpch_q19/datafusion:vortex-file-compressed	229123780 / 229960470 / -0.4%	423939115 / 413460126 / +2.5%	0.54 / 0.56 / -2.8%
tpch_q20/datafusion:vortex-file-compressed	289933646 / 302608991 / -4.2%	439555743 / 447419393 / -1.8%	0.66 / 0.68 / -2.5%
tpch_q21/datafusion:vortex-file-compressed	530998256 / 454104703 / +16.9%	814572686 / 631752754 / +28.9%	0.65 / 0.72 / -9.3%
tpch_q22/datafusion:vortex-file-compressed	151097823 / 198824498 / -24.0%	361077935 / 470244230 / -23.2%	0.42 / 0.42 / -1.0%

datafusion / parquet / ns (0.977x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	148383203 / 146935642 / +1.0%	547363944 / 415930655 / +31.6% 🔴	0.27 / 0.35 / -23.3%
tpch_q02/datafusion:parquet	291362869 / 277781165 / +4.9%	542473993 / 532621464 / +1.8%	0.54 / 0.52 / +3.0%
tpch_q03/datafusion:parquet	251426067 / 228043966 / +10.3%	687235168 / 609944433 / +12.7%	0.37 / 0.37 / -2.1%
tpch_q04/datafusion:parquet	137426727 / 127539255 / +7.8%	291048696 / 329116247 / -11.6%	0.47 / 0.39 / +21.8%
tpch_q05/datafusion:parquet	378395437 / 358899858 / +5.4%	487110710 / 476224287 / +2.3%	0.78 / 0.75 / +3.1%
tpch_q06/datafusion:parquet	109559297 / 111357439 / -1.6%	259270393 / 248020115 / +4.5%	0.42 / 0.45 / -5.9%
tpch_q07/datafusion:parquet	354641576 / 358814058 / -1.2%	485269724 / 490109386 / -1.0%	0.73 / 0.73 / -0.2%
tpch_q08/datafusion:parquet	444916743 / 398242750 / +11.7%	548976747 / 512063492 / +7.2%	0.81 / 0.78 / +4.2%
tpch_q09/datafusion:parquet	407538826 / 383529801 / +6.3%	463651892 / 526847165 / -12.0%	0.88 / 0.73 / +20.7%
tpch_q10/datafusion:parquet	304357155 / 306023205 / -0.5%	479246116 / 430048039 / +11.4%	0.64 / 0.71 / -10.8%
tpch_q11/datafusion:parquet	249915128 / 258875421 / -3.5%	363745974 / 346521641 / +5.0%	0.69 / 0.75 / -8.0%
tpch_q12/datafusion:parquet	170898522 / 156764494 / +9.0%	351624580 / 330489222 / +6.4%	0.49 / 0.47 / +2.5%
tpch_q13/datafusion:parquet	282006111 / 276617850 / +1.9%	367066318 / 401947384 / -8.7%	0.77 / 0.69 / +11.6%
tpch_q14/datafusion:parquet	152273562 / 166571684 / -8.6%	308821225 / 267146928 / +15.6%	0.49 / 0.62 / -20.9%
tpch_q15/datafusion:parquet	312801198 / 300504286 / +4.1%	465447557 / 453462716 / +2.6%	0.67 / 0.66 / +1.4%
tpch_q16/datafusion:parquet	103531917 / 106543201 / -2.8%	203463283 / 194659454 / +4.5%	0.51 / 0.55 / -7.0%
tpch_q17/datafusion:parquet	305184098 / 274307466 / +11.3%	487910937 / 471952217 / +3.4%	0.63 / 0.58 / +7.6%
tpch_q18/datafusion:parquet	342089015 / 319773776 / +7.0%	478920495 / 470632831 / +1.8%	0.71 / 0.68 / +5.1%
tpch_q19/datafusion:parquet	171847804 / 152498263 / +12.7%	353854067 / 276005497 / +28.2%	0.49 / 0.55 / -12.1%
tpch_q20/datafusion:parquet	237208314 / 988164577 / -76.0% 🟢	411117679 / 1102472720 / -62.7% 🟢	0.58 / 0.90 / -35.6%
tpch_q21/datafusion:parquet	322095307 / 299060066 / +7.7%	472652038 / 437082511 / +8.1%	0.68 / 0.68 / -0.4%
tpch_q22/datafusion:parquet	174260863 / 153098924 / +13.8%	355466319 / 313135946 / +13.5%	0.49 / 0.49 / +0.3%

duckdb / vortex-file-compressed / ns (1.124x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	299676921 / 238450159 / +25.7%	261609444 / 254579015 / +2.8%	1.15 / 0.94 / +22.3%
tpch_q02/duckdb:vortex-file-compressed	462778058 / 402143668 / +15.1%	520109207 / 474518250 / +9.6%	0.89 / 0.85 / +5.0%
tpch_q03/duckdb:vortex-file-compressed	403416934 / 408901330 / -1.3%	532631582 / 481079692 / +10.7%	0.76 / 0.85 / -10.9%
tpch_q04/duckdb:vortex-file-compressed	242476480 / 239163288 / +1.4%	298767049 / 538500648 / -44.5% 🟢	0.81 / 0.44 / +82.7%
tpch_q05/duckdb:vortex-file-compressed	582671125 / 584155004 / -0.3%	738092377 / 590734026 / +24.9%	0.79 / 0.99 / -20.2%
tpch_q06/duckdb:vortex-file-compressed	199935003 / 156460780 / +27.8%	212535950 / 175341440 / +21.2%	0.94 / 0.89 / +5.4%
tpch_q07/duckdb:vortex-file-compressed	392898339 / 428612362 / -8.3%	518363612 / 496966362 / +4.3%	0.76 / 0.86 / -12.1%
tpch_q08/duckdb:vortex-file-compressed	709542420 / 560875664 / +26.5%	678451932 / 654646983 / +3.6%	1.05 / 0.86 / +22.1%
tpch_q09/duckdb:vortex-file-compressed	413366011 / 389386766 / +6.2%	447490593 / 467777161 / -4.3%	0.92 / 0.83 / +11.0%
tpch_q10/duckdb:vortex-file-compressed	497197053 / 508914634 / -2.3%	528448383 / 564865368 / -6.4%	0.94 / 0.90 / +4.4%
tpch_q11/duckdb:vortex-file-compressed	325810599 / 326333326 / -0.2%	332297265 / 330487200 / +0.5%	0.98 / 0.99 / -0.7%
tpch_q12/duckdb:vortex-file-compressed	276502154 / 216561819 / +27.7%	309004914 / 241057681 / +28.2%	0.89 / 0.90 / -0.4%
tpch_q13/duckdb:vortex-file-compressed	271208332 / 268094714 / +1.2%	236339622 / 192274268 / +22.9%	1.15 / 1.39 / -17.7%
tpch_q14/duckdb:vortex-file-compressed	231900450 / 222879747 / +4.0%	291370394 / 239914897 / +21.4%	0.80 / 0.93 / -14.3%
tpch_q15/duckdb:vortex-file-compressed	256421933 / 229795479 / +11.6%	270037253 / 262138528 / +3.0%	0.95 / 0.88 / +8.3%
tpch_q16/duckdb:vortex-file-compressed	204734259 / 193631890 / +5.7%	261882096 / 282040728 / -7.1%	0.78 / 0.69 / +13.9%
tpch_q17/duckdb:vortex-file-compressed	423650241 / 299096239 / +41.6% 🔴	580137227 / 399436201 / +45.2% 🔴	0.73 / 0.75 / -2.5%
tpch_q18/duckdb:vortex-file-compressed	379037932 / 340492034 / +11.3%	594764417 / 384412151 / +54.7% 🔴	0.64 / 0.89 / -28.1%
tpch_q19/duckdb:vortex-file-compressed	336803136 / 266212209 / +26.5%	301765606 / 361011095 / -16.4%	1.12 / 0.74 / +51.4%
tpch_q20/duckdb:vortex-file-compressed	395165998 / 381516058 / +3.6%	479199782 / 414242037 / +15.7%	0.82 / 0.92 / -10.5%
tpch_q21/duckdb:vortex-file-compressed	793767340 / 623742293 / +27.3%	737164521 / 697456491 / +5.7%	1.08 / 0.89 / +20.4%
tpch_q22/duckdb:vortex-file-compressed	329424438 / 231853529 / +42.1% 🔴	457873162 / 331886224 / +38.0% 🔴	0.72 / 0.70 / +3.0%

duckdb / parquet / ns (1.055x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	167624777 / 188016182 / -10.8%	274366217 / 243553613 / +12.7%	0.61 / 0.77 / -20.9%
tpch_q02/duckdb:parquet	446412780 / 459733941 / -2.9%	470186868 / 497554104 / -5.5%	0.95 / 0.92 / +2.8%
tpch_q03/duckdb:parquet	380578152 / 347994528 / +9.4%	484561580 / 422611347 / +14.7%	0.79 / 0.82 / -4.6%
tpch_q04/duckdb:parquet	250256531 / 264738198 / -5.5%	549363800 / 306032461 / +79.5% 🔴	0.46 / 0.87 / -47.3%
tpch_q05/duckdb:parquet	628463419 / 504593348 / +24.5%	656986103 / 577692551 / +13.7%	0.96 / 0.87 / +9.5%
tpch_q06/duckdb:parquet	174668222 / 171851977 / +1.6%	242941322 / 264454959 / -8.1%	0.72 / 0.65 / +10.6%
tpch_q07/duckdb:parquet	463447657 / 420237735 / +10.3%	1013333570 / 535636918 / +89.2% 🔴	0.46 / 0.78 / -41.7%
tpch_q08/duckdb:parquet	676756722 / 594872881 / +13.8%	727837274 / 626542510 / +16.2%	0.93 / 0.95 / -2.1%
tpch_q09/duckdb:parquet	544675686 / 625944803 / -13.0%	603236858 / 624290025 / -3.4%	0.90 / 1.00 / -9.9%
tpch_q10/duckdb:parquet	603200379 / 564506808 / +6.9%	683720507 / 612530721 / +11.6%	0.88 / 0.92 / -4.3%
tpch_q11/duckdb:parquet	287261487 / 292462104 / -1.8%	314883751 / 322367784 / -2.3%	0.91 / 0.91 / +0.6%
tpch_q12/duckdb:parquet	270152812 / 261694205 / +3.2%	285741602 / 286312444 / -0.2%	0.95 / 0.91 / +3.4%
tpch_q13/duckdb:parquet	433197552 / 354567642 / +22.2%	511486976 / 441007370 / +16.0%	0.85 / 0.80 / +5.3%
tpch_q14/duckdb:parquet	272378890 / 252698769 / +7.8%	304826631 / 290942978 / +4.8%	0.89 / 0.87 / +2.9%
tpch_q15/duckdb:parquet	237365898 / 225253795 / +5.4%	283304580 / 268159209 / +5.6%	0.84 / 0.84 / -0.3%
tpch_q16/duckdb:parquet	298579349 / 272297242 / +9.7%	336978424 / 289212157 / +16.5%	0.89 / 0.94 / -5.9%
tpch_q17/duckdb:parquet	259570953 / 277734261 / -6.5%	344930917 / 305571576 / +12.9%	0.75 / 0.91 / -17.2%
tpch_q18/duckdb:parquet	391612585 / 351015542 / +11.6%	418910459 / 379519987 / +10.4%	0.93 / 0.92 / +1.1%
tpch_q19/duckdb:parquet	291828781 / 278868564 / +4.6%	347595425 / 312942367 / +11.1%	0.84 / 0.89 / -5.8%
tpch_q20/duckdb:parquet	605100604 / 496308625 / +21.9%	501644659 / 545776535 / -8.1%	1.21 / 0.91 / +32.6%
tpch_q21/duckdb:parquet	519690467 / 476140460 / +9.1%	654544497 / 515466015 / +27.0%	0.79 / 0.92 / -14.0%
tpch_q22/duckdb:parquet	325095821 / 295179811 / +10.1%	352839355 / 329261795 / +7.2%	0.92 / 0.90 / +2.8%

joseph-isaacs · 2026-10-26T23:04:48Z

CodSpeed flags test_repeated_scan_scalar_at[int_str] as 15% slower on bef7c23 (394.6 µs to 466 µs). This PR doesn't touch that path:

to_repeated_scan().scalar_at() runs RepeatedScan, the V1 layout-reader scan. It doesn't filter or export Arrow.
The only change since the last run (06c0701, which didn't flag this benchmark) is filtered-chunk sizing in the V2 scan builder and the DataFusion opener.
This benchmark family moves around from run to run: on 02d9b08, test_repeated_scan_scalar_at[int] was flagged 17.5% faster. CodSpeed's own report also warns that base and head ran on different runner types.

So I'm treating it as noise, not a regression. Every other CodSpeed change in this run is faster.

Generated by Claude Code

joseph-isaacs · 2026-10-26T23:58:46Z

On eedd5bf, CodSpeed reports two regressions: chunked_dict_primitive_canonical_into[f64, (1000, 1000, 10)] at -27% and test_scan_scalar_at[int]. This commit doesn't run code behind either one. Its only change since bef7c23 is how the V2 ScanCache in vortex-layout/src/scan/v2/cache.rs keys filter and projection plans.

The first is a vortex-array chunked-dictionary builder bench, which never touches the scan cache.
The second, test_scan_scalar_at, measures the Python bindings' scan, which doesn't go through the V2 ScanCache.

CodSpeed also notes that base and head ran on different runner types for the changed benchmarks. I'm treating both as runner noise.

Generated by Claude Code

joseph-isaacs · 2026-10-27T01:27:00Z

I don't think the three CodSpeed regressions on 9847c99 come from this commit, which only changes Patches::filter. None of the three benchmarks filters patches:

chunked_dict_primitive_canonical_into[f64, (1000, 1000, 10)] (27% slower): CodSpeed showed this same change on eedd5bf, and it went away on eb87fcd, which did not touch vortex-array.
test_repeated_scan_scalar_at[int_float] (11% slower): this runs the V1 repeated-scan point lookup from Python.
or_true_constant (10% slower): this is a boolean or against a constant.

CodSpeed also notes again that base and head ran on different runner types. The new filter_patched cases, which measure the changed code, are in the bitpacking filter bench.

Generated by Claude Code

joseph-isaacs · 2026-10-27T10:59:42Z

On d365fc8, CodSpeed's two regressions are starts_with_avx2[8, VarBin] (14% slower) and starts_with_avx2[64, VarBin] (10% slower). No commit on this branch changes the UTF-8 row functions they measure. Both were measured with the Walltime instrument outside CodSpeed's Macro Runners, which CodSpeed itself warns may be unreliable.

Generated by Claude Code

A V2 scan reads each chunk through a session of its own, and the file's segment source shares a read only while it is in flight. A stored segment that spans a chunk boundary was therefore read again by every chunk that started after its neighbour had finished, and by every partition and every concurrent scan of the file. TPC-DS q28 on SF1 read 188 MB where V1 reads 114 MB, every segment V1 reads up to two and a half times as often. The file's ScanCache now retains up to 64 MiB of recently read host segments in least-recently-used order, and every scan of the file reads through it. ScanCache::with_retained_bytes sets the budget; zero disables it. q28 now reads 125 MB. TPC-DS SF1 on DataFusion, V2 vs V1 geomean: 1.052 -> 1.002. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC Signed-off-by: Claude <noreply@anthropic.com>

TPC-H already defaults to the planner-driven V2 scan. Extend the default to TPC-DS and ClickBench so the SQL benchmarks measure V2 on them too. `--scan-v2 false` or `VORTEX_SCAN_V2=0` still selects V1. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC Signed-off-by: Claude <noreply@anthropic.com>

The V2 scan cache keyed filter and projection plans by `ExactBoundExpr`, which compares children by pointer. DataFusion opens each partition of a file separately and binds its predicate and projection anew, so no partition ever found the plans another had built: every partition lowered its own filter plans, optimized its own projection and re-evaluated the zone maps. The cost scales with the partition count, so TPC-DS q09 and q28 ran twice as long as V1 on the 32-core benchmark runners. Key the cache by structure instead. Hashing walks the scalar functions and skips dtypes, so a lookup does not walk a wide schema; equality still compares dtypes. Both walk the tree iteratively. Locally (4 cores, 32 partitions), q09/q13/q28/q44/q48 go from a 1.41x geomean of V1 to 1.15x, and q28 from 1.57x to 1.15x. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC Signed-off-by: Claude <noreply@anthropic.com>

A V2 scan cuts its rows on a fixed grid in the file's row domain, but DataFusion's partition edges fall off that grid. Every partition of a filtered scan then planned a sliver at its edge: TPC-DS q28 at 32 partitions cut each 90,112-row partition into chunks of 81,920 and 8,192 rows. The sliver costs a whole chunk's pipeline compile and conjunct setup, which dominates a selective filter over few rows. The chunk planner now joins an edge chunk under half a chunk to its neighbour; interior boundaries stay on the grid. Locally at 32 partitions, q28's V2 CPU time falls from 1.32x V1 to 1.10x and its wall time matches V1. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC Signed-off-by: Claude <noreply@anthropic.com>

joseph-isaacs · 2026-10-27T11:56:43Z

On 65bf7e9, CodSpeed's one regression is missing_stats[16] in vortex-layout/benches/zone_map_prune.rs (70.8 µs to 85 µs). That benchmark calls ZoneMap pruning directly. This branch's four commits change only the V2 scan cache, retained segments, chunk planning and the datafusion-bench default, and none of that code is on the ZoneMap pruning path.

Generated by Claude Code

joseph-isaacs changed the base branch from ji/jolly-shannon-f0erx1 to develop October 26, 2026 14:06

joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 26, 2026 — with Claude

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026

joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 4960855 to 02d9b08 Compare October 26, 2026 14:46

joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026 — with Claude

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026

joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 02d9b08 to ba0fb42 Compare October 26, 2026 16:30

joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026 — with Claude

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026

joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from ba0fb42 to 78afd60 Compare October 26, 2026 17:28

joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026 — with Claude

joseph-isaacs mentioned this pull request Oct 26, 2026

Reduce V2 scan filtering, planning, and repeated DataFusion file reads #10844

Draft

joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 78afd60 to 06c0701 Compare October 26, 2026 21:51

joseph-isaacs added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR and removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 26, 2026 — with Claude

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026

joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 06c0701 to bef7c23 Compare October 26, 2026 22:59

joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026 — with Claude

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026

joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026 — with Claude

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026

joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026 — with Claude

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026

joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026 — with Claude

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026

joseph-isaacs mentioned this pull request Oct 27, 2026

Reuse deserialized segments across partial V2 scans #10849

Draft

joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 9847c99 to d365fc8 Compare October 27, 2026 10:51

claude added 4 commits October 27, 2026 11:49

joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from d365fc8 to 65bf7e9 Compare October 27, 2026 11:50

joseph-isaacs changed the title ~~Default datafusion-bench to the V2 scan for TPC-DS and ClickBench~~ Speed up V2 scans and default datafusion-bench to V2 for TPC-DS and ClickBench Oct 27, 2026

joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026

Conversation

joseph-isaacs commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Uh oh!

codspeed Bot commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will degrade performance by 16.7%

Performance Changes

Footnotes

Uh oh!

github-actions Bot commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Oct 26, 2026

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

joseph-isaacs commented Oct 26, 2026

Uh oh!

joseph-isaacs commented Oct 26, 2026

Uh oh!

joseph-isaacs commented Oct 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

joseph-isaacs commented Oct 27, 2026

Uh oh!

joseph-isaacs commented Oct 27, 2026

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

joseph-isaacs commented Oct 26, 2026 •

edited

Loading

codspeed Bot commented Oct 26, 2026 •

edited

Loading

github-actions Bot commented Oct 26, 2026 •

edited

Loading

github-actions Bot commented Oct 26, 2026 •

edited

Loading

github-actions Bot commented Oct 26, 2026 •

edited

Loading

github-actions Bot commented Oct 26, 2026 •

edited

Loading

github-actions Bot commented Oct 26, 2026 •

edited

Loading

github-actions Bot commented Oct 26, 2026 •

edited

Loading

github-actions Bot commented Oct 26, 2026 •

edited

Loading

github-actions Bot commented Oct 26, 2026 •

edited

Loading

joseph-isaacs commented Oct 27, 2026 •

edited

Loading