Skip to content

Experiment: optimize compressor selection for scan time (revival)#8794

Draft
connortsui20 wants to merge 1 commit into
ct/compressor-cost-modelfrom
ct/cost-model-scan-opt
Draft

Experiment: optimize compressor selection for scan time (revival)#8794
connortsui20 wants to merge 1 commit into
ct/compressor-cost-modelfrom
ct/cost-model-scan-opt

feat: add scan-oriented compressor cost model

4e73ee6
Select commit
Loading
Failed to load commit list.
CodSpeed HQ / CodSpeed Performance Analysis succeeded Jul 16, 2026 in 0s

Performance Gate Passed

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 6 improved benchmarks
✅ 1691 untouched benchmarks
🆕 26 new benchmarks
⏩ 10 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime cuda/bitpacked_u8/unpack/3bw[100M] 646.3 µs 299.7 µs ×2.2
WallTime cuda/bitpacked_patched_u8/unpack/1%[100M] 768.9 µs 381.3 µs ×2
WallTime cuda/bitpacked_patched_u8/unpack/10%[100M] 828.6 µs 481.3 µs +72.16%
WallTime cuda/bitpacked_patched_u16/unpack/1%[100M] 712.3 µs 595.6 µs +19.6%
WallTime cuda/bitpacked_patched_u16/unpack/10%[100M] 831 µs 716.4 µs +15.99%
WallTime cuda/bitpacked_u16/unpack/5bw[100M] 634.8 µs 558 µs +13.75%
🆕 WallTime cuda/fsst/decompress_to_varbin[10M] N/A 19.3 ms N/A
🆕 WallTime cuda/fsst/decompress_to_varbinview[10M] N/A 20.1 ms N/A
🆕 WallTime cuda/fsst/export_binary_view[10M] N/A 20.1 ms N/A
🆕 WallTime cuda/fsst/export_binary[10M] N/A 19.3 ms N/A
🆕 WallTime cuda/fsst/export_utf8_view[10M] N/A 20.1 ms N/A
🆕 Simulation bitpacked_decode N/A 2.6 ms N/A
🆕 Simulation bitpacked_eq_fill N/A 2.4 ms N/A
🆕 Simulation bitpacked_filter_10pct N/A 3.7 ms N/A
🆕 Simulation dict_decode N/A 39.3 ms N/A
🆕 Simulation dict_eq N/A 4.5 ms N/A
🆕 Simulation dict_like N/A 62.3 ms N/A
🆕 Simulation fsst_decode N/A 28.2 ms N/A
🆕 Simulation fsst_eq N/A 4.3 ms N/A
🆕 Simulation fsst_like N/A 16.4 ms N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ct/cost-model-scan-opt (4e73ee6) with ct/compressor-cost-model (43f6c42)

Open in CodSpeed

Footnotes

  1. 10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.