Experiment: optimize compressor selection for scan time (revival)#8794
Experiment: optimize compressor selection for scan time (revival)#8794connortsui20 wants to merge 1 commit into
Performance Gate Passed
⚠️ Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.
For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.
⚡ 6 improved benchmarks
✅ 1691 untouched benchmarks
🆕 26 new benchmarks
⏩ 10 skipped benchmarks1
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ⚡ | WallTime | cuda/bitpacked_u8/unpack/3bw[100M] |
646.3 µs | 299.7 µs | ×2.2 |
| ⚡ | WallTime | cuda/bitpacked_patched_u8/unpack/1%[100M] |
768.9 µs | 381.3 µs | ×2 |
| ⚡ | WallTime | cuda/bitpacked_patched_u8/unpack/10%[100M] |
828.6 µs | 481.3 µs | +72.16% |
| ⚡ | WallTime | cuda/bitpacked_patched_u16/unpack/1%[100M] |
712.3 µs | 595.6 µs | +19.6% |
| ⚡ | WallTime | cuda/bitpacked_patched_u16/unpack/10%[100M] |
831 µs | 716.4 µs | +15.99% |
| ⚡ | WallTime | cuda/bitpacked_u16/unpack/5bw[100M] |
634.8 µs | 558 µs | +13.75% |
| 🆕 | WallTime | cuda/fsst/decompress_to_varbin[10M] |
N/A | 19.3 ms | N/A |
| 🆕 | WallTime | cuda/fsst/decompress_to_varbinview[10M] |
N/A | 20.1 ms | N/A |
| 🆕 | WallTime | cuda/fsst/export_binary_view[10M] |
N/A | 20.1 ms | N/A |
| 🆕 | WallTime | cuda/fsst/export_binary[10M] |
N/A | 19.3 ms | N/A |
| 🆕 | WallTime | cuda/fsst/export_utf8_view[10M] |
N/A | 20.1 ms | N/A |
| 🆕 | Simulation | bitpacked_decode |
N/A | 2.6 ms | N/A |
| 🆕 | Simulation | bitpacked_eq_fill |
N/A | 2.4 ms | N/A |
| 🆕 | Simulation | bitpacked_filter_10pct |
N/A | 3.7 ms | N/A |
| 🆕 | Simulation | dict_decode |
N/A | 39.3 ms | N/A |
| 🆕 | Simulation | dict_eq |
N/A | 4.5 ms | N/A |
| 🆕 | Simulation | dict_like |
N/A | 62.3 ms | N/A |
| 🆕 | Simulation | fsst_decode |
N/A | 28.2 ms | N/A |
| 🆕 | Simulation | fsst_eq |
N/A | 4.3 ms | N/A |
| 🆕 | Simulation | fsst_like |
N/A | 16.4 ms | N/A |
| ... | ... | ... | ... | ... | ... |
ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.
Tip
Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.
Comparing ct/cost-model-scan-opt (4e73ee6) with ct/compressor-cost-model (43f6c42)
Footnotes
-
10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩