Repository navigation

DuckDB V2 scan: cut chunks on file boundaries, default it for TPC-DS and ClickBench - #10833

Closed

joseph-isaacs wants to merge 27 commits into

developfrom

ji/loving-edison-936mz7

Closed

DuckDB V2 scan: cut chunks on file boundaries, default it for TPC-DS and ClickBench#10833
joseph-isaacs wants to merge 27 commits into
developfrom
ji/loving-edison-936mz7

Commits on Oct 26, 2026
- Expose a V2 scan's planners and prepared plans; drive them elsewhere
  
  joseph-isaacs
  and
  claude
  committed
  fae2626
- Compose and drive a V2 scan in DataFusion
  
  joseph-isaacs
  and
  claude
  committed
  92f3f4d
- Drive a V2 scan of a file for callers without an engine
  
  joseph-isaacs
  and
  claude
  committed
  c7d3c3f
- Compose a V2 scan's planners in the DataFusion opener
  
  joseph-isaacs
  and
  claude
  committed
  95424b8
- Drop is_proved: a proved proof lists no segment
  
  joseph-isaacs
  and
  claude
  committed
  04de767
- Call the zone-map plans pruning plans, not proofs
  
  joseph-isaacs
  and
  claude
  committed
  429e005
- Add a planner-driven V2 scan path to the DuckDB extension
  claude
  committed
  1db58aa
- End DuckDB V2 splits on layout chunk boundaries
  claude
  committed
  fd7a173
- Merge #10708 (Compose and drive a V2 scan in DataFusion) into the DuckDB V2 branch
  claude
  committed
  8cae054
- Drive DuckDB V2 scans on DuckDB's threads with a custom driver
  claude
  committed
  58940c0
- Merge develop into the DuckDB V2 branch
  claude
  committed
  115575d
- Merge develop into the DuckDB V2 branch
  claude
  committed
  c521dd8
- Merge develop, which now has #10708, into the DuckDB V2 branch
  claude
  committed
  9189e89
- Default duckdb-bench to the V2 scan for TPC-DS and ClickBench
  claude
  committed
  43671cc
- Merge develop after #10809 landed
  claude
  committed
  2aa98a2
- Cut DuckDB V2 scan chunks on the file's chunk boundaries
  claude
  committed
  8a4cefe
- Keep a few V2 chunks per thread when merging file chunks
  claude
  committed
  8a464a9
- Plan each DuckDB V2 file fully at initialize and queue its chunks
  claude
  committed
  527684b
- Turn on the DuckDB V2 scan for TPC-DS and ClickBench in vx-bench
  claude
  committed
  1ed88fe
- Run a DuckDB V2 part's chunks inline so they share reads
  claude
  committed
  431717c
- Choose the V2 scan per benchmark in vx-bench only
  claude
  committed
  746f52b
- Prune each DuckDB V2 part again under a dynamic filter
  claude
  committed
  4e9cede
- Prune a DuckDB V2 file only per part under a dynamic filter
  claude
  committed
  e4eb6f2
- Share a segment's read across a V2 scan's live IO sessions
  claude
  committed
  9b8a90e
- Prune a DuckDB V2 file again before its parts under a dynamic filter
  claude
  committed
  3b2d95d
Commits on Oct 27, 2026
- Plan a V2 projection of fields as one pack of column plans
  claude
  committed
  c867e73
- Retain a sparse V2 fetch's reads and plan only its selected chunks
  claude
  committed
  0ad75b1

Commits

Commits on Oct 26, 2026

Commits on Oct 27, 2026