Repository navigation

Fix and speed up the V2 scan's planner chain - #10789

Open

joseph-isaacs wants to merge 30 commits into

developfrom

ji/vibrant-cray-rw57ni

Open

Fix and speed up the V2 scan's planner chain#10789
joseph-isaacs wants to merge 30 commits into
developfrom
ji/vibrant-cray-rw57ni

Commits on Oct 23, 2026
- Plan a V2 scan as a chain of planners from one prepared scan
  
  joseph-isaacs
  and
  claude
  committed
  c56ec58
- Optimize a zoned data plan to its data child
  
  joseph-isaacs
  and
  claude
  committed
  8e106ac
- Share one V2 scan cache per file across DataFusion partitions
  
  joseph-isaacs
  and
  claude
  committed
  38f6a81
- Drive a V2 scan's run from its stream, with compute on spawn_cpu
  
  joseph-isaacs
  and
  claude
  committed
  6894be0
- Build a prune planner with the planner it continues into
  
  joseph-isaacs
  and
  claude
  committed
  5a66bc1
- Spawn a scan's chunks as independent planners and run them beside each other
  
  joseph-isaacs
  and
  claude
  committed
  a74502f
- Dedup a planner's IO hints with a set
  
  joseph-isaacs
  and
  claude
  committed
  52daa27
- Run a V2 scan's chunks beside each other only as far as the engine does not
  
  joseph-isaacs
  and
  claude
  committed
  26c4265
- Link the run driver by its imported name in the V2 module doc
  
  joseph-isaacs
  and
  claude
  committed
  c441bc4
- Merge remote-tracking branch 'origin/develop' into ji/scan-v2-chain-2-planners
  
  claude
  authored and
  joseph-isaacs
  committed
  1cb2d99
- Pass an execution context to ListArray::try_new in the nested empty list test
  
  joseph-isaacs
  and
  claude
  committed
  33a5b24
- Merge remote-tracking branch 'origin/develop' into ji/scan-v2-chain-2-planners
  
  joseph-isaacs
  and
  claude
  committed
  9f8bf1c
- Run a V2 scan's chunks inline at concurrency one, each root on its own IO session
  claude
  committed
  a07e7f1
- Build each V2 scan cache entry once when partitions miss together
  claude
  committed
  338e550
- Register a whole IO batch before polling any of its reads
  claude
  committed
  efa7556
- Share the mask-driving loop of the filter and prune planners, and align projection windows
  claude
  committed
  64e12b6
- Drop identity struct evals and skip lowering legacy stats for data reads
  claude
  committed
  6168ba0
- Expect segment ids as they display in the batch registration test
  claude
  committed
  c1ce3af
- Project a chunk on one scan, a split and a batch per output window
  claude
  committed
  aae7554
Commits on Oct 26, 2026
- Merge remote-tracking branch 'origin/develop' into ji/vibrant-cray-rw57ni
  claude
  committed
  166a50f
- Size a V2 scan's chunk concurrency by the partitions reading its file
  claude
  committed
  cc817bf
- Keep at least 256Ki rows in each V2 scan partition
  claude
  committed
  9b71061
- Size a V2 scan's filtered chunks to keep its concurrency busy
  claude
  committed
  5f20be0
- Merge develop into ji/vibrant-cray-rw57ni
  claude
  committed
  9c40282
- Merge develop into ji/vibrant-cray-rw57ni
  claude
  committed
  ac08e5f
- Merge develop into ji/vibrant-cray-rw57ni
  claude
  committed
  c7d79cf
- Size a V2 scan's projection chunks to keep its concurrency busy
  claude
  committed
  09d0360
- Keep the engine's partitions for an unfiltered V2 scan
  claude
  committed
  6a4c019
Commits on Oct 27, 2026
- Merge develop into ji/vibrant-cray-rw57ni
  claude
  committed
  9d4cbf7
- DCO Remediation Commit for Claude <noreply@anthropic.com>
  claude
  committed
  143c86e

Commits

Commits on Oct 23, 2026

Commits on Oct 26, 2026

Commits on Oct 27, 2026