Skip to content

Expose progress boundaries for projected ingestion-log reads - #369

Open
beinan wants to merge 1 commit into
codex/trace-wal-output-projectionfrom
codex/wal-read-progress
Open

beinan wants to merge 1 commit into
codex/trace-wal-output-projectionfrom
codex/wal-read-progress

Conversation

@beinan

@beinan beinan commented Oct 9, 2026

Copy link
Copy Markdown
Collaborator

Projected log reads currently expose only the final result, making a slow scan or projected row fetch indistinguishable to callers. Add an optional public stage/batch callback while preserving the existing read methods, returned data, errors, limits, and cancellation behavior. The callback carries no payload or storage paths and must remain nonblocking.

Validation: all 69 ingestion-package tests pass, including real Lance projection/result/error parity and ordered stage notifications. Formatting and all-target Clippy pass.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant