Skip to content

[Flink] Kvscan flink integration#3383

Open
polyzos wants to merge 13 commits into
apache:mainfrom
polyzos:kvscan-flink-integration
Open

[Flink] Kvscan flink integration#3383
polyzos wants to merge 13 commits into
apache:mainfrom
polyzos:kvscan-flink-integration

Conversation

@polyzos
Copy link
Copy Markdown
Contributor

@polyzos polyzos commented May 26, 2026

#3126 extended the java client to support kvscan for the live rocksdb table.

This PR integrates that functionality inside the flink connector

Introduces KvBatchSplit and KvBatchSplitState as a new split type in the Flink source, enabling the connector to perform bounded full-table scans on primary-key tables via the server-side KV scan API (FIP-17), rather than reading from snapshots.

@polyzos polyzos force-pushed the kvscan-flink-integration branch from ddb782e to ecdb181 Compare May 26, 2026 12:21
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comment thread website/docs/engine-flink/options.md Outdated
@polyzos polyzos requested review from loserwang1024 and wuchong May 27, 2026 06:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants