Skip to content

[tiering] Reduce LakeSnapshot log verbosity in TieringSplitGenerator#3700

Open
beryllw wants to merge 1 commit into
apache:mainfrom
beryllw:feature/reduce-tiering-log
Open

[tiering] Reduce LakeSnapshot log verbosity in TieringSplitGenerator#3700
beryllw wants to merge 1 commit into
apache:mainfrom
beryllw:feature/reduce-tiering-log

Conversation

@beryllw

@beryllw beryllw commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Purpose

Linked issue: close #xxx
TieringSplitGenerator logs the full LakeSnapshot object at INFO level every time it generates splits (every tiering.poll.table.interval, default 30s). For partitioned tables with many buckets , a single log line becomes extremely long and floods out other logs needed for troubleshooting.

Brief change log

  • INFO level now logs only summary metadata: snapshotId + numBucketOffsets
  • Full LakeSnapshot content moved to DEBUG level, available on demand during troubleshooting

Tests

API and Format

No impact — logging-only change.

Documentation

No documentation update needed.

@beryllw
beryllw force-pushed the feature/reduce-tiering-log branch from 47755d8 to df4f479 Compare July 20, 2026 06:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants