Skip to content

[SPARK-58195][BUILD] Upgrade ORC to 2.3.1#57335

Open
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-58195
Open

[SPARK-58195][BUILD] Upgrade ORC to 2.3.1#57335
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-58195

Conversation

@dongjoon-hyun

@dongjoon-hyun dongjoon-hyun commented Jul 17, 2026

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR aims to upgrade ORC to 2.3.1.

Why are the changes needed?

To bring the latest bug fixes from the ORC 2.3.1 maintenance release:

Notable Java-side changes include:

  • ORC-2131: Set default of orc.stripe.size.check.ratio and orc.dictionary.max.size.bytes to 0
  • ORC-2149: Supports merging multiple ORC files with the same schema into multiple ORC files
  • ORC-2177: Fix array conversion with empty first batch
  • ORC-2180: Upgrade threeten-extra to 1.9.0
  • Many robustness improvements

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Fable 5

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

For the record, this is tested during Apache ORC RC1 vote period.

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Could you review this PR, too, @peter-toth ?

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Thank you so much!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants