Skip to content

Bump minimum Hadoop compatibility checks from 3.0.3 to 3.3.0#6461

Open
dlmarion wants to merge 1 commit into
apache:2.1from
dlmarion:bump-min-hadoop-compatibility
Open

Bump minimum Hadoop compatibility checks from 3.0.3 to 3.3.0#6461
dlmarion wants to merge 1 commit into
apache:2.1from
dlmarion:bump-min-hadoop-compatibility

Conversation

@dlmarion

@dlmarion dlmarion commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@ctubbsii ctubbsii left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is a prerequisite for #6460 . I'm okay with the change in 2.1.6, but it needs to be called out in the release notes that Hadoop will need to be upgraded to at least 3.3.6

- {name: 'unit-tests', javaver: 21, args: 'verify -PskipQA -DskipTests=false'}
- {name: 'qa-checks', javaver: 21, args: 'verify javadoc:jar -Psec-bugs -DskipTests -Dspotbugs.timeout=3600000'}
- {name: 'compat', javaver: 21, args: 'package -DskipTests -Dversion.hadoop=3.0.3 -Dversion.zookeeper=3.5.10'}
- {name: 'compat', javaver: 21, args: 'package -DskipTests -Dversion.hadoop=3.3.0 -Dversion.zookeeper=3.5.10'}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this should use the latest 3.3 (3.3.6?). We don't need to test compatibility with versions that have been superseded with bugfixes. Compatibility with the latest release in that series is sufficient because that's what users should be using if they are on that series.

Suggested change
- {name: 'compat', javaver: 21, args: 'package -DskipTests -Dversion.hadoop=3.3.0 -Dversion.zookeeper=3.5.10'}
- {name: 'compat', javaver: 21, args: 'package -DskipTests -Dversion.hadoop=3.3.6 -Dversion.zookeeper=3.5.10'}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants