TEZ-4732: MergeManager: deadlock when usedMemory exceeds limit but commitMemory is below merge threshold

[ryukobayashi]

Details are included on the ticket: https://issues.apache.org/jira/browse/TEZ-4732

[tez-yetus]

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 8s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ master Compile Tests _
+1 💚	mvninstall	3m 14s		master passed
+1 💚	compile	2m 33s		master passed
+1 💚	checkstyle	0m 27s		master passed
+1 💚	javadoc	0m 25s		master passed
+0 🆗	spotbugs	0m 50s		tez-runtime-library in master has 143 extant spotbugs warnings.
			_ Patch Compile Tests _
+1 💚	mvninstall	2m 15s		the patch passed
+1 💚	codespell	0m 51s		No new issues.
+1 💚	compile	2m 33s		the patch passed
+1 💚	javac	2m 33s		the patch passed
+1 💚	blanks	0m 1s		The patch has no blanks issues.
+1 💚	checkstyle	0m 22s		the patch passed
+1 💚	javadoc	0m 24s		the patch passed
+1 💚	spotbugs	0m 55s		the patch passed
			_ Other Tests _
+1 💚	unit	60m 24s		root in the patch passed.
+1 💚	asflicense	0m 23s		The patch does not generate ASF License warnings.
		76m 48s

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-515/1/artifact/out/Dockerfile
Optional Tests	dupname compile unit asflicense javac javadoc spotbugs checkstyle codespell detsecrets
uname	Linux 8bf191a847bf 5.15.0-179-generic #189-Ubuntu SMP Tue May 5 18:20:56 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	tez-personality.sh
git revision	master / 17d1549
Default Java	Eclipse Adoptium-21.0.11+10-LTS
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-515/1/testReport/
Max. process+thread count	1377 (vs. ulimit of 5500)
modules	C: tez-runtime-library U: tez-runtime-library
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-515/1/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1
Powered by	Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

[abstractdog]

nice catch @ryukobayashi, thanks for this patch, I only left a minor comment

[tez-yetus]

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 8s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ master Compile Tests _
+1 💚	mvninstall	3m 10s		master passed
+1 💚	compile	2m 30s		master passed
+1 💚	checkstyle	0m 26s		master passed
+1 💚	javadoc	0m 25s		master passed
+0 🆗	spotbugs	0m 48s		tez-runtime-library in master has 143 extant spotbugs warnings.
			_ Patch Compile Tests _
+1 💚	mvninstall	2m 11s		the patch passed
+1 💚	codespell	0m 49s		No new issues.
+1 💚	compile	2m 31s		the patch passed
+1 💚	javac	2m 31s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 21s		the patch passed
+1 💚	javadoc	0m 24s		the patch passed
+1 💚	spotbugs	0m 52s		the patch passed
			_ Other Tests _
+1 💚	unit	60m 51s		root in the patch passed.
+1 💚	asflicense	0m 21s		The patch does not generate ASF License warnings.
		76m 49s

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-515/2/artifact/out/Dockerfile
Optional Tests	dupname compile unit asflicense javac javadoc spotbugs checkstyle codespell detsecrets
uname	Linux 90c5002b5c2d 5.15.0-179-generic #189-Ubuntu SMP Tue May 5 18:20:56 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	tez-personality.sh
git revision	master / 17d1549
Default Java	Eclipse Adoptium-21.0.11+10-LTS
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-515/2/testReport/
Max. process+thread count	1563 (vs. ulimit of 5500)
modules	C: tez-runtime-library U: tez-runtime-library
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-515/2/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1
Powered by	Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.