Commit 595cf68
mm/khugepaged: fix race with folio split/free using temporary reference
hpage_collapse_scan_file() calls is_refcount_suitable(), which in turn
calls folio_mapcount(). folio_mapcount() checks folio_test_large() before
proceeding to folio_large_mapcount(), but there is a race window where the
folio may get split/freed between these checks, triggering:
VM_WARN_ON_FOLIO(!folio_test_large(folio), folio)
Take a temporary reference to the folio in hpage_collapse_scan_file().
This stabilizes the folio during refcount check and prevents incorrect
large folio detection due to concurrent split/free. Use helper
folio_expected_ref_count() + 1 to compare with folio_ref_count() instead
of using is_refcount_suitable().
Link: https://lkml.kernel.org/r/20250526182818.37978-1-shivankg@amd.com
Fixes: 05c5323 ("mm: track mapcount of large folios in single value")
Signed-off-by: Shivank Garg <shivankg@amd.com>
Reported-by: syzbot+2b99589e33edbe9475ca@syzkaller.appspotmail.com
Closes: https://lore.kernel.org/all/6828470d.a70a0220.38f255.000c.GAE@google.com
Suggested-by: David Hildenbrand <david@redhat.com>
Acked-by: David Hildenbrand <david@redhat.com>
Acked-by: Dev Jain <dev.jain@arm.com>
Reviewed-by: Baolin Wang <baolin.wang@linux.alibaba.com>
Cc: Bharata B Rao <bharata@amd.com>
Cc: Fengwei Yin <fengwei.yin@intel.com>
Cc: Liam Howlett <liam.howlett@oracle.com>
Cc: Lorenzo Stoakes <lorenzo.stoakes@oracle.com>
Cc: Mariano Pache <npache@redhat.com>
Cc: Ryan Roberts <ryan.roberts@arm.com>
Cc: Zi Yan <ziy@nvidia.com>
Cc: <stable@vger.kernel.org>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>1 parent e13e792 commit 595cf68
1 file changed
Lines changed: 17 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2293 | 2293 | | |
2294 | 2294 | | |
2295 | 2295 | | |
| 2296 | + | |
| 2297 | + | |
| 2298 | + | |
| 2299 | + | |
| 2300 | + | |
| 2301 | + | |
| 2302 | + | |
| 2303 | + | |
| 2304 | + | |
| 2305 | + | |
| 2306 | + | |
2296 | 2307 | | |
2297 | 2308 | | |
2298 | 2309 | | |
| |||
2303 | 2314 | | |
2304 | 2315 | | |
2305 | 2316 | | |
| 2317 | + | |
2306 | 2318 | | |
2307 | 2319 | | |
2308 | 2320 | | |
2309 | 2321 | | |
2310 | 2322 | | |
2311 | 2323 | | |
| 2324 | + | |
2312 | 2325 | | |
2313 | 2326 | | |
2314 | 2327 | | |
2315 | 2328 | | |
2316 | 2329 | | |
2317 | 2330 | | |
| 2331 | + | |
2318 | 2332 | | |
2319 | 2333 | | |
2320 | 2334 | | |
2321 | | - | |
| 2335 | + | |
2322 | 2336 | | |
| 2337 | + | |
2323 | 2338 | | |
2324 | 2339 | | |
2325 | 2340 | | |
| |||
2331 | 2346 | | |
2332 | 2347 | | |
2333 | 2348 | | |
| 2349 | + | |
2334 | 2350 | | |
2335 | 2351 | | |
2336 | 2352 | | |
| |||
0 commit comments