Skip to content

Commit 76ed276

Browse files
rostedtPeter Zijlstra
authored andcommitted
perf: sched: Fix perf crash with new is_user_task() helper
In order to do a user space stacktrace the current task needs to be a user task that has executed in user space. It use to be possible to test if a task is a user task or not by simply checking the task_struct mm field. If it was non NULL, it was a user task and if not it was a kernel task. But things have changed over time, and some kernel tasks now have their own mm field. An idea was made to instead test PF_KTHREAD and two functions were used to wrap this check in case it became more complex to test if a task was a user task or not[1]. But this was rejected and the C code simply checked the PF_KTHREAD directly. It was later found that not all kernel threads set PF_KTHREAD. The io-uring helpers instead set PF_USER_WORKER and this needed to be added as well. But checking the flags is still not enough. There's a very small window when a task exits that it frees its mm field and it is set back to NULL. If perf were to trigger at this moment, the flags test would say its a user space task but when perf would read the mm field it would crash with at NULL pointer dereference. Now there are flags that can be used to test if a task is exiting, but they are set in areas that perf may still want to profile the user space task (to see where it exited). The only real test is to check both the flags and the mm field. Instead of making this modification in every location, create a new is_user_task() helper function that does all the tests needed to know if it is safe to read the user space memory or not. [1] https://lore.kernel.org/all/20250425204120.639530125@goodmis.org/ Fixes: 90942f9 ("perf: Use current->flags & PF_KTHREAD|PF_USER_WORKER instead of current->mm == NULL") Closes: https://lore.kernel.org/all/0d877e6f-41a7-4724-875d-0b0a27b8a545@roeck-us.net/ Reported-by: Guenter Roeck <linux@roeck-us.net> Signed-off-by: Steven Rostedt (Google) <rostedt@goodmis.org> Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org> Tested-by: Guenter Roeck <linux@roeck-us.net> Cc: stable@vger.kernel.org Link: https://patch.msgid.link/20260129102821.46484722@gandalf.local.home
1 parent 63804fe commit 76ed276

3 files changed

Lines changed: 9 additions & 4 deletions

File tree

include/linux/sched.h

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1776,6 +1776,11 @@ static __always_inline bool is_percpu_thread(void)
17761776
(current->nr_cpus_allowed == 1);
17771777
}
17781778

1779+
static __always_inline bool is_user_task(struct task_struct *task)
1780+
{
1781+
return task->mm && !(task->flags & (PF_KTHREAD | PF_USER_WORKER));
1782+
}
1783+
17791784
/* Per-process atomic flags. */
17801785
#define PFA_NO_NEW_PRIVS 0 /* May not gain new privileges. */
17811786
#define PFA_SPREAD_PAGE 1 /* Spread page cache over cpuset */

kernel/events/callchain.c

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -246,7 +246,7 @@ get_perf_callchain(struct pt_regs *regs, bool kernel, bool user,
246246

247247
if (user && !crosstask) {
248248
if (!user_mode(regs)) {
249-
if (current->flags & (PF_KTHREAD | PF_USER_WORKER))
249+
if (!is_user_task(current))
250250
goto exit_put;
251251
regs = task_pt_regs(current);
252252
}

kernel/events/core.c

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -7460,7 +7460,7 @@ static void perf_sample_regs_user(struct perf_regs *regs_user,
74607460
if (user_mode(regs)) {
74617461
regs_user->abi = perf_reg_abi(current);
74627462
regs_user->regs = regs;
7463-
} else if (!(current->flags & (PF_KTHREAD | PF_USER_WORKER))) {
7463+
} else if (is_user_task(current)) {
74647464
perf_get_regs_user(regs_user, regs);
74657465
} else {
74667466
regs_user->abi = PERF_SAMPLE_REGS_ABI_NONE;
@@ -8100,7 +8100,7 @@ static u64 perf_virt_to_phys(u64 virt)
81008100
* Try IRQ-safe get_user_page_fast_only first.
81018101
* If failed, leave phys_addr as 0.
81028102
*/
8103-
if (!(current->flags & (PF_KTHREAD | PF_USER_WORKER))) {
8103+
if (is_user_task(current)) {
81048104
struct page *p;
81058105

81068106
pagefault_disable();
@@ -8215,7 +8215,7 @@ perf_callchain(struct perf_event *event, struct pt_regs *regs)
82158215
{
82168216
bool kernel = !event->attr.exclude_callchain_kernel;
82178217
bool user = !event->attr.exclude_callchain_user &&
8218-
!(current->flags & (PF_KTHREAD | PF_USER_WORKER));
8218+
is_user_task(current);
82198219
/* Disallow cross-task user callchains. */
82208220
bool crosstask = event->ctx->task && event->ctx->task != current;
82218221
bool defer_user = IS_ENABLED(CONFIG_UNWIND_USER) && user &&

0 commit comments

Comments
 (0)