tasks_rcu_exit_srcu_stall: rcu_tasks grace period number 53 (since boot) gp_state: RTGS_POST_SCAN_TASKLIST is 143585 jiffies old. Please check any exiting tasks stuck between calls to exit_tasks_rcu_start() and exit_tasks_rcu_finish() INFO: task rcu_tasks_kthre:12 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:rcu_tasks_kthre state:D stack:28416 pid:12 ppid:2 flags:0x00004000 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_timeout+0x3b0/0x400 __wait_for_common+0x1d3/0x550 __synchronize_srcu+0x142/0x240 rcu_tasks_postscan+0x50/0x70 rcu_tasks_wait_gp+0x448/0xb90 rcu_tasks_one_gp+0xa69/0xe10 rcu_tasks_kthread+0x1a7/0x240 kthread+0x33f/0x440 ret_from_fork+0x2f/0x70 ret_from_fork_asm+0x1b/0x30 RIP: 0000:0x0 Code: Unable to access opcode bytes at 0xffffffffffffffd6. RSP: 0000:0000000000000000 EFLAGS: 00000000 ORIG_RAX: 0000000000000000 RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 INFO: task syz-executor.1:4133 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.1 state:D stack:27344 pid:4133 ppid:269 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f6298d4bb19 RSP: 002b:00007f62962c1218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f6298e5ef68 RCX: 00007f6298d4bb19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f6298e5ef68 RBP: 00007f6298e5ef60 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f6298e5ef6c R13: 00007ffe66aed8ef R14: 00007f62962c1300 R15: 0000000000022000 INFO: task syz-executor.1:4174 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.1 state:D stack:27344 pid:4174 ppid:269 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f6298d4bb19 RSP: 002b:00007f62962c1218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f6298e5ef68 RCX: 00007f6298d4bb19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f6298e5ef68 RBP: 00007f6298e5ef60 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f6298e5ef6c R13: 00007ffe66aed8ef R14: 00007f62962c1300 R15: 0000000000022000 INFO: task syz-executor.1:4213 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.1 state:D stack:27344 pid:4213 ppid:269 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f6298d4bb19 RSP: 002b:00007f62962c1218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f6298e5ef68 RCX: 00007f6298d4bb19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f6298e5ef68 RBP: 00007f6298e5ef60 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f6298e5ef6c R13: 00007ffe66aed8ef R14: 00007f62962c1300 R15: 0000000000022000 INFO: task syz-executor.1:4461 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.1 state:D stack:28496 pid:4461 ppid:269 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f6298d4bb19 RSP: 002b:00007f62962a0218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f6298e5f028 RCX: 00007f6298d4bb19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f6298e5f028 RBP: 00007f6298e5f020 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f6298e5f02c R13: 00007ffe66aed8ef R14: 00007f62962a0300 R15: 0000000000022000 INFO: task kworker/1:3:5513 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:kworker/1:3 state:D stack:26952 pid:5513 ppid:2 flags:0x00004000 Workqueue: events kprobe_optimizer Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_timeout+0x3b0/0x400 __wait_for_common+0x1d3/0x550 __wait_rcu_gp+0x24e/0x400 synchronize_rcu_tasks_generic.constprop.0+0xd6/0x170 kprobe_optimizer+0x343/0x7e0 process_one_work+0xabf/0x1770 worker_thread+0x64f/0x12a0 kthread+0x33f/0x440 ret_from_fork+0x2f/0x70 ret_from_fork_asm+0x1b/0x30 RIP: 0000:0x0 Code: Unable to access opcode bytes at 0xffffffffffffffd6. RSP: 0000:0000000000000000 EFLAGS: 00000000 ORIG_RAX: 0000000000000000 RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 INFO: task syz-executor.1:5547 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.1 state:D stack:26240 pid:5547 ppid:269 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f6298d4bb19 RSP: 002b:00007f62962a0218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f6298e5f028 RCX: 00007f6298d4bb19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f6298e5f028 RBP: 00007f6298e5f020 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f6298e5f02c R13: 00007ffe66aed8ef R14: 00007f62962a0300 R15: 0000000000022000 INFO: task syz-executor.1:5561 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.1 state:D stack:27672 pid:5561 ppid:269 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f6298d4bb19 RSP: 002b:00007f629627f218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f6298e5f0e8 RCX: 00007f6298d4bb19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f6298e5f0e8 RBP: 00007f6298e5f0e0 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f6298e5f0ec R13: 00007ffe66aed8ef R14: 00007f629627f300 R15: 0000000000022000 INFO: task syz-executor.1:5609 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.1 state:D stack:27344 pid:5609 ppid:269 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f6298d4bb19 RSP: 002b:00007f62962c1218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f6298e5ef68 RCX: 00007f6298d4bb19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f6298e5ef68 RBP: 00007f6298e5ef60 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f6298e5ef6c R13: 00007ffe66aed8ef R14: 00007f62962c1300 R15: 0000000000022000 INFO: task syz-executor.1:5641 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.1 state:D stack:27344 pid:5641 ppid:269 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f6298d4bb19 RSP: 002b:00007f62962c1218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f6298e5ef68 RCX: 00007f6298d4bb19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f6298e5ef68 RBP: 00007f6298e5ef60 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f6298e5ef6c R13: 00007ffe66aed8ef R14: 00007f62962c1300 R15: 0000000000022000 Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings Showing all locks held in the system: 1 lock held by rcu_tasks_kthre/12: #0: ffffffff8560b6d0 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x31/0xe10 1 lock held by khungtaskd/25: #0: ffffffff8560c2a0 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x55/0x340 2 locks held by in:imklog/163: #0: ffff888010244348 (&f->f_pos_lock){+.+.}-{3:3}, at: __fdget_pos+0xdf/0x100 #1: ffffffff855ff168 (syslog_lock){+.+.}-{3:3}, at: select_task_rq_fair+0x266/0x35e0 1 lock held by syz-executor.1/4133: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.1/4174: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.1/4213: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.1/4461: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.0/4505: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.0/4514: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 5 locks held by kworker/1:3/5513: #0: ffff888008468d38 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0x99d/0x1770 #1: ffff888044defd90 ((optimizing_work).work){+.+.}-{0:0}, at: process_one_work+0x9d0/0x1770 #2: ffffffff85654f68 (kprobe_mutex){+.+.}-{3:3}, at: kprobe_optimizer+0x25/0x7e0 #3: ffffffff854e2f90 (cpu_hotplug_lock){++++}-{0:0}, at: kprobe_optimizer+0x2a/0x7e0 #4: ffffffff854f7568 (text_mutex){+.+.}-{3:3}, at: kprobe_optimizer+0x38/0x7e0 1 lock held by syz-executor.1/5547: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.1/5561: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.1/5609: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.1/5641: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.6/5733: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.2/5749: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 6 locks held by syz-executor.0/5752: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_init+0x4d/0x2f0 #2: ffffffff8565a168 (tracepoints_mutex){+.+.}-{3:3}, at: tracepoint_probe_register+0x7c/0xf0 #3: ffffffff854e2f90 (cpu_hotplug_lock){++++}-{0:0}, at: __static_call_update+0x8b/0x620 #4: ffffffff856842a8 (static_call_mutex){+.+.}-{3:3}, at: __static_call_update+0x99/0x620 #5: ffffffff854f7568 (text_mutex){+.+.}-{3:3}, at: arch_static_call_transform+0x23/0xa0 2 locks held by syz-executor.3/5757: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_init+0x4d/0x2f0 2 locks held by syz-executor.3/5760: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_init+0x4d/0x2f0 2 locks held by syz-executor.7/5759: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_init+0x4d/0x2f0 ============================================= tasks_rcu_exit_srcu_stall: rcu_tasks grace period number 53 (since boot) gp_state: RTGS_POST_SCAN_TASKLIST is 153825 jiffies old. Please check any exiting tasks stuck between calls to exit_tasks_rcu_start() and exit_tasks_rcu_finish()