tasks_rcu_exit_srcu_stall: rcu_tasks grace period number 125 (since boot) gp_state: RTGS_POST_SCAN_TASKLIST is 143390 jiffies old. Please check any exiting tasks stuck between calls to exit_tasks_rcu_start() and exit_tasks_rcu_finish() INFO: task rcu_tasks_kthre:12 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:rcu_tasks_kthre state:D stack:28416 pid:12 ppid:2 flags:0x00004000 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_timeout+0x3b0/0x400 __wait_for_common+0x1d3/0x550 __synchronize_srcu+0x142/0x240 rcu_tasks_postscan+0x50/0x70 rcu_tasks_wait_gp+0x448/0xb90 rcu_tasks_one_gp+0xa69/0xe10 rcu_tasks_kthread+0x1a7/0x240 kthread+0x33f/0x440 ret_from_fork+0x2f/0x70 ret_from_fork_asm+0x1b/0x30 RIP: 0000:0x0 Code: Unable to access opcode bytes at 0xffffffffffffffd6. RSP: 0000:0000000000000000 EFLAGS: 00000000 ORIG_RAX: 0000000000000000 RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 INFO: task kworker/1:1:29 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:kworker/1:1 state:D stack:26400 pid:29 ppid:2 flags:0x00004000 Workqueue: events kprobe_optimizer Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_timeout+0x3b0/0x400 __wait_for_common+0x1d3/0x550 __wait_rcu_gp+0x24e/0x400 synchronize_rcu_tasks_generic.constprop.0+0xd6/0x170 kprobe_optimizer+0x343/0x7e0 process_one_work+0xabf/0x1770 worker_thread+0x64f/0x12a0 kthread+0x33f/0x440 ret_from_fork+0x2f/0x70 ret_from_fork_asm+0x1b/0x30 RIP: 0000:0x0 Code: Unable to access opcode bytes at 0xffffffffffffffd6. RSP: 0000:0000000000000000 EFLAGS: 00000000 ORIG_RAX: 0000000000000000 RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 INFO: task syz-executor.5:6077 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.5 state:D stack:28496 pid:6077 ppid:275 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f88acf15b19 RSP: 002b:00007f88aa46a218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f88ad029028 RCX: 00007f88acf15b19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f88ad029028 RBP: 00007f88ad029020 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f88ad02902c R13: 00007fff407b060f R14: 00007f88aa46a300 R15: 0000000000022000 INFO: task syz-executor.5:6094 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.5 state:D stack:26240 pid:6094 ppid:275 flags:0x00004006 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_destroy+0x27/0x1c0 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 do_exit+0xa92/0x2740 do_group_exit+0xd4/0x2a0 get_signal+0x2693/0x2720 arch_do_signal_or_restart+0x79/0x590 exit_to_user_mode_prepare+0xeb/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f88acf15b19 RSP: 002b:00007f88aa449218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: fffffffffffffe00 RBX: 00007f88ad0290e8 RCX: 00007f88acf15b19 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f88ad0290e8 RBP: 00007f88ad0290e0 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f88ad0290ec R13: 00007fff407b060f R14: 00007f88aa449300 R15: 0000000000022000 INFO: task syz-executor.0:6104 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.0 state:D stack:26984 pid:6104 ppid:269 flags:0x00000004 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 disable_kprobe+0x21/0x70 __disable_trace_kprobe+0xef/0x190 disable_trace_kprobe+0x267/0x2e0 kprobe_register+0x69/0xd0 perf_trace_event_unreg.isra.0+0xae/0x1e0 perf_kprobe_destroy+0xc8/0x200 _free_event+0x207/0x1190 perf_event_release_kernel+0x5b8/0x7a0 perf_release+0x37/0x50 __fput+0x406/0xad0 task_work_run+0x174/0x280 exit_to_user_mode_prepare+0x17d/0x180 syscall_exit_to_user_mode+0x1d/0x50 do_syscall_64+0x4c/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7fcc3eef472b RSP: 002b:00007ffcab3b8690 EFLAGS: 00000293 ORIG_RAX: 0000000000000003 RAX: 0000000000000000 RBX: 0000000000000008 RCX: 00007fcc3eef472b RDX: 0000000000000000 RSI: 00007fcc3ee3a9e0 RDI: 0000000000000007 RBP: 0000000000000001 R08: 0000000000000000 R09: 0000001b2c128ae8 R10: 0000000000001c8f R11: 0000000000000293 R12: 00007fcc3f055b60 R13: 00007fcc3f055b60 R14: 00007fcc3f054f60 R15: 000000000009281a INFO: task syz-executor.6:6131 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.6 state:D stack:28144 pid:6131 ppid:276 flags:0x00000004 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_init+0x4d/0x2f0 perf_tp_event_init+0xa6/0x120 perf_try_init_event+0x130/0x570 perf_event_alloc.part.0+0xf84/0x3a70 __do_sys_perf_event_open+0x4db/0x2ae0 do_syscall_64+0x3f/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f89a42a7b19 RSP: 002b:00007f89a181d188 EFLAGS: 00000246 ORIG_RAX: 000000000000012a RAX: ffffffffffffffda RBX: 00007f89a43baf60 RCX: 00007f89a42a7b19 RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 0000000020000080 RBP: 00007f89a4301f6d R08: 0000000000000000 R09: 0000000000000000 R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000 R13: 00007ffdb09a928f R14: 00007f89a181d300 R15: 0000000000022000 INFO: task syz-executor.6:6139 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.6 state:D stack:28888 pid:6139 ppid:276 flags:0x00004004 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 register_kretprobe+0x164/0x900 __register_trace_kprobe+0x23a/0x2d0 create_local_trace_kprobe+0x1ea/0x3d0 perf_kprobe_init+0x119/0x210 perf_kprobe_event_init+0xfc/0x1d0 perf_try_init_event+0x130/0x570 perf_event_alloc.part.0+0xf84/0x3a70 __do_sys_perf_event_open+0x4db/0x2ae0 do_syscall_64+0x3f/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f89a42a7b19 RSP: 002b:00007f89a17fc188 EFLAGS: 00000246 ORIG_RAX: 000000000000012a RAX: ffffffffffffffda RBX: 00007f89a43bb020 RCX: 00007f89a42a7b19 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000020000280 RBP: 00007f89a4301f6d R08: 0000000000000000 R09: 0000000000000000 R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000 R13: 00007ffdb09a928f R14: 00007f89a17fc300 R15: 0000000000022000 INFO: task syz-executor.4:6137 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.4 state:D stack:29648 pid:6137 ppid:927 flags:0x00000004 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_init+0x4d/0x2f0 perf_tp_event_init+0xa6/0x120 perf_try_init_event+0x130/0x570 perf_event_alloc.part.0+0xf84/0x3a70 __do_sys_perf_event_open+0x4db/0x2ae0 do_syscall_64+0x3f/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7ffa81c84b19 RSP: 002b:00007ffa7f1fa188 EFLAGS: 00000246 ORIG_RAX: 000000000000012a RAX: ffffffffffffffda RBX: 00007ffa81d97f60 RCX: 00007ffa81c84b19 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000020000080 RBP: 00007ffa81cdef6d R08: 0000000000000000 R09: 0000000000000000 R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000 R13: 00007ffced14796f R14: 00007ffa7f1fa300 R15: 0000000000022000 INFO: task syz-executor.4:6141 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.4 state:D stack:29576 pid:6141 ppid:927 flags:0x00000004 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_init+0x4d/0x2f0 perf_tp_event_init+0xa6/0x120 perf_try_init_event+0x130/0x570 perf_event_alloc.part.0+0xf84/0x3a70 __do_sys_perf_event_open+0x4db/0x2ae0 do_syscall_64+0x3f/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7ffa81c84b19 RSP: 002b:00007ffa7f1d9188 EFLAGS: 00000246 ORIG_RAX: 000000000000012a RAX: ffffffffffffffda RBX: 00007ffa81d98020 RCX: 00007ffa81c84b19 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000020000080 RBP: 00007ffa81cdef6d R08: 0000000000000000 R09: 0000000000000000 R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000 R13: 00007ffced14796f R14: 00007ffa7f1d9300 R15: 0000000000022000 INFO: task syz-executor.3:6138 blocked for more than 143 seconds. Not tainted 6.5.0-rc2-next-20230721 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor.3 state:D stack:29056 pid:6138 ppid:272 flags:0x00000004 Call Trace: __schedule+0x9a9/0x2b00 schedule+0xdb/0x1a0 schedule_preempt_disabled+0x10/0x20 __mutex_lock+0xc10/0x1a30 perf_trace_init+0x4d/0x2f0 perf_tp_event_init+0xa6/0x120 perf_try_init_event+0x130/0x570 perf_event_alloc.part.0+0xf84/0x3a70 __do_sys_perf_event_open+0x4db/0x2ae0 do_syscall_64+0x3f/0x90 entry_SYSCALL_64_after_hwframe+0x6e/0xd8 RIP: 0033:0x7f7b192b8b19 RSP: 002b:00007f7b1682e188 EFLAGS: 00000246 ORIG_RAX: 000000000000012a RAX: ffffffffffffffda RBX: 00007f7b193cbf60 RCX: 00007f7b192b8b19 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000020000080 RBP: 00007f7b19312f6d R08: 0000000000000000 R09: 0000000000000000 R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000 R13: 00007ffe8ca205af R14: 00007f7b1682e300 R15: 0000000000022000 Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings Showing all locks held in the system: 1 lock held by rcu_tasks_kthre/12: #0: ffffffff8560b6d0 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x31/0xe10 1 lock held by khungtaskd/25: #0: ffffffff8560c2a0 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x55/0x340 5 locks held by kworker/1:1/29: #0: ffff888008468d38 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0x99d/0x1770 #1: ffff888008f0fd90 ((optimizing_work).work){+.+.}-{0:0}, at: process_one_work+0x9d0/0x1770 #2: ffffffff85654f68 (kprobe_mutex){+.+.}-{3:3}, at: kprobe_optimizer+0x25/0x7e0 #3: ffffffff854e2f90 (cpu_hotplug_lock){++++}-{0:0}, at: kprobe_optimizer+0x2a/0x7e0 #4: ffffffff854f7568 (text_mutex){+.+.}-{3:3}, at: kprobe_optimizer+0x38/0x7e0 2 locks held by in:imklog/167: #0: ffff88800de2d9c8 (&f->f_pos_lock){+.+.}-{3:3}, at: __fdget_pos+0xdf/0x100 #1: ffff8880166581a0 (&mm->mmap_lock){++++}-{3:3}, at: kmem_cache_alloc+0x47/0x390 1 lock held by syz-executor.6/4146: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.6/4941: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.0/5737: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.0/5748: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.5/6077: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 1 lock held by syz-executor.5/6094: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_destroy+0x27/0x1c0 2 locks held by syz-executor.0/6104: #0: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_kprobe_destroy+0x27/0x200 #1: ffffffff85654f68 (kprobe_mutex){+.+.}-{3:3}, at: disable_kprobe+0x21/0x70 2 locks held by syz-executor.6/6131: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_init+0x4d/0x2f0 2 locks held by syz-executor.6/6139: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff85654f68 (kprobe_mutex){+.+.}-{3:3}, at: register_kretprobe+0x164/0x900 2 locks held by syz-executor.4/6137: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_init+0x4d/0x2f0 2 locks held by syz-executor.4/6141: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_init+0x4d/0x2f0 2 locks held by syz-executor.3/6138: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_init+0x4d/0x2f0 2 locks held by syz-executor.3/6147: #0: ffffffff87b92d70 (&pmus_srcu){.+.+}-{0:0}, at: perf_event_alloc.part.0+0xcd2/0x3a70 #1: ffffffff856680a8 (event_mutex){+.+.}-{3:3}, at: perf_trace_init+0x4d/0x2f0 ============================================= tasks_rcu_exit_srcu_stall: rcu_tasks grace period number 125 (since boot) gp_state: RTGS_POST_SCAN_TASKLIST is 153629 jiffies old. Please check any exiting tasks stuck between calls to exit_tasks_rcu_start() and exit_tasks_rcu_finish()