kmem_cache_node 47KB 47KB
kmem_cache 78KB 78KB
oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/systemd-journald.service,task=systemd-journal,pid=110,uid=0
BUG: sleeping function called from invalid context at kernel/locking/mutex.c:577
in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 110, name: systemd-journal
preempt_count: 1, expected: 0
RCU nest depth: 0, expected: 0
3 locks held by systemd-journal/110:
#0: ffff88800f1067a0 (mapping.invalidate_lock){++++}-{3:3}, at: filemap_invalidate_lock_shared include/linux/fs.h:832 [inline]
#0: ffff88800f1067a0 (mapping.invalidate_lock){++++}-{3:3}, at: filemap_fault+0x151a/0x2130 mm/filemap.c:3126
#1: ffffffff85278828 (oom_lock){+.+.}-{3:3}, at: __alloc_pages_may_oom mm/page_alloc.c:4281 [inline]
#1: ffffffff85278828 (oom_lock){+.+.}-{3:3}, at: __alloc_pages_slowpath.constprop.0+0xcc9/0x1f10 mm/page_alloc.c:5063
#2: ffff88800f9bd8e0 (&p->alloc_lock){+.+.}-{2:2}, at: spin_lock include/linux/spinlock.h:354 [inline]
#2: ffff88800f9bd8e0 (&p->alloc_lock){+.+.}-{2:2}, at: task_lock include/linux/sched/task.h:170 [inline]
#2: ffff88800f9bd8e0 (&p->alloc_lock){+.+.}-{2:2}, at: find_lock_task_mm+0xe3/0x2b0 mm/oom_kill.c:144
Preemption disabled at:
[<0000000000000000>] 0x0
CPU: 0 PID: 110 Comm: systemd-journal Not tainted 5.16.0-next-20220111 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.14.0-0-g155821a1990b-prebuilt.qemu.org 04/01/2014
Call Trace:
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0x8b/0xb3 lib/dump_stack.c:106
__might_resched.cold+0x222/0x26b kernel/sched/core.c:9583
__mutex_lock_common kernel/locking/mutex.c:577 [inline]
__mutex_lock+0x9e/0x1480 kernel/locking/mutex.c:733
futex_cleanup_begin kernel/futex/core.c:1058 [inline]
futex_exit_release+0x2d/0x220 kernel/futex/core.c:1110
__oom_kill_process+0x373/0xf90 mm/oom_kill.c:893
oom_kill_process+0xd7/0x5c0 mm/oom_kill.c:1003
out_of_memory+0x1198/0x1460 mm/oom_kill.c:1114
__alloc_pages_may_oom mm/page_alloc.c:4332 [inline]
__alloc_pages_slowpath.constprop.0+0x1972/0x1f10 mm/page_alloc.c:5063
__alloc_pages+0x403/0x4e0 mm/page_alloc.c:5394
alloc_pages+0x1a0/0x2f0 mm/mempolicy.c:2271
filemap_alloc_folio mm/filemap.c:989 [inline]
__filemap_get_folio+0x65c/0xfd0 mm/filemap.c:1992
filemap_fault+0x155a/0x2130 mm/filemap.c:3129
__do_fault+0x113/0x5a0 mm/memory.c:3868
do_read_fault mm/memory.c:4183 [inline]
do_fault mm/memory.c:4312 [inline]
handle_pte_fault mm/memory.c:4570 [inline]
__handle_mm_fault+0x1325/0x3570 mm/memory.c:4705
handle_mm_fault+0x2e6/0xa20 mm/memory.c:4803
do_user_addr_fault+0x54a/0x12a0 arch/x86/mm/fault.c:1397
handle_page_fault arch/x86/mm/fault.c:1484 [inline]
exc_page_fault+0xa2/0x1a0 arch/x86/mm/fault.c:1540
asm_exc_page_fault+0x1e/0x30 arch/x86/include/asm/idtentry.h:568
RIP: 0033:0x7f146adb0116
Code: Unable to access opcode bytes at RIP 0x7f146adb00ec.
RSP: 002b:00007fffc8fb0460 EFLAGS: 00010293
RAX: 0000000000000001 RBX: 00007f146b282360 RCX: 00007f146adb0116
RDX: 0000000000000014 RSI: 00007f146b288b70 RDI: 0000000000000008
RBP: ffffffffffffffff R08: 0000000000000000 R09: 00007fffc8fe1080
R10: 00000000ffffffff R11: 0000000000000293 R12: 0000000000000001
R13: 0000000000000014 R14: 0000000000000000 R15: 0000000000000000
=============================
[ BUG: Invalid wait context ]
5.16.0-next-20220111 #1 Tainted: G W
-----------------------------
systemd-journal/110 is trying to lock:
ffff88800f9be2f0 (&tsk->futex_exit_mutex){+.+.}-{3:3}, at: futex_cleanup_begin kernel/futex/core.c:1058 [inline]
ffff88800f9be2f0 (&tsk->futex_exit_mutex){+.+.}-{3:3}, at: futex_exit_release+0x2d/0x220 kernel/futex/core.c:1110
other info that might help us debug this:
context-{4:4}
3 locks held by systemd-journal/110:
#0: ffff88800f1067a0 (mapping.invalidate_lock){++++}-{3:3}, at: filemap_invalidate_lock_shared include/linux/fs.h:832 [inline]
#0: ffff88800f1067a0 (mapping.invalidate_lock){++++}-{3:3}, at: filemap_fault+0x151a/0x2130 mm/filemap.c:3126
#1: ffffffff85278828 (oom_lock){+.+.}-{3:3}, at: __alloc_pages_may_oom mm/page_alloc.c:4281 [inline]
#1: ffffffff85278828 (oom_lock){+.+.}-{3:3}, at: __alloc_pages_slowpath.constprop.0+0xcc9/0x1f10 mm/page_alloc.c:5063
#2: ffff88800f9bd8e0 (&p->alloc_lock){+.+.}-{2:2}, at: spin_lock include/linux/spinlock.h:354 [inline]
#2: ffff88800f9bd8e0 (&p->alloc_lock){+.+.}-{2:2}, at: task_lock include/linux/sched/task.h:170 [inline]
#2: ffff88800f9bd8e0 (&p->alloc_lock){+.+.}-{2:2}, at: find_lock_task_mm+0xe3/0x2b0 mm/oom_kill.c:144
stack backtrace:
CPU: 0 PID: 110 Comm: systemd-journal Tainted: G W 5.16.0-next-20220111 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.14.0-0-g155821a1990b-prebuilt.qemu.org 04/01/2014
Call Trace:
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0x8b/0xb3 lib/dump_stack.c:106
print_lock_invalid_wait_context kernel/locking/lockdep.c:4678 [inline]
check_wait_context kernel/locking/lockdep.c:4739 [inline]
__lock_acquire.cold+0xc8/0x3b4 kernel/locking/lockdep.c:4977
lock_acquire kernel/locking/lockdep.c:5639 [inline]
lock_acquire+0x1a2/0x4d0 kernel/locking/lockdep.c:5604
__mutex_lock_common kernel/locking/mutex.c:600 [inline]
__mutex_lock+0x136/0x1480 kernel/locking/mutex.c:733
futex_cleanup_begin kernel/futex/core.c:1058 [inline]
futex_exit_release+0x2d/0x220 kernel/futex/core.c:1110
__oom_kill_process+0x373/0xf90 mm/oom_kill.c:893
oom_kill_process+0xd7/0x5c0 mm/oom_kill.c:1003
out_of_memory+0x1198/0x1460 mm/oom_kill.c:1114
__alloc_pages_may_oom mm/page_alloc.c:4332 [inline]
__alloc_pages_slowpath.constprop.0+0x1972/0x1f10 mm/page_alloc.c:5063
__alloc_pages+0x403/0x4e0 mm/page_alloc.c:5394
alloc_pages+0x1a0/0x2f0 mm/mempolicy.c:2271
filemap_alloc_folio mm/filemap.c:989 [inline]
__filemap_get_folio+0x65c/0xfd0 mm/filemap.c:1992
filemap_fault+0x155a/0x2130 mm/filemap.c:3129
__do_fault+0x113/0x5a0 mm/memory.c:3868
do_read_fault mm/memory.c:4183 [inline]
do_fault mm/memory.c:4312 [inline]
handle_pte_fault mm/memory.c:4570 [inline]
__handle_mm_fault+0x1325/0x3570 mm/memory.c:4705
handle_mm_fault+0x2e6/0xa20 mm/memory.c:4803
do_user_addr_fault+0x54a/0x12a0 arch/x86/mm/fault.c:1397
handle_page_fault arch/x86/mm/fault.c:1484 [inline]
exc_page_fault+0xa2/0x1a0 arch/x86/mm/fault.c:1540
asm_exc_page_fault+0x1e/0x30 arch/x86/include/asm/idtentry.h:568
RIP: 0033:0x7f146adb0116
Code: Unable to access opcode bytes at RIP 0x7f146adb00ec.
RSP: 002b:00007fffc8fb0460 EFLAGS: 00010293
RAX: 0000000000000001 RBX: 00007f146b282360 RCX: 00007f146adb0116
RDX: 0000000000000014 RSI: 00007f146b288b70 RDI: 0000000000000008
RBP: ffffffffffffffff R08: 0000000000000000 R09: 00007fffc8fe1080
R10: 00000000ffffffff R11: 0000000000000293 R12: 0000000000000001
R13: 0000000000000014 R14: 0000000000000000 R15: 0000000000000000
Out of memory (oom_kill_allocating_task): Killed process 110 (systemd-journal) total-vm:31948kB, anon-rss:876kB, file-rss:0kB, shmem-rss:4kB, UID:0 pgtables:68kB oom_score_adj:-250
oom_reaper: reaped process 110 (systemd-journal), now anon-rss:0kB, file-rss:0kB, shmem-rss:4kB
systemd[1]: systemd-journald.service: Main process exited, code=killed, status=9/KILL
systemd[1]: systemd-journald.service: Failed with result 'oom-kill'.
systemd[1]: systemd-journald.service: Consumed 1.656s CPU time.
systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.
systemd[1]: Stopping Flush Journal to Persistent Storage...
systemd[1]: systemd-journal-flush.service: Succeeded.
systemd[1]: Stopped Flush Journal to Persistent Storage.
systemd[1]: Stopped Journal Service.
systemd[1]: systemd-journald.service: Consumed 1.656s CPU time.
systemd[1]: Starting Journal Service...
systemd-journald[48158]: File /var/log/journal/7e681e5076844de4a5cfa8606a84b008/system.journal corrupted or uncleanly shut down, renaming and replacing.
systemd[1]: Started Journal Service.
systemd-journald[48158]: Received client request to flush runtime journal.