Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Worrying kernel memory messages
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Kernel & Hardware
View previous topic :: View next topic  
Author Message
binro
l33t
l33t


Joined: 06 May 2005
Posts: 639
Location: Bangkok, Thailand

PostPosted: Sun May 22, 2016 1:16 pm    Post subject: Worrying kernel memory messages Reply with quote

Every time I do a full backup, or some other CPU intensive task, I get warning messages like:

    May 22 11:18:55 opal kernel python2.7: page allocation failure: order:1, mode:0x204020
    May 22 11:18:55 opal kernel CPU: 1 PID: 23641 Comm: python2.7 Tainted: G W 4.3.3-gentoo
    #1
    May 22 11:18:55 opal kernel Hardware name: Gigabyte Technology Co., Ltd. G41M-Combo/G41M-Combo, BIOS
    FA 02/29/2012
    May 22 11:18:55 opal kernel 0000000000000001 ffff880237c83718 ffffffff812813b8 0000000000000000
    May 22 11:18:55 opal kernel 0000000000204020 ffff880237c837a8 ffffffff810ec830 0000000000000040
    May 22 11:18:55 opal kernel ffffffff817e2778 ffff880237c83768 ffff880237c83860 0000000000000030
    May 22 11:18:55 opal kernel Call Trace:
    May 22 11:18:55 opal kernel <IRQ> [<ffffffff812813b8>] dump_stack+0x4f/0x87
    May 22 11:18:55 opal kernel [<ffffffff810ec830>] warn_alloc_failed+0xe0/0x130
    May 22 11:18:55 opal kernel [<ffffffff810eeff0>] __alloc_pages_nodemask+0x6c0/0x870
    May 22 11:18:55 opal kernel [<ffffffffa0caa506>] ? nf_ct_deliver_cached_events+0xb6/0x100 [nf_co
    nntrack]
    May 22 11:18:55 opal kernel [<ffffffff8112da0b>] cache_alloc_refill+0x30b/0x5c0
    May 22 11:18:55 opal kernel [<ffffffff8112e136>] kmem_cache_alloc+0x136/0x180
    May 22 11:18:55 opal kernel [<ffffffff81424f8f>] sk_prot_alloc+0x3f/0x180
    May 22 11:18:55 opal kernel [<ffffffff81426e7b>] sk_clone_lock+0x1b/0x3a0
    May 22 11:18:55 opal kernel [<ffffffff8147ddf1>] inet_csk_clone_lock+0x11/0x140
    May 22 11:18:55 opal kernel [<ffffffff8149739e>] tcp_create_openreq_child+0x1e/0x480
    May 22 11:18:55 opal kernel [<ffffffff81494c6a>] tcp_v4_syn_recv_sock+0x3a/0x2a0
    May 22 11:18:55 opal kernel [<ffffffffa0da5635>] tcp_v6_syn_recv_sock+0x4c5/0x750 [ipv6]
    May 22 11:18:55 opal kernel [<ffffffff8104eb82>] ? __local_bh_enable_ip+0x42/0xa0
    May 22 11:18:55 opal kernel [<ffffffff81497043>] tcp_check_req+0x183/0x4c0
    May 22 11:18:55 opal kernel [<ffffffff814f0600>] ? ldsem_down_write+0x170/0x1c4
    May 22 11:18:55 opal kernel [<ffffffff81494a74>] tcp_v4_do_rcv+0x1f4/0x3b0
    May 22 11:18:55 opal kernel [<ffffffff81496d62>] tcp_v4_rcv+0x942/0x980
    May 22 11:18:55 opal kernel [<ffffffffa0d56f25>] ? ipv4_confirm+0x75/0xe0 [nf_conntrack_ipv4]
    May 22 11:18:55 opal kernel [<ffffffff81472e53>] ip_local_deliver_finish+0xa3/0x220
    May 22 11:18:55 opal kernel [<ffffffff81473130>] ip_local_deliver+0x40/0xc0
    May 22 11:18:55 opal kernel [<ffffffff81472db0>] ? ip_rcv_finish+0x3d0/0x3d0
    May 22 11:18:55 opal kernel [<ffffffff81472b6e>] ip_rcv_finish+0x18e/0x3d0
    May 22 11:18:55 opal kernel [<ffffffff81473443>] ip_rcv+0x293/0x430
    May 22 11:18:55 opal kernel [<ffffffff814729e0>] ? inet_add_protocol+0x40/0x40
    May 22 11:18:55 opal kernel [<ffffffff8143723b>] __netif_receive_skb_core+0x61b/0x930
    May 22 11:18:55 opal kernel [<ffffffff81080401>] ? autoremove_wake_function+0x11/0x40
    May 22 11:18:55 opal kernel [<ffffffff8107fcef>] ? __wake_up_common+0x4f/0x80
    May 22 11:18:55 opal kernel [<ffffffff8143b59c>] __netif_receive_skb+0x1c/0x70
    May 22 11:18:55 opal kernel [<ffffffff8143b695>] process_backlog+0xa5/0x150
    May 22 11:18:55 opal kernel [<ffffffff8143bb34>] net_rx_action+0x144/0x2c0
    May 22 11:18:55 opal kernel [<ffffffff8104e977>] __do_softirq+0xd7/0x200
    May 22 11:18:55 opal kernel [<ffffffff814f265c>] do_softirq_own_stack+0x1c/0x30
    May 22 11:18:55 opal kernel <EOI> [<ffffffff8104eb39>] do_softirq+0x49/0x50
    May 22 11:18:55 opal kernel [<ffffffff8104ebd5>] __local_bh_enable_ip+0x95/0xa0
    May 22 11:18:55 opal kernel [<ffffffff81477066>] ip_finish_output2+0x1b6/0x350
    May 22 11:18:55 opal kernel [<ffffffff81477e5b>] ip_finish_output+0x11b/0x1c0
    May 22 11:18:55 opal kernel [<ffffffff81478825>] ip_output+0x65/0xc0
    May 22 11:18:55 opal kernel [<ffffffff81477d40>] ? ip_fragment.constprop.40+0xa0/0xa0
    May 22 11:18:55 opal kernel [<ffffffff81477fe5>] ip_local_out_sk+0x35/0x40
    May 22 11:18:55 opal kernel [<ffffffff8147813b>] ip_queue_xmit+0x14b/0x370
    May 22 11:18:55 opal kernel [<ffffffff8148f0dc>] tcp_transmit_skb+0x49c/0x840
    May 22 11:18:55 opal kernel [<ffffffff81490021>] tcp_write_xmit+0x161/0xce0
    May 22 11:18:55 opal kernel [<ffffffff81490c11>] __tcp_push_pending_frames+0x31/0xb0
    May 22 11:18:55 opal kernel [<ffffffff8147f9ac>] tcp_push+0xec/0x120
    May 22 11:18:55 opal kernel [<ffffffff8148300b>] tcp_sendmsg+0xab/0xa90
    May 22 11:18:55 opal kernel [<ffffffff8142ba61>] ? __kfree_skb+0x41/0x90
    May 22 11:18:55 opal kernel [<ffffffff814ab1d4>] inet_sendmsg+0x64/0xc0
    May 22 11:18:55 opal kernel [<ffffffff81421592>] sock_sendmsg+0x42/0x50
    May 22 11:18:55 opal kernel [<ffffffff81422877>] SyS_sendto+0x107/0x160
    May 22 11:18:55 opal kernel [<ffffffff811548a9>] ? poll_select_set_timeout+0x79/0x90
    May 22 11:18:55 opal kernel [<ffffffff81155c46>] ? SyS_poll+0x66/0x100
    May 22 11:18:55 opal kernel [<ffffffff814f0fee>] entry_SYSCALL_64_fastpath+0x12/0x71
    May 22 11:18:55 opal kernel Mem-Info:
    May 22 11:18:55 opal kernel active_anon:701326 inactive_anon:197761 isolated_anon:0
    May 22 11:18:55 opal kernel active_file:496260 inactive_file:505914 isolated_file:0
    May 22 11:18:55 opal kernel unevictable:3744 dirty:3130 writeback:0 unstable:0
    May 22 11:18:55 opal kernel slab_reclaimable:66011 slab_unreclaimable:20176
    May 22 11:18:55 opal kernel mapped:41590 shmem:13506 pagetables:19488 bounce:0
    May 22 11:18:55 opal kernel free:14447 free_pcp:644 free_cma:0
    May 22 11:18:55 opal kernel DMA free:15908kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB
    active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
    present:15992kB managed:15908kB mlocked:0kB dirty:0kB writeback:0kB
    mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB
    pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
    writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
    May 22 11:18:55 opal kernel lowmem_reserve[]: 0 3109 7960 7960
    May 22 11:18:55 opal kernel DMA32 free:28680kB min:4428kB low:5532kB high:6640kB active_anon:1019212kB
    inactive_anon:341680kB active_file:791384kB inactive_file:806172kB unevictable:7380kB
    isolated(anon):0kB isolated(file):0kB present:3259264kB managed:3184988kB
    mlocked:7380kB dirty:5100kB writeback:0kB mapped:61096kB shmem:18004kB slab_reclaimable:100076kB
    slab_unreclaimable:29224kB kernel_stack:3056kB pagetables:33524kB
    unstable:0kB bounce:0kB free_pcp:1160kB local_pcp:632kB free_cma:0kB writeback_tmp:0kB
    pages_scanned:0 all_unreclaimable? no
    May 22 11:18:55 opal kernel lowmem_reserve[]: 0 0 4850 4850
    May 22 11:18:55 opal kernel Normal free:13200kB min:6908kB low:8632kB high:10360kB active_anon:1786092kB
    inactive_anon:449364kB active_file:1193656kB inactive_file:1217484kB unevictable:7596kB
    isolated(anon):0kB isolated(file):0kB present:5111808kB managed:4967308kB
    mlocked:7596kB dirty:7420kB writeback:0kB mapped:105264kB shmem:36020kB
    slab_reclaimable:163968kB slab_unreclaimable:51480kB kernel_stack:5136kB pagetables:44428kB
    unstable:0kB bounce:0kB free_pcp:1416kB local_pcp:672kB free_cma:0kB
    writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
    May 22 11:18:55 opal kernel lowmem_reserve[]: 0 0 0 0
    May 22 11:18:55 opal kernel DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB
    (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
    May 22 11:18:55 opal kernel DMA32: 7170*4kB (UE) 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB
    0*1024kB 0*2048kB 0*4096kB = 28680kB
    May 22 11:18:55 opal kernel Normal: 3300*4kB (UE) 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB
    0*1024kB 0*2048kB 0*4096kB = 13200kB
    May 22 11:18:55 opal kernel Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages
    _size=2048kB
    May 22 11:18:55 opal kernel 1021483 total pagecache pages
    May 22 11:18:55 opal kernel 4344 pages in swap cache
    May 22 11:18:55 opal kernel Swap cache stats: add 665184, delete 660840, find 19069774/19169392
    May 22 11:18:55 opal kernel Free swap = 7291076kB
    May 22 11:18:55 opal kernel Total swap = 8388604kB
    May 22 11:18:55 opal kernel 2096766 pages RAM
    May 22 11:18:55 opal kernel 0 pages HighMem/MovableOnly
    May 22 11:18:55 opal kernel 54715 pages reserved

Does this mean I have run out of memory? Or have bad memory? The messages persisted across a kernel upgrade.

TIA
_________________
"Ship me somewheres east of Suez, where the best is like the worst,
Where there ain't no Ten Commandments an' a man can raise a thirst"
from "Mandalay" by Rudyard Kipling
Back to top
View user's profile Send private message
Keruskerfuerst
Advocate
Advocate


Joined: 01 Feb 2006
Posts: 2288
Location: near Augsburg, Germany

PostPosted: Tue May 24, 2016 2:40 pm    Post subject: Reply with quote

What hardware do you have?
Any additional driver in kernel?

Maybe the CPu does run too hot. Check temperature.

Or one RAM module is defective.
Use memtest.
Back to top
View user's profile Send private message
chithanh
Developer
Developer


Joined: 05 Aug 2006
Posts: 2152
Location: Berlin, Germany

PostPosted: Tue May 24, 2016 3:05 pm    Post subject: Reply with quote

page allocation failure can mean that your memory has become fragmented. You are running amd64, yes?

Try setting an increased value for vm.min_free_kbytes in /etc/sysctl.conf (current value can be discovered with "sysctl vm.min_free_kbytes" command)
see /usr/src/linux/Documentation/sysctl/vm.txt for details.
Back to top
View user's profile Send private message
binro
l33t
l33t


Joined: 06 May 2005
Posts: 639
Location: Bangkok, Thailand

PostPosted: Wed May 25, 2016 11:52 am    Post subject: Reply with quote

sysctl vm.min_free_kbytes shows 11360, which seems quite large. I have set it to 20480 and will see what happens. If nothing, then memtest!

Thanks
_________________
"Ship me somewheres east of Suez, where the best is like the worst,
Where there ain't no Ten Commandments an' a man can raise a thirst"
from "Mandalay" by Rudyard Kipling
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Kernel & Hardware All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum