The kernel version is 2.6.32-358.2.1. This server runs map reduce jobs and is under moderate load. It has an Intel E5-2670 processor @ 2.6GHz and 96GB of RAM. The system is a Dell Poweredge R620.<br />
<br />
<br />
<4>[952066.084197] CPU 19<br />
<4>[952066.108416] Modules linked in: ip6_tables dm_round_robin dm_multipath be2iscsi iscsi_boot_sysfs bnx2i cnic uio cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi kvm_intel kvm fnic libfcoe libfc scsi_transport_fc tun nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 iptable_filter ip_tables bonding ipv6 bridge 8021q garp stp mlx4_en mlx4_core bnx2x(U) mdio bnx2(U) be2net(U) zram(C) lzo_decompress lzo_compress dm_mod usb_storage power_meter hwmon sb_edac edac_core iTCO_wdt iTCO_vendor_support shpchp ixgbe(U) dca [last unloaded: scsi_wait_scan]<br />
<4>[952066.738840]<br />
<4>[952066.778482] Pid: 17687, comm: java Tainted: G C --------------- 2.6.32-358.2.1.el6GUAVUSsmp guavus Dell Inc. PowerEdge R620/0KCKR5<br />
<4>[952066.972480] RIP: 0010:[<ffffffff81313e07>] [<ffffffff81313e07>] __list_add+0x17/0xa0<br />
<4>[952067.106640] RSP: 0000:ffff880fdb273a08 EFLAGS: 00010082<br />
<4>[952067.190482] RAX: ffffea003a50dcb0 RBX: ffffea003a50dcd8 RCX: ffffea003a50dcd8<br />
<4>[952067.315826] RDX: dead000000100100 RSI: ffffea003a50dcd8 RDI: ffffea003a50dcd8<br />
<4>[952067.441128] RBP: ffff880fdb273a28 R08: ffffea003a50dcd8 R09: 000000000000b68d<br />
<4>[952067.566590] R10: 0000000000000000 R11: 0000000000000206 R12: 0000000000000000<br />
<4>[952067.692352] R13: ffff881040010dc0 R14: 0000000000000001 R15: ffffea003a50dcd8<br />
<4>[952067.818144] FS: 00007fd67011a700(0000) GS:ffff881078920000(0000) knlGS:0000000000000000<br />
<4>[952067.956162] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033<br />
<4>[952068.046507] CR2: 00007fd5f5a02978 CR3: 0000000c06e64000 CR4: 00000000000407e0<br />
<4>[952068.175519] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000<br />
<4>[952068.304991] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400<br />
<4>[952068.434982] Process java (pid: 17687, threadinfo ffff880fdb272000, task ffff880c00460aa0)<br />
<4>[952068.579000] Stack:<br />
<4>[952068.626875] 0000000000000000 000000000000001f 0000000000000000 ffff881040010dc0<br />
<4>[952068.737927] <d> ffff880fdb273b48 ffffffff8112ae0e ffffea003a50dcd8 ffffea003a50dcb0<br />
<4>[952068.877761] <d> 0000000100000002 ffff8820296a2bc0 0000000000000010 00000040ffffffff<br />
<4>[952069.042965] Call Trace:<br />
<4>[952069.096189] [<ffffffff8112ae0e>] get_page_from_freelist+0x5ce/0x830<br />
<4>[952069.195777] [<ffffffff8112c473>] __alloc_pages_nodemask+0x113/0x8d0<br />
<4>[952069.295408] [<ffffffff81068695>] ? enqueue_entity+0x125/0x410<br />
<4>[952069.388593] [<ffffffff81059c94>] ? check_preempt_wakeup+0x1a4/0x260<br />
<4>[952069.487912] [<ffffffff81068a7b>] ? enqueue_task_fair+0xfb/0x100<br />
<4>[952069.582796] [<ffffffff81054ccc>] ? check_preempt_curr+0x7c/0x90<br />
<4>[952069.677383] [<ffffffff8116120a>] alloc_pages_current+0xaa/0x110<br />
<4>[952069.771540] [<ffffffff8104b1db>] pte_alloc_one+0x1b/0x50<br />
<4>[952069.858063] [<ffffffff8113fdf2>] __pte_alloc+0x32/0x160<br />
<4>[952069.943121] [<ffffffff8114888f>] ? vma_adjust+0x11f/0x5e0<br />
<4>[952070.029898] [<ffffffff8117bec7>] do_huge_pmd_anonymous_page+0x2f7/0x380<br />
<4>[952070.131087] [<ffffffff81144cf0>] handle_mm_fault+0x280/0x310<br />
<4>[952070.220505] [<ffffffff81046c19>] __do_page_fault+0x139/0x480<br />
<4>[952070.309565] [<ffffffff816e371e>] do_page_fault+0x3e/0xa0<br />
<4>[952070.393924] [<ffffffff816e0ad5>] page_fault+0x25/0x30<br />
<4>[952070.474784] Code: ff 48 8b 03 eb 92 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 48 83 ec 20 48 89 5d e8 4c 89 65 f0 48 89 fb 4c 89 6d f8 <4c> 8b 42 08 49 89 f5 49 89 d4 49 39 f0 75 27 4d 8b 45 00 4d 39<br />
<1>[952070.775818] RIP [<ffffffff81313e07>] __list_add+0x17/0xa0<br />
<4>[952070.862306] RSP <ffff880fdb273a08>
↧