dmesg - gcrypt
Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-279.19.1.el6.x86_64 ([email protected]) (gcc version 4.4.6 20120305 (Red Hat 4.4.6-4) (GCC) ) #1 SMP Wed Dec 19 07:05:20 UTC 2012
Command line: ro root=/dev/mapper/vg00-root rd_NO_LUKS rd_LVM_LV=vg00/swap LANG=en_US.UTF-8 rd_LVM_LV=vg00/root rd_NO_MD SYSFONT=latarcyrheb-sun16 KEYBOARDTYPE=pc KEYTABLE=fr-latin1 crashkernel=auto rd_NO_DM consoleblank=0 nomodeset console=tty0 console=ttyS0
KERNEL supported cpus:
Intel GenuineIntel
AMD AuthenticAMD
Centaur CentaurHauls
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 000000003fff0000 (usable)
BIOS-e820: 000000003fff0000 - 000000003ffff000 (ACPI data)
BIOS-e820: 000000003ffff000 - 0000000040000000 (ACPI NVS)
BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
DMI 2.3 present.
SMBIOS version 2.3 @ 0xF52F0
DMI: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090004 03/19/2009
AMI BIOS detected: BIOS may corrupt low RAM, working around it.
e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved)
e820 update range: 0000000000000000 - 0000000000001000 (usable) ==> (reserved)
e820 remove range: 00000000000a0000 - 0000000000100000 (usable)
last_pfn = 0x3fff0 max_arch_pfn = 0x400000000
MTRR default type: uncachable
MTRR fixed ranges enabled:
00000-9FFFF write-back
A0000-DFFFF uncachable
E0000-FFFFF write-back
MTRR variable ranges enabled:
0 base 0000000000 mask 3F80000000 write-back
1 disabled
2 disabled
3 disabled
4 disabled
5 disabled
6 disabled
7 disabled
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
initial memory mapped : 0 - 20000000
init_memory_mapping: 0000000000000000-000000003fff0000
0000000000 - 003fe00000 page 2M
003fe00000 - 003fff0000 page 4k
kernel direct mapping tables up to 3fff0000 @ 10000-13000
RAMDISK: 3721c000 - 37fef3ab
ACPI: RSDP 00000000000f5210 00014 (v00 ACPIAM)
ACPI: RSDT 000000003fff0000 00040 (v01 VRTUAL MICROSFT 03000919 MSFT 00000097)
ACPI: FACP 000000003fff0200 00081 (v02 VRTUAL MICROSFT 03000919 MSFT 00000097)
ACPI: DSDT 000000003fff0da4 0217C (v01 MSFTVM MSFTVM02 00000002 INTL 02002026)
ACPI: FACS 000000003ffff000 00040
ACPI: WAET 000000003fff0b00 00028 (v01 VRTUAL MICROSFT 03000919 MSFT 00000097)
ACPI: SLIC 000000003fff0b40 00176 (v01 VRTUAL MICROSFT 03000919 MSFT 00000097)
ACPI: OEM0 000000003fff0d40 00064 (v01 VRTUAL MICROSFT 03000919 MSFT 00000097)
ACPI: SRAT 000000003fff0600 004C0 (v02 VRTUAL MICROSFT 03000919 MSFT 00000097)
ACPI: APIC 000000003fff0300 00244 (v01 VRTUAL MICROSFT 03000919 MSFT 00000097)
ACPI: OEMB 000000003ffff240 00053 (v01 VRTUAL MICROSFT 03000919 MSFT 00000097)
ACPI: Local APIC address 0xfee00000
SRAT: PXM 1 -> APIC 0 -> Node 0
SRAT: Node 0 PXM 1 0-40000000
SRAT: Node 0 PXM 1 40000000-40400000
SRAT: hot plug zone found 40000000 - 40400000
NUMA: Using 30 for the hash shift.
Bootmem setup node 0 0000000000000000-000000003fff0000
NODE_DATA [0000000000011000 - 0000000000044fff]
bootmap [0000000000045000 - 000000000004cfff] pages 8
(7 early reservations) ==> bootmem [0000000000 - 003fff0000]
#0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
#1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
#2 [0001000000 - 0002010024] TEXT DATA BSS ==> [0001000000 - 0002010024]
#3 [003721c000 - 0037fef3ab] RAMDISK ==> [003721c000 - 0037fef3ab]
#4 [000009fc00 - 0000100000] BIOS reserved ==> [000009fc00 - 0000100000]
#5 [0002011000 - 0002011297] BRK ==> [0002011000 - 0002011297]
#6 [0000010000 - 0000011000] PGTABLE ==> [0000010000 - 0000011000]
found SMP MP-table at [ffff8800000ff780] ff780
[ffffea0000000000-ffffea0000dfffff] PMD -> [ffff880002600000-ffff8800033fffff] on node 0
Zone PFN ranges:
DMA 0x00000010 -> 0x00001000
DMA32 0x00001000 -> 0x00100000
Normal 0x00100000 -> 0x00100000
Movable zone start PFN for each node
early_node_map[2] active PFN ranges
0: 0x00000010 -> 0x0000009f
0: 0x00000100 -> 0x0003fff0
On node 0 totalpages: 262015
DMA zone: 56 pages used for memmap
DMA zone: 100 pages reserved
DMA zone: 3827 pages, LIFO batch:0
DMA32 zone: 3528 pages used for memmap
DMA32 zone: 254504 pages, LIFO batch:31
ACPI: PM-Timer IO Port: 0x408
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] disabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] disabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] disabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x04] disabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x05] disabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x06] disabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x07] disabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x08] disabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x09] disabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0a] disabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0b] disabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x0c] disabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x0d] disabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x0e] disabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x0f] disabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x10] disabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x11] disabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x12] disabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x13] disabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x14] disabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x15] disabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x16] disabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x17] disabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x18] disabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x19] disabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x1a] disabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x1b] disabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x1c] disabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x1d] disabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x1e] disabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0x1f] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0x20] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0x21] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0x22] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0x23] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0x24] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0x25] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0x26] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0x27] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0x28] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0x29] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0x2a] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0x2b] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0x2c] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0x2d] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0x2e] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0x2f] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0x30] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0x31] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0x32] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0x33] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0x34] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0x35] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0x36] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0x37] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0x38] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x39] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x3a] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x3b] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x3c] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0x3d] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0x3e] disabled)
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ9 used by override.
Using ACPI (MADT) for SMP configuration information
SMP: Allowing 63 CPUs, 62 hotplug CPUs
nr_irqs_gsi: 24
PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
Allocating PCI resources starting at 40000000 (gap: 40000000:bffc0000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:63 nr_cpu_ids:63 nr_node_ids:1
PERCPU: Embedded 31 pages/cpu @ffff880003400000 s94424 r8192 d24360 u131072
pcpu-alloc: s94424 r8192 d24360 u131072 alloc=1*2097152
pcpu-alloc: [0] 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15
pcpu-alloc: [0] 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
pcpu-alloc: [0] 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47
pcpu-alloc: [0] 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 --
Built 1 zonelists in Node order, mobility grouping on. Total pages: 258331
Policy zone: DMA32
Kernel command line: ro root=/dev/mapper/vg00-root rd_NO_LUKS rd_LVM_LV=vg00/swap LANG=en_US.UTF-8 rd_LVM_LV=vg00/root rd_NO_MD SYSFONT=latarcyrheb-sun16 KEYBOARDTYPE=pc KEYTABLE=fr-latin1 rd_NO_DM consoleblank=0 nomodeset console=tty0 console=ttyS0
PID hash table entries: 4096 (order: 3, 32768 bytes)
Checking aperture...
No AGP bridge found
Memory: 994780k/1048512k available (5072k kernel code, 452k absent, 53280k reserved, 7246k data, 1252k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:912
Console: colour VGA+ 80x25
console [tty0] enabled
console [ttyS0] enabled
allocated 8388608 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
Fast TSC calibration failed
TSC: Unable to calibrate against PIT
TSC: using PMTIMER reference calibration
Detected 2333.348 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 4666.69 BogoMIPS (lpj=2333348)
pid_max: default: 64512 minimum: 504
Security Framework initialized
SELinux: Initializing.
SELinux: Starting in permissive mode
Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 0 MCE banks
alternatives: switching to unfair spinlock
SMP alternatives: switching to UP code
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 20987 entries in 83 pages
Setting APIC routing to physical flat
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5345 @ 2.33GHz stepping 0b
APIC calibration not consistent with PM-Timer: 72ms instead of 100ms
APIC delta adjusted to PM-Timer: 1249953 (911326)
Performance Events: unsupported p6 CPU model 15 no PMU driver, software events only.
NMI watchdog disabled (cpu0): hardware events not enabled
Brought up 1 CPUs
Total of 1 processors activated (4666.69 BogoMIPS).
sizeof(vma)=200 bytes
sizeof(page)=56 bytes
sizeof(inode)=592 bytes
sizeof(dentry)=192 bytes
sizeof(ext3inode)=800 bytes
sizeof(buffer_head)=104 bytes
sizeof(skbuff)=232 bytes
sizeof(task_struct)=2648 bytes
devtmpfs: initialized
PM: Registering ACPI NVS region at 3ffff000 (4096 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using configuration type 1 for base access
bio: create slab at 0
ACPI: EC: Look up EC in DSDT
ACPI: Interpreter enabled
ACPI: (supports S0 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table not found.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
pci_root PNP0A03:00: host bridge window [io 0x0000-0x0cf7]
pci_root PNP0A03:00: host bridge window [io 0x0d00-0xffff]
pci_root PNP0A03:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A03:00: host bridge window [mem 0xf8000000-0xfffbffff]
pci 0000:00:07.1: reg 20: [io 0xffa0-0xffaf]
* Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
* this clock source is slow. Consider trying other clock sources
pci 0000:00:07.3: quirk: [io 0x0400-0x043f] claimed by PIIX4 ACPI
pci 0000:00:08.0: reg 10: [mem 0xf8000000-0xfbffffff]
pci 0000:00:0a.0: reg 10: [io 0xec00-0xec7f]
pci 0000:00:0a.0: reg 14: [mem 0xfebff000-0xfebfffff]
pci 0000:00:0a.0: reg 30: [mem 0xfebe0000-0xfebeffff pref]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
vgaarb: device added: PCI:0000:00:08.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:00:08.0
SCSI subsystem initialized
libata version 3.00 loaded.
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
PCI: old code would have set cacheline size to 32 bytes, but clflush_size = 64
PCI: pci_cache_line_size set to 64 bytes
NetLabel: Initializing
NetLabel: domain hash size = 128
NetLabel: protocols = UNLABELED CIPSOv4
NetLabel: unlabeled traffic allowed by default
Switching to clocksource jiffies
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp 00:00: [io 0x0cf8-0x0cff]
pnp 00:00: Plug and Play ACPI device, IDs PNP0a03 (active)
pnp 00:01: [dma 4]
pnp 00:01: [io 0x0000-0x000f]
pnp 00:01: [io 0x0081-0x0083]
pnp 00:01: [io 0x0087]
pnp 00:01: [io 0x0089-0x008b]
pnp 00:01: [io 0x008f]
pnp 00:01: [io 0x00c0-0x00df]
pnp 00:01: Plug and Play ACPI device, IDs PNP0200 (active)
pnp 00:02: [io 0x0070-0x0071]
pnp 00:02: [irq 8]
pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
pnp 00:03: [io 0x0060]
pnp 00:03: [io 0x0064]
pnp 00:03: [irq 1]
pnp 00:03: Plug and Play ACPI device, IDs PNP0303 PNP030b (active)
pnp 00:04: [irq 12]
pnp 00:04: Plug and Play ACPI device, IDs PNP0f03 PNP0f13 (active)
pnp 00:05: [io 0x0061]
pnp 00:05: Plug and Play ACPI device, IDs PNP0800 (active)
pnp 00:06: [io 0x00f0-0x00ff]
pnp 00:06: [irq 13]
pnp 00:06: Plug and Play ACPI device, IDs PNP0c04 (active)
pnp 00:07: [irq 4]
pnp 00:07: [dma 0 disabled]
pnp 00:07: [io 0x03f8-0x03ff]
pnp 00:07: Plug and Play ACPI device, IDs PNP0501 (active)
pnp 00:08: [irq 3]
pnp 00:08: [dma 0 disabled]
pnp 00:08: [io 0x02f8-0x02ff]
pnp 00:08: Plug and Play ACPI device, IDs PNP0501 (active)
pnp 00:09: [irq 6]
pnp 00:09: [dma 2]
pnp 00:09: [io 0x03f0-0x03f5]
pnp 00:09: [io 0x03f7]
pnp 00:09: Plug and Play ACPI device, IDs PNP0700 (active)
pnp 00:0a: [io 0x0010-0x001f]
pnp 00:0a: [io 0x0022-0x003f]
pnp 00:0a: [io 0x0044-0x005f]
pnp 00:0a: [io 0x0062-0x0063]
pnp 00:0a: [io 0x0065-0x006f]
pnp 00:0a: [io 0x0072-0x007f]
pnp 00:0a: [io 0x0080]
pnp 00:0a: [io 0x0084-0x0086]
pnp 00:0a: [io 0x0088]
pnp 00:0a: [io 0x008c-0x008e]
pnp 00:0a: [io 0x0090-0x009f]
pnp 00:0a: [io 0x00a2-0x00bf]
pnp 00:0a: [io 0x00e0-0x00ef]
pnp 00:0a: [io 0x01e0-0x01ef]
pnp 00:0a: [io 0x0160-0x016f]
pnp 00:0a: [io 0x0278-0x027f]
pnp 00:0a: [io 0x0378-0x037f]
pnp 00:0a: [io 0x0678-0x067f]
pnp 00:0a: [io 0x0778-0x077f]
pnp 00:0a: [io 0x04d0-0x04d1]
pnp 00:0a: Plug and Play ACPI device, IDs PNP0c02 (active)
pnp 00:0b: [io 0x0400-0x043f]
pnp 00:0b: [io 0x0370-0x0371]
pnp 00:0b: [io 0x0000-0xffffffffffffffff disabled]
pnp 00:0b: [io 0x0440-0x044f]
pnp 00:0b: [mem 0xfec00000-0xfec00fff]
pnp 00:0b: [mem 0xfee00000-0xfee00fff]
pnp 00:0b: Plug and Play ACPI device, IDs PNP0c02 (active)
pnp 00:0c: [mem 0x00000000-0x0009ffff]
pnp 00:0c: [mem 0x000c0000-0x000dffff]
pnp 00:0c: [mem 0x000e0000-0x000fffff]
pnp 00:0c: [mem 0x00100000-0xf7ffffff]
pnp 00:0c: [mem 0xfffc0000-0xffffffff]
pnp 00:0c: Plug and Play ACPI device, IDs PNP0c01 (active)
pnp: PnP ACPI: found 13 devices
ACPI: ACPI bus type pnp unregistered
system 00:0a: [io 0x01e0-0x01ef] has been reserved
system 00:0a: [io 0x0160-0x016f] has been reserved
system 00:0a: [io 0x0278-0x027f] has been reserved
system 00:0a: [io 0x0378-0x037f] has been reserved
system 00:0a: [io 0x0678-0x067f] has been reserved
system 00:0a: [io 0x0778-0x077f] has been reserved
system 00:0a: [io 0x04d0-0x04d1] has been reserved
system 00:0b: [io 0x0400-0x043f] has been reserved
system 00:0b: [io 0x0370-0x0371] has been reserved
system 00:0b: [io 0x0440-0x044f] has been reserved
system 00:0b: [mem 0xfec00000-0xfec00fff] could not be reserved
system 00:0b: [mem 0xfee00000-0xfee00fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009ffff] could not be reserved
system 00:0c: [mem 0x000c0000-0x000dffff] could not be reserved
system 00:0c: [mem 0x000e0000-0x000fffff] could not be reserved
system 00:0c: [mem 0x00100000-0xf7ffffff] could not be reserved
system 00:0c: [mem 0xfffc0000-0xffffffff] has been reserved
Switching to clocksource acpi_pm
PCI: max bus depth: 0 pci_try_num: 1
pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7]
pci_bus 0000:00: resource 5 [io 0x0d00-0xffff]
pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: resource 7 [mem 0xf8000000-0xfffbffff]
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 6, 262144 bytes)
TCP established hash table entries: 131072 (order: 9, 2097152 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:00.0: Limiting direct PCI/PCI transfers
pci 0000:00:08.0: Boot video device
Trying to unpack rootfs image as initramfs...
Freeing initrd memory: 14156k freed
audit: initializing netlink socket (disabled)
type=2000 audit(1361466650.022:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 1970
SELinux: Registering netfilter hooks
alg: No test for stdrng (krng)
ksign: Installing public key data
Loading keyring
- Added public key 822A73AE165296BF
- User ID: CentOS (Kernel Module GPG key)
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
ACPI: acpi_idle registered with cpuidle
ERST: Table is not found!
GHES: HEST is not enabled!
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Refined TSC clocksource calibration: 2333.332 MHz.
00:07: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Switching to clocksource tsc
00:08: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mice: PS/2 mouse device common for all mice
rtc_cmos 00:02: RTC can wake from S4
rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2
rtc0: alarms up to one month, 114 bytes nvram
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:02: setting system clock to 2013-02-21 17:10:55 UTC (1361466655)
Initalizing network drop monitor service
Freeing unused kernel memory: 1252k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 1052k freed
Freeing unused kernel memory: 1732k freed
trackpoint.c: failed to get extended button data
dracut: dracut-004-284.el6_3.1
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.22.6-ioctl (2011-10-19) initialised: [email protected]
udev: starting version 147
dracut: Starting plymouth daemon
ata_piix 0000:00:07.1: version 2.13
ata_piix 0000:00:07.1: setting latency timer to 64
scsi0 : ata_piix
scsi1 : ata_piix
ata1: PATA max UDMA/33 cmd 0x1f0 ctl 0x3f6 bmdma 0xffa0 irq 14
ata2: PATA max UDMA/33 cmd 0x170 ctl 0x376 bmdma 0xffa8 irq 15
ata2.00: ATAPI: Virtual CD, , max MWDMA2
ata1.00: ATA-0: Virtual HD, 1.1.0, max MWDMA2
ata1.00: 31456656 sectors, multi 128: LBA
ata2.00: configured for MWDMA2
ata1.00: configured for MWDMA2
ata1.00: configured for MWDMA2
ata1: EH complete
scsi 0:0:0:0: Direct-Access ATA Virtual HD 1.1. PQ: 0 ANSI: 5
scsi 1:0:0:0: CD-ROM Msft Virtual CD/ROM 1.0 PQ: 0 ANSI: 5
sr0: scsi3-mmc drive: 0x/0x tray
Uniform CD-ROM driver Revision: 3.20
sr 1:0:0:0: Attached scsi CD-ROM sr0
sd 0:0:0:0: [sda] 31456656 512-byte logical blocks: (16.1 GB/14.9 GiB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
sda: sda1 sda2
sd 0:0:0:0: [sda] Attached SCSI disk
hv_vmbus: Hyper-V Host OS Build:7601-6.1-17-0.17514
hv_vmbus: child device vmbus_0_1 registered
hv_vmbus: child device vmbus_0_2 registered
hv_vmbus: child device vmbus_0_3 registered
hv_vmbus: child device vmbus_0_4 registered
hv_vmbus: child device vmbus_0_5 registered
hv_vmbus: child device vmbus_0_6 registered
hv_vmbus: child device vmbus_0_7 registered
hv_vmbus: child device vmbus_0_8 registered
hv_vmbus: child device vmbus_0_9 registered
hv_vmbus: child device vmbus_0_10 registered
IBM TrackPoint firmware: 0x01, buttons: 0/0
input: TPPS/2 IBM TrackPoint as /devices/platform/i8042/serio1/input/input3
hv_vmbus: registering driver hv_storvsc
scsi2 : storvsc_host_t
scsi 2:0:0:0: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 4
sd 2:0:0:0: [sdb] 31457280 512-byte logical blocks: (16.1 GB/15.0 GiB)
sd 2:0:0:0: [sdb] Write Protect is off
sd 2:0:0:0: [sdb] Mode Sense: 0f 00 10 00
scsi3 : storvsc_host_t
sd 2:0:0:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
scsi scan: INQUIRY result too short (5), using 36
scsi scan: INQUIRY result too short (5), using 36
sdb: sdb1 sdb2
sd 2:0:0:0: [sdb] Attached SCSI disk
dracut: Scanning devices sda2 sdb2 for LVM logical volumes vg00/swap vg00/root
dracut: Found duplicate PV 2Uuwxy6UmWkSnVqyYO5n4f3MoTLpNLTH: using /dev/sdb2 not /dev/sda2
dracut: inactive '/dev/vg00/root' [1.00 GiB] inherit
dracut: inactive '/dev/vg00/swap' [1.00 GiB] inherit
dracut: inactive '/dev/vg00/usr' [5.00 GiB] inherit
dracut: inactive '/dev/vg00/var' [2.00 GiB] inherit
dracut: inactive '/dev/vg00/log' [1.00 GiB] inherit
dracut: inactive '/dev/vg00/tmp' [2.00 GiB] inherit
dracut: inactive '/dev/vg00/home' [1.00 GiB] inherit
dracut: inactive '/dev/vg00/rpm' [1.00 GiB] inherit
dracut: inactive '/dev/vg00/MIDDLE' [224.00 MiB] inherit
dracut: inactive '/dev/vg00/WEBS' [224.00 MiB] inherit
dracut: inactive '/dev/vg00/WEBLOGS' [64.00 MiB] inherit
dracut: inactive '/dev/vg00/MIDDLELOGS' [64.00 MiB] inherit
dracut: Found duplicate PV 2Uuwxy6UmWkSnVqyYO5n4f3MoTLpNLTH: using /dev/sdb2 not /dev/sda2
kjournald starting. Commit interval 5 seconds
EXT3-fs (dm-0): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/mapper/vg00-root
SELinux: Disabled at runtime.
SELinux: Unregistering netfilter hooks
type=1404 audit(1361466672.644:2): selinux=0 auid=4294967295 ses=4294967295
dracut:
dracut: Switching root
udev: starting version 147
sd 0:0:0:0: Attached scsi generic sg0 type 0
sr 1:0:0:0: Attached scsi generic sg1 type 5
sd 2:0:0:0: Attached scsi generic sg2 type 0
piix4_smbus 0000:00:07.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
hv_timesource: Registering HyperV clock source
Switching to clocksource hyperv_clocksource
Linux Tulip driver version 1.1.15 (Feb 27, 2007)
ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 9
tulip 0000:00:0a.0: PCI INT A -> Link[LNKA] -> GSI 9 (level, low) -> IRQ 9
tulip0: EEPROM default media type 100baseTx-FDX.
tulip0: Index #0 - Media 100baseTx (#3) described by a 21140 non-MII (0) block.
tulip0: Index #1 - Media 100baseTx-FDX (#5) described by a 21140 non-MII (0) block.
eth0: Digital DS21140 Tulip rev 32 at MMIO 0xfebff000, 00:15:5d:47:08:17, IRQ 9.
udev: renamed network interface eth0 to eth1
hv_vmbus: registering driver hv_netvsc
eth0: Dropping NETIF_F_SG since no checksum feature.
hv_netvsc: hv_netvsc channel opened successfully
hv_netvsc vmbus_0_10: Device MAC 00:15:5d:47:08:15 link state up
hv_vmbus: registering driver hid_hyperv
input: Microsoft Vmbus HID-compliant Mouse as /devices/virtual/input/input4
hid 0006:045E:0621.0001: input: HID v0.01 Mouse [Microsoft Vmbus HID-compliant Mouse] on
hv_utils: Registering HyperV Utility Driver
hv_vmbus: registering driver hv_util
EXT3-fs (dm-0): using internal journal
kjournald starting. Commit interval 5 seconds
EXT3-fs (dm-6): using internal journal
EXT3-fs (dm-6): mounted filesystem with ordered data mode
kjournald starting. Commit interval 5 seconds
EXT3-fs (dm-5): using internal journal
EXT3-fs (dm-5): mounted filesystem with ordered data mode
kjournald starting. Commit interval 5 seconds
EXT3-fs (dm-2): using internal journal
EXT3-fs (dm-2): mounted filesystem with ordered data mode
kjournald starting. Commit interval 5 seconds
EXT3-fs (dm-3): using internal journal
EXT3-fs (dm-3): mounted filesystem with ordered data mode
kjournald starting. Commit interval 5 seconds
EXT3-fs (dm-7): using internal journal
EXT3-fs (dm-7): mounted filesystem with ordered data mode
kjournald starting. Commit interval 5 seconds
EXT3-fs (dm-4): using internal journal
EXT3-fs (dm-4): mounted filesystem with ordered data mode
EXT4-fs (dm-9): mounted filesystem with ordered data mode. Opts:
EXT4-fs (dm-10): mounted filesystem with ordered data mode. Opts:
EXT4-fs (dm-8): mounted filesystem with ordered data mode. Opts:
EXT4-fs (dm-11): mounted filesystem with ordered data mode. Opts:
Adding 1048568k swap on /dev/mapper/vg00-swap. Priority:-1 extents:1 across:1048568k
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
eth1: Using EEPROM-set media 100baseTx-FDX.
RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Installing knfsd (copyright (C) 1996 [email protected]).
NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
hv_utils: KVP: user-mode registering done.
nfsd: nfsv4 idmapping failing: has idmapd not been started?
eth0: no IPv6 routers present
eth1: no IPv6 routers present
nfsd: nfsv4 idmapping failing: has idmapd not been started?
------------[ cut here ]------------
WARNING: at kernel/softirq.c:159 local_bh_enable+0x7d/0xb0() (Not tainted)
Hardware name: Virtual Machine
Modules linked in: nfsd lockd nfs_acl auth_rpcgss sunrpc exportfs ipv6 ext4 jbd2 ext2 hv_utils(U) hid_hyperv(U) hv_netvsc(U) tulip hv_timesource(U) i2c_piix4 i2c_core sg ext3 jbd mbcache hv_storvsc(U) hv_vmbus(U) sd_mod crc_t10dif sr_mod cdrom pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
Pid: 0, comm: swapper Not tainted 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? warn_slowpath_common+0x87/0xc0
[] ? warn_slowpath_null+0x1a/0x20
[] ? local_bh_enable+0x7d/0xb0
[] ? netvsc_linkstatus_callback+0xb3/0x180 [hv_netvsc]
[] ? rndis_filter_receive+0x188/0x910 [hv_netvsc]
[] ? hv_ringbuffer_read+0xc7/0x100 [hv_vmbus]
[] ? vmbus_recvpacket_raw+0x7e/0xb0 [hv_vmbus]
[] ? netvsc_channel_cb+0x3ab/0x710 [hv_netvsc]
[] ? ret_from_intr+0x0/0x11
[] ? vmbus_on_event+0xa9/0x110 [hv_vmbus]
[] ? tasklet_action+0xe5/0x120
[] ? __do_softirq+0xc1/0x1e0
[] ? hrtimer_interrupt+0x140/0x250
[] ? call_softirq+0x1c/0x30
[] ? do_softirq+0x65/0xa0
[] ? irq_exit+0x85/0x90
[] ? smp_apic_timer_interrupt+0x70/0x9b
[] ? apic_timer_interrupt+0x13/0x20
[] ? native_safe_halt+0xb/0x10
[] ? default_idle+0x4d/0xb0
[] ? cpu_idle+0xb6/0x110
[] ? rest_init+0x7a/0x80
[] ? start_kernel+0x424/0x430
[] ? x86_64_start_reservations+0x125/0x129
[] ? x86_64_start_kernel+0xfa/0x109
---[ end trace df969b95a14733ee ]---
hv_vmbus: child device vmbus_0_8 unregistered
beam.smp invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
beam.smp cpuset=/ mems_allowed=0
Pid: 2884, comm: beam.smp Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0xe1/0x120
[] ? select_bad_process+0x1/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? handle_pte_fault+0x76b/0xb50
[] ? thread_return+0x4e/0x76e
[] ? handle_mm_fault+0x23a/0x310
[] ? __get_user_pages+0x12a/0x430
[] ? ____pagevec_lru_add+0x167/0x180
[] ? __mlock_vma_pages_range+0xa0/0x1f0
[] ? vma_adjust+0x128/0x590
[] ? mlock_vma_pages_range+0x98/0xa0
[] ? mmap_region+0x302/0x590
[] ? do_mmap_pgoff+0x33a/0x380
[] ? sys_mmap_pgoff+0x7a/0x2d0
[] ? sys_mmap+0x29/0x30
[] ? system_call_fastpath+0x16/0x1b
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
active_anon:0 inactive_anon:0 isolated_anon:0
active_file:39 inactive_file:0 isolated_file:0
unevictable:220160 dirty:3 writeback:0 unstable:0
free:12247 slab_reclaimable:4015 slab_unreclaimable:7540
mapped:10155 shmem:0 pagetables:1861 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:0kB unevictable:11044kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:16kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44348kB min:44388kB low:55484kB high:66580kB active_anon:0kB inactive_anon:0kB active_file:152kB inactive_file:0kB unevictable:869596kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:530316kB dirty:12kB writeback:0kB mapped:40620kB shmem:0kB slab_reclaimable:16044kB slab_unreclaimable:30160kB kernel_stack:2632kB pagetables:7444kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:268 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 6*4kB 5*8kB 6*16kB 2*32kB 3*64kB 3*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 4640kB
Node 0 DMA32: 1437*4kB 987*8kB 499*16kB 216*32kB 87*64kB 42*128kB 5*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 44348kB
10193 total pagecache pages
0 pages in swap cache
Swap cache stats: add 161744, delete 161744, find 60487/76670
Free swap = 987836kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
57026 pages shared
226204 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 64 0 -17 -1000 udevd
0 720 2691 59 0 -17 -1000 udevd
0 726 2691 56 0 -17 -1000 udevd
0 1177 123341 176 0 0 0 rsyslogd
32 1204 4743 117 0 0 0 rpcbind
81 1214 5350 84 0 0 0 dbus-daemon
0 1226 47289 209 0 0 0 cupsd
0 1282 5443 138 0 0 0 rpc.mountd
0 1317 1741 149 0 0 0 hv_kvp_daemon
38 1337 7540 211 0 0 0 ntpd
0 1413 19671 232 0 0 0 master
89 1420 19734 235 0 0 0 qmgr
0 1423 29309 133 0 0 0 crond
0 1437 17706 85 0 0 0 squid
0 1440 18419 400 0 0 0 squid
23 1441 5020 213 0 0 0 unlinkd
0 1452 5363 70 0 0 0 atd
0 1557 7516 187 0 0 0 watchdot
0 1566 1015 126 0 0 0 mingetty
0 1568 1018 133 0 0 0 agetty
0 1569 1015 126 0 0 0 mingetty
0 11045 10283 194 0 0 0 stunnel
0 11046 10283 18 0 0 0 stunnel
0 11047 10283 18 0 0 0 stunnel
0 11048 10283 18 0 0 0 stunnel
0 11049 10283 18 0 0 0 stunnel
0 11050 10283 18 0 0 0 stunnel
0 44606 12718 122 0 0 0 httpd.worker
48 44608 213471 162 0 0 0 httpd.worker
48 44609 213471 162 0 0 0 httpd.worker
48 44610 213471 162 0 0 0 httpd.worker
0 60209 16018 74 0 0 0 sshd
0 20329 34524 144 0 0 0 scheduler
207 1856 2706 100 0 0 0 epmd
207 1864 270294 124402 0 0 0 beam.smp
207 1888 26516 172 0 0 0 sh
207 1889 1013 120 0 0 0 memsup
207 1890 1012 87 0 0 0 cpu_sup
207 1892 9752 169 0 0 0 ssl_esock
207 1899 2697 106 0 0 0 inet_gethost
207 1900 2697 76 0 0 0 inet_gethost
0 1970 22758 267 0 0 0 sshd
0 1972 27167 203 0 0 0 bash
0 2449 5716 1530 0 0 0 atop
0 2547 35030 163 0 0 0 crond
0 2552 1029 150 0 0 0 sadc
89 2659 19700 286 0 0 0 pickup
207 2727 189420 44746 0 0 0 beam.smp
207 2751 26516 172 0 0 0 sh
207 2752 1013 118 0 0 0 memsup
207 2753 1012 87 0 0 0 cpu_sup
207 2777 9752 405 0 0 0 ssl_esock
207 2795 189714 45040 0 0 0 beam.smp
207 2819 26516 172 0 0 0 sh
207 2820 1013 118 0 0 0 memsup
207 2821 1012 87 0 0 0 cpu_sup
207 2857 9752 405 0 0 0 ssl_esock
207 2863 179098 34416 0 0 0 beam.smp
207 2887 26516 172 0 0 0 sh
207 2888 1013 118 0 0 0 memsup
207 2889 1012 87 0 0 0 cpu_sup
207 2892 9752 405 0 0 0 ssl_esock
Out of memory: Kill process 1864 (beam.smp) score 241 or sacrifice child
Killed process 1888, UID 207, (sh) total-vm:106064kB, anon-rss:0kB, file-rss:688kB
squid invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
squid cpuset=/ mems_allowed=0
Pid: 1440, comm: squid Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0xe1/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_current+0xaa/0x110
[] ? __page_cache_alloc+0x87/0x90
[] ? __do_page_cache_readahead+0xdb/0x210
[] ? ra_submit+0x21/0x30
[] ? filemap_fault+0x4c3/0x500
[] ? __do_fault+0x54/0x510
[] ? handle_pte_fault+0xf7/0xb50
[] ? handle_mm_fault+0x23a/0x310
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 40
active_anon:1 inactive_anon:81 isolated_anon:0
active_file:46 inactive_file:261 isolated_file:0
unevictable:219780 dirty:0 writeback:0 unstable:0
free:12247 slab_reclaimable:4002 slab_unreclaimable:7533
mapped:10178 shmem:0 pagetables:1852 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:4kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:11044kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:16kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2 all_unreclaimable? no
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44348kB min:44388kB low:55484kB high:66580kB active_anon:0kB inactive_anon:324kB active_file:184kB inactive_file:1044kB unevictable:868076kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:528772kB dirty:0kB writeback:0kB mapped:40712kB shmem:0kB slab_reclaimable:15992kB slab_unreclaimable:30132kB kernel_stack:2632kB pagetables:7408kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:399 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 6*4kB 5*8kB 6*16kB 2*32kB 3*64kB 3*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 4640kB
Node 0 DMA32: 1449*4kB 989*8kB 499*16kB 216*32kB 88*64kB 41*128kB 5*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 44348kB
10533 total pagecache pages
73 pages in swap cache
Swap cache stats: add 161842, delete 161769, find 60523/76727
Free swap = 988108kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
56902 pages shared
226146 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 64 0 -17 -1000 udevd
0 720 2691 59 0 -17 -1000 udevd
0 726 2691 56 0 -17 -1000 udevd
0 1177 123341 185 0 0 0 rsyslogd
32 1204 4743 117 0 0 0 rpcbind
81 1214 5350 84 0 0 0 dbus-daemon
0 1226 47289 209 0 0 0 cupsd
0 1282 5443 138 0 0 0 rpc.mountd
0 1317 1741 149 0 0 0 hv_kvp_daemon
38 1337 7540 211 0 0 0 ntpd
0 1413 19671 232 0 0 0 master
89 1420 19734 235 0 0 0 qmgr
0 1423 29309 133 0 0 0 crond
0 1437 17706 85 0 0 0 squid
0 1440 18419 412 0 0 0 squid
23 1441 5020 213 0 0 0 unlinkd
0 1452 5363 70 0 0 0 atd
0 1557 7516 215 0 0 0 watchdot
0 1566 1015 126 0 0 0 mingetty
0 1568 1018 133 0 0 0 agetty
0 1569 1015 126 0 0 0 mingetty
0 11045 10283 194 0 0 0 stunnel
0 11046 10283 18 0 0 0 stunnel
0 11047 10283 18 0 0 0 stunnel
0 11048 10283 18 0 0 0 stunnel
0 11049 10283 18 0 0 0 stunnel
0 11050 10283 18 0 0 0 stunnel
0 44606 12718 122 0 0 0 httpd.worker
48 44608 213471 162 0 0 0 httpd.worker
48 44609 213471 162 0 0 0 httpd.worker
48 44610 213471 162 0 0 0 httpd.worker
0 60209 16018 74 0 0 0 sshd
0 20329 34524 144 0 0 0 scheduler
207 1856 2706 100 0 0 0 epmd
207 1864 270294 124404 0 0 0 beam.smp
207 1889 1013 120 0 0 0 memsup
207 1890 1012 87 0 0 0 cpu_sup
207 1892 9752 169 0 0 0 ssl_esock
207 1899 2697 106 0 0 0 inet_gethost
207 1900 2697 76 0 0 0 inet_gethost
0 1970 22758 267 0 0 0 sshd
0 1972 27167 203 0 0 0 bash
0 2449 5716 1530 0 0 0 atop
0 2547 35030 163 0 0 0 crond
0 2552 1029 150 0 0 0 sadc
89 2659 19700 286 0 0 0 pickup
207 2727 189035 44361 0 0 0 beam.smp
207 2751 26516 172 0 0 0 sh
207 2752 1013 118 0 0 0 memsup
207 2753 1012 87 0 0 0 cpu_sup
207 2777 9752 405 0 0 0 ssl_esock
207 2795 189714 45040 0 0 0 beam.smp
207 2819 26516 172 0 0 0 sh
207 2820 1013 118 0 0 0 memsup
207 2821 1012 87 0 0 0 cpu_sup
207 2857 9752 405 0 0 0 ssl_esock
207 2863 179098 34424 0 0 0 beam.smp
207 2887 26516 172 0 0 0 sh
207 2888 1013 118 0 0 0 memsup
207 2889 1012 87 0 0 0 cpu_sup
207 2892 9752 414 0 0 0 ssl_esock
207 2895 270294 124404 0 0 0 beam.smp
Out of memory: Kill process 1864 (beam.smp) score 241 or sacrifice child
Killed process 1889, UID 207, (memsup) total-vm:4052kB, anon-rss:0kB, file-rss:480kB
beam.smp invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
beam.smp cpuset=/ mems_allowed=0
Pid: 2884, comm: beam.smp Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0xe1/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? handle_pte_fault+0x76b/0xb50
[] ? thread_return+0x4e/0x76e
[] ? do_huge_pmd_anonymous_page+0xb9/0x380
[] ? handle_mm_fault+0x23a/0x310
[] ? __get_user_pages+0x12a/0x430
[] ? __wake_up+0x53/0x70
[] ? __mlock_vma_pages_range+0xa0/0x1f0
[] ? vma_adjust+0x128/0x590
[] ? mlock_vma_pages_range+0x98/0xa0
[] ? mmap_region+0x302/0x590
[] ? do_mmap_pgoff+0x33a/0x380
[] ? sys_mmap_pgoff+0x7a/0x2d0
[] ? sys_mmap+0x29/0x30
[] ? system_call_fastpath+0x16/0x1b
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
active_anon:1 inactive_anon:12 isolated_anon:0
active_file:13 inactive_file:65 isolated_file:0
unevictable:220137 dirty:0 writeback:0 unstable:0
free:12236 slab_reclaimable:4002 slab_unreclaimable:7533
mapped:10152 shmem:0 pagetables:1852 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:4kB inactive_anon:12kB active_file:0kB inactive_file:0kB unevictable:11032kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:16kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3 all_unreclaimable? no
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44304kB min:44388kB low:55484kB high:66580kB active_anon:0kB inactive_anon:36kB active_file:52kB inactive_file:260kB unevictable:869516kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:530228kB dirty:0kB writeback:0kB mapped:40608kB shmem:0kB slab_reclaimable:15992kB slab_unreclaimable:30132kB kernel_stack:2632kB pagetables:7408kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:96 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 7*4kB 5*8kB 6*16kB 2*32kB 3*64kB 3*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 4644kB
Node 0 DMA32: 1446*4kB 989*8kB 499*16kB 217*32kB 87*64kB 41*128kB 5*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 44304kB
10251 total pagecache pages
13 pages in swap cache
Swap cache stats: add 162094, delete 162081, find 60622/76886
Free swap = 988064kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
56808 pages shared
226193 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 64 0 -17 -1000 udevd
0 720 2691 59 0 -17 -1000 udevd
0 726 2691 56 0 -17 -1000 udevd
0 1177 123341 176 0 0 0 rsyslogd
32 1204 4743 117 0 0 0 rpcbind
81 1214 5350 84 0 0 0 dbus-daemon
0 1226 47289 209 0 0 0 cupsd
0 1282 5443 138 0 0 0 rpc.mountd
0 1317 1741 149 0 0 0 hv_kvp_daemon
38 1337 7540 211 0 0 0 ntpd
0 1413 19671 232 0 0 0 master
89 1420 19734 235 0 0 0 qmgr
0 1423 29309 133 0 0 0 crond
0 1437 17706 85 0 0 0 squid
0 1440 18419 403 0 0 0 squid
23 1441 5020 213 0 0 0 unlinkd
0 1452 5363 70 0 0 0 atd
0 1557 7516 187 0 0 0 watchdot
0 1566 1015 126 0 0 0 mingetty
0 1568 1018 133 0 0 0 agetty
0 1569 1015 126 0 0 0 mingetty
0 11045 10283 194 0 0 0 stunnel
0 11046 10283 18 0 0 0 stunnel
0 11047 10283 18 0 0 0 stunnel
0 11048 10283 18 0 0 0 stunnel
0 11049 10283 18 0 0 0 stunnel
0 11050 10283 18 0 0 0 stunnel
0 44606 12718 122 0 0 0 httpd.worker
48 44608 213471 162 0 0 0 httpd.worker
48 44609 213471 162 0 0 0 httpd.worker
48 44610 213471 162 0 0 0 httpd.worker
0 60209 16018 74 0 0 0 sshd
0 20329 34524 144 0 0 0 scheduler
207 1856 2706 100 0 0 0 epmd
207 1864 270441 124549 0 0 0 beam.smp
207 1890 1012 87 0 0 0 cpu_sup
207 1892 9752 169 0 0 0 ssl_esock
207 1899 2697 106 0 0 0 inet_gethost
207 1900 2697 76 0 0 0 inet_gethost
0 1970 22758 267 0 0 0 sshd
0 1972 27167 203 0 0 0 bash
0 2449 5716 1530 0 0 0 atop
0 2547 35030 163 0 0 0 crond
0 2552 1029 150 0 0 0 sadc
89 2659 19700 286 0 0 0 pickup
207 2727 189238 44564 0 0 0 beam.smp
207 2751 26516 172 0 0 0 sh
207 2752 1013 118 0 0 0 memsup
207 2753 1012 87 0 0 0 cpu_sup
207 2777 9752 405 0 0 0 ssl_esock
207 2795 189476 44802 0 0 0 beam.smp
207 2819 26516 172 0 0 0 sh
207 2820 1013 118 0 0 0 memsup
207 2821 1012 87 0 0 0 cpu_sup
207 2857 9752 405 0 0 0 ssl_esock
207 2863 180617 34664 0 0 0 beam.smp
207 2887 26516 172 0 0 0 sh
207 2888 1013 118 0 0 0 memsup
207 2889 1012 87 0 0 0 cpu_sup
207 2892 9752 405 0 0 0 ssl_esock
207 2895 72 29 0 0 0 child_setup
207 2896 72 27 0 0 0 child_setup
Out of memory: Kill process 1864 (beam.smp) score 242 or sacrifice child
Killed process 1890, UID 207, (cpu_sup) total-vm:4048kB, anon-rss:0kB, file-rss:348kB
beam.smp invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
beam.smp cpuset=/ mems_allowed=0
Pid: 2884, comm: beam.smp Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0xe1/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? handle_pte_fault+0x76b/0xb50
[] ? thread_return+0x4e/0x76e
[] ? do_huge_pmd_anonymous_page+0xb9/0x380
[] ? handle_mm_fault+0x23a/0x310
[] ? __get_user_pages+0x12a/0x430
[] ? __wake_up+0x53/0x70
[] ? __mlock_vma_pages_range+0xa0/0x1f0
[] ? vma_adjust+0x128/0x590
[] ? mlock_vma_pages_range+0x98/0xa0
[] ? mmap_region+0x302/0x590
[] ? do_mmap_pgoff+0x33a/0x380
[] ? sys_mmap_pgoff+0x7a/0x2d0
[] ? sys_mmap+0x29/0x30
[] ? system_call_fastpath+0x16/0x1b
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 80
active_anon:4 inactive_anon:5 isolated_anon:0
active_file:29 inactive_file:2 isolated_file:32
unevictable:220140 dirty:0 writeback:1 unstable:0
free:12236 slab_reclaimable:4002 slab_unreclaimable:7533
mapped:10154 shmem:0 pagetables:1854 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:0kB inactive_anon:12kB active_file:0kB inactive_file:4kB unevictable:11032kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:4kB mapped:0kB shmem:0kB slab_reclaimable:16kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:30 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44304kB min:44388kB low:55484kB high:66580kB active_anon:16kB inactive_anon:8kB active_file:116kB inactive_file:4kB unevictable:869528kB isolated(anon):0kB isolated(file):128kB present:1018016kB mlocked:530224kB dirty:0kB writeback:0kB mapped:40616kB shmem:0kB slab_reclaimable:15992kB slab_unreclaimable:30132kB kernel_stack:2632kB pagetables:7416kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:312 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 6*4kB 5*8kB 6*16kB 2*32kB 3*64kB 3*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 4640kB
Node 0 DMA32: 1446*4kB 990*8kB 499*16kB 217*32kB 87*64kB 41*128kB 5*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 44312kB
10210 total pagecache pages
7 pages in swap cache
Swap cache stats: add 162099, delete 162092, find 60624/76894
Free swap = 988140kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
56725 pages shared
226141 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 64 0 -17 -1000 udevd
0 720 2691 59 0 -17 -1000 udevd
0 726 2691 56 0 -17 -1000 udevd
0 1177 123341 176 0 0 0 rsyslogd
32 1204 4743 117 0 0 0 rpcbind
81 1214 5350 84 0 0 0 dbus-daemon
0 1226 47289 209 0 0 0 cupsd
0 1282 5443 138 0 0 0 rpc.mountd
0 1317 1741 149 0 0 0 hv_kvp_daemon
38 1337 7540 211 0 0 0 ntpd
0 1413 19671 232 0 0 0 master
89 1420 19734 235 0 0 0 qmgr
0 1423 29309 133 0 0 0 crond
0 1437 17706 85 0 0 0 squid
0 1440 18419 401 0 0 0 squid
23 1441 5020 213 0 0 0 unlinkd
0 1452 5363 70 0 0 0 atd
0 1557 7516 187 0 0 0 watchdot
0 1566 1015 126 0 0 0 mingetty
0 1568 1018 133 0 0 0 agetty
0 1569 1015 126 0 0 0 mingetty
0 11045 10283 194 0 0 0 stunnel
0 11046 10283 18 0 0 0 stunnel
0 11047 10283 18 0 0 0 stunnel
0 11048 10283 18 0 0 0 stunnel
0 11049 10283 18 0 0 0 stunnel
0 11050 10283 18 0 0 0 stunnel
0 44606 12718 121 0 0 0 httpd.worker
48 44608 213471 162 0 0 0 httpd.worker
48 44609 213471 162 0 0 0 httpd.worker
48 44610 213471 162 0 0 0 httpd.worker
0 60209 16018 74 0 0 0 sshd
0 20329 34524 144 0 0 0 scheduler
207 1856 2706 100 0 0 0 epmd
207 1864 270441 124549 0 0 0 beam.smp
207 1892 9752 169 0 0 0 ssl_esock
207 1899 2697 106 0 0 0 inet_gethost
207 1900 2697 76 0 0 0 inet_gethost
0 1970 22758 267 0 0 0 sshd
0 1972 27167 203 0 0 0 bash
0 2449 5716 1530 0 0 0 atop
0 2547 35030 163 0 0 0 crond
0 2552 1029 150 0 0 0 sadc
89 2659 19700 286 0 0 0 pickup
207 2727 189238 44564 0 0 0 beam.smp
207 2751 26516 172 0 0 0 sh
207 2752 1013 118 0 0 0 memsup
207 2753 1012 87 0 0 0 cpu_sup
207 2777 9752 405 0 0 0 ssl_esock
207 2795 189476 44802 0 0 0 beam.smp
207 2819 26516 172 0 0 0 sh
207 2820 1013 118 0 0 0 memsup
207 2821 1012 87 0 0 0 cpu_sup
207 2857 9752 405 0 0 0 ssl_esock
207 2863 180617 34664 0 0 0 beam.smp
207 2887 26516 172 0 0 0 sh
207 2888 1013 118 0 0 0 memsup
207 2889 1012 87 0 0 0 cpu_sup
207 2892 9752 405 0 0 0 ssl_esock
207 2895 72 26 0 0 0 child_setup
207 2896 72 26 0 0 0 child_setup
Out of memory: Kill process 1864 (beam.smp) score 242 or sacrifice child
Killed process 1892, UID 207, (ssl_esock) total-vm:39008kB, anon-rss:0kB, file-rss:676kB
beam.smp invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
beam.smp cpuset=/ mems_allowed=0
Pid: 2884, comm: beam.smp Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0xe1/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? handle_pte_fault+0x76b/0xb50
[] ? pte_alloc_one+0x37/0x50
[] ? do_huge_pmd_anonymous_page+0xb9/0x380
[] ? handle_mm_fault+0x23a/0x310
[] ? __get_user_pages+0x12a/0x430
[] ? __wake_up+0x53/0x70
[] ? __mlock_vma_pages_range+0xa0/0x1f0
[] ? vma_adjust+0x128/0x590
[] ? mlock_vma_pages_range+0x98/0xa0
[] ? mmap_region+0x302/0x590
[] ? do_mmap_pgoff+0x33a/0x380
[] ? sys_mmap_pgoff+0x7a/0x2d0
[] ? sys_mmap+0x29/0x30
[] ? system_call_fastpath+0x16/0x1b
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
active_anon:4 inactive_anon:21 isolated_anon:0
active_file:17 inactive_file:32 isolated_file:32
unevictable:220113 dirty:0 writeback:1 unstable:0
free:12259 slab_reclaimable:4002 slab_unreclaimable:7533
mapped:10154 shmem:0 pagetables:1828 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:0kB inactive_anon:12kB active_file:0kB inactive_file:4kB unevictable:11032kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:4kB mapped:0kB shmem:0kB slab_reclaimable:16kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:30 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44396kB min:44388kB low:55484kB high:66580kB active_anon:16kB inactive_anon:72kB active_file:68kB inactive_file:124kB unevictable:869420kB isolated(anon):0kB isolated(file):128kB present:1018016kB mlocked:530120kB dirty:0kB writeback:0kB mapped:40616kB shmem:0kB slab_reclaimable:15992kB slab_unreclaimable:30132kB kernel_stack:2632kB pagetables:7312kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:69 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 6*4kB 5*8kB 6*16kB 2*32kB 3*64kB 3*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 4640kB
Node 0 DMA32: 1459*4kB 1004*8kB 500*16kB 216*32kB 88*64kB 40*128kB 5*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 44396kB
10262 total pagecache pages
30 pages in swap cache
Swap cache stats: add 162244, delete 162214, find 60668/76970
Free swap = 988660kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
56567 pages shared
226162 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 64 0 -17 -1000 udevd
0 720 2691 59 0 -17 -1000 udevd
0 726 2691 56 0 -17 -1000 udevd
0 1177 123341 176 0 0 0 rsyslogd
32 1204 4743 117 0 0 0 rpcbind
81 1214 5350 84 0 0 0 dbus-daemon
0 1226 47289 209 0 0 0 cupsd
0 1282 5443 138 0 0 0 rpc.mountd
0 1317 1741 149 0 0 0 hv_kvp_daemon
38 1337 7540 211 0 0 0 ntpd
0 1413 19671 232 0 0 0 master
89 1420 19734 235 0 0 0 qmgr
0 1423 29309 133 0 0 0 crond
0 1437 17706 85 0 0 0 squid
0 1440 18419 403 0 0 0 squid
23 1441 5020 213 0 0 0 unlinkd
0 1452 5363 70 0 0 0 atd
0 1557 7516 189 0 0 0 watchdot
0 1566 1015 126 0 0 0 mingetty
0 1568 1018 133 0 0 0 agetty
0 1569 1015 126 0 0 0 mingetty
0 11045 10283 194 0 0 0 stunnel
0 11046 10283 18 0 0 0 stunnel
0 11047 10283 18 0 0 0 stunnel
0 11048 10283 18 0 0 0 stunnel
0 11049 10283 18 0 0 0 stunnel
0 11050 10283 18 0 0 0 stunnel
0 44606 12718 123 0 0 0 httpd.worker
48 44608 213471 162 0 0 0 httpd.worker
48 44609 213471 162 0 0 0 httpd.worker
48 44610 213471 162 0 0 0 httpd.worker
0 60209 16018 74 0 0 0 sshd
0 20329 34524 144 0 0 0 scheduler
207 1856 2706 100 0 0 0 epmd
207 1864 269853 123961 0 0 0 beam.smp
207 1899 2697 106 0 0 0 inet_gethost
207 1900 2697 76 0 0 0 inet_gethost
0 1970 22758 267 0 0 0 sshd
0 1972 27167 203 0 0 0 bash
0 2449 5716 1530 0 0 0 atop
0 2547 35030 163 0 0 0 crond
0 2552 1029 150 0 0 0 sadc
89 2659 19700 286 0 0 0 pickup
207 2727 189238 44564 0 0 0 beam.smp
207 2751 26516 172 0 0 0 sh
207 2752 1013 118 0 0 0 memsup
207 2753 1012 87 0 0 0 cpu_sup
207 2777 9752 405 0 0 0 ssl_esock
207 2795 189238 44564 0 0 0 beam.smp
207 2819 26516 172 0 0 0 sh
207 2820 1013 118 0 0 0 memsup
207 2821 1012 87 0 0 0 cpu_sup
207 2857 9752 405 0 0 0 ssl_esock
207 2863 180617 35470 0 0 0 beam.smp
207 2887 26516 172 0 0 0 sh
207 2888 1013 118 0 0 0 memsup
207 2889 1012 87 0 0 0 cpu_sup
207 2892 9752 407 0 0 0 ssl_esock
207 2895 72 26 0 0 0 child_setup
207 2896 72 26 0 0 0 child_setup
Out of memory: Kill process 1864 (beam.smp) score 241 or sacrifice child
Killed process 1899, UID 207, (inet_gethost) total-vm:10788kB, anon-rss:0kB, file-rss:424kB
inet_gethost invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
inet_gethost cpuset=/ mems_allowed=0
Pid: 1900, comm: inet_gethost Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0xe1/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_current+0xaa/0x110
[] ? __page_cache_alloc+0x87/0x90
[] ? __do_page_cache_readahead+0xdb/0x210
[] ? ra_submit+0x21/0x30
[] ? ondemand_readahead+0x115/0x240
[] ? sync_page_killable+0x0/0x40
[] ? page_cache_sync_readahead+0x33/0x50
[] ? filemap_fault+0x4f1/0x500
[] ? __wait_on_bit+0x7e/0x90
[] ? __do_fault+0x54/0x510
[] ? mem_cgroup_uncharge_swap+0x27/0x90
[] ? handle_pte_fault+0xf7/0xb50
[] ? autoremove_wake_function+0x0/0x40
[] ? mutex_lock+0x1e/0x50
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? security_file_permission+0x16/0x20
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
active_anon:0 inactive_anon:12 isolated_anon:0
active_file:1 inactive_file:39 isolated_file:32
unevictable:220156 dirty:0 writeback:1 unstable:0
free:12240 slab_reclaimable:3997 slab_unreclaimable:7533
mapped:10153 shmem:0 pagetables:1819 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:0kB inactive_anon:12kB active_file:4kB inactive_file:0kB unevictable:11032kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:16kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:30 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44320kB min:44388kB low:55484kB high:66580kB active_anon:0kB inactive_anon:36kB active_file:0kB inactive_file:156kB unevictable:869592kB isolated(anon):0kB isolated(file):128kB present:1018016kB mlocked:530300kB dirty:0kB writeback:4kB mapped:40612kB shmem:0kB slab_reclaimable:15972kB slab_unreclaimable:30132kB kernel_stack:2616kB pagetables:7276kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 6*4kB 5*8kB 6*16kB 2*32kB 3*64kB 3*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 4640kB
Node 0 DMA32: 1476*4kB 1005*8kB 499*16kB 216*32kB 88*64kB 39*128kB 5*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 44328kB
10229 total pagecache pages
17 pages in swap cache
Swap cache stats: add 162270, delete 162253, find 60675/76985
Free swap = 988692kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
56453 pages shared
226186 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 64 0 -17 -1000 udevd
0 720 2691 59 0 -17 -1000 udevd
0 726 2691 56 0 -17 -1000 udevd
0 1177 123341 176 0 0 0 rsyslogd
32 1204 4743 117 0 0 0 rpcbind
81 1214 5350 84 0 0 0 dbus-daemon
0 1226 47289 209 0 0 0 cupsd
0 1282 5443 138 0 0 0 rpc.mountd
0 1317 1741 149 0 0 0 hv_kvp_daemon
38 1337 7540 211 0 0 0 ntpd
0 1413 19671 232 0 0 0 master
89 1420 19734 235 0 0 0 qmgr
0 1423 29309 133 0 0 0 crond
0 1437 17706 85 0 0 0 squid
0 1440 18419 403 0 0 0 squid
23 1441 5020 213 0 0 0 unlinkd
0 1452 5363 70 0 0 0 atd
0 1557 7516 189 0 0 0 watchdot
0 1566 1015 126 0 0 0 mingetty
0 1568 1018 133 0 0 0 agetty
0 1569 1015 126 0 0 0 mingetty
0 11045 10283 194 0 0 0 stunnel
0 11046 10283 18 0 0 0 stunnel
0 11047 10283 18 0 0 0 stunnel
0 11048 10283 18 0 0 0 stunnel
0 11049 10283 18 0 0 0 stunnel
0 11050 10283 18 0 0 0 stunnel
0 44606 12718 123 0 0 0 httpd.worker
48 44608 213471 162 0 0 0 httpd.worker
48 44609 213471 162 0 0 0 httpd.worker
48 44610 213471 162 0 0 0 httpd.worker
0 60209 16018 74 0 0 0 sshd
0 20329 34524 144 0 0 0 scheduler
207 1856 2706 100 0 0 0 epmd
207 1864 269853 123961 0 0 0 beam.smp
207 1900 2697 77 0 0 0 inet_gethost
0 1970 22758 267 0 0 0 sshd
0 1972 27167 203 0 0 0 bash
0 2449 5716 1530 0 0 0 atop
0 2547 35030 163 0 0 0 crond
0 2552 1029 150 0 0 0 sadc
89 2659 19700 286 0 0 0 pickup
207 2727 189238 44564 0 0 0 beam.smp
207 2751 26516 172 0 0 0 sh
207 2752 1013 118 0 0 0 memsup
207 2753 1012 87 0 0 0 cpu_sup
207 2777 9752 405 0 0 0 ssl_esock
207 2795 189238 44564 0 0 0 beam.smp
207 2819 26516 172 0 0 0 sh
207 2820 1013 118 0 0 0 memsup
207 2821 1012 87 0 0 0 cpu_sup
207 2857 9752 405 0 0 0 ssl_esock
207 2863 180617 35514 0 0 0 beam.smp
207 2887 26516 172 0 0 0 sh
207 2888 1013 118 0 0 0 memsup
207 2889 1012 87 0 0 0 cpu_sup
207 2892 9752 405 0 0 0 ssl_esock
207 2895 72 27 0 0 0 child_setup
207 2896 72 26 0 0 0 child_setup
207 2897 269853 123961 0 0 0 beam.smp
Out of memory: Kill process 1864 (beam.smp) score 241 or sacrifice child
Killed process 2895, UID 207, (child_setup) total-vm:288kB, anon-rss:4kB, file-rss:104kB
beam.smp invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
beam.smp cpuset=/ mems_allowed=0
Pid: 2748, comm: beam.smp Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0xe1/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? next_zones_zonelist+0x9/0x60
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? handle_pte_fault+0x76b/0xb50
[] ? thread_return+0x4e/0x76e
[] ? handle_mm_fault+0x23a/0x310
[] ? __get_user_pages+0x12a/0x430
[] ? __mlock_vma_pages_range+0xa0/0x1f0
[] ? vma_adjust+0x128/0x590
[] ? vma_merge+0x1d2/0x3e0
[] ? mlock_vma_pages_range+0x98/0xa0
[] ? mmap_region+0x302/0x590
[] ? do_mmap_pgoff+0x33a/0x380
[] ? sys_mmap_pgoff+0x7a/0x2d0
[] ? math_state_restore+0x45/0x60
[] ? sys_mmap+0x29/0x30
[] ? system_call_fastpath+0x16/0x1b
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 51
active_anon:0 inactive_anon:3 isolated_anon:0
active_file:34 inactive_file:29 isolated_file:32
unevictable:220156 dirty:0 writeback:1 unstable:0
free:12241 slab_reclaimable:3997 slab_unreclaimable:7533
mapped:10153 shmem:0 pagetables:1819 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:0kB inactive_anon:12kB active_file:4kB inactive_file:0kB unevictable:11032kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:16kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:30 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44324kB min:44388kB low:55484kB high:66580kB active_anon:0kB inactive_anon:0kB active_file:132kB inactive_file:116kB unevictable:869592kB isolated(anon):0kB isolated(file):128kB present:1018016kB mlocked:530300kB dirty:0kB writeback:4kB mapped:40612kB shmem:0kB slab_reclaimable:15972kB slab_unreclaimable:30132kB kernel_stack:2616kB pagetables:7276kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:448 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 6*4kB 5*8kB 6*16kB 2*32kB 3*64kB 3*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 4640kB
Node 0 DMA32: 1475*4kB 1005*8kB 499*16kB 216*32kB 88*64kB 39*128kB 5*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 44324kB
10242 total pagecache pages
8 pages in swap cache
Swap cache stats: add 162270, delete 162262, find 60678/76990
Free swap = 988732kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
56418 pages shared
226175 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 64 0 -17 -1000 udevd
0 720 2691 59 0 -17 -1000 udevd
0 726 2691 56 0 -17 -1000 udevd
0 1177 123341 177 0 0 0 rsyslogd
32 1204 4743 117 0 0 0 rpcbind
81 1214 5350 84 0 0 0 dbus-daemon
0 1226 47289 209 0 0 0 cupsd
0 1282 5443 138 0 0 0 rpc.mountd
0 1317 1741 149 0 0 0 hv_kvp_daemon
38 1337 7540 211 0 0 0 ntpd
0 1413 19671 232 0 0 0 master
89 1420 19734 235 0 0 0 qmgr
0 1423 29309 133 0 0 0 crond
0 1437 17706 85 0 0 0 squid
0 1440 18419 404 0 0 0 squid
23 1441 5020 213 0 0 0 unlinkd
0 1452 5363 70 0 0 0 atd
0 1557 7516 189 0 0 0 watchdot
0 1566 1015 126 0 0 0 mingetty
0 1568 1018 133 0 0 0 agetty
0 1569 1015 126 0 0 0 mingetty
0 11045 10283 194 0 0 0 stunnel
0 11046 10283 18 0 0 0 stunnel
0 11047 10283 18 0 0 0 stunnel
0 11048 10283 18 0 0 0 stunnel
0 11049 10283 18 0 0 0 stunnel
0 11050 10283 18 0 0 0 stunnel
0 44606 12718 124 0 0 0 httpd.worker
48 44608 213471 162 0 0 0 httpd.worker
48 44609 213471 162 0 0 0 httpd.worker
48 44610 213471 162 0 0 0 httpd.worker
0 60209 16018 74 0 0 0 sshd
0 20329 34524 144 0 0 0 scheduler
207 1856 2706 100 0 0 0 epmd
207 1864 269853 123961 0 0 0 beam.smp
207 1900 2697 77 0 0 0 inet_gethost
0 1970 22758 267 0 0 0 sshd
0 1972 27167 203 0 0 0 bash
0 2449 5716 1530 0 0 0 atop
0 2547 35030 163 0 0 0 crond
0 2552 1029 150 0 0 0 sadc
89 2659 19700 286 0 0 0 pickup
207 2727 189476 44564 0 0 0 beam.smp
207 2751 26516 172 0 0 0 sh
207 2752 1013 118 0 0 0 memsup
207 2753 1012 87 0 0 0 cpu_sup
207 2777 9752 405 0 0 0 ssl_esock
207 2795 189238 44564 0 0 0 beam.smp
207 2819 26516 172 0 0 0 sh
207 2820 1013 118 0 0 0 memsup
207 2821 1012 87 0 0 0 cpu_sup
207 2857 9752 405 0 0 0 ssl_esock
207 2863 180617 35514 0 0 0 beam.smp
207 2887 26516 172 0 0 0 sh
207 2888 1013 118 0 0 0 memsup
207 2889 1012 87 0 0 0 cpu_sup
207 2892 9752 405 0 0 0 ssl_esock
207 2896 72 27 0 0 0 child_setup
207 2897 269853 123961 0 0 0 beam.smp
Out of memory: Kill process 1864 (beam.smp) score 241 or sacrifice child
Killed process 2896, UID 207, (child_setup) total-vm:288kB, anon-rss:4kB, file-rss:104kB
ssl_esock invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
ssl_esock cpuset=/ mems_allowed=0
Pid: 2857, comm: ssl_esock Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0xe1/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_current+0xaa/0x110
[] ? __page_cache_alloc+0x87/0x90
[] ? do_sys_poll+0x349/0x520
[] ? __do_page_cache_readahead+0xdb/0x210
[] ? ra_submit+0x21/0x30
[] ? filemap_fault+0x4c3/0x500
[] ? __do_fault+0x54/0x510
[] ? mem_cgroup_uncharge_swap+0x27/0x90
[] ? handle_pte_fault+0xf7/0xb50
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? __switch_to+0x1ac/0x320
[] ? read_hv_clock+0x1b/0x20 [hv_timesource]
[] ? ktime_get_ts+0xa9/0xe0
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 34
active_anon:6 inactive_anon:12 isolated_anon:0
active_file:13 inactive_file:33 isolated_file:0
unevictable:220218 dirty:1 writeback:0 unstable:0
free:12256 slab_reclaimable:3997 slab_unreclaimable:7533
mapped:10154 shmem:0 pagetables:1818 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:0kB inactive_anon:12kB active_file:4kB inactive_file:0kB unevictable:11032kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:16kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:30 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44384kB min:44388kB low:55484kB high:66580kB active_anon:24kB inactive_anon:36kB active_file:48kB inactive_file:132kB unevictable:869840kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:530528kB dirty:4kB writeback:0kB mapped:40616kB shmem:0kB slab_reclaimable:15972kB slab_unreclaimable:30132kB kernel_stack:2616kB pagetables:7272kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:245 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 6*4kB 5*8kB 6*16kB 2*32kB 3*64kB 3*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 4640kB
Node 0 DMA32: 1498*4kB 1007*8kB 500*16kB 216*32kB 87*64kB 39*128kB 5*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 44384kB
10207 total pagecache pages
11 pages in swap cache
Swap cache stats: add 162285, delete 162274, find 60682/76998
Free swap = 988756kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
56382 pages shared
226185 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 64 0 -17 -1000 udevd
0 720 2691 59 0 -17 -1000 udevd
0 726 2691 56 0 -17 -1000 udevd
0 1177 123341 176 0 0 0 rsyslogd
32 1204 4743 117 0 0 0 rpcbind
81 1214 5350 84 0 0 0 dbus-daemon
0 1226 47289 209 0 0 0 cupsd
0 1282 5443 138 0 0 0 rpc.mountd
0 1317 1741 149 0 0 0 hv_kvp_daemon
38 1337 7540 211 0 0 0 ntpd
0 1413 19671 232 0 0 0 master
89 1420 19734 235 0 0 0 qmgr
0 1423 29309 133 0 0 0 crond
0 1437 17706 85 0 0 0 squid
0 1440 18419 400 0 0 0 squid
23 1441 5020 213 0 0 0 unlinkd
0 1452 5363 70 0 0 0 atd
0 1557 7516 188 0 0 0 watchdot
0 1566 1015 126 0 0 0 mingetty
0 1568 1018 133 0 0 0 agetty
0 1569 1015 126 0 0 0 mingetty
0 11045 10283 194 0 0 0 stunnel
0 11046 10283 18 0 0 0 stunnel
0 11047 10283 18 0 0 0 stunnel
0 11048 10283 18 0 0 0 stunnel
0 11049 10283 18 0 0 0 stunnel
0 11050 10283 18 0 0 0 stunnel
0 44606 12718 122 0 0 0 httpd.worker
48 44608 213471 162 0 0 0 httpd.worker
48 44609 213471 162 0 0 0 httpd.worker
48 44610 213471 162 0 0 0 httpd.worker
0 60209 16018 74 0 0 0 sshd
0 20329 34524 144 0 0 0 scheduler
207 1856 2706 100 0 0 0 epmd
207 1864 269853 123961 0 0 0 beam.smp
207 1900 2697 76 0 0 0 inet_gethost
0 1970 22758 267 0 0 0 sshd
0 1972 27167 203 0 0 0 bash
0 2449 5716 1530 0 0 0 atop
0 2547 35030 163 0 0 0 crond
0 2552 1029 150 0 0 0 sadc
89 2659 19700 286 0 0 0 pickup
207 2727 189476 44623 0 0 0 beam.smp
207 2751 26516 172 0 0 0 sh
207 2752 1013 118 0 0 0 memsup
207 2753 1012 87 0 0 0 cpu_sup
207 2777 9752 406 0 0 0 ssl_esock
207 2795 189238 44564 0 0 0 beam.smp
207 2819 26516 172 0 0 0 sh
207 2820 1013 118 0 0 0 memsup
207 2821 1012 87 0 0 0 cpu_sup
207 2857 9752 407 0 0 0 ssl_esock
207 2863 180617 35514 0 0 0 beam.smp
207 2887 26516 172 0 0 0 sh
207 2888 1013 118 0 0 0 memsup
207 2889 1012 87 0 0 0 cpu_sup
207 2892 9752 406 0 0 0 ssl_esock
207 2897 269853 123961 0 0 0 beam.smp
Out of memory: Kill process 1864 (beam.smp) score 241 or sacrifice child
Killed process 1864, UID 207, (beam.smp) total-vm:1079412kB, anon-rss:455400kB, file-rss:40444kB
Kill process 2897 (beam.smp) sharing same memory
memcached[2970]: segfault at 0 ip 00007fc120ddb534 sp 00007fc11fa40de0 error 4 in libc-2.12.so[7fc120d74000+189000]
scsi 3:0:0:0: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 4
sd 3:0:0:0: Attached scsi generic sg3 type 0
sd 3:0:0:0: [sdc] 10485760 512-byte logical blocks: (5.36 GB/5.00 GiB)
sd 3:0:0:0: [sdc] Write Protect is off
sd 3:0:0:0: [sdc] Mode Sense: 0f 00 10 00
sd 3:0:0:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
sdc: unknown partition table
sd 3:0:0:0: [sdc] Attached SCSI disk
sdc: sdc1
kjournald starting. Commit interval 5 seconds
EXT3-fs (sdc1): using internal journal
EXT3-fs (sdc1): mounted filesystem with ordered data mode
beam.smp invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
beam.smp cpuset=/ mems_allowed=0
Pid: 9583, comm: beam.smp Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0x9e/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? handle_pte_fault+0x76b/0xb50
[] ? pte_alloc_one+0x37/0x50
[] ? do_huge_pmd_anonymous_page+0xb9/0x380
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? __switch_to+0x1ac/0x320
[] ? thread_return+0x4e/0x76e
[] ? read_hv_clock+0x1b/0x20 [hv_timesource]
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 152
active_anon:107849 inactive_anon:107904 isolated_anon:0
active_file:86 inactive_file:957 isolated_file:0
unevictable:3613 dirty:1 writeback:0 unstable:0
free:12261 slab_reclaimable:2897 slab_unreclaimable:7795
mapped:1128 shmem:12 pagetables:2398 bounce:0
Node 0 DMA free:4648kB min:664kB low:828kB high:996kB active_anon:5316kB inactive_anon:5436kB active_file:24kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:32kB shmem:0kB slab_reclaimable:168kB slab_unreclaimable:20kB kernel_stack:0kB pagetables:32kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44396kB min:44388kB low:55484kB high:66580kB active_anon:426080kB inactive_anon:426180kB active_file:320kB inactive_file:3828kB unevictable:14452kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:4kB writeback:0kB mapped:4480kB shmem:48kB slab_reclaimable:11420kB slab_unreclaimable:31160kB kernel_stack:2288kB pagetables:9560kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:17549 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 20*4kB 13*8kB 13*16kB 15*32kB 9*64kB 5*128kB 2*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 4648kB
Node 0 DMA32: 1129*4kB 665*8kB 360*16kB 206*32kB 89*64kB 17*128kB 14*256kB 3*512kB 7*1024kB 1*2048kB 0*4096kB = 44396kB
3441 total pagecache pages
1659 pages in swap cache
Swap cache stats: add 3986486, delete 3984827, find 2178532/2860339
Free swap = 0kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
5040 pages shared
235057 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 0 0 -17 -1000 udevd
0 1177 123341 61 0 0 0 rsyslogd
32 1204 4743 18 0 0 0 rpcbind
81 1214 5350 15 0 0 0 dbus-daemon
0 1226 47289 1 0 0 0 cupsd
0 1282 5443 112 0 0 0 rpc.mountd
0 1317 1741 1 0 0 0 hv_kvp_daemon
38 1337 7540 55 0 0 0 ntpd
0 1413 19671 33 0 0 0 master
89 1420 19734 88 0 0 0 qmgr
0 1423 29309 63 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18419 199 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 7871 164 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 33 0 0 0 httpd.worker
48 44608 213471 22 0 0 0 httpd.worker
48 44609 213471 65 0 0 0 httpd.worker
48 44610 213471 64 0 0 0 httpd.worker
0 60209 16018 20 0 0 0 sshd
0 20329 34524 330 0 0 0 scheduler
0 3388 2691 0 0 -17 -1000 udevd
0 3389 2691 0 0 -17 -1000 udevd
0 55287 10292 191 0 0 0 stunnel
0 55288 10292 18 0 0 0 stunnel
0 55289 10292 18 0 0 0 stunnel
0 55290 10292 18 0 0 0 stunnel
0 55291 10292 18 0 0 0 stunnel
0 55292 10292 18 0 0 0 stunnel
207 9554 2706 116 0 0 0 epmd
207 9562 731252 205339 0 0 0 beam.smp
207 9586 26516 172 0 0 0 sh
207 9587 1013 132 0 0 0 memsup
207 9588 1012 87 0 0 0 cpu_sup
207 9590 9752 162 0 0 0 ssl_esock
207 9592 2697 109 0 0 0 inet_gethost
207 9593 2697 83 0 0 0 inet_gethost
207 9615 41097 300 0 0 0 moxi
207 9616 123656 8885 0 0 0 memcached
207 9629 1566 116 0 0 0 sigar_port
0 11720 7800 3614 0 0 0 atop
89 24858 19700 212 0 0 0 pickup
0 24870 35030 161 0 0 0 crond
0 24874 1029 150 0 0 0 sadc
0 24933 22857 321 0 0 0 sshd
0 24935 27215 207 0 0 0 bash
Out of memory: Kill process 9562 (beam.smp) score 793 or sacrifice child
Killed process 9616, UID 207, (memcached) total-vm:494624kB, anon-rss:33920kB, file-rss:1620kB
beam.smp invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
beam.smp cpuset=/ mems_allowed=0
Pid: 9583, comm: beam.smp Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0x9e/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? handle_pte_fault+0x76b/0xb50
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? __switch_to+0x1ac/0x320
[] ? thread_return+0x4e/0x76e
[] ? read_hv_clock+0x1b/0x20 [hv_timesource]
[] ? getnstimeofday+0x60/0xf0
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 97
active_anon:108449 inactive_anon:108456 isolated_anon:0
active_file:294 inactive_file:226 isolated_file:0
unevictable:3613 dirty:5 writeback:3 unstable:0
free:12230 slab_reclaimable:2536 slab_unreclaimable:7738
mapped:1040 shmem:12 pagetables:2391 bounce:0
Node 0 DMA free:4644kB min:664kB low:828kB high:996kB active_anon:5420kB inactive_anon:5424kB active_file:0kB inactive_file:52kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:8kB shmem:0kB slab_reclaimable:72kB slab_unreclaimable:20kB kernel_stack:0kB pagetables:44kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44276kB min:44388kB low:55484kB high:66580kB active_anon:428376kB inactive_anon:428400kB active_file:1176kB inactive_file:852kB unevictable:14452kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:20kB writeback:12kB mapped:4152kB shmem:48kB slab_reclaimable:10072kB slab_unreclaimable:30932kB kernel_stack:2096kB pagetables:9520kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:71056 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 19*4kB 13*8kB 13*16kB 11*32kB 5*64kB 4*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 4644kB
Node 0 DMA32: 981*4kB 596*8kB 354*16kB 227*32kB 118*64kB 24*128kB 13*256kB 3*512kB 1*1024kB 1*2048kB 1*4096kB = 44276kB
14992 total pagecache pages
13750 pages in swap cache
Swap cache stats: add 4064778, delete 4051028, find 2188236/2873283
Free swap = 0kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
4705 pages shared
235272 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 0 0 -17 -1000 udevd
0 1177 123341 65 0 0 0 rsyslogd
32 1204 4743 18 0 0 0 rpcbind
81 1214 5350 15 0 0 0 dbus-daemon
0 1226 47289 1 0 0 0 cupsd
0 1282 5443 128 0 0 0 rpc.mountd
0 1317 1741 1 0 0 0 hv_kvp_daemon
38 1337 7540 84 0 0 0 ntpd
0 1413 19671 46 0 0 0 master
89 1420 19734 88 0 0 0 qmgr
0 1423 29309 64 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18419 204 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 7871 176 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 34 0 0 0 httpd.worker
48 44608 213471 22 0 0 0 httpd.worker
48 44609 213471 65 0 0 0 httpd.worker
48 44610 213471 64 0 0 0 httpd.worker
0 60209 16018 20 0 0 0 sshd
0 20329 34524 70 0 0 0 scheduler
0 3388 2691 0 0 -17 -1000 udevd
0 3389 2691 0 0 -17 -1000 udevd
0 55287 10292 191 0 0 0 stunnel
0 55288 10292 18 0 0 0 stunnel
0 55289 10292 18 0 0 0 stunnel
0 55290 10292 18 0 0 0 stunnel
0 55291 10292 18 0 0 0 stunnel
0 55292 10292 18 0 0 0 stunnel
207 9554 2706 116 0 0 0 epmd
207 9562 804496 203155 0 0 0 beam.smp
207 9586 26516 172 0 0 0 sh
207 9587 1013 120 0 0 0 memsup
207 9588 1012 87 0 0 0 cpu_sup
207 9590 9752 162 0 0 0 ssl_esock
207 9592 2697 104 0 0 0 inet_gethost
207 9593 2697 75 0 0 0 inet_gethost
207 9615 41097 314 0 0 0 moxi
207 9629 1566 110 0 0 0 sigar_port
0 11720 7800 3614 0 0 0 atop
89 24858 19700 227 0 0 0 pickup
0 24870 35030 161 0 0 0 crond
0 24874 1029 150 0 0 0 sadc
0 24933 22857 287 0 0 0 sshd
0 24935 27215 207 0 0 0 bash
Out of memory: Kill process 9562 (beam.smp) score 876 or sacrifice child
Killed process 9586, UID 207, (sh) total-vm:106064kB, anon-rss:0kB, file-rss:688kB
scheduler invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0
scheduler cpuset=/ mems_allowed=0
Pid: 20329, comm: scheduler Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0x9e/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? read_swap_cache_async+0xf2/0x150
[] ? valid_swaphandles+0x69/0x150
[] ? swapin_readahead+0x87/0xc0
[] ? handle_pte_fault+0x70b/0xb50
[] ? perf_event_task_sched_out+0x33/0x80
[] ? dequeue_entity+0x113/0x2e0
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? hrtimer_try_to_cancel+0x3f/0xd0
[] ? hrtimer_cancel+0x22/0x30
[] ? do_nanosleep+0x93/0xc0
[] ? hrtimer_nanosleep+0xc4/0x180
[] ? hrtimer_wakeup+0x0/0x30
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 64
active_anon:108462 inactive_anon:108486 isolated_anon:0
active_file:279 inactive_file:252 isolated_file:0
unevictable:3613 dirty:1 writeback:6 unstable:0
free:12232 slab_reclaimable:2533 slab_unreclaimable:7738
mapped:1042 shmem:12 pagetables:2381 bounce:0
Node 0 DMA free:4644kB min:664kB low:828kB high:996kB active_anon:5368kB inactive_anon:5552kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:72kB slab_unreclaimable:20kB kernel_stack:0kB pagetables:44kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44284kB min:44388kB low:55484kB high:66580kB active_anon:428480kB inactive_anon:428392kB active_file:1116kB inactive_file:1008kB unevictable:14452kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:4kB writeback:24kB mapped:4168kB shmem:48kB slab_reclaimable:10060kB slab_unreclaimable:30932kB kernel_stack:2088kB pagetables:9480kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:7092 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 19*4kB 13*8kB 13*16kB 11*32kB 5*64kB 4*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 4644kB
Node 0 DMA32: 999*4kB 594*8kB 351*16kB 225*32kB 123*64kB 24*128kB 14*256kB 2*512kB 1*1024kB 1*2048kB 1*4096kB = 44284kB
15104 total pagecache pages
13839 pages in swap cache
Swap cache stats: add 4065017, delete 4051178, find 2188276/2873343
Free swap = 8kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
4537 pages shared
235300 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 0 0 -17 -1000 udevd
0 1177 123341 86 0 0 0 rsyslogd
32 1204 4743 18 0 0 0 rpcbind
81 1214 5350 15 0 0 0 dbus-daemon
0 1226 47289 1 0 0 0 cupsd
0 1282 5443 125 0 0 0 rpc.mountd
0 1317 1741 1 0 0 0 hv_kvp_daemon
38 1337 7540 84 0 0 0 ntpd
0 1413 19671 46 0 0 0 master
89 1420 19734 88 0 0 0 qmgr
0 1423 29309 64 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18419 204 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 7871 176 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 34 0 0 0 httpd.worker
48 44608 213471 22 0 0 0 httpd.worker
48 44609 213471 65 0 0 0 httpd.worker
48 44610 213471 64 0 0 0 httpd.worker
0 60209 16018 20 0 0 0 sshd
0 20329 34524 72 0 0 0 scheduler
0 3388 2691 0 0 -17 -1000 udevd
0 3389 2691 0 0 -17 -1000 udevd
0 55287 10292 191 0 0 0 stunnel
0 55288 10292 18 0 0 0 stunnel
0 55289 10292 18 0 0 0 stunnel
0 55290 10292 18 0 0 0 stunnel
0 55291 10292 18 0 0 0 stunnel
0 55292 10292 18 0 0 0 stunnel
207 9554 2706 116 0 0 0 epmd
207 9562 804496 203087 0 0 0 beam.smp
207 9587 1013 120 0 0 0 memsup
207 9588 1012 87 0 0 0 cpu_sup
207 9590 9752 162 0 0 0 ssl_esock
207 9592 2697 104 0 0 0 inet_gethost
207 9593 2697 75 0 0 0 inet_gethost
207 9615 41097 314 0 0 0 moxi
207 9629 1566 110 0 0 0 sigar_port
0 11720 7800 3614 0 0 0 atop
89 24858 19700 227 0 0 0 pickup
0 24870 35030 161 0 0 0 crond
0 24874 1029 150 0 0 0 sadc
0 24933 22857 287 0 0 0 sshd
0 24935 27215 207 0 0 0 bash
Out of memory: Kill process 9562 (beam.smp) score 876 or sacrifice child
Killed process 9587, UID 207, (memsup) total-vm:4052kB, anon-rss:0kB, file-rss:480kB
scheduler invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0
scheduler cpuset=/ mems_allowed=0
Pid: 20329, comm: scheduler Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0x9e/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? read_swap_cache_async+0xf2/0x150
[] ? valid_swaphandles+0x69/0x150
[] ? swapin_readahead+0x87/0xc0
[] ? handle_pte_fault+0x70b/0xb50
[] ? perf_event_task_sched_out+0x33/0x80
[] ? dequeue_entity+0x113/0x2e0
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? hrtimer_try_to_cancel+0x3f/0xd0
[] ? hrtimer_cancel+0x22/0x30
[] ? do_nanosleep+0x93/0xc0
[] ? hrtimer_nanosleep+0xc4/0x180
[] ? hrtimer_wakeup+0x0/0x30
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 99
active_anon:108412 inactive_anon:108515 isolated_anon:0
active_file:279 inactive_file:252 isolated_file:0
unevictable:3613 dirty:1 writeback:6 unstable:0
free:12232 slab_reclaimable:2533 slab_unreclaimable:7738
mapped:1042 shmem:12 pagetables:2381 bounce:0
Node 0 DMA free:4644kB min:664kB low:828kB high:996kB active_anon:5368kB inactive_anon:5552kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:72kB slab_unreclaimable:20kB kernel_stack:0kB pagetables:44kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44284kB min:44388kB low:55484kB high:66580kB active_anon:428280kB inactive_anon:428508kB active_file:1116kB inactive_file:1008kB unevictable:14452kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:4kB writeback:24kB mapped:4168kB shmem:48kB slab_reclaimable:10060kB slab_unreclaimable:30932kB kernel_stack:2088kB pagetables:9480kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 19*4kB 13*8kB 13*16kB 11*32kB 5*64kB 4*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 4644kB
Node 0 DMA32: 999*4kB 595*8kB 351*16kB 225*32kB 123*64kB 24*128kB 14*256kB 2*512kB 1*1024kB 1*2048kB 1*4096kB = 44292kB
15104 total pagecache pages
13841 pages in swap cache
Swap cache stats: add 4065043, delete 4051202, find 2188279/2873348
Free swap = 0kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
4428 pages shared
235253 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 0 0 -17 -1000 udevd
0 1177 123341 89 0 0 0 rsyslogd
32 1204 4743 18 0 0 0 rpcbind
81 1214 5350 15 0 0 0 dbus-daemon
0 1226 47289 1 0 0 0 cupsd
0 1282 5443 125 0 0 0 rpc.mountd
0 1317 1741 1 0 0 0 hv_kvp_daemon
38 1337 7540 84 0 0 0 ntpd
0 1413 19671 46 0 0 0 master
89 1420 19734 88 0 0 0 qmgr
0 1423 29309 64 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18419 204 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 7871 176 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 34 0 0 0 httpd.worker
48 44608 213471 22 0 0 0 httpd.worker
48 44609 213471 65 0 0 0 httpd.worker
48 44610 213471 64 0 0 0 httpd.worker
0 60209 16018 20 0 0 0 sshd
0 20329 34524 72 0 0 0 scheduler
0 3388 2691 0 0 -17 -1000 udevd
0 3389 2691 0 0 -17 -1000 udevd
0 55287 10292 191 0 0 0 stunnel
0 55288 10292 18 0 0 0 stunnel
0 55289 10292 18 0 0 0 stunnel
0 55290 10292 18 0 0 0 stunnel
0 55291 10292 18 0 0 0 stunnel
0 55292 10292 18 0 0 0 stunnel
207 9554 2706 116 0 0 0 epmd
207 9562 804496 203063 0 0 0 beam.smp
207 9588 1012 87 0 0 0 cpu_sup
207 9590 9752 162 0 0 0 ssl_esock
207 9592 2697 104 0 0 0 inet_gethost
207 9593 2697 75 0 0 0 inet_gethost
207 9615 41097 314 0 0 0 moxi
207 9629 1566 110 0 0 0 sigar_port
0 11720 7800 3614 0 0 0 atop
89 24858 19700 227 0 0 0 pickup
0 24870 35030 161 0 0 0 crond
0 24874 1029 150 0 0 0 sadc
0 24933 22857 287 0 0 0 sshd
0 24935 27215 207 0 0 0 bash
Out of memory: Kill process 9562 (beam.smp) score 876 or sacrifice child
Killed process 9588, UID 207, (cpu_sup) total-vm:4048kB, anon-rss:0kB, file-rss:348kB
rsyslogd invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0
rsyslogd cpuset=/ mems_allowed=0
Pid: 1181, comm: rsyslogd Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0x9e/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? read_swap_cache_async+0xf2/0x150
[] ? valid_swaphandles+0x69/0x150
[] ? swapin_readahead+0x87/0xc0
[] ? handle_pte_fault+0x70b/0xb50
[] ? handle_mm_fault+0x23a/0x310
[] ? security_capable+0x29/0x30
[] ? __do_page_fault+0x139/0x480
[] ? pde_users_dec+0x25/0x60
[] ? read_hv_clock+0x1b/0x20 [hv_timesource]
[] ? getnstimeofday+0x60/0xf0
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 41
active_anon:107542 inactive_anon:109494 isolated_anon:0
active_file:231 inactive_file:261 isolated_file:0
unevictable:3613 dirty:0 writeback:0 unstable:0
free:12236 slab_reclaimable:2533 slab_unreclaimable:7738
mapped:1027 shmem:12 pagetables:2374 bounce:0
Node 0 DMA free:4644kB min:664kB low:828kB high:996kB active_anon:5368kB inactive_anon:5552kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:72kB slab_unreclaimable:20kB kernel_stack:0kB pagetables:44kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44300kB min:44388kB low:55484kB high:66580kB active_anon:424800kB inactive_anon:432424kB active_file:924kB inactive_file:1044kB unevictable:14452kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:0kB writeback:0kB mapped:4108kB shmem:48kB slab_reclaimable:10060kB slab_unreclaimable:30932kB kernel_stack:2080kB pagetables:9452kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:6983 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 19*4kB 13*8kB 13*16kB 11*32kB 5*64kB 4*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 4644kB
Node 0 DMA32: 1045*4kB 595*8kB 346*16kB 224*32kB 122*64kB 24*128kB 14*256kB 2*512kB 1*1024kB 1*2048kB 1*4096kB = 44300kB
15141 total pagecache pages
13923 pages in swap cache
Swap cache stats: add 4065316, delete 4051393, find 2188347/2873438
Free swap = 24kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
4274 pages shared
235377 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 0 0 -17 -1000 udevd
0 1177 123341 157 0 0 0 rsyslogd
32 1204 4743 18 0 0 0 rpcbind
81 1214 5350 15 0 0 0 dbus-daemon
0 1226 47289 1 0 0 0 cupsd
0 1282 5443 112 0 0 0 rpc.mountd
0 1317 1741 1 0 0 0 hv_kvp_daemon
38 1337 7540 84 0 0 0 ntpd
0 1413 19671 46 0 0 0 master
89 1420 19734 88 0 0 0 qmgr
0 1423 29309 64 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18419 203 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 7871 175 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 34 0 0 0 httpd.worker
48 44608 213471 22 0 0 0 httpd.worker
48 44609 213471 65 0 0 0 httpd.worker
48 44610 213471 64 0 0 0 httpd.worker
0 60209 16018 20 0 0 0 sshd
0 20329 34524 61 0 0 0 scheduler
0 3388 2691 0 0 -17 -1000 udevd
0 3389 2691 0 0 -17 -1000 udevd
0 55287 10292 191 0 0 0 stunnel
0 55288 10292 18 0 0 0 stunnel
0 55289 10292 18 0 0 0 stunnel
0 55290 10292 18 0 0 0 stunnel
0 55291 10292 18 0 0 0 stunnel
0 55292 10292 18 0 0 0 stunnel
207 9554 2706 116 0 0 0 epmd
207 9562 804753 203028 0 0 0 beam.smp
207 9590 9752 162 0 0 0 ssl_esock
207 9592 2697 104 0 0 0 inet_gethost
207 9593 2697 75 0 0 0 inet_gethost
207 9615 41097 314 0 0 0 moxi
207 9629 1566 110 0 0 0 sigar_port
0 11720 7800 3614 0 0 0 atop
89 24858 19700 227 0 0 0 pickup
0 24870 35030 161 0 0 0 crond
0 24874 1029 150 0 0 0 sadc
0 24933 22857 287 0 0 0 sshd
0 24935 27215 207 0 0 0 bash
Out of memory: Kill process 9562 (beam.smp) score 876 or sacrifice child
Killed process 9590, UID 207, (ssl_esock) total-vm:39008kB, anon-rss:20kB, file-rss:628kB
moxi invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
moxi cpuset=/ mems_allowed=0
Pid: 9622, comm: moxi Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0x9e/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_current+0xaa/0x110
[] ? __page_cache_alloc+0x87/0x90
[] ? __do_page_cache_readahead+0xdb/0x210
[] ? ra_submit+0x21/0x30
[] ? filemap_fault+0x4c3/0x500
[] ? __do_fault+0x54/0x510
[] ? ep_poll_callback+0xbb/0xf0
[] ? do_lookup+0x9f/0x230
[] ? current_fs_time+0x27/0x30
[] ? handle_pte_fault+0xf7/0xb50
[] ? perf_event_task_sched_out+0x33/0x80
[] ? dequeue_entity+0x113/0x2e0
[] ? __dequeue_entity+0x30/0x50
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? hrtimer_try_to_cancel+0x3f/0xd0
[] ? hrtimer_cancel+0x22/0x30
[] ? do_nanosleep+0x93/0xc0
[] ? hrtimer_nanosleep+0xc4/0x180
[] ? hrtimer_wakeup+0x0/0x30
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 38
active_anon:108525 inactive_anon:108555 isolated_anon:0
active_file:69 inactive_file:395 isolated_file:0
unevictable:3613 dirty:13 writeback:0 unstable:0
free:12253 slab_reclaimable:2524 slab_unreclaimable:7738
mapped:897 shmem:12 pagetables:2348 bounce:0
Node 0 DMA free:4644kB min:664kB low:828kB high:996kB active_anon:5368kB inactive_anon:5552kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:72kB slab_unreclaimable:20kB kernel_stack:0kB pagetables:44kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44368kB min:44388kB low:55484kB high:66580kB active_anon:428732kB inactive_anon:428668kB active_file:276kB inactive_file:1580kB unevictable:14452kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:52kB writeback:0kB mapped:3588kB shmem:48kB slab_reclaimable:10024kB slab_unreclaimable:30932kB kernel_stack:2080kB pagetables:9348kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3394 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 19*4kB 13*8kB 13*16kB 11*32kB 5*64kB 4*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 4644kB
Node 0 DMA32: 1068*4kB 594*8kB 343*16kB 227*32kB 123*64kB 25*128kB 13*256kB 2*512kB 1*1024kB 1*2048kB 1*4096kB = 44368kB
15297 total pagecache pages
14097 pages in swap cache
Swap cache stats: add 4065759, delete 4051662, find 2188415/2873536
Free swap = 0kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
4012 pages shared
235473 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 0 0 -17 -1000 udevd
0 1177 123341 178 0 0 0 rsyslogd
32 1204 4743 18 0 0 0 rpcbind
81 1214 5350 15 0 0 0 dbus-daemon
0 1226 47289 1 0 0 0 cupsd
0 1282 5443 112 0 0 0 rpc.mountd
0 1317 1741 1 0 0 0 hv_kvp_daemon
38 1337 7540 84 0 0 0 ntpd
0 1413 19671 46 0 0 0 master
89 1420 19734 88 0 0 0 qmgr
0 1423 29309 64 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18419 187 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 7871 175 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 33 0 0 0 httpd.worker
48 44608 213471 22 0 0 0 httpd.worker
48 44609 213471 65 0 0 0 httpd.worker
48 44610 213471 64 0 0 0 httpd.worker
0 60209 16018 20 0 0 0 sshd
0 20329 34524 116 0 0 0 scheduler
0 3388 2691 0 0 -17 -1000 udevd
0 3389 2691 0 0 -17 -1000 udevd
0 55287 10292 191 0 0 0 stunnel
0 55288 10292 18 0 0 0 stunnel
0 55289 10292 18 0 0 0 stunnel
0 55290 10292 18 0 0 0 stunnel
0 55291 10292 18 0 0 0 stunnel
0 55292 10292 18 0 0 0 stunnel
207 9554 2706 111 0 0 0 epmd
207 9562 804753 202768 0 0 0 beam.smp
207 9592 2697 104 0 0 0 inet_gethost
207 9593 2697 75 0 0 0 inet_gethost
207 9615 41097 267 0 0 0 moxi
207 9629 1566 110 0 0 0 sigar_port
0 11720 7800 3614 0 0 0 atop
89 24858 19700 227 0 0 0 pickup
0 24870 35030 161 0 0 0 crond
0 24874 1029 150 0 0 0 sadc
0 24933 22857 287 0 0 0 sshd
0 24935 27215 207 0 0 0 bash
Out of memory: Kill process 9562 (beam.smp) score 876 or sacrifice child
Killed process 9592, UID 207, (inet_gethost) total-vm:10788kB, anon-rss:0kB, file-rss:416kB
moxi invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
moxi cpuset=/ mems_allowed=0
Pid: 9622, comm: moxi Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0x9e/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_current+0xaa/0x110
[] ? __page_cache_alloc+0x87/0x90
[] ? __do_page_cache_readahead+0xdb/0x210
[] ? ra_submit+0x21/0x30
[] ? filemap_fault+0x4c3/0x500
[] ? __do_fault+0x54/0x510
[] ? handle_pte_fault+0xf7/0xb50
[] ? dequeue_entity+0x113/0x2e0
[] ? autoremove_wake_function+0x0/0x40
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? sys_recvfrom+0x16b/0x180
[] ? read_hv_clock+0x1b/0x20 [hv_timesource]
[] ? read_hv_clock+0x1b/0x20 [hv_timesource]
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
active_anon:108540 inactive_anon:108598 isolated_anon:0
active_file:149 inactive_file:309 isolated_file:0
unevictable:3613 dirty:0 writeback:0 unstable:0
free:12232 slab_reclaimable:2517 slab_unreclaimable:7733
mapped:883 shmem:12 pagetables:2332 bounce:0
Node 0 DMA free:4644kB min:664kB low:828kB high:996kB active_anon:5368kB inactive_anon:5552kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:72kB slab_unreclaimable:20kB kernel_stack:0kB pagetables:44kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44284kB min:44388kB low:55484kB high:66580kB active_anon:428792kB inactive_anon:428840kB active_file:596kB inactive_file:1236kB unevictable:14452kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:0kB writeback:0kB mapped:3532kB shmem:48kB slab_reclaimable:9996kB slab_unreclaimable:30912kB kernel_stack:2064kB pagetables:9284kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:5685 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 19*4kB 13*8kB 13*16kB 11*32kB 5*64kB 4*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 4644kB
Node 0 DMA32: 1085*4kB 595*8kB 343*16kB 228*32kB 124*64kB 25*128kB 14*256kB 3*512kB 2*1024kB 2*2048kB 0*4096kB = 44284kB
15351 total pagecache pages
14161 pages in swap cache
Swap cache stats: add 4065923, delete 4051762, find 2188464/2873603
Free swap = 12kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
3894 pages shared
235518 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 0 0 -17 -1000 udevd
0 1177 123341 150 0 0 0 rsyslogd
32 1204 4743 18 0 0 0 rpcbind
81 1214 5350 15 0 0 0 dbus-daemon
0 1226 47289 1 0 0 0 cupsd
0 1282 5443 112 0 0 0 rpc.mountd
0 1317 1741 1 0 0 0 hv_kvp_daemon
38 1337 7540 84 0 0 0 ntpd
0 1413 19671 46 0 0 0 master
89 1420 19734 88 0 0 0 qmgr
0 1423 29309 64 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18419 177 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 7871 175 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 33 0 0 0 httpd.worker
48 44608 213471 22 0 0 0 httpd.worker
48 44609 213471 65 0 0 0 httpd.worker
48 44610 213471 64 0 0 0 httpd.worker
0 60209 16018 20 0 0 0 sshd
0 20329 34524 138 0 0 0 scheduler
0 3388 2691 0 0 -17 -1000 udevd
0 3389 2691 0 0 -17 -1000 udevd
0 55287 10292 191 0 0 0 stunnel
0 55288 10292 18 0 0 0 stunnel
0 55289 10292 18 0 0 0 stunnel
0 55290 10292 18 0 0 0 stunnel
0 55291 10292 18 0 0 0 stunnel
0 55292 10292 18 0 0 0 stunnel
207 9554 2706 111 0 0 0 epmd
207 9562 804753 202709 0 0 0 beam.smp
207 9593 2697 98 0 0 0 inet_gethost
207 9615 41097 307 0 0 0 moxi
207 9629 1566 110 0 0 0 sigar_port
0 11720 7800 3614 0 0 0 atop
89 24858 19700 227 0 0 0 pickup
0 24870 35030 161 0 0 0 crond
0 24874 1029 150 0 0 0 sadc
0 24933 22857 287 0 0 0 sshd
0 24935 27215 207 0 0 0 bash
Out of memory: Kill process 9562 (beam.smp) score 876 or sacrifice child
Killed process 9615, UID 207, (moxi) total-vm:164388kB, anon-rss:148kB, file-rss:1080kB
beam.smp invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0
beam.smp cpuset=/ mems_allowed=0
Pid: 9583, comm: beam.smp Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __delayacct_freepages_end+0x2e/0x30
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0x9e/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? read_swap_cache_async+0xf2/0x150
[] ? valid_swaphandles+0x69/0x150
[] ? swapin_readahead+0x87/0xc0
[] ? handle_pte_fault+0x70b/0xb50
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? ep_poll+0x306/0x330
[] ? thread_return+0x4e/0x76e
[] ? read_hv_clock+0x1b/0x20 [hv_timesource]
[] ? read_hv_clock+0x1b/0x20 [hv_timesource]
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 62
active_anon:108393 inactive_anon:108486 isolated_anon:0
active_file:219 inactive_file:589 isolated_file:0
unevictable:3613 dirty:0 writeback:2 unstable:0
free:12245 slab_reclaimable:2463 slab_unreclaimable:7736
mapped:1027 shmem:12 pagetables:2314 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:5368kB inactive_anon:5560kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:72kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:44kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44340kB min:44388kB low:55484kB high:66580kB active_anon:428204kB inactive_anon:428384kB active_file:876kB inactive_file:2356kB unevictable:14452kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:0kB writeback:8kB mapped:4108kB shmem:48kB slab_reclaimable:9780kB slab_unreclaimable:30928kB kernel_stack:1984kB pagetables:9212kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:19659 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 20*4kB 14*8kB 12*16kB 11*32kB 5*64kB 4*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 4640kB
Node 0 DMA32: 1061*4kB 584*8kB 334*16kB 220*32kB 130*64kB 29*128kB 13*256kB 3*512kB 2*1024kB 2*2048kB 0*4096kB = 44340kB
10119 total pagecache pages
8585 pages in swap cache
Swap cache stats: add 4091812, delete 4083227, find 2197337/2884611
Free swap = 0kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
3740 pages shared
235345 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 0 0 -17 -1000 udevd
0 1177 123341 136 0 0 0 rsyslogd
32 1204 4743 23 0 0 0 rpcbind
81 1214 5350 15 0 0 0 dbus-daemon
0 1226 47289 1 0 0 0 cupsd
0 1282 5443 112 0 0 0 rpc.mountd
0 1317 1741 1 0 0 0 hv_kvp_daemon
38 1337 7540 84 0 0 0 ntpd
0 1413 19671 46 0 0 0 master
89 1420 19734 88 0 0 0 qmgr
0 1423 29309 64 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18419 204 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 7871 185 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 34 0 0 0 httpd.worker
48 44608 213471 22 0 0 0 httpd.worker
48 44609 213471 65 0 0 0 httpd.worker
48 44610 213471 64 0 0 0 httpd.worker
0 60209 16018 20 0 0 0 sshd
0 20329 34524 279 0 0 0 scheduler
0 3388 2691 0 0 -17 -1000 udevd
0 3389 2691 0 0 -17 -1000 udevd
0 55287 10292 191 0 0 0 stunnel
0 55288 10292 18 0 0 0 stunnel
0 55289 10292 18 0 0 0 stunnel
0 55290 10292 18 0 0 0 stunnel
0 55291 10292 18 0 0 0 stunnel
0 55292 10292 18 0 0 0 stunnel
207 9554 2706 116 0 0 0 epmd
207 9562 811692 208029 0 0 0 beam.smp
207 9629 1566 110 0 0 0 sigar_port
0 11720 7800 3614 0 0 0 atop
89 24858 19700 227 0 0 0 pickup
0 24870 35030 161 0 0 0 crond
0 24874 1029 150 0 0 0 sadc
0 24933 22857 321 0 0 0 sshd
0 24935 27215 207 0 0 0 bash
Out of memory: Kill process 9562 (beam.smp) score 887 or sacrifice child
Killed process 9629, UID 207, (sigar_port) total-vm:6264kB, anon-rss:0kB, file-rss:440kB
beam.smp invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0
beam.smp cpuset=/ mems_allowed=0
Pid: 9583, comm: beam.smp Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0x9e/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_vma+0x9a/0x150
[] ? read_swap_cache_async+0xf2/0x150
[] ? valid_swaphandles+0x69/0x150
[] ? swapin_readahead+0x87/0xc0
[] ? handle_pte_fault+0x70b/0xb50
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? sys_recvfrom+0x16b/0x180
[] ? read_hv_clock+0x1b/0x20 [hv_timesource]
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 34
active_anon:108503 inactive_anon:108585 isolated_anon:0
active_file:228 inactive_file:403 isolated_file:0
unevictable:3613 dirty:0 writeback:0 unstable:0
free:12250 slab_reclaimable:2463 slab_unreclaimable:7736
mapped:1066 shmem:12 pagetables:2314 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:5368kB inactive_anon:5560kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:72kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:44kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44360kB min:44388kB low:55484kB high:66580kB active_anon:428644kB inactive_anon:428780kB active_file:912kB inactive_file:1612kB unevictable:14452kB isolated(anon):0kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:0kB writeback:0kB mapped:4264kB shmem:48kB slab_reclaimable:9780kB slab_unreclaimable:30928kB kernel_stack:1984kB pagetables:9212kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:5089 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 21*4kB 14*8kB 12*16kB 11*32kB 5*64kB 4*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 4644kB
Node 0 DMA32: 1106*4kB 586*8kB 333*16kB 221*32kB 129*64kB 28*128kB 13*256kB 3*512kB 2*1024kB 2*2048kB 0*4096kB = 44360kB
10183 total pagecache pages
8816 pages in swap cache
Swap cache stats: add 4092246, delete 4083430, find 2197422/2884736
Free swap = 0kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
3675 pages shared
235323 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2692 0 0 -17 -1000 udevd
0 1177 123341 179 0 0 0 rsyslogd
32 1204 4743 18 0 0 0 rpcbind
81 1214 5350 15 0 0 0 dbus-daemon
0 1226 47289 1 0 0 0 cupsd
0 1282 5443 112 0 0 0 rpc.mountd
0 1317 1741 1 0 0 0 hv_kvp_daemon
38 1337 7540 84 0 0 0 ntpd
0 1413 19671 46 0 0 0 master
89 1420 19734 88 0 0 0 qmgr
0 1423 29309 64 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18419 204 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 7871 185 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 34 0 0 0 httpd.worker
48 44608 213471 22 0 0 0 httpd.worker
48 44609 213471 65 0 0 0 httpd.worker
48 44610 213471 64 0 0 0 httpd.worker
0 60209 16018 20 0 0 0 sshd
0 20329 34524 279 0 0 0 scheduler
0 3388 2691 0 0 -17 -1000 udevd
0 3389 2691 0 0 -17 -1000 udevd
0 55287 10292 191 0 0 0 stunnel
0 55288 10292 18 0 0 0 stunnel
0 55289 10292 18 0 0 0 stunnel
0 55290 10292 18 0 0 0 stunnel
0 55291 10292 18 0 0 0 stunnel
0 55292 10292 18 0 0 0 stunnel
207 9554 2706 116 0 0 0 epmd
207 9562 811692 208004 0 0 0 beam.smp
0 11720 7800 3614 0 0 0 atop
89 24858 19700 227 0 0 0 pickup
0 24870 35030 161 0 0 0 crond
0 24874 1029 150 0 0 0 sadc
0 24933 22857 321 0 0 0 sshd
0 24935 27215 207 0 0 0 bash
Out of memory: Kill process 9562 (beam.smp) score 887 or sacrifice child
Killed process 9562, UID 207, (beam.smp) total-vm:3246768kB, anon-rss:830360kB, file-rss:1656kB
hrtimer: interrupt took 2344315 ns
Bluetooth: Core ver 2.15
NET: Registered protocol family 31
Bluetooth: HCI device and connection manager initialized
Bluetooth: HCI socket layer initialized
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth1 entered promiscuous mode
device eth1 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
device eth0 entered promiscuous mode
device eth0 left promiscuous mode
memcached invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
memcached cpuset=/ mems_allowed=0
Pid: 32327, comm: memcached Tainted: G W --------------- 2.6.32-279.19.1.el6.x86_64 #1
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x91/0xb0
[] ? dump_header+0x90/0x1b0
[] ? __bitmap_intersects+0x1a/0xa0
[] ? security_real_capable_noaudit+0x3c/0x70
[] ? oom_kill_process+0x82/0x2a0
[] ? select_bad_process+0xe1/0x120
[] ? out_of_memory+0x220/0x3c0
[] ? __alloc_pages_nodemask+0x89e/0x940
[] ? alloc_pages_current+0xaa/0x110
[] ? __page_cache_alloc+0x87/0x90
[] ? __do_page_cache_readahead+0xdb/0x210
[] ? apic_timer_interrupt+0xe/0x20
[] ? ra_submit+0x21/0x30
[] ? filemap_fault+0x4c3/0x500
[] ? __do_fault+0x54/0x510
[] ? handle_pte_fault+0xf7/0xb50
[] ? handle_mm_fault+0x23a/0x310
[] ? __do_page_fault+0x139/0x480
[] ? rb_erase+0x1bc/0x310
[] ? __switch_to+0x26e/0x320
[] ? do_page_fault+0x3e/0xa0
[] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
active_anon:108704 inactive_anon:108768 isolated_anon:32
active_file:75 inactive_file:133 isolated_file:0
unevictable:1471 dirty:0 writeback:0 unstable:0
free:12251 slab_reclaimable:2786 slab_unreclaimable:9247
mapped:762 shmem:12 pagetables:2351 bounce:0
Node 0 DMA free:4640kB min:664kB low:828kB high:996kB active_anon:5368kB inactive_anon:5604kB active_file:12kB inactive_file:12kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15308kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:36kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:8kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:9 all_unreclaimable? no
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:44364kB min:44388kB low:55484kB high:66580kB active_anon:429448kB inactive_anon:429468kB active_file:288kB inactive_file:520kB unevictable:5884kB isolated(anon):128kB isolated(file):0kB present:1018016kB mlocked:0kB dirty:0kB writeback:0kB mapped:3028kB shmem:48kB slab_reclaimable:11108kB slab_unreclaimable:36972kB kernel_stack:2280kB pagetables:9396kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:320 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 10*4kB 9*8kB 5*16kB 3*32kB 6*64kB 7*128kB 4*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 4640kB
Node 0 DMA32: 1039*4kB 642*8kB 358*16kB 249*32kB 138*64kB 46*128kB 12*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 44364kB
19277 total pagecache pages
18333 pages in swap cache
Swap cache stats: add 179465007, delete 179446674, find 55419421/85850821
Free swap = 0kB
Total swap = 1048568kB
262112 pages RAM
8868 pages reserved
5550 pages shared
235450 pages non-shared
[ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
0 390 2677 78 0 -17 -1000 udevd
32 1204 4743 19 0 0 0 rpcbind
81 1214 5350 16 0 0 0 dbus-daemon
0 1226 47289 2 0 0 0 cupsd
0 1282 5443 105 0 0 0 rpc.mountd
0 1317 1743 28 0 0 0 hv_kvp_daemon
38 1337 7540 57 0 0 0 ntpd
0 1413 19671 46 0 0 0 master
89 1420 19734 89 0 0 0 qmgr
0 1423 29309 90 0 0 0 crond
0 1437 17706 0 0 0 0 squid
0 1440 18451 179 0 0 0 squid
23 1441 5020 1 0 0 0 unlinkd
0 1452 5363 4 0 0 0 atd
0 1557 19431 169 0 0 0 watchdot
0 1566 1015 1 0 0 0 mingetty
0 1568 1018 1 0 0 0 agetty
0 1569 1015 1 0 0 0 mingetty
0 44606 12718 26 0 0 0 httpd.worker
48 44608 213471 68 0 0 0 httpd.worker
48 44609 213471 68 0 0 0 httpd.worker
48 44610 213471 67 0 0 0 httpd.worker
0 60209 16018 21 0 0 0 sshd
0 55287 10292 95 0 0 0 stunnel
0 55288 10292 5 0 0 0 stunnel
0 55289 10292 5 0 0 0 stunnel
0 55290 10292 5 0 0 0 stunnel
0 55291 10292 5 0 0 0 stunnel
0 55292 10292 5 0 0 0 stunnel
207 32243 2706 76 0 0 0 epmd
207 32251 463861 93810 0 0 0 beam.smp
207 32275 26516 118 0 0 0 sh
207 32276 1013 68 0 0 0 memsup
207 32277 1012 23 0 0 0 cpu_sup
207 32279 9752 73 0 0 0 ssl_esock
207 32281 2697 36 0 0 0 inet_gethost
207 32282 2697 55 0 0 0 inet_gethost
207 32304 124178 9324 0 0 0 memcached
207 32317 1566 60 0 0 0 sigar_port
207 41065 41097 257 0 0 0 moxi
0 61218 34524 339 0 0 0 scheduler
0 49702 5658 1472 0 0 0 atop
0 485 22829 233 0 0 0 sshd
0 487 27129 204 0 0 0 bash
89 1366 19787 224 0 0 0 pickup
0 1432 22829 232 0 0 0 sshd
0 1434 27128 202 0 0 0 bash
0 1508 35030 161 0 0 0 crond
0 1512 1029 150 0 0 0 sadc
0 1540 26514 171 0 0 0 phoronix-test-s
0 1543 67747 388 0 0 0 php
0 1788 67619 431 0 0 0 php
0 1858 26514 170 0 0 0 sh
0 1859 2298 167 0 0 0 compress-pbzip2
0 1860 141430 95602 0 0 0 pbzip2
Out of memory: Kill process 32251 (beam.smp) score 497 or sacrifice child
Killed process 32304, UID 207, (memcached) total-vm:496712kB, anon-rss:36480kB, file-rss:816kB
INFO: task beam.smp:32272 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
beam.smp D 0000000000000000 0 32272 1 0x00000000
ffff880033001e08 0000000000000086 0000000000000000 00007fa7c414a128
00007fa7c414a128 ffff88003d5cb100 ffff88003b014890 00003ffffffff000
ffff88003bf91098 ffff880033001fd8 000000000000fb88 ffff88003bf91098
Call Trace:
[] rwsem_down_failed_common+0x95/0x1d0
[] rwsem_down_write_failed+0x23/0x30
[] call_rwsem_down_write_failed+0x13/0x20
[] ? down_write+0x32/0x40
[] sys_mmap_pgoff+0x5c/0x2d0
[] sys_mmap+0x29/0x30
[] system_call_fastpath+0x16/0x1b
INFO: task atop:48253 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
atop D 0000000000000000 0 48253 1 0x00000000
ffff880017e01c50 0000000000000082 ffff88001f162c40 ffff88001f11cbb0
00007f7c71058000 ffff880017e01c28 ffffffff8113680f ffff88003c67cb00
ffff88003b9ff058 ffff880017e01fd8 000000000000fb88 ffff88003b9ff058
Call Trace:
[] ? follow_page+0x31f/0x470
[] rwsem_down_failed_common+0x95/0x1d0
[] rwsem_down_read_failed+0x26/0x30
[] call_rwsem_down_read_failed+0x14/0x30
[] ? down_read+0x24/0x30
[] __access_remote_vm+0x41/0x1f0
[] ? vma_merge+0x1d2/0x3e0
[] ? mlock_vma_pages_range+0x98/0xa0
[] access_process_vm+0x5b/0x80
[] proc_pid_cmdline+0x6d/0x120
[] ? alloc_pages_current+0xaa/0x110
[] proc_info_read+0xad/0xf0
[] vfs_read+0xb5/0x1a0
[] sys_read+0x51/0x90
[] system_call_fastpath+0x16/0x1b
INFO: task beam.smp:32272 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
beam.smp D 0000000000000000 0 32272 1 0x00000000
ffff880033001e48 0000000000000086 ffff880033001db8 ffffffff8118cf68
ffff88002f71e180 ffff88002f71e180 ffff880033001dd8 ffff88003edd2950
ffff88003bf91098 ffff880033001fd8 000000000000fb88 ffff88003bf91098
Call Trace:
[] ? d_free+0x58/0x60
[] ? __fput+0x1a1/0x210
[] rwsem_down_failed_common+0x95/0x1d0
[] ? sys_accept4+0x286/0x2b0
[] rwsem_down_write_failed+0x23/0x30
[] call_rwsem_down_write_failed+0x13/0x20
[] ? down_write+0x32/0x40
[] sys_munmap+0x48/0x80
[] system_call_fastpath+0x16/0x1b
INFO: task atop:48253 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
atop D 0000000000000000 0 48253 1 0x00000000
ffff880017e01c50 0000000000000082 ffff88001f162c40 ffff88001f11cbb0
00007f7c71058000 ffff880017e01c28 ffffffff8113680f ffff88001fdbb780
ffff88003b9ff058 ffff880017e01fd8 000000000000fb88 ffff88003b9ff058
Call Trace:
[] ? follow_page+0x31f/0x470
[] rwsem_down_failed_common+0x95/0x1d0
[] rwsem_down_read_failed+0x26/0x30
[] call_rwsem_down_read_failed+0x14/0x30
[] ? down_read+0x24/0x30
[] __access_remote_vm+0x41/0x1f0
[] ? vma_merge+0x1d2/0x3e0
[] ? mlock_vma_pages_range+0x98/0xa0
[] access_process_vm+0x5b/0x80
[] proc_pid_cmdline+0x6d/0x120
[] ? alloc_pages_current+0xaa/0x110
[] proc_info_read+0xad/0xf0
[] vfs_read+0xb5/0x1a0
[] sys_read+0x51/0x90
[] system_call_fastpath+0x16/0x1b
INFO: task blogbench:18560 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
blogbench D 0000000000000000 0 18560 18557 0x00000000
ffff8800098f9cd8 0000000000000086 ffffffffa00fdbe0 000000000000005e
ffff88003de1d2c0 ffff880001510878 ffff8800098f9eb8 0000000000000001
ffff88003d5ed098 ffff8800098f9fd8 000000000000fb88 ffff88003d5ed098
Call Trace:
[] __mutex_lock_slowpath+0x13e/0x180
[] mutex_lock+0x2b/0x50
[] generic_file_aio_write+0x59/0xe0
[] do_sync_write+0xfa/0x140
[] ? autoremove_wake_function+0x0/0x40
[] ? hrtimer_cancel+0x22/0x30
[] ? hrtimer_nanosleep+0xc4/0x180
[] ? security_file_permission+0x16/0x20
[] vfs_write+0xb8/0x1a0
[] sys_write+0x51/0x90
[] system_call_fastpath+0x16/0x1b
INFO: task blogbench:18569 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
blogbench D 0000000000000000 0 18569 18557 0x00000000
ffff8800098cfcd8 0000000000000086 ffff8800098cfc88 ffffffff811a849c
ffff880025ee9118 ffff88001b908a58 ffffffffa00fdb00 ffff88001bae5908
ffff88003b6705f8 ffff8800098cffd8 000000000000fb88 ffff88003b6705f8
Call Trace:
[] ? __getblk+0x2c/0x2e0
[] ? __ext3_journal_dirty_metadata+0x2d/0x60 [ext3]
[] __mutex_lock_slowpath+0x13e/0x180
[] mutex_lock+0x2b/0x50
[] generic_file_aio_write+0x59/0xe0
[] do_sync_write+0xfa/0x140
[] ? check_preempt_curr+0x7c/0x90
[] ? autoremove_wake_function+0x0/0x40
[] ? mntput_no_expire+0x30/0x110
[] ? putname+0x35/0x50
[] ? sys_mkdirat+0xcf/0x120
[] ? security_file_permission+0x16/0x20
[] vfs_write+0xb8/0x1a0
[] sys_write+0x51/0x90
[] ? do_device_not_available+0xe/0x10
[] system_call_fastpath+0x16/0x1b
INFO: task blogbench:18570 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
blogbench D 0000000000000000 0 18570 18557 0x00000000
ffff880009813cd8 0000000000000086 ffff880009813c88 ffffffff811a849c
ffff88002d153438 ffff88001b908a58 ffffffffa00fdb00 ffff88001bae5908
ffff880037d75af8 ffff880009813fd8 000000000000fb88 ffff880037d75af8
Call Trace:
[] ? __getblk+0x2c/0x2e0
[] ? __ext3_journal_dirty_metadata+0x2d/0x60 [ext3]
[] __mutex_lock_slowpath+0x13e/0x180
[] mutex_lock+0x2b/0x50
[] generic_file_aio_write+0x59/0xe0
[] do_sync_write+0xfa/0x140
[] ? check_preempt_curr+0x7c/0x90
[] ? autoremove_wake_function+0x0/0x40
[] ? mntput_no_expire+0x30/0x110
[] ? putname+0x35/0x50
[] ? sys_mkdirat+0xcf/0x120
[] ? security_file_permission+0x16/0x20
[] vfs_write+0xb8/0x1a0
[] sys_write+0x51/0x90
[] system_call_fastpath+0x16/0x1b
INFO: task blogbench:18572 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
blogbench D 0000000000000000 0 18572 18557 0x00000000
ffff880001859cd8 0000000000000086 ffffffffa00fdbe0 0000000000000000
ffff8800099986c0 ffff88002f7b2eb8 ffff880001859eb8 0000000000000001
ffff88003d849ab8 ffff880001859fd8 000000000000fb88 ffff88003d849ab8
Call Trace:
[] __mutex_lock_slowpath+0x13e/0x180
[] mutex_lock+0x2b/0x50
[] generic_file_aio_write+0x59/0xe0
[] do_sync_write+0xfa/0x140
[] ? do_filp_open+0xbc4/0xd60
[] ? autoremove_wake_function+0x0/0x40
[] ? hrtimer_cancel+0x22/0x30
[] ? security_file_permission+0x16/0x20
[] vfs_write+0xb8/0x1a0
[] sys_write+0x51/0x90
[] ? do_device_not_available+0xe/0x10
[] system_call_fastpath+0x16/0x1b
INFO: task blogbench:18577 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
blogbench D 0000000000000000 0 18577 18557 0x00000000
ffff88000985bcd8 0000000000000086 ffffffffa00fdbe0 0000000000000000
ffff880033190180 ffff880007c40878 ffff88000985beb8 0000000000000001
ffff88001935daf8 ffff88000985bfd8 000000000000fb88 ffff88001935daf8
Call Trace:
[] __mutex_lock_slowpath+0x13e/0x180
[] mutex_lock+0x2b/0x50
[] generic_file_aio_write+0x59/0xe0
[] do_sync_write+0xfa/0x140
[] ? do_filp_open+0xbc4/0xd60
[] ? autoremove_wake_function+0x0/0x40
[] ? hrtimer_cancel+0x22/0x30
[] ? security_file_permission+0x16/0x20
[] vfs_write+0xb8/0x1a0
[] sys_write+0x51/0x90
[] ? do_device_not_available+0xe/0x10
[] system_call_fastpath+0x16/0x1b
INFO: task blogbench:18588 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
blogbench D 0000000000000000 0 18588 18557 0x00000000
ffff88000697dba8 0000000000000086 ffff880037fd58c0 0000000000000000
0000000000000000 ffff88000697db78 0000000000000001 ffff880004c60438
ffff8800068565f8 ffff88000697dfd8 000000000000fb88 ffff8800068565f8
Call Trace:
[] __mutex_lock_slowpath+0x13e/0x180
[] ? __d_lookup+0xa7/0x150
[] mutex_lock+0x2b/0x50
[] do_lookup+0x11b/0x230
[] __link_path_walk+0x734/0x1030
[] ? generic_file_aio_read+0x380/0x700
[] path_walk+0x6a/0xe0
[] do_path_lookup+0x5b/0xa0
[] ? get_empty_filp+0xa0/0x180
[] do_filp_open+0xfb/0xd60
[] ? _atomic_dec_and_lock+0x55/0x80
[] ? mntput_no_expire+0x30/0x110
[] ? alloc_fd+0x92/0x160
[] do_sys_open+0x69/0x140
[] sys_open+0x20/0x30
[] system_call_fastpath+0x16/0x1b