[Kittyhawk] KH is not fault-tolerant/fault oblivious

Eric Van Hensbergen ericvh at gmail.com
Fri Sep 9 17:27:51 EDT 2011


Okay, so reproduction is as follows -- seems to happen reliably.
login2%  khqsub 512 60
login2%  khfoxdev

khfoxdev% khbootapp 500 worker.cpio.gz.uimg
khfoxdev% cat root.500.workers | khdo writefile root.500.workers

FWIW, I'm using ron's workers and my kernel -- but I think we'll see
this everywhere.

Going to switch khctl to my kernel just so I have that process in
place since its the kernel I'll need to "fix".  Haven't gone much
deeper than that at the moment, we don't get the decision to drop,
panic is inside the skb code (yay).  So I'm going to try and figure
out why we are running out unless someone can tell me something
horribly stupid I'm doing wrong (beyond using khdo writefile on a
kernel, I know that's stupid, its just the quickest way to reproduce).

        -eric


On Fri, Sep 9, 2011 at 4:12 PM, Eric Van Hensbergen <ericvh at gmail.com> wrote:
> Okay, to start out with, I'd like to say I triggered this by doing
> something I shouldn't have been doing -- but regardless, it crashes
> the khctl node -- the memory buffer console turned out to be
> unnecessary, it dumps out quite well to the jtag console (which is
> lucky because I didn't boot my new kernel on the khctl node).
>
> I'm still working on stable reproduction, when I have it I'll pass it
> on -- but offhand I think we have a memory leak in the tree receive
> path.
>
>       -eric
>
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {0}.0: bgtree: inject fifo timed out!
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> {20}.0: swapper: page allocation failure. order:0, mode:0x20
> {20}.0: Call Trace:
> {20}.0: [c0323ba0] [c000607c] show_stack+0x3c/0x1b0 (unreliable)
> {20}.0: [c0323bd0] [c005a778] __alloc_pages+0x2b8/0x2e0
> {20}.0: [c0323c20] [c007d7e8] cache_alloc_refill+0x368/0x5c0
> {20}.0: [c0323c70] [c007db08] __kmalloc+0xc8/0xd0
> {20}.0: [c0323c80] [c01c9180] __alloc_skb+0x60/0x130
> {20}.0: [c0323ca0] [c01b4748] bgtree_receive_interrupt+0x208/0x5a0
> {20}.0: [c0323d10] [c0050530] handle_IRQ_event+0x60/0xb0
> {20}.0: [c0323d30] [c005245c] handle_fasteoi_irq+0xac/0x1a0
> {20}.0: [c0323d50] [c0004198] do_IRQ+0xd8/0x110
> {20}.0: [c0323d70] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323e30] [000000b5] 0xb5
> {20}.0: [c0323e70] [c00040b4] do_softirq+0x64/0x70
> {20}.0: [c0323e80] [c00315a4] irq_exit+0x54/0x70
> {20}.0: [c0323e90] [c000419c] do_IRQ+0xdc/0x110
> {20}.0: [c0323eb0] [c000e644] ret_from_except+0x0/0x18
> {20}.0: [c0323f70] [c00070ac] cpu_idle+0xcc/0xe0
> {20}.0: [c0323f90] [c02682f4] rest_init+0x54/0x70
> {20}.0: [c0323fa0] [c02ddc44] start_kernel+0x314/0x390
> {20}.0: [c0323ff0] [c00001f8] skpinv+0x1a0/0x1dc
> {20}.0: Mem-info:
> {20}.0: DMA per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  51   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  13   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: HighMem per-cpu:
> {20}.0: CPU    0: Hot: hi:  186, btch:  31 usd: 100   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    1: Hot: hi:  186, btch:  31 usd:  28   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    2: Hot: hi:  186, btch:  31 usd:  97   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: CPU    3: Hot: hi:  186, btch:  31 usd:  36   Cold: hi:   62,
> btch:  15 usd:   0
> {20}.0: Active:2354 inactive:3829 dirty:0 writeback:0 unstable:0
> {20}.0:  free:321500 slab:189981 mapped:727 pagetables:48 bounce:0
> {20}.0: DMA free:1236kB min:3532kB low:4412kB high:5296kB active:0kB
> inactive:0kB present:780288kB pages_scanned:0 all_unreclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 1270
> {20}.0: HighMem free:1284764kB min:512kB low:1980kB high:3452kB
> active:9416kB inactive:15316kB present:1300480kB pages_scanned:0
> all_unr
> {20}.0: eclaimable? no
> {20}.0: lowmem_reserve[]: 0 0 0
> {20}.0: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB
> 1*1024kB 0*2048kB 0*4096kB = 1208kB
> {20}.0: HighMem: 1*4kB 1*8kB 23*16kB 11*32kB 3*64kB 0*128kB 1*256kB
> 1*512kB 1*1024kB 0*2048kB 313*4096kB = 1284764kB
> {20}.0: Swap cache: add 0, delete 0, find 0/0, race 0+0
> {20}.0: Free swap  = 0kB
> {20}.0: Total swap = 0kB
> {20}.0: Free swap:            0kB
> {20}.0: 524288 pages of RAM
> {20}.0: 327680 pages of HIGHMEM
> {20}.0: 5151 reserved pages
> {20}.0: 2885 pages shared
> {20}.0: 0 pages swap cached
> OK
>



More information about the Kittyhawk mailing list