Linode Forum
Linode Community Forums 		 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Post new topic  Reply to topic

Board index » Linux Community Forums » General Discussion
  Previous topic | Next topic 
Author Message
dfelicia
PostPosted: Mon Sep 14, 2009 1:18 pm 
Offline
Senior Member

Joined: Mon Jul 30, 2007 9:55 pm
Posts: 80
Running 32-bit Gentoo and updated world, last night. Was running 2.6.29-linode19, and decided to try 2.6.30.5-linode20 since I was going to reboot (and since caker moved 2.6.29 to the deprecated list).

It hangs on boot:

Code:
Showing last 100 lines from current boot
-----------------------------------------
 00000000 00000000 00000000 00000000 e3221584 e3224b80 e3221580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d
 c0 8d 84 97 80 06 00 00 <f0> 01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00 
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e2483f28
CR2: 00000000964439d8
---[ end trace 28ff39c8e0512d27 ]---
BUG: unable to handle kernel paging request at 964438d8
IP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0
*pdpt = 00000004bd039007 
Oops: 0002 [#3] SMP 
last sysfs file: 
Modules linked in:

Pid: 12, comm: events/1 Tainted: G      D    (2.6.30.5-linode20 #1) 
EIP: 0061:[<c0172b50>] EFLAGS: 00010246 CPU: 1
EIP is at refresh_cpu_vm_stats+0x70/0xc0
EAX: 96443880 EBX: ffffffff ECX: 00000200 EDX: f5752040
ESI: c06fb200 EDI: c06fb100 EBP: e2481f2c ESP: e2481f28
 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0069
Process events/1 (pid: 12, ti=e2480000 task=e245d420 task.ti=e2480000)
Stack:
 00000100 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 e3211584 e3214b80 e3211580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d
 c0 8d 84 97 80 06 00 00 <f0> 01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00 
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e2481f28
CR2: 00000000964438d8
---[ end trace 28ff39c8e0512d28 ]---
BUG: unable to handle kernel paging request at 96442fd8
IP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0
*pdpt = 000000052d058027 
Oops: 0002 [#4] SMP 
last sysfs file: 
Modules linked in:

Pid: 11, comm: events/0 Tainted: G      D    (2.6.30.5-linode20 #1) 
EIP: 0061:[<c0172b50>] EFLAGS: 00010246 CPU: 0
EIP is at refresh_cpu_vm_stats+0x70/0xc0
EAX: 96442f80 EBX: 00000001 ECX: 00000200 EDX: f5752000
ESI: c06fa980 EDI: c06fa900 EBP: e247ff2c ESP: e247ff28
 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0069
Process events/0 (pid: 11, ti=e247e000 task=e245d810 task.ti=e247e000)
Stack:
 00000080 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 e3201584 e3204b80 e3201580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d
 c0 8d 84 97 80 06 00 00 <f0> 01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00 
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e247ff28
CR2: 0000000096442fd8
---[ end trace 28ff39c8e0512d29 ]---
udev: starting version 141
udev: deprecated sysfs layout; update the kernel or disable CONFIG_SYSFS_DEPRECATED; some udev features will n
ot work correctly
                                                     [ ok ]
 * Populating /dev with existing devices through uevents ...              [ ok ]
 * Waiting for uevents to be processed ...                                [ ok ]
 * Mounting devpts at /dev/pts ...                                        [ ok ]
 * Checking root filesystem .../dev/xvda: clean, 580007/6209536 files, 6110565/12419072 blocks
                                           [ ok ]
 * Remounting root filesystem read/write ...EXT3 FS on xvda, internal journal
                              [ ok ]
FATAL: Could not load /lib/modules/2.6.30.5-linode20/modules.dep: No such file or directory
 * Checking all filesystems ...                                           [ ok ]
 * Mounting local filesystems ...                                         [ ok ]
 * Mounting misc binary format filesystem ...                             [ ok ]
 * Activating (possible) swap ...Adding 655352k swap on /dev/xvdb.  Priority:-1 extents:1 across:655352k SS
                                         [ ok ]
 * Setting system clock using the hardware clock [UTC] ...                [ ok ]
 * Configuring kernel parameters ...                                      [ ok ]
 * Updating environment ...                                               [ ok ]
 * Cleaning /var/lock, /var/run ...                                       [ ok ]
 * Wiping /tmp directory ...                                              [ ok ]

<HANGS FOREVER HERE - NORMALLY UDEV-POSTMOUNT RUNS NOW>


Switching back to 2.6.29-linode18 results in a boot, but there is an Oops:


Code:
Showing last 100 lines from current boot
-----------------------------------------
 00000000 00000000 00000000 00000000 e3221584 e3224b80 e3221580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d
 c0 8d 84 97 80 06 00 00 <f0> 01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e2483f28
CR2: 00000000964439d8
---[ end trace 28ff39c8e0512d27 ]---
BUG: unable to handle kernel paging request at 964438d8
IP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0
*pdpt = 00000004bd039007
Oops: 0002 [#3] SMP
last sysfs file:
Modules linked in:

Pid: 12, comm: events/1 Tainted: G      D    (2.6.30.5-linode20 #1)
EIP: 0061:[<c0172b50>] EFLAGS: 00010246 CPU: 1
EIP is at refresh_cpu_vm_stats+0x70/0xc0
EAX: 96443880 EBX: ffffffff ECX: 00000200 EDX: f5752040
EIP is at refresh_cpu_vm_stats+0x70/0xc0
EAX: 96443880 EBX: ffffffff ECX: 00000200 EDX: f5752040
ESI: c06fb200 EDI: c06fb100 EBP: e2481f2c ESP: e2481f28
 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0069
Process events/1 (pid: 12, ti=e2480000 task=e245d420 task.ti=e2480000)
Stack:
 00000100 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 e3211584 e3214b80 e3211580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d c0 8d 84 97 80 06 00 00 <f0> 01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e2481f28
CR2: 00000000964438d8
---[ end trace 28ff39c8e0512d28 ]---
BUG: unable to handle kernel paging request at 96442fd8
IP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0
*pdpt = 000000052d058027
Oops: 0002 [#4] SMP
last sysfs file:
Modules linked in:

Pid: 11, comm: events/0 Tainted: G      D    (2.6.30.5-linode20 #1)


Interestingly, using pv-grub to boot a kernel compiled using gentoo-sources (2.6.30-gentoo-r6) based on /proc/config.gz from 2.6.29-linode19 I get no Oops. That said, the initial boot of this pv-grub kernel resulting in a panic during udev-postmount. Subsequent boot worked. <shrug>
Top
   
Reply with quote  
caker
 Post subject:
PostPosted: Mon Sep 14, 2009 1:29 pm 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
You're getting this because the host your Linode is on has a very old Xen stack, which doesn't support our latest versions of pv_ops based kernels. Submit a ticket and we'll move you to an updated host.

-Chris
Top
   
Reply with quote  
dfelicia
 Post subject:
PostPosted: Mon Sep 14, 2009 1:55 pm 
Offline
Senior Member

Joined: Mon Jul 30, 2007 9:55 pm
Posts: 80
OK, will do. FYI, pv-grub kernel panic'd shortly after booting:

Code:
------------[ cut here ]------------
 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069
Process apache2 (pid: 5955, ti=d7c68000 task=e1ccdc00 task.ti=d7c68000)
Stack:
 c05c7740 e2524420 c0125e40 0011aee0 00000000 00000000 00000200 e16f3f4c
 e171ff4c 00000000 e15696c8 c03a2020 e24df3c0 000011e7 e1569700 00000000
 00000001 e15696c8 00000001 c03a2683 d7ce9600 00001743 e184e6c8 e184e6c4
Call Trace:
 [<c0125e40>] ? try_to_wake_up+0xa0/0x1d0
 [<c03a2020>] ? update_queue+0x80/0xb0
 [<c03a2683>] ? sys_semtimedop+0x3d3/0x6e0
 [<c0121000>] ? init_sched_build_groups+0xd0/0x130
 [<c01051d6>] ? __raw_callee_save_xen_save_fl+0x6/0x8
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c0165f74>] ? find_get_page+0x24/0xb0
 [<c016631b>] ? find_lock_page+0x1b/0x70
 [<c0166830>] ? filemap_fault+0x0/0x400
 [<c0166954>] ? filemap_fault+0x124/0x400
 [<c0487953>] ? release_sock+0x13/0xa0
 [<c01051de>] ? __raw_callee_save_xen_restore_fl+0x6/0x8
 [<c0104290>] ? xen_set_pte_at+0x80/0xf0
 [<c0178f81>] ? __do_fault+0x3b1/0x490
 [<c018cbcb>] ? fd_install+0x3b/0x50
 [<c0166830>] ? filemap_fault+0x0/0x400
 [<c017ae49>] ? handle_mm_fault+0x169/0x900
 [<c01051de>] ? __raw_callee_save_xen_restore_fl+0x6/0x8
 [<c05c3e3e>] ? _spin_unlock_irqrestore+0x1e/0x30
 [<c01babd2>] ? ep_scan_ready_list+0x142/0x150
 [<c05c3dd5>] ? _spin_lock+0x5/0x10
 [<c019b2a3>] ? set_close_on_exec+0x43/0x60
 [<c010bd54>] ? sys_ipc+0x74/0x2f0
 [<c01051ee>] ? __raw_callee_save_xen_irq_enable+0x6/0x8
 [<c0107d1c>] ? sysenter_past_esp+0x3d/0x63
 [<c0107d54>] ? sysenter_do_call+0x12/0x28
Code: c2 74 0e 0f ae f0 89 f6 8b 46 04 f6 40 0c 04 74 09 5b 5e c3 8d b6 00 00 00 00 89 d0 ff 15 f0 4e 6f c0 5b 5e 8d b6 00 00 00 00 c3 <0f> 0b eb fe 8d 76 00 53 89 c3 8b 0c 85 a0 d6 73 c0 ba 00 96 7a
EIP: [<c011e6c9>] resched_task+0x69/0x70 SS:ESP 0069:d7c69d48
---[ end trace 69daa05273def3ad ]---
Kernel panic - not syncing: Fatal exception
Pid: 5955, comm: apache2 Tainted: G      D W  2.6.30-gentoo-r6 #1
Call Trace:
 [<c05c146d>] ? panic+0x42/0xeb
 [<c010b2b6>] ? oops_end+0x76/0xa0
 [<c010903f>] ? do_invalid_op+0x7f/0x90
 [<c011e6c9>] ? resched_task+0x69/0x70
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c010599f>] ? xen_sched_clock+0x1f/0x80
 [<c05c40e5>] ? error_code+0x6d/0x74
 [<c012007b>] ? sched_group_rt_runtime+0x3b/0x70
 [<c05c00d8>] ? wakeup_secondary_cpu_via_init+0xc8/0x234
 [<c0108fc0>] ? do_invalid_op+0x0/0x90
 [<c011e6c9>] ? resched_task+0x69/0x70
 [<c0125e40>] ? try_to_wake_up+0xa0/0x1d0
 [<c03a2020>] ? update_queue+0x80/0xb0
 [<c03a2683>] ? sys_semtimedop+0x3d3/0x6e0
 [<c0121000>] ? init_sched_build_groups+0xd0/0x130
 [<c01051d6>] ? __raw_callee_save_xen_save_fl+0x6/0x8
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c0165f74>] ? find_get_page+0x24/0xb0
 [<c016631b>] ? find_lock_page+0x1b/0x70
 [<c0166830>] ? filemap_fault+0x0/0x400
 [<c0166954>] ? filemap_fault+0x124/0x400
 [<c0487953>] ? release_sock+0x13/0xa0
 [<c01051de>] ? __raw_callee_save_xen_restore_fl+0x6/0x8
 [<c0104290>] ? xen_set_pte_at+0x80/0xf0
 [<c0178f81>] ? __do_fault+0x3b1/0x490
 [<c018cbcb>] ? fd_install+0x3b/0x50
 [<c0166830>] ? filemap_fault+0x0/0x400
 [<c017ae49>] ? handle_mm_fault+0x169/0x900
 [<c01051de>] ? __raw_callee_save_xen_restore_fl+0x6/0x8
 [<c05c3e3e>] ? _spin_unlock_irqrestore+0x1e/0x30
 [<c01babd2>] ? ep_scan_ready_list+0x142/0x150
 [<c05c3dd5>] ? _spin_lock+0x5/0x10
 [<c019b2a3>] ? set_close_on_exec+0x43/0x60
 [<c010bd54>] ? sys_ipc+0x74/0x2f0
 [<c01051ee>] ? __raw_callee_save_xen_irq_enable+0x6/0x8
 [<c0107d1c>] ? sysenter_past_esp+0x3d/0x63
 [<c0107d54>] ? sysenter_do_call+0x12/0x28
Rebooting in 3 seconds..
Top
   
Reply with quote  
dfelicia
 Post subject:
PostPosted: Mon Sep 14, 2009 8:58 pm 
Offline
Senior Member

Joined: Mon Jul 30, 2007 9:55 pm
Posts: 80
Migration did the trick.

BTW, Linode support was excellent as usual. My migration was ready literally a few minutes after I logged the ticket. I've never had such good customer support.
Top
   
Reply with quote  
caker
 Post subject:
PostPosted: Mon Sep 14, 2009 9:31 pm 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
Would you like fries with that shake?

Glad it worked out...

-Chris
Top
   
Reply with quote  
Display posts from previous:  Sort by  
Post new topic  Reply to topic

Board index » Linux Community Forums » General Discussion


Who is online

Users browsing this forum: No registered users and 4 guests

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group