Bug 183663

Fatal trap 9: general protection fault while in kernel mode
cpuid = 4; apic id = 04
instruction pointer<--->= 0x20:0xffffffff80938d51
stack pointer<->        = 0x28:0xffffff80002fb890
frame pointer<->        = 0x28:0xffffff80002fb900
code segment<--><------>= base rx0, limit 0xfffff, type 0x1b
<------><------><------>= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags<------>= resume, IOPL = 0
current process><------>= 12 (swi4: clock)
trap number<---><------>= 9
panic: general protection fault
cpuid = 4
KDB: stack backtrace:
#0 0xffffffff80947986 at kdb_backtrace+0x66
#1 0xffffffff8090d9ae at panic+0x1ce
#2 0xffffffff80cf20d0 at trap_fatal+0x290
#3 0xffffffff80cf28e1 at trap+0x241
#4 0xffffffff80cdbd13 at calltrap+0x8
#5 0xffffffff80938ff5 at sched_add+0x55
#6 0xffffffff80916b08 at setrunnable+0x78
#7 0xffffffff80952c9f at sleepq_timeout+0x4f
#8 0xffffffff80923698 at softclock+0x378
#9 0xffffffff808dec2d at intr_event_execute_handlers+0xfd
#10 0xffffffff808e041d at ithread_loop+0x9d
#11 0xffffffff808db67f at fork_exit+0x11f
#12 0xffffffff80cdc23e at fork_trampoline+0xe
Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/geom_mirror.ko
Reading symbols from /boot/kernel/pf.ko...Reading symbols from /boot/kernel/pf.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/pf.ko
Reading symbols from /boot/kernel/if_bridge.ko...Reading symbols from /boot/kernel/if_bridge.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/if_bridge.ko
Reading symbols from /boot/kernel/bridgestp.ko...Reading symbols from /boot/kernel/bridgestp.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/bridgestp.ko
Reading symbols from /boot/kernel/netgraph.ko...Reading symbols from /boot/kernel/netgraph.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/netgraph.ko
Reading symbols from /boot/modules/vboxdrv.ko...Reading symbols from /boot/modules/vboxdrv.ko.symbols...done.
done.
Loaded symbols for /boot/modules/vboxdrv.ko
Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/zfs.ko
Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/opensolaris.ko
Reading symbols from /boot/kernel/pflog.ko...Reading symbols from /boot/kernel/pflog.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/pflog.ko
Reading symbols from /boot/modules/vboxnetflt.ko...Reading symbols from /boot/modules/vboxnetflt.ko.symbols...done.
done.
Loaded symbols for /boot/modules/vboxnetflt.ko
Reading symbols from /boot/kernel/ng_ether.ko...Reading symbols from /boot/kernel/ng_ether.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ng_ether.ko
Reading symbols from /boot/modules/vboxnetadp.ko...Reading symbols from /boot/modules/vboxnetadp.ko.symbols...done.
done.
Loaded symbols for /boot/modules/vboxnetadp.ko
#0  doadump (textdump=<value optimized out>) at pcpu.h:234
234<--->pcpu.h: No such file or directory.
<------>in pcpu.h
(kgdb) #0  doadump (textdump=<value optimized out>) at pcpu.h:234
#1  0xffffffff8090d486 in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:449
#2  0xffffffff8090d987 in panic (fmt=0x1 <Address 0x1 out of bounds>)
    at /usr/src/sys/kern/kern_shutdown.c:637
#3  0xffffffff80cf20d0 in trap_fatal (frame=0x9, eva=<value optimized out>)
    at /usr/src/sys/amd64/amd64/trap.c:879
#4  0xffffffff80cf28e1 in trap (frame=0xffffff80002fb7e0)
    at /usr/src/sys/amd64/amd64/trap.c:605
#5  0xffffffff80cdbd13 in calltrap ()
    at /usr/src/sys/amd64/amd64/exception.S:232
#6  0xffffffff80938d51 in sched_pickcpu (td=0xfffffe000a9a4490, flags=0)
    at /usr/src/sys/kern/sched_ule.c:1211
#7  0xffffffff80938ff5 in sched_add (td=0xfffffe000a9a4490, flags=0)
    at /usr/src/sys/kern/sched_ule.c:2370
#8  0xffffffff80916b08 in setrunnable (td=<value optimized out>)
    at /usr/src/sys/kern/kern_synch.c:537
#9  0xffffffff80952c9f in sleepq_timeout (arg=<value optimized out>)
    at /usr/src/sys/kern/subr_sleepqueue.c:905
#10 0xffffffff80923698 in softclock (arg=<value optimized out>)
    at /usr/src/sys/kern/kern_timeout.c:520
#11 0xffffffff808dec2d in intr_event_execute_handlers (
    p=<value optimized out>, ie=0xfffffe0008341400)
    at /usr/src/sys/kern/kern_intr.c:1272
#12 0xffffffff808e041d in ithread_loop (arg=0xfffffe0008324500)
    at /usr/src/sys/kern/kern_intr.c:1285
#13 0xffffffff808db67f in fork_exit (
    callout=0xffffffff808e0380 <ithread_loop>, arg=0xfffffe0008324500,.
    frame=0xffffff80002fbb00) at /usr/src/sys/kern/kern_fork.c:992
#14 0xffffffff80cdc23e in fork_trampoline ()
    at /usr/src/sys/amd64/amd64/exception.S:606
#15 0x0000000000000000 in ?? ()

(kgdb) list *0xffffffff80938d51
0xffffffff80938d51 is in sched_pickcpu (/usr/src/sys/kern/sched_ule.c:1211).
warning: Source file is more recent than executable.

1206                curthread->td_intr_nesting_level && ts->ts_cpu != self) {
1207                    SCHED_STAT_INC(pickcpu_intrbind);
1208                    ts->ts_cpu = self;
1209                    if (TDQ_CPU(self)->tdq_lowpri > pri) {
1210                            SCHED_STAT_INC(pickcpu_affinity);
1211                            return (ts->ts_cpu);
1212                    }
1213            }
1214            /*
1215             * If the thread can run on the last cpu and the affinity has not

How-To-Repeat: No idea, it happens randomly.