Hi, My FreeBSD 11-RC2 with ZFS is crashing after some hours running with the same debug message. Let me know if i can help with more info: # kgdb kernel.debug /var/crash/vmcore.last GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: Fatal trap 12: page fault while in kernel mode cpuid = 7; apic id = 0e fault virtual address = 0xffffffffffffffc0 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff822cac63 stack pointer = 0x28:0xfffffe02370d02e0 frame pointer = 0x28:0xfffffe02370d0350 code segment = base rx0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 1174 (syslogd) trap number = 12 panic: page fault cpuid = 5 KDB: stack backtrace: #0 0xffffffff80b33417 at kdb_backtrace+0x67 #1 0xffffffff80ae8812 at vpanic+0x182 #2 0xffffffff80ae8683 at panic+0x43 #3 0xffffffff81036d31 at trap_fatal+0x351 #4 0xffffffff81036f23 at trap_pfault+0x1e3 #5 0xffffffff810364cc at trap+0x26c #6 0xffffffff810191d1 at calltrap+0x8 #7 0xffffffff822a360d at dmu_buf_hold_array_by_dnode+0x34d #8 0xffffffff822a4703 at dmu_write_uio_dnode+0x43 #9 0xffffffff822a46a2 at dmu_write_uio_dbuf+0x42 #10 0xffffffff82342c48 at zfs_freebsd_write+0x7b8 #11 0xffffffff811a1dc5 at VOP_WRITE_APV+0x125 #12 0xffffffff80bcffec at vn_write+0x25c #13 0xffffffff80bcd5b2 at vn_io_fault1+0x1c2 #14 0xffffffff80bcb5a7 at vn_io_fault+0x197 #15 0xffffffff80b50667 at dofilewrite+0x87 #16 0xffffffff80b50348 at kern_writev+0x68 #17 0xffffffff80b505b6 at sys_writev+0x36 Uptime: 4h30m39s Dumping 1031 out of 8142 MB: (CTRL-C to abort) ..2%..11%..21%..32%..41%..52%..61%..72%..81%..92% Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /usr/lib/debug//boot/kernel/zfs.ko.debug...done. done. Loaded symbols for /boot/kernel/zfs.ko Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /usr/lib/debug//boot/kernel/opensolaris.ko.debug...done. done. Loaded symbols for /boot/kernel/opensolaris.ko Reading symbols from /boot/kernel/ng_UI.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_UI.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_UI.ko Reading symbols from /boot/kernel/netgraph.ko...Reading symbols from /usr/lib/debug//boot/kernel/netgraph.ko.debug...done. done. Loaded symbols for /boot/kernel/netgraph.ko Reading symbols from /boot/kernel/ng_async.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_async.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_async.ko Reading symbols from /boot/kernel/ng_bpf.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_bpf.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_bpf.ko Reading symbols from /boot/kernel/ng_cisco.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_cisco.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_cisco.ko Reading symbols from /boot/kernel/ng_echo.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_echo.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_echo.ko Reading symbols from /boot/kernel/ng_ether.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_ether.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_ether.ko Reading symbols from /boot/kernel/ng_frame_relay.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_frame_relay.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_frame_relay.ko Reading symbols from /boot/kernel/ng_hole.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_hole.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_hole.ko Reading symbols from /boot/kernel/ng_iface.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_iface.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_iface.ko Reading symbols from /boot/kernel/ng_ksocket.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_ksocket.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_ksocket.ko Reading symbols from /boot/kernel/ng_l2tp.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_l2tp.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_l2tp.ko Reading symbols from /boot/kernel/ng_lmi.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_lmi.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_lmi.ko Reading symbols from /boot/kernel/ng_mppc.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_mppc.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_mppc.ko Reading symbols from /boot/kernel/rc4.ko...Reading symbols from /usr/lib/debug//boot/kernel/rc4.ko.debug...done. done. Loaded symbols for /boot/kernel/rc4.ko Reading symbols from /boot/kernel/ng_netflow.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_netflow.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_netflow.ko Reading symbols from /boot/kernel/ng_ppp.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_ppp.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_ppp.ko Reading symbols from /boot/kernel/ng_pppoe.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_pppoe.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_pppoe.ko Reading symbols from /boot/kernel/ng_pptpgre.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_pptpgre.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_pptpgre.ko Reading symbols from /boot/kernel/ng_rfc1490.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_rfc1490.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_rfc1490.ko Reading symbols from /boot/kernel/ng_socket.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_socket.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_socket.ko Reading symbols from /boot/kernel/ng_tee.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_tee.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_tee.ko Reading symbols from /boot/kernel/ng_tty.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_tty.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_tty.ko Reading symbols from /boot/kernel/ng_vjc.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_vjc.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_vjc.ko Reading symbols from /boot/kernel/coretemp.ko...Reading symbols from /usr/lib/debug//boot/kernel/coretemp.ko.debug...done. done. Loaded symbols for /boot/kernel/coretemp.ko Reading symbols from /boot/kernel/ng_tcpmss.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_tcpmss.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_tcpmss.ko Reading symbols from /boot/kernel/ng_nat.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_nat.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_nat.ko Reading symbols from /boot/kernel/ng_car.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_car.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_car.ko #0 doadump (textdump=<value optimized out>) at pcpu.h:221 221 pcpu.h: No such file or directory. in pcpu.h (kgdb) list *0xffffffff822cac63 0xffffffff822cac63 is in dmu_zfetch (/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_zfetch.c:243). 238 239 rw_enter(&zf->zf_rwlock, RW_READER); 240 241 for (zs = list_head(&zf->zf_stream); zs != NULL; 242 zs = list_next(&zf->zf_stream, zs)) { 243 if (blkid == zs->zs_blkid) { 244 mutex_enter(&zs->zs_lock); 245 /* 246 * zs_blkid could have changed before we 247 * acquired zs_lock; re-check them here. Current language: auto; currently minimal (kgdb) bt #0 doadump (textdump=<value optimized out>) at pcpu.h:221 #1 0xffffffff80ae8299 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:366 #2 0xffffffff80ae884b in vpanic (fmt=<value optimized out>, ap=<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:759 #3 0xffffffff80ae8683 in panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:690 #4 0xffffffff81036d31 in trap_fatal (frame=0xfffffe02370d0230, eva=18446744073709551552) at /usr/src/sys/amd64/amd64/trap.c:841 #5 0xffffffff81036f23 in trap_pfault (frame=0xfffffe02370d0230, usermode=0) at /usr/src/sys/amd64/amd64/trap.c:691 #6 0xffffffff810364cc in trap (frame=0xfffffe02370d0230) at /usr/src/sys/amd64/amd64/trap.c:442 #7 0xffffffff810191d1 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236 #8 0xffffffff822cac63 in dmu_zfetch (zf=<value optimized out>, blkid=<value optimized out>, nblks=<value optimized out>, fetch_data=<value optimized out>) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_zfetch.c:241 #9 0xffffffff822a360d in dmu_buf_hold_array_by_dnode (dn=<value optimized out>, offset=<value optimized out>, length=<value optimized out>, read=0, tag=0xffffffff8239f791, numbufsp=<value optimized out>, dbpp=0xffffffffffffffc0, flags=<value optimized out>) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:463 #10 0xffffffff822a4703 in dmu_write_uio_dnode (dn=0xfffff8001bc532c8, uio=0xfffff8010f1a1600, size=47, tx=0xfffff8010f16aa00) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:1173 #11 0xffffffff822a46a2 in dmu_write_uio_dbuf (zdb=0xfffff8001bba4438, uio=0xfffff8010f1a1600, size=47, tx=0xfffff8010f16aa00) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:1244 #12 0xffffffff82342c48 in zfs_freebsd_write (ap=<value optimized out>) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1117 #13 0xffffffff811a1dc5 in VOP_WRITE_APV (vop=<value optimized out>, a=<value optimized out>) at vnode_if.c:1000 #14 0xffffffff80bcffec in vn_write (fp=<value optimized out>, uio=0xfffff8010f1a1600, active_cred=<value optimized out>, flags=<value optimized out>, td=0x0) at vnode_if.h:413 #15 0xffffffff80bcd5b2 in vn_io_fault1 () at /usr/src/sys/kern/vfs_vnops.c:1060 #16 0xffffffff80bcb5a7 in vn_io_fault (fp=<value optimized out>, uio=<value optimized out>, active_cred=<value optimized out>, flags=<value optimized out>, td=<value optimized out>) at /usr/src/sys/kern/vfs_vnops.c:1165 #17 0xffffffff80b50667 in dofilewrite (td=0xfffff8001ba19500, fd=19, fp=0xfffff8001b91cd70, auio=0xfffff8010f1a1600, offset=<value optimized out>, flags=0) at file.h:311 #18 0xffffffff80b50348 in kern_writev (td=0xfffff8001ba19500, fd=19, auio=0xfffff8010f1a1600) at /usr/src/sys/kern/sys_generic.c:506 #19 0xffffffff80b505b6 in sys_writev (td=0xfffff8001ba19500, uap=0xfffffe02370d0b80) at /usr/src/sys/kern/sys_generic.c:491 #20 0xffffffff8103768e in amd64_syscall (td=<value optimized out>, traced=0) at subr_syscall.c:135 #21 0xffffffff810194bb in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 #22 0x0000000800b87f8a in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb)
Appears to be fixed. Please re-submit if that is inaccurate.