Tue Jan  8 10:43:35 CET 2019

FreeBSD filer2 12.0-STABLE FreeBSD 12.0-STABLE r342545 GENERIC  amd64

panic: I/O to pool 'tank4' appears to be hung on vdev guid 9065594179041453320 at '/dev/da7'.

GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...

Unread portion of the kernel message buffer:
panic: I/O to pool 'tank4' appears to be hung on vdev guid 9065594179041453320 at '/dev/da7'.
cpuid = 43
time = 1546934419
KDB: stack backtrace:
#0 0xffffffff80bedc07 at kdb_backtrace+0x67
#1 0xffffffff80ba1da3 at vpanic+0x1a3
#2 0xffffffff80ba1bf3 at panic+0x43
#3 0xffffffff82bc1281 at vdev_deadman+0x191
#4 0xffffffff82bc1131 at vdev_deadman+0x41
#5 0xffffffff82bc1131 at vdev_deadman+0x41
#6 0xffffffff82bb1ac7 at spa_deadman+0x87
#7 0xffffffff80bffea4 at taskqueue_run_locked+0x154
#8 0xffffffff80c01238 at taskqueue_thread_loop+0x98
#9 0xffffffff80b62d63 at fork_exit+0x83
#10 0xffffffff81056fce at fork_trampoline+0xe
Uptime: 17h51m23s
(da7:smartpqi1:0:64:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
(da7:smartpqi1:0:64:0): CAM status: Command timeout
(da7:smartpqi1:0:64:0): Error 5, Retries exhausted
(da7:smartpqi1:0:64:0): Synchronize cache failed
(da8:smartpqi1:0:65:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
(da8:smartpqi1:0:65:0): CAM status: Command timeout
(da8:smartpqi1:0:65:0): Error 5, Retries exhausted
(da8:smartpqi1:0:65:0): Synchronize cache failed
(da9:smartpqi1:0:66:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
(da9:smartpqi1:0:66:0): CAM status: Command timeout
(da9:smartpqi1:0:66:0): Error 5, Retries exhausted
(da9:smartpqi1:0:66:0): Synchronize cache failed
(da10:smartpqi1:0:67:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
(da10:smartpqi1:0:67:0): CAM status: Command timeout
(da10:smartpqi1:0:67:0): Error 5, Retries exhausted
(da10:smartpqi1:0:67:0): Synchronize cache failed
(da11:smartpqi1:0:68:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
(da11:smartpqi1:0:68:0): CAM status: Command timeout
(da11:smartpqi1:0:68:0): Error 5, Retries exhausted
(da11:smartpqi1:0:68:0): Synchronize cache failed
(da12:smartpqi1:0:69:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
(da12:smartpqi1:0:69:0): CAM status: Command timeout
(da12:smartpqi1:0:69:0): Error 5, Retries exhausted
(da12:smartpqi1:0:69:0): Synchronize cache failed
(da13:smartpqi1:0:70:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
(da13:smartpqi1:0:70:0): CAM status: Command timeout
(da13:smartpqi1:0:70:0): Error 5, Retries exhausted
(da13:smartpqi1:0:70:0): Synchronize cache failed
(da14:smartpqi1:0:71:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
(da14:smartpqi1:0:71:0): CAM status: Command timeout
(da14:smartpqi1:0:71:0): Error 5, Retries exhausted
(da14:smartpqi1:0:71:0): Synchronize cache failed
Dumping 10865 out of 196211 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%

Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /usr/lib/debug//boot/kernel/zfs.ko.debug...done.
done.
Loaded symbols for /boot/kernel/zfs.ko
Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /usr/lib/debug//boot/kernel/opensolaris.ko.debug...done.
done.
Loaded symbols for /boot/kernel/opensolaris.ko
Reading symbols from /boot/kernel/ioat.ko...Reading symbols from /usr/lib/debug//boot/kernel/ioat.ko.debug...done.
done.
Loaded symbols for /boot/kernel/ioat.ko
#0  doadump (textdump=<value optimized out>) at pcpu.h:230
230     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) #0  doadump (textdump=<value optimized out>) at pcpu.h:230
#1  0xffffffff80ba198b in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:446
#2  0xffffffff80ba1e03 in vpanic (fmt=<value optimized out>,
    ap=<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:872
#3  0xffffffff80ba1bf3 in panic (fmt=<value optimized out>)
    at /usr/src/sys/kern/kern_shutdown.c:799
#4  0xffffffff82bc1281 in vdev_deadman (vd=<value optimized out>)
    at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev.c:4353
#5  0xffffffff82bc1131 in vdev_deadman (vd=0xfffff8015a7ff000)
    at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev.c:4329
#6  0xffffffff82bc1131 in vdev_deadman (vd=0xfffff8186aaf7000)
    at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev.c:4329
#7  0xffffffff82bb1ac7 in spa_deadman (arg=0xfffffe01481ab000,
    pending=<value optimized out>)
    at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/spa_misc.c:666
#8  0xffffffff80bffea4 in taskqueue_run_locked (queue=0xfffff81840083100)
    at /usr/src/sys/kern/subr_taskqueue.c:467
#9  0xffffffff80c01238 in taskqueue_thread_loop (arg=<value optimized out>)
    at /usr/src/sys/kern/subr_taskqueue.c:773
#10 0xffffffff80b62d63 in fork_exit (
    callout=0xffffffff80c011a0 <taskqueue_thread_loop>,
    arg=0xffffffff8200a3b0, frame=0xfffffe013bc18340)
    at /usr/src/sys/kern/kern_fork.c:1059
#11 0xffffffff81056fce in fork_trampoline ()
    at /usr/src/sys/amd64/amd64/exception.S:993
#12 0x0000000000000000 in ?? ()
Current language:  auto; currently minimal
(kgdb)