Bug 181791 - [zfs] ZFS ARC Deadlock
Summary: [zfs] ZFS ARC Deadlock
Status: Open
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: 9.1-RELEASE
Hardware: Any Any
: Normal Affects Only Me
Assignee: freebsd-bugs (Nobody)
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2013-09-04 05:50 UTC by Grant Grant
Modified: 2017-12-31 22:27 UTC (History)
0 users

See Also:


Attachments
file.txt (7.62 KB, text/plain)
2013-09-04 05:50 UTC, Grant Grant
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Grant Grant 2013-09-04 05:50:00 UTC
Intermittent livelock/deadlock encountered typically every 1-2 days, up to twice a day after introducing ZFS pools of SSD members (no spinning disks).

Mailing list submission regarding this issue:
http://lists.freebsd.org/pipermail/freebsd-fs/2013-September/018202.html

Speculation such as bug may exist:
http://svnweb.freebsd.org/base?view=revision&revision=211762

Possibly same/similar bug:
http://lists.freebsd.org/pipermail/freebsd-stable/2013-January/071529.html

Discussion of similar issue in the context of OpenSolaris:
http://www.mail-archive.com/zfs-code@mail.opensolaris.org/msg00789.html

Attached to this PR are filesystem details.

procstat -kk -a:
  PID    TID COMM             TDNAME           KSTACK                       
    0 100000 kernel           swapper          mi_switch+0x194 sleepq_timedwait+0x42 _sleep+0x1c9 scheduler+0x359 mi_startup+0x77 btext+0x2c 
    0 100013 kernel           firmware taskq   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100019 kernel           thread taskq     mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100022 kernel           acpi_task_0      mi_switch+0x194 sleepq_wait+0x42 msleep_spin+0x1bb taskqueue_thread_loop+0x67 fork_exit+0x11f fork_trampoline+0xe 
    0 100023 kernel           acpi_task_1      mi_switch+0x194 sleepq_wait+0x42 msleep_spin+0x1bb taskqueue_thread_loop+0x67 fork_exit+0x11f fork_trampoline+0xe 
    0 100024 kernel           acpi_task_2      mi_switch+0x194 sleepq_wait+0x42 msleep_spin+0x1bb taskqueue_thread_loop+0x67 fork_exit+0x11f fork_trampoline+0xe 
    0 100025 kernel           kqueue taskq     mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100026 kernel           aiod_bio taskq   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100027 kernel           ffs_trim taskq   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100041 kernel           nfe0 taskq       mi_switch+0x194 sleepq_wait+0x42 msleep_spin+0x1bb taskqueue_thread_loop+0x67 fork_exit+0x11f fork_trampoline+0xe 
    0 100046 kernel           nfe1 taskq       mi_switch+0x194 sleepq_wait+0x42 msleep_spin+0x1bb taskqueue_thread_loop+0x67 fork_exit+0x11f fork_trampoline+0xe 
    0 100047 kernel           em0 taskq        mi_switch+0x194 sleepq_wait+0x42 msleep_spin+0x1bb taskqueue_thread_loop+0x67 fork_exit+0x11f fork_trampoline+0xe 
    0 100048 kernel           em1 taskq        mi_switch+0x194 sleepq_wait+0x42 msleep_spin+0x1bb taskqueue_thread_loop+0x67 fork_exit+0x11f fork_trampoline+0xe 
    0 100054 kernel           mca taskq        mi_switch+0x194 sleepq_wait+0x42 msleep_spin+0x1bb taskqueue_thread_loop+0x67 fork_exit+0x11f fork_trampoline+0xe 
    0 100055 kernel           system_taskq_0   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100056 kernel           system_taskq_1   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100057 kernel           system_taskq_2   mi_switch+0x194 sleepq_wait+0x42 _sx_xlock_hard+0x4d6 _sx_xlock+0x75 buf_hash_find+0x52 arc_read+0x63 traverse_prefetcher+0xf0 traverse_visitbp+0x2d8 traverse_visitbp+0x412 traverse_visitbp+0x412 traverse_visitbp+0x412 traverse_visitbp+0x412 traverse_dnode+0x6c traverse_visitbp+0x54a traverse_visitbp+0x412 traverse_visitbp+0x412 traverse_visitbp+0x412 traverse_visitbp+0x412 
    0 100058 kernel           system_taskq_3   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100071 kernel           zio_null_issue   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100072 kernel           zio_null_intr    mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100073 kernel           zio_read_issue_0 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100074 kernel           zio_read_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100075 kernel           zio_read_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100076 kernel           zio_read_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100077 kernel           zio_read_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100078 kernel           zio_read_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100079 kernel           zio_read_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100080 kernel           zio_read_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100081 kernel           zio_read_intr_0  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100082 kernel           zio_read_intr_1  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100083 kernel           zio_read_intr_2  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100084 kernel           zio_read_intr_3  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100085 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100086 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100087 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100088 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100089 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100090 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100091 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100092 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100093 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100094 kernel           zio_write_intr_0 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100095 kernel           zio_write_intr_1 mi_switch+0x194 sleepq_wait+0x42 _sx_xlock_hard+0x4d6 _sx_xlock+0x75 buf_hash_insert+0x56 arc_write_done+0x90 zio_done+0x353 zio_execute+0xc3 zio_done+0x3d0 zio_execute+0xc3 zio_done+0x3d0 zio_execute+0xc3 zio_done+0x3d0 zio_execute+0xc3 taskqueue_run_locked+0x74 taskqueue_thread_loop+0x46 fork_exit+0x11f fork_trampoline+0xe 
    0 100096 kernel           zio_write_intr_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100097 kernel           zio_write_intr_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100098 kernel           zio_write_intr_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100099 kernel           zio_write_intr_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100100 kernel           zio_write_intr_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100101 kernel           zio_write_intr_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100102 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100103 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100104 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100105 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100106 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100107 kernel           zio_free_issue_0 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
:
    0 100108 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100109 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100110 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100111 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100112 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100113 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100114 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100115 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100116 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100117 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100118 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100119 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100120 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100121 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100122 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100123 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100124 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100125 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100126 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100127 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100128 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100129 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100130 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100131 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100132 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100133 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100134 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100135 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100136 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100137 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100138 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100139 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100140 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100141 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100142 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100143 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100144 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100145 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100146 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100147 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100148 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100149 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100150 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100151 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100152 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100153 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100154 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100155 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100156 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100157 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100158 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100159 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100160 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100161 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100162 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100163 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100164 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100165 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100166 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
:
    0 100167 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100168 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100169 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100170 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100171 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100172 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100173 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100174 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100175 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100176 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100177 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100178 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100179 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100180 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100181 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100182 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100183 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100184 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100185 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100186 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100187 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100188 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100189 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100190 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100191 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100192 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100193 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100194 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100195 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100196 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100197 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100198 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100199 kernel           zio_null_issue   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100200 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100201 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100202 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100204 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100205 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100212 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100213 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100214 kernel           zio_null_issue   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100215 kernel           zio_null_intr    mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100216 kernel           zio_read_issue_0 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100217 kernel           zio_read_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100218 kernel           zio_read_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3    0 100233 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100234 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100235 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100236 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100237 kernel           zio_write_intr_0 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100238 kernel           zio_write_intr_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100239 kernel           zio_write_intr_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100240 kernel           zio_write_intr_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100241 kernel           zio_write_intr_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100242 kernel           zio_write_intr_5 mi_switch+0x194 sleepq_wait+0x42 _sx_xlock_hard+0x4d6 _sx_xlock+0x75 buf_hash_insert+0x56 arc_write_done+0x90 zio_done+0x353 zio_execute+0xc3 zio_done+0x3d0 zio_execute+0xc3 zio_done+0x3d0 zio_execute+0xc3 zio_done+0x3d0 zio_execute+0xc3 taskqueue_run_locked+0x74 taskqueue_thread_loop+0x46 fork_exit+0x11f fork_trampoline+0xe 
    0 100243 kernel           zio_write_intr_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100244 kernel           zio_write_intr_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100245 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100246 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100247 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100248 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100249 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100250 kernel           zio_free_issue_0 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100251 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100252 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100253 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100254 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100255 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100256 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100257 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100258 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100259 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100260 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100261 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100262 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100263 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100264 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100265 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100266 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100267 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100268 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100269 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100270 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100271 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100272 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100273 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100274 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100275 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100276 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100277 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100278 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100279 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100280 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100281 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100282 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100283 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100284 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100285 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100286 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100287 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100288 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100289 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100290 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xea2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100219 kernel           zio_read_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100220 kernel           zio_read_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100221 kernel           zio_read_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100222 kernel           zio_read_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100223 kernel           zio_read_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100224 kernel           zio_read_intr_0  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100225 kernel           zio_read_intr_1  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100226 kernel           zio_read_intr_2  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100227 kernel           zio_read_intr_3  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100228 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100229 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100230 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100231 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100232 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
:
    0 100291 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100292 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100293 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100294 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100295 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100296 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100297 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100298 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100299 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100300 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100301 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100302 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100303 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100304 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100305 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100306 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100307 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100308 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100309 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100310 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100311 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100312 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100313 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100314 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100315 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100316 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100317 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100318 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100319 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100320 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100321 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100322 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100323 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100324 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100325 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100326 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100327 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100328 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100329 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100330 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100331 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100332 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100333 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100334 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100335 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100336 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100337 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100338 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100339 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100340 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100341 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100342 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100343 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100344 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100345 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100346 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100347 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100348 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100349 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
:
    0 100350 kernel           zio_free_intr    mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100351 kernel           zio_claim_issue  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100352 kernel           zio_claim_intr   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100353 kernel           zio_ioctl_issue  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100354 kernel           zio_ioctl_intr   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100356 kernel           zfs_vn_rele_task mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100360 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100361 kernel           zio_free_intr    mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100362 kernel           zio_claim_issue  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100363 kernel           zio_claim_intr   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100364 kernel           zio_ioctl_issue  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100365 kernel           zio_ioctl_intr   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100367 kernel           zil_clean        mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100534 kernel           zio_null_issue   mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100535 kernel           zio_null_intr    mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100536 kernel           zio_read_issue_0 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100537 kernel           zio_read_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100538 kernel           zio_read_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100539 kernel           zio_read_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100540 kernel           zio_read_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100541 kernel           zio_read_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100542 kernel           zio_read_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100543 kernel           zio_read_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100544 kernel           zio_read_intr_0  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100545 kernel           zio_read_intr_1  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100546 kernel           zio_read_intr_2  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100547 kernel           zio_read_intr_3  mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100548 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100549 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100550 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100551 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100552 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100553 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100554 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100555 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100556 kernel           zio_write_issue_ mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100557 kernel           zio_write_intr_0 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100558 kernel           zio_write_intr_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100559 kernel           zio_write_intr_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100560 kernel           zio_write_intr_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100561 kernel           zio_write_intr_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100562 kernel           zio_write_intr_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100563 kernel           zio_write_intr_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100564 kernel           zio_write_intr_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100565 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100566 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100567 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100568 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100569 kernel           zio_write_intr_h mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100570 kernel           zio_free_issue_0 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100571 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100572 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100573 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100574 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100575 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100576 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100577 kernel           zio_free_issue_7 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100578 kernel           zio_free_issue_8 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100579 kernel           zio_free_issue_9 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
:
    0 100580 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100581 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100582 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100583 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100584 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100585 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100586 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100587 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100588 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100589 kernel           zio_free_issue_1 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100590 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100591 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100592 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100593 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100594 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100595 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100596 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100597 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100598 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100599 kernel           zio_free_issue_2 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100600 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100601 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100602 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100603 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100604 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100605 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100606 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100607 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100608 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100609 kernel           zio_free_issue_3 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100610 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100611 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100612 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100613 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100614 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100615 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100616 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100617 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100618 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100619 kernel           zio_free_issue_4 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100620 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100621 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100622 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100623 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100624 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100625 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100626 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100627 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100628 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100629 kernel           zio_free_issue_5 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100630 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100631 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100632 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100633 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100634 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100635 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100636 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100637 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
    0 100638 kernel           zio_free_issue_6 mi_switch+0x194 sleepq_wait+0x42 _sleep+0x3a2 taskqueue_thread_loop+0xbb fork_exit+0x11f fork_trampoline+0xe 
Comment 1 Mark Linimon freebsd_committer freebsd_triage 2014-04-16 01:38:40 UTC
Responsible Changed
From-To: freebsd-bugs->freebsd-fs

reclassify and assign.
Comment 2 Eitan Adler freebsd_committer freebsd_triage 2017-12-31 08:01:11 UTC
For bugs matching the following criteria:

Status: In Progress Changed: (is less than) 2014-06-01

Reset to default assignee and clear in-progress tags.

Mail being skipped