Bug 226141
| Summary: | "zpool remove" causes panic: solaris assert: zio->io_type == ZIO_TYPE_WRITE (0x3 == 0x2) | ||
|---|---|---|---|
| Product: | Base System | Reporter: | Edward Tomasz Napierala <trasz> |
| Component: | kern | Assignee: | freebsd-fs (Nobody) <fs> |
| Status: | New --- | ||
| Severity: | Affects Only Me | CC: | maurizio1018, mav, pstef |
| Priority: | --- | ||
| Version: | CURRENT | ||
| Hardware: | Any | ||
| OS: | Any | ||
Looks like this could be a fallout from r329732 "7614 zfs device evacuation/removal". I don't get a panic, but: : root@thinkpad:/tmp # zpool remove meh md0 load: 0.17 cmd: zpool 685 [spa_namespace_lock] 41.78r 0.00u 0.00s 0% 6288k mi_switch+0xbf _sx_xlock_hard+0x3d1 spa_open_common+0x3ac zfs_ioc_log_history+0x63 zfsdev_ioctl_common+0x503 zfsdev_ioctl+0x143 devfs_ioctl+0xc5 vn_ioctl+0x1a4 devfs_ioctl_f+0x1e kern_ioctl+0x25b sys_ioctl+0xf1 amd64_syscall+0x10c fast_syscall_common+0xf8 (In reply to Piotr Pawel Stefaniak from comment #2) After a while: # zpool status meh pool: meh state: ONLINE remove: Removal of vdev 0 copied 47.5K in 1h0m, completed on Thu Apr 21 19:58:42 2022 144 memory used for removed device mappings config: NAME STATE READ WRITE CKSUM meh ONLINE 0 0 0 md1 ONLINE 0 0 0 errors: No known data errors |
Doing: mdconfig -s1g mdconfig -s1g zpool create meh md0 md1 zpool remove meh md0 Results in: Unread portion of the kernel message buffer: panic: solaris assert: zio->io_type == ZIO_TYPE_WRITE (0x3 == 0x2), file: /usr/home/trasz/svn-ssh/head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_indirect.c, line: 1093 cpuid = 2 time = 1519336503 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe003009f6d0 vpanic() at vpanic+0x18d/frame 0xfffffe003009f730 panic() at panic+0x43/frame 0xfffffe003009f790 assfail3() at assfail3+0x2c/frame 0xfffffe003009f7b0 vdev_indirect_io_start() at vdev_indirect_io_start+0x6b/frame 0xfffffe003009f7d0 zio_vdev_io_start() at zio_vdev_io_start+0x4c6/frame 0xfffffe003009f830 zio_execute() at zio_execute+0x17c/frame 0xfffffe003009f880 zio_nowait() at zio_nowait+0xc4/frame 0xfffffe003009f8b0 vdev_mirror_io_start() at vdev_mirror_io_start+0x3fa/frame 0xfffffe003009f930 zio_vdev_io_start() at zio_vdev_io_start+0x208/frame 0xfffffe003009f990 zio_execute() at zio_execute+0x17c/frame 0xfffffe003009f9e0 taskqueue_run_locked() at taskqueue_run_locked+0x14c/frame 0xfffffe003009fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe003009fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003009fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003009fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic __curthread () at ./machine/pcpu.h:230 230 __asm("movq %%gs:%1,%0" : "=r" (td) (kgdb) #0 __curthread () at ./machine/pcpu.h:230 #1 doadump (textdump=0) at /usr/home/trasz/svn-ssh/head/sys/kern/kern_shutdown.c:347 #2 0xffffffff8040996b in db_dump (dummy=<optimized out>, dummy2=<unavailable>, dummy3=<unavailable>, dummy4=<unavailable>) at /usr/home/trasz/svn-ssh/head/sys/ddb/db_command.c:574 #3 0xffffffff80409739 in db_command (last_cmdp=<optimized out>, cmd_table=<optimized out>, dopager=<optimized out>) at /usr/home/trasz/svn-ssh/head/sys/ddb/db_command.c:481 #4 0xffffffff804094b4 in db_command_loop () at /usr/home/trasz/svn-ssh/head/sys/ddb/db_command.c:534 #5 0xffffffff8040c6df in db_trap (type=<optimized out>, code=<optimized out>) at /usr/home/trasz/svn-ssh/head/sys/ddb/db_main.c:250 #6 0xffffffff80b0ef13 in kdb_trap (type=3, code=-61456, tf=<optimized out>) at /usr/home/trasz/svn-ssh/head/sys/kern/subr_kdb.c:697 #7 0xffffffff80f7e748 in trap (frame=0xfffffe003009f600) at /usr/home/trasz/svn-ssh/head/sys/amd64/amd64/trap.c:547 #8 <signal handler called> #9 kdb_enter (why=0xffffffff811f8407 "panic", msg=<optimized out>) at /usr/home/trasz/svn-ssh/head/sys/kern/subr_kdb.c:479 #10 0xffffffff80ac9faa in vpanic (fmt=<optimized out>, ap=0xfffffe003009f770) at /usr/home/trasz/svn-ssh/head/sys/kern/kern_shutdown.c:801 #11 0xffffffff80aca033 in panic ( fmt=0xffffffff81b64ad8 <cnputs_mtx> "-\025\034\201\377\377\377\377") at /usr/home/trasz/svn-ssh/head/sys/kern/kern_shutdown.c:739 #12 0xffffffff8249824c in assfail3 ( a=0x80 <error: Cannot access memory at address 0x80>, lv=18446741875492255168, op=0x80 <error: Cannot access memory at address 0x80>, rv=32, f=0xfffffe003009f300 "\320\363\t0", l=<optimized out>) at /usr/home/trasz/svn-ssh/head/sys/cddl/compat/opensolaris/kern/opensolaris_cmn_err.c:91 #13 0xffffffff822dfd8b in vdev_indirect_io_start (zio=0xfffff801245b6820) at /usr/home/trasz/svn-ssh/head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_indirect.c:1093 #14 0xffffffff82316626 in zio_vdev_io_start (zio=0xfffff801245b6820) at /usr/home/trasz/svn-ssh/head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:3308 #15 0xffffffff823114ac in zio_execute (zio=<optimized out>) at /usr/home/trasz/svn-ssh/head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:1767 #16 0xffffffff82310724 in zio_nowait (zio=0xfffff801245b6820) at /usr/home/trasz/svn-ssh/head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:1825 #17 0xffffffff822e4e3a in vdev_mirror_io_start (zio=<optimized out>) at /usr/home/trasz/svn-ssh/head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_mirror.c:557 #18 0xffffffff82316368 in zio_vdev_io_start (zio=0xfffff8012419b000) at /usr/home/trasz/svn-ssh/head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:3177 #19 0xffffffff823114ac in zio_execute (zio=<optimized out>) at /usr/home/trasz/svn-ssh/head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:1767 #20 0xffffffff80b21f6c in taskqueue_run_locked (queue=0xfffff8010e0eb000) at /usr/home/trasz/svn-ssh/head/sys/kern/subr_taskqueue.c:465 #21 0xffffffff80b22d38 in taskqueue_thread_loop (arg=<optimized out>) at /usr/home/trasz/svn-ssh/head/sys/kern/subr_taskqueue.c:757 #22 0xffffffff80a8a574 in fork_exit ( callout=0xffffffff80b22cb0 <taskqueue_thread_loop>, arg=0xfffff8000752db00, frame=0xfffffe003009fac0) at /usr/home/trasz/svn-ssh/head/sys/kern/kern_fork.c:1039 #23 <signal handler called> (kgdb) The panic is semi-immediate - the command succeeds, but panic happens in a few seconds afterwards. FreeBSD v2 12.0-CURRENT FreeBSD 12.0-CURRENT #1 r329822: Thu Feb 22 02:36:44 GMT 2018 trasz@v2:/usr/obj/usr/home/trasz/svn-ssh/head/amd64.amd64/sys/GENERIC amd64