FreeBSD server.example.com 13.0-RELEASE FreeBSD 13.0-RELEASE #0 ea31abc26: Fri Apr 9 19:34:58 EEST 2021 root@server.cretaforce.gr:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 panic: handle_written_inodeblock: Invalid link count -1 for inodedep 0xfffff8009b512c00 GNU gdb (GDB) 10.1 [GDB v10.1 for FreeBSD] Copyright (C) 2020 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd13.0". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: panic: handle_written_inodeblock: Invalid link count -1 for inodedep 0xfffff8009b512c00 cpuid = 0 time = 1618779673 KDB: stack backtrace: #0 0xffffffff80c57345 at kdb_backtrace+0x65 #1 0xffffffff80c09d21 at vpanic+0x181 #2 0xffffffff80c09b93 at panic+0x43 #3 0xffffffff80efb285 at handle_written_inodeblock+0xb05 #4 0xffffffff80edee0a at softdep_disk_write_complete+0x5da #5 0xffffffff80cc2cac at bufdone+0x22c #6 0xffffffff80cbddbc at bufwrite+0x1dc #7 0xffffffff80cc102f at vfs_bio_awrite+0x37f #8 0xffffffff80cff213 at vn_fsync_buf+0x213 #9 0xffffffff80ced995 at sched_sync+0x465 #10 0xffffffff80bc7c5e at fork_exit+0x7e #11 0xffffffff8106282e at fork_trampoline+0xe Uptime: 6d21h3m7s Dumping 4321 out of 65273 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 /usr/src/sys/amd64/include/pcpu_aux.h: No such file or directory. (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c09916 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:486 #3 0xffffffff80c09d90 in vpanic (fmt=<optimized out>, ap=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:919 #4 0xffffffff80c09b93 in panic (fmt=<unavailable>) at /usr/src/sys/kern/kern_shutdown.c:843 #5 0xffffffff80efb285 in handle_written_inodeblock ( inodedep=inodedep@entry=0xfffff8009b512c00, bp=bp@entry=0xfffffe006bd0a1d0, flags=flags@entry=4194304) at /usr/src/sys/ufs/ffs/ffs_softdep.c:11996 #6 0xffffffff80edee0a in softdep_disk_write_complete (bp=<optimized out>, bp@entry=<error reading variable: value is not available>) at /usr/src/sys/ufs/ffs/ffs_softdep.c:11505 #7 0xffffffff80cc2cac in buf_complete (bp=0xfffffe006bd0a1d0) at /usr/src/sys/sys/buf.h:450 #8 bufdone (bp=0xfffffe006bd0a1d0, bp@entry=<error reading variable: value is not available>) at /usr/src/sys/kern/vfs_bio.c:4492 #9 0xffffffff80cbddbc in bstrategy (bp=0xfffffe006bd0a1d0, bp@entry=<error reading variable: value is not available>) at /usr/src/sys/sys/buf.h:431 #10 bufwrite (bp=0xfffffe006bd0a1d0, bp@entry=<error reading variable: value is not available>) at /usr/src/sys/kern/vfs_bio.c:2302 #11 0xffffffff80cc102f in bwrite (bp=0xfffffe006bd0a1d0) at /usr/src/sys/sys/buf.h:419 #12 vfs_bio_awrite (bp=<optimized out>, bp@entry=0xfffffe006bd0a1d0) at /usr/src/sys/kern/vfs_bio.c:3233 #13 0xffffffff80cff213 in vn_fsync_buf (vp=<optimized out>, vp@entry=<error reading variable: value is not available>, waitfor=3, waitfor@entry=<error reading variable: value is not available>) at /usr/src/sys/kern/vfs_vnops.c:2760 #14 0xffffffff80ced995 in VOP_FSYNC (vp=0xfffff8000bba47a0, waitfor=3, td=0xfffffe015bd0ca00) at ./vnode_if.h:771 #15 sync_vnode (slp=<optimized out>, bo=<optimized out>, td=0xfffffe015bd0ca00) at /usr/src/sys/kern/vfs_subr.c:2583 #16 sched_sync () at /usr/src/sys/kern/vfs_subr.c:2685 #17 0xffffffff80bc7c5e in fork_exit (callout=0xffffffff80ced530 <sched_sync>, arg=0x0, frame=0xffffffff8242cb00) at /usr/src/sys/kern/kern_fork.c:1069 #18 <signal handler called> (kgdb)
Keyword: crash – in lieu of summary line prefix: [panic] * bulk change for the keyword * summary lines may be edited manually (not in bulk). Keyword descriptions and search interface: <https://bugs.freebsd.org/bugzilla/describekeywords.cgi>
Hi Team, we are also facing same issue. It is very difficult to reproduce it. It happens once out of 20-30 times on reboot. Version String: FreeBSD 13.0-RELEASE-p13 #0: Mon Apr 10 23:08:53 IST 2023 /usr/build/iproot/freebsd/mods/src/sys/amd64/compile/MESSAGING_GATEWAY.amd64 Panic String: handle_written_inodeblock: Invalid link count -1 for inodedep 0xfffff80117296000 Dump Parity: 3386838829 Bounds: 0 Dump Status: good Not able to do it repeatedly. One way i was able to reproduce it only one time. 1. Downloaded some files. 2. Enabled console logs in boot/loader.conf and enabled rc debugging in rc.conf 3. Reboot the system. It looks like due uncleaned shutdown it might be causing some file system corruprtion. Platform vmware (VMware Virtual Platform) Disk 0 200GB VMware Virtual disk 2.0 at mpt0 bus 0 scbus2 target 0 lun 0 RAM Total 8192M Swap 6 GB Any idea by when it can be fixed.
I have not been able to reproduce this panic with our existing tests. If you can find a script that will produce this panic let me know and I will track it down. Note that there has been a fix for this panic message in 14.0, but it fixed a problem that was introduced during the 14.0 development so is not relevant to the 13 releases.