I see a LOR at every boot at base r292046. It was also present on base r291769. These are GENERIC kernels w/ the system installed on geli-encrypted ZFS. lock order reversal: 1st 0xfffff8000b896490 filedesc structure (filedesc structure) @ /usr/src/sys/kern/kern_descrip.c:1231 2nd 0xfffff800b11c0b78 zfs (zfs) @ /usr/src/sys/kern/vfs_subr.c:4756 stack backtrace: #0 0xffffffff80a80110 at witness_debugger+0x70 #1 0xffffffff80a80011 at witness_checkorder+0xe71 #2 0xffffffff80a019db at __lockmgr_args+0xd3b #3 0xffffffff80ac805c at vop_stdlock+0x3c #4 0xffffffff80fba300 at VOP_LOCK1_APV+0x100 #5 0xffffffff80ae8e1a at _vn_lock+0x9a #6 0xffffffff809e2e4e at knlist_remove_kq+0x7e #7 0xffffffff80adf9c8 at filt_vfsdetach+0x28 #8 0xffffffff809e3727 at knote_fdclose+0xc7 #9 0xffffffff809d79d5 at closefp+0x65 #10 0xffffffff80e6f11e at amd64_syscall+0x2de #11 0xffffffff80e4e93b at Xfast_syscall+0xfb
I think I'm seeing the same, but on a i386 10.3-RELEASE; no GELI or ZFS, but NFS client and GMIRRORed UFS. The machine got badly locked. Jun 29 07:52:56 xxxxxx kernel: 1st 0xce29dc28 filedesc structure (filedesc structure) @ /usr/src/sys/kern/kern_descrip.c:1235 Jun 29 07:52:56 xxxxxx kernel: 2nd 0xd00b7d84 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:4544 Jun 29 07:52:56 xxxxxx kernel: KDB: stack backtrace: Jun 29 07:52:56 xxxxxx kernel: db_trace_self_wrapper(c0a1efd8,2f6e7265,6e72656b,7365645f,70697263,...) at db_trace_self_wrapper+0x2d/frame 0xc53ce8c8 Jun 29 07:52:56 xxxxxx kernel: kdb_backtrace(c0a231d4,d00b7d84,c0a0ed4d,cd7bfb08,c0a2caa8,...) at kdb_backtrace+0x30/frame 0xc53ce92c Jun 29 07:52:56 xxxxxx kernel: witness_checkorder(d00b7d84,9,c0a2caa8,11c0,0,...) at witness_checkorder+0xd4f/frame 0xc53ce978 Jun 29 07:52:56 xxxxxx kernel: __lockmgr_args(d00b7d84,80400,d00b7da4,0,0,...) at __lockmgr_args+0x911/frame 0xc53cea58 Jun 29 07:52:56 xxxxxx kernel: ffs_lock(c53cead8,c53ceaac,c0799df5,d00b7d84,c53cead8,...) at ffs_lock+0x94/frame 0xc53cea94 Jun 29 07:52:56 xxxxxx kernel: VOP_LOCK1_APV(c0abc8f0,c53cead8,cebf9148,cff02c00,c0ad43f8,...) at VOP_LOCK1_APV+0x10a/frame 0xc53ceac0 Jun 29 07:52:56 xxxxxx kernel: _vn_lock(d00b7d50,80400,c0a2caa8,11c0) at _vn_lock+0xca/frame 0xc53ceb00 Jun 29 07:52:56 xxxxxx kernel: vfs_knllock(d00b7d50,0,c0a133e0,79b,d00b7d50,...) at vfs_knllock+0x29/frame 0xc53ceb18 Jun 29 07:52:56 xxxxxx kernel: knlist_remove_kq(0,0) at knlist_remove_kq+0x8e/frame 0xc53ceb3c Jun 29 07:52:56 xxxxxx kernel: knlist_remove(cebf9148,ceb08000,0,e,e,...) at knlist_remove+0x1f/frame 0xc53ceb4c Jun 29 07:52:56 xxxxxx kernel: filt_vfsdetach(ceb08000,0,c0a133e0,8a5,c07566d6,...) at filt_vfsdetach+0x2f/frame 0xc53ceb6c Jun 29 07:52:56 xxxxxx kernel: knote_fdclose(ce06dc80,e,c0a12ac1,48e,ce29dc28,...) at knote_fdclose+0xde/frame 0xc53ceba8 Jun 29 07:52:56 xxxxxx kernel: closefp(d00795b0,ce06dc80,1,b5,ced5ca34,...) at closefp+0x6c/frame 0xc53cebdc Jun 29 07:52:56 xxxxxx kernel: kern_close(ce06dc80,e) at kern_close+0xf5/frame 0xc53cec08 Jun 29 07:52:56 xxxxxx kernel: sys_close(ce06dc80,c53ceca8,cebd9918,0,0,...) at sys_close+0x1a/frame 0xc53cec18 Jun 29 07:52:56 xxxxxx kernel: syscall(c53cece8) at syscall+0x381/frame 0xc53cecdc Jun 29 07:52:56 xxxxxx kernel: Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc53cecdc Jun 29 07:52:56 xxxxxx kernel: --- syscall (6, FreeBSD ELF32, sys_close), eip = 0x28644bdf, esp = 0xbb7f9e70, ebp = 0xbb7f9e88 ---