I used crotchet-freebsd to build an ARM version of FreeBSD 10.0-STABLE r264836 for the BeagleBone Black. I booted a BeagleBone from the SD card. NOT the eMMC (although I have also seen this in FreeBSD-CURRENT booted from the eMMC). Next, I copied over bash-4.3.src.tgz to build and while unpacking it with `tar xf`, I see the following on the console: lock order reversal: 1st 0xcd182f70 bufwait (bufwait) @ /usr/src/FreeBSD-stable-10/sys/kern/vfs_bio.c:3050 2nd 0xc29c6a00 dirhash (dirhash) @ /usr/src/FreeBSD-stable-10/sys/ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self() at db_trace_self pc = 0xc0540880 lr = 0xc0230328 (db_trace_self_wrapper+0x30) sp = 0xdeafa7e8 fp = 0xdeafa900 r10 = 0xc29c6a00 db_trace_self_wrapper() at db_trace_self_wrapper+0x30 pc = 0xc0230328 lr = 0xc0398c90 (kdb_backtrace+0x38) sp = 0xdeafa908 fp = 0xdeafa910 r4 = 0xc067e3a4 r5 = 0xc05a5545 r6 = 0xc05c1009 r7 = 0xc05aaab5 kdb_backtrace() at kdb_backtrace+0x38 pc = 0xc0398c90 lr = 0xc03b367c (witness_checkorder+0xe48) sp = 0xdeafa918 fp = 0xdeafa968 r4 = 0xc05c13cd witness_checkorder() at witness_checkorder+0xe48 pc = 0xc03b367c lr = 0xc0368dec (_sx_xlock+0x84) sp = 0xdeafa970 fp = 0xdeafa998 r4 = 0x0000011c r5 = 0xc05c1006 r6 = 0xc29c6a10 r7 = 0xc29c6a00 r8 = 0x00000000 r9 = 0xc2ef27e0 r10 = 0x00000000 _sx_xlock() at _sx_xlock+0x84 pc = 0xc0368dec lr = 0xc04fc83c (ufsdirhash_add+0x34) sp = 0xdeafa9a0 fp = 0xdeafa9b8 r4 = 0xc29c6a00 r5 = 0x00000818 r6 = 0xc2eee180 r7 = 0xdeafaa50 r8 = 0xdeafaa50 ufsdirhash_add() at ufsdirhash_add+0x34 pc = 0xc04fc83c lr = 0xc04ff350 (ufs_direnter+0x63c) sp = 0xdeafa9c0 fp = 0xdeafaa28 r4 = 0xc2eee180 r5 = 0x00000018 r6 = 0xcd39b818 r7 = 0xdeafaa50 r8 = 0xc2c41c80 r9 = 0xc2ef27e0 ufs_direnter() at ufs_direnter+0x63c pc = 0xc04ff350 lr = 0xc05087f4 (ufs_makeinode+0x3ec) sp = 0xdeafaa30 fp = 0xdeafab90 r4 = 0x00000000 r5 = 0xdeafad30 r6 = 0xdeafaa50 r7 = 0x00000000 r8 = 0xdeafad48 r9 = 0xc2ef27e0 r10 = 0xc2f33b80 ufs_makeinode() at ufs_makeinode+0x3ec pc = 0xc05087f4 lr = 0xc0504bdc (ufs_create+0x24) sp = 0xdeafab98 fp = 0xdeafab98 r4 = 0xdeafac68 r5 = 0xc06629d0 r6 = 0x00000000 r7 = 0x00100a02 r8 = 0x00000000 r9 = 0xdeafad50 r10 = 0xdeafad30 ufs_create() at ufs_create+0x24 pc = 0xc0504bdc lr = 0xc0563fc4 (VOP_CREATE_APV+0xd0) sp = 0xdeafaba0 fp = 0xdeafabb0 VOP_CREATE_APV() at VOP_CREATE_APV+0xd0 pc = 0xc0563fc4 lr = 0xc04143ac (vn_open_cred+0x274) sp = 0xdeafabb8 fp = 0xdeafac98 r4 = 0xdeaface0 r5 = 0xdeafad30 r6 = 0xc2ef27e0 vn_open_cred() at vn_open_cred+0x274 pc = 0xc04143ac lr = 0xc0414130 (vn_open+0x24) sp = 0xdeafaca0 fp = 0xdeafaca8 r4 = 0xc2c41c80 r5 = 0x000500cf r6 = 0x00000012 r7 = 0xdeaface0 r8 = 0x00000000 r9 = 0x20c4a380 r10 = 0xdeafacd0 vn_open() at vn_open+0x24 pc = 0xc0414130 lr = 0xc040d668 (kern_openat+0x248) sp = 0xdeafacb0 fp = 0xdeafada8 kern_openat() at kern_openat+0x248 pc = 0xc040d668 lr = 0xc040d3b0 (sys_open+0x28) sp = 0xdeafadb0 fp = 0xdeafadb8 r4 = 0xc2c41c80 r5 = 0xc29da640 r6 = 0x00000000 r7 = 0x00000000 r8 = 0x00000001 r9 = 0xdeafae10 r10 = 0x20c42080 sys_open() at sys_open+0x28 pc = 0xc040d3b0 lr = 0xc0552a7c (swi_handler+0x284) sp = 0xdeafadc0 fp = 0xdeafae58 swi_handler() at swi_handler+0x284 pc = 0xc0552a7c lr = 0xc05421ac (swi_entry+0x2c) sp = 0xdeafae60 fp = 0xbffffa28 r4 = 0x20c09200 r5 = 0x000001a4 r6 = 0x20c4a39b r7 = 0x00000005 r8 = 0x00000001 r9 = 0x20c09364 swi_entry() at swi_entry+0x2c pc = 0xc05421ac lr = 0xc05421ac (swi_entry+0x2c) sp = 0xdeafae60 fp = 0xbffffa28 Unable to unwind further Filesystem mounts are as follows: /dev/ufs/sdfreebsd1 on / (ufs, local, noatime, journaled soft-updates, nfsv4acls) devfs on /dev (devfs, local) /dev/msdosfs/SDBOOT on /boot/msdos (msdosfs, local, noatime) /dev/md0 on /tmp (ufs, local, noatime, soft-updates) /dev/md1 on /var/log (ufs, local, noatime, soft-updates) /dev/md2 on /var/tmp (ufs, local, noatime, soft-updates) And here's the dmesg output: KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2014 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-STABLE #0 r264836: Wed Apr 23 18:52:04 EDT 2014 root@freebsd:/usr/home/davem/Work/crochet-freebsd/work/obj/arm.armv6/usr/src/FreeBSD-stable-10/sys/BEAGLEBONE arm FreeBSD clang version 3.4 (tags/RELEASE_34/final 197956) 20140216 WARNING: WITNESS option enabled, expect reduced performance. CPU: Cortex A8-r3 rev 2 (Cortex-A core) Supported features: ARM_ISA THUMB2 JAZELLE THUMBEE ARMv4 Security_Ext WB disabled EABT branch prediction enabled LoUU:2 LoC:2 LoUIS:1 Cache level 1: 32KB/64B 4-way data cache WT WB Read-Alloc 32KB/64B 4-way instruction cache Read-Alloc Cache level 2: 256KB/64B 8-way unified cache WT WB Read-Alloc Write-Alloc real memory = 536870912 (512 MB) avail memory = 515538944 (491 MB) Texas Instruments AM3358 Processor, Revision ES1.1 random: <Software, Yarrow> initialized simplebus0: <Flattened device tree simple bus> on fdtbus0 aintc0: <TI AINTC Interrupt Controller> mem 0x48200000-0x48200fff on simplebus0 aintc0: Revision 5.0 ti_scm0: <TI Control Module> mem 0x44e10000-0x44e11fff on simplebus0 am335x_prcm0: <AM335x Power and Clock Management> mem 0x44e00000-0x44e012ff on simplebus0 am335x_prcm0: Clocks: System 24.0 MHz, CPU 550 MHz am335x_dmtimer0: <AM335x DMTimer> mem 0x44e05000-0x44e05fff,0x44e31000-0x44e31fff,0x48040000-0x48040fff,0x48042000-0x48042fff,0x48044000-0x48044fff,0x48046000-0x48046fff,0x48048000-0x48048fff,0x4804a000-0x4804afff irq 66,67,68,69,92,93,94,95 on simplebus0 Timecounter "AM335x Timecounter" frequency 24000000 Hz quality 1000 Event timer "AM335x Eventtimer0" frequency 24000000 Hz quality 1000 gpio0: <TI General Purpose I/O (GPIO)> mem 0x44e07000-0x44e07fff,0x4804c000-0x4804cfff,0x481ac000-0x481acfff,0x481ae000-0x481aefff irq 96,97,98,99,32,33,62,63 on simplebus0 gpioc0: <GPIO controller> on gpio0 gpiobus0: <GPIO bus> on gpio0 uart0: <TI UART (16550 compatible)> mem 0x44e09000-0x44e09fff irq 72 on simplebus0 uart0: console (115384,n,8,1) ti_edma30: <TI EDMA Controller> mem 0x49000000-0x490fffff,0x49800000-0x498fffff,0x49900000-0x499fffff,0x49a00000-0x49afffff irq 12,13,14 on simplebus0 ti_edma30: EDMA revision 40014c00 sdhci_ti0: <TI MMCHS (SDHCI 2.0)> mem 0x48060000-0x48060fff irq 64 on simplebus0 mmc0: <MMC/SD bus> on sdhci_ti0 sdhci_ti1: <TI MMCHS (SDHCI 2.0)> mem 0x481d8000-0x481d8fff irq 28 on simplebus0 mmc1: <MMC/SD bus> on sdhci_ti1 cpsw0: <3-port Switch Ethernet Subsystem> mem 0x4a100000-0x4a103fff irq 40,41,42,43 on simplebus0 cpsw0: CPSW SS Version 1.12 (0) cpsw0: Initial queue size TX=128 RX=384 cpsw0: Ethernet address: 90:59:af:7c:14:f7 miibus0: <MII bus> on cpsw0 smscphy0: <SMC LAN8710A 10/100 interface> PHY 0 on miibus0 smscphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto iichb0: <TI I2C Controller> mem 0x44e0b000-0x44e0bfff irq 70 on simplebus0 iichb0: I2C revision 4.0 iicbus0: <OFW I2C bus> on iichb0 iic0: <I2C generic I/O> on iicbus0 am335x_pmic0: <TI TPS65217 Power Management IC> at addr 0x24 on iicbus0 am335x_pwm0: <AM335x PWM> mem 0x48300000-0x483000ff,0x48300100-0x4830017f,0x48300180-0x483001ff,0x48300200-0x4830025f irq 86,58 on simplebus0 am335x_pwm1: <AM335x PWM> mem 0x48302000-0x483020ff,0x48302100-0x4830217f,0x48302180-0x483021ff,0x48302200-0x4830225f irq 87,59 on simplebus0 am335x_pwm2: <AM335x PWM> mem 0x48304000-0x483040ff,0x48304100-0x4830417f,0x48304180-0x483041ff,0x48304200-0x4830425f irq 88,60 on simplebus0 musbotg0: <TI AM33xx integrated USB OTG controller> mem 0x47400000-0x47400fff,0x47401000-0x474012ff,0x47401300-0x474013ff,0x47401400-0x474017ff,0x47401800-0x47401aff,0x47401b00-0x47401bff,0x47401c00-0x47401fff irq 17,18,19 on simplebus0 musbotg0: TI AM335X USBSS v0.0.13 usbus0: Dynamic FIFO sizing detected, assuming 16Kbytes of FIFO RAM usbus0 on musbotg0 usbus1: Dynamic FIFO sizing detected, assuming 16Kbytes of FIFO RAM usbus1 on musbotg0 Timecounters tick every 10.000 msec usbus0: 480Mbps High Speed USB v2.0 usbus1: 480Mbps High Speed USB v2.0 ugen0.1: <Mentor Graphics> at usbus0 uhub0: <Mentor Graphics OTG Root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0 ugen1.1: <Mentor Graphics> at usbus1 uhub1: <Mentor Graphics OTG Root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 mmcsd0: 4GB <SDHC SA04G 1.0 SN 628739603 MFG 09/2011 by 2 TM> at mmc0 48.0MHz/4bit/65535-block uhub0: 1 port with 1 removable, self powered uhub1: 1 port with 1 removable, self powered mmcsd1: 2GB <MMC MMC02G 3.10 SN 2440249566 MFG 08/1997 by 254 0x004e> at mmc1 48.0MHz/8bit/65535-block am335x_pmic0: TPS65217C ver 1.2 powered by AC random: unblocking device. WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:/dev/ufs/sdfreebsd1 [rw,noatime]... warning: no time-of-day clock registered, system time will not be set accurately How-To-Repeat: Happens on a fairly regular bases when accessing the SD card or eMMC devices. I've also seen it when umounting filesystems as well as during /sbin/halt.
Happened again, with a different report: lock order reversal: 1st 0xc2ad7814 ufs (ufs) @ /usr/src/FreeBSD-stable-10/sys/kern/vfs_subr.c:2101 2nd 0xcd2533f0 bufwait (bufwait) @ /usr/src/FreeBSD-stable-10/sys/ufs/ffs/ffs_vnops.c:262 3rd 0xc34e1814 ufs (ufs) @ /usr/src/FreeBSD-stable-10/sys/kern/vfs_subr.c:2101 KDB: stack backtrace: db_trace_self() at db_trace_self pc = 0xc0540880 lr = 0xc0230328 (db_trace_self_wrapper+0x30) sp = 0xdd9483f8 fp = 0xdd948510 r10 = 0xc34e1814 db_trace_self_wrapper() at db_trace_self_wrapper+0x30 pc = 0xc0230328 lr = 0xc0398c90 (kdb_backtrace+0x38) sp = 0xdd948518 fp = 0xdd948520 r4 = 0xc067e3a4 r5 = 0xc05a5545 r6 = 0xc05ad9ad r7 = 0xc05c0ac2 kdb_backtrace() at kdb_backtrace+0x38 pc = 0xc0398c90 lr = 0xc03b367c (witness_checkorder+0xe48) sp = 0xdd948528 fp = 0xdd948578 r4 = 0xc05940e2 witness_checkorder() at witness_checkorder+0xe48 pc = 0xc03b367c lr = 0xc0344d3c (__lockmgr_args+0x8f0) sp = 0xdd948580 fp = 0xdd9485e8 r4 = 0x00000100 r5 = 0x00080100 r6 = 0x00000835 r7 = 0xc34e1834 r8 = 0xc34e1814 r9 = 0x00080000 r10 = 0xc05ad9aa __lockmgr_args() at __lockmgr_args+0x8f0 pc = 0xc0344d3c lr = 0xc04f6e54 (ffs_lock+0x80) sp = 0xdd9485f0 fp = 0xdd948618 r4 = 0xdd948638 r5 = 0x00080100 r6 = 0xc34e17e0 r7 = 0xc34e1814 r8 = 0xc34e1834 r9 = 0x00000000 r10 = 0x00000835 ffs_lock() at ffs_lock+0x80 pc = 0xc04f6e54 lr = 0xc0565e74 (VOP_LOCK1_APV+0xd8) sp = 0xdd948620 fp = 0xdd948630 r4 = 0xdd948638 r5 = 0xc06624c0 r6 = 0x00000000 r7 = 0x00080100 r8 = 0xdd948638 r9 = 0xc05acbea VOP_LOCK1_APV() at VOP_LOCK1_APV+0xd8 pc = 0xc0565e74 lr = 0xc0414b20 (_vn_lock+0x44) sp = 0xdd948638 fp = 0xdd948668 r4 = 0xc34e17e0 r5 = 0x00000004 r6 = 0xc05ad9aa _vn_lock() at _vn_lock+0x44 pc = 0xc0414b20 lr = 0xc04054d0 (vget+0x60) sp = 0xdd948670 fp = 0xdd948690 r4 = 0xc34e17e0 r5 = 0x00000004 r6 = 0x00080100 r7 = 0xc07dbdac r8 = 0xc2c42c80 r9 = 0xc05acbea r10 = 0x00000000 vget() at vget+0x60 pc = 0xc04054d0 lr = 0xc03f9b4c (vfs_hash_get+0xd8) sp = 0xdd948698 fp = 0xdd9486c8 r4 = 0xc07dbd90 r5 = 0x00000004 r6 = 0xc29e4ac0 r7 = 0xc07dbdac r8 = 0xc34e17e0 vfs_hash_get() at vfs_hash_get+0xd8 pc = 0xc03f9b4c lr = 0xc04f1ea4 (ffs_vgetf+0x3c) sp = 0xdd9486d0 fp = 0xdd948728 r4 = 0xc325b0c0 r5 = 0x00080000 r6 = 0xc29e4ac0 r7 = 0x00000004 r8 = 0xc325b0c0 r9 = 0x00000000 r10 = 0xdd948788 ffs_vgetf() at ffs_vgetf+0x3c pc = 0xc04f1ea4 lr = 0xc04e8d40 (softdep_sync_buf+0x9c8) sp = 0xdd948730 fp = 0xdd9487a8 r4 = 0xc325b0c0 r5 = 0xc05bcdd9 r6 = 0xc05bcdd9 r7 = 0xc29f1300 r8 = 0xc325b0c0 r9 = 0x00000000 r10 = 0x00000004 softdep_sync_buf() at softdep_sync_buf+0x9c8 pc = 0xc04e8d40 lr = 0xc04f7c6c (ffs_syncvnode+0x2ec) sp = 0xdd9487b0 fp = 0xdd948800 r4 = 0xc2ad77e0 r5 = 0x00000000 r6 = 0xc05c0abf r7 = 0x00000001 r8 = 0xcd2533f0 r9 = 0x00000010 r10 = 0xcd253398 ffs_syncvnode() at ffs_syncvnode+0x2ec pc = 0xc04f7c6c lr = 0xc04cb414 (ffs_truncate+0x6d8) sp = 0xdd948808 fp = 0xdd9489b8 r4 = 0xc2ad77e0 r5 = 0x00000000 r6 = 0x00000200 r7 = 0xc2a01c80 r8 = 0x00000880 r9 = 0x00000000 r10 = 0x00000200 ffs_truncate() at ffs_truncate+0x6d8 pc = 0xc04cb414 lr = 0xc04ff5bc (ufs_direnter+0x8a8) sp = 0xdd9489c0 fp = 0xdd948a28 r4 = 0xc2ad77e0 r5 = 0xc2a01c80 r6 = 0x00000000 r7 = 0x00000000 r8 = 0xc34e17e0 r9 = 0xc2ad77e0 r10 = 0x00000000 ufs_direnter() at ufs_direnter+0x8a8 pc = 0xc04ff5bc lr = 0xc05087f4 (ufs_makeinode+0x3ec) sp = 0xdd948a30 fp = 0xdd948b90 r4 = 0x00000000 r5 = 0xdd948d30 r6 = 0xdd948a50 r7 = 0x00000000 r8 = 0xdd948d48 r9 = 0xc2ad77e0 r10 = 0xc34df780 ufs_makeinode() at ufs_makeinode+0x3ec pc = 0xc05087f4 lr = 0xc0504bdc (ufs_create+0x24) sp = 0xdd948b98 fp = 0xdd948b98 r4 = 0xdd948c68 r5 = 0xc06629d0 r6 = 0x00000000 r7 = 0x00000a03 r8 = 0x00000000 r9 = 0xdd948d50 r10 = 0xdd948d30 ufs_create() at ufs_create+0x24 pc = 0xc0504bdc lr = 0xc0563fc4 (VOP_CREATE_APV+0xd0) sp = 0xdd948ba0 fp = 0xdd948bb0 VOP_CREATE_APV() at VOP_CREATE_APV+0xd0 pc = 0xc0563fc4 lr = 0xc04143ac (vn_open_cred+0x274) sp = 0xdd948bb8 fp = 0xdd948c98 r4 = 0xdd948ce0 r5 = 0xdd948d30 r6 = 0xc2ad77e0 vn_open_cred() at vn_open_cred+0x274 pc = 0xc04143ac lr = 0xc0414130 (vn_open+0x24) sp = 0xdd948ca0 fp = 0xdd948ca8 r4 = 0xc2c42c80 r5 = 0x000500cf r6 = 0x00000012 r7 = 0xdd948ce0 r8 = 0x00000000 r9 = 0xbfffe25c r10 = 0xdd948cd0 vn_open() at vn_open+0x24 pc = 0xc0414130 lr = 0xc040d668 (kern_openat+0x248) sp = 0xdd948cb0 fp = 0xdd948da8 kern_openat() at kern_openat+0x248 pc = 0xc040d668 lr = 0xc040d3b0 (sys_open+0x28) sp = 0xdd948db0 fp = 0xdd948db8 r4 = 0xc2c42c80 r5 = 0xc2c2c640 r6 = 0x00000000 r7 = 0x00000000 r8 = 0xffffffe4 r9 = 0xdd948e10 r10 = 0x01650f48 sys_open() at sys_open+0x28 pc = 0xc040d3b0 lr = 0xc0552a7c (swi_handler+0x284) sp = 0xdd948dc0 fp = 0xdd948e58 swi_handler() at swi_handler+0x284 pc = 0xc0552a7c lr = 0xc05421ac (swi_entry+0x2c) sp = 0xdd948e60 fp = 0xbfffe188 r4 = 0xbfffdfa8 r5 = 0xffffffe4 r6 = 0xbfffe250 r7 = 0x00000005 r8 = 0xffffffe4 r9 = 0x00000001 swi_entry() at swi_entry+0x2c pc = 0xc05421ac lr = 0xc05421ac (swi_entry+0x2c) sp = 0xdd948e60 fp = 0xbfffe188 Unable to unwind further
I found the exact same issue testing on FreeBSD-CURRENT on the BBB; this was removing a directory tree with `rm -rf` on the eMMC: FreeBSD beaglebone 11.0-CURRENT FreeBSD 11.0-CURRENT #0 r264670: Fri Apr 18 18:55:02 EDT 2014 root@freebsd:/root/Work/crochet-freebsd/work/obj/arm.armv6/usr/src/FreeBSD-CURRENT/sys/BEAGLEBONE arm lock order reversal: 1st 0xcd25b0f8 bufwait (bufwait) @ /usr/src/FreeBSD-CURRENT/sys/kern/vfs_bio.c:3081 2nd 0xc3260600 dirhash (dirhash) @ /usr/src/FreeBSD-CURRENT/sys/ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self() at db_trace_self pc = 0xc0542258 lr = 0xc02324bc (db_trace_self_wrapper+0x30) sp = 0xde6c89e0 fp = 0xde6c8af8 r10 = 0xc3260600 db_trace_self_wrapper() at db_trace_self_wrapper+0x30 pc = 0xc02324bc lr = 0xc039b358 (kdb_backtrace+0x38) sp = 0xde6c8b00 fp = 0xde6c8b08 r4 = 0xc0689484 r5 = 0xc059401b r6 = 0xc05c7b91 r7 = 0xc05b16e0 kdb_backtrace() at kdb_backtrace+0x38 pc = 0xc039b358 lr = 0xc03b5c78 (witness_checkorder+0xe50) sp = 0xde6c8b10 fp = 0xde6c8b60 r4 = 0xc05c7f53 witness_checkorder() at witness_checkorder+0xe50 pc = 0xc03b5c78 lr = 0xc036c1bc (_sx_xlock+0x7c) sp = 0xde6c8b68 fp = 0xde6c8b90 r4 = 0x0000011c r5 = 0xc05c7b8e r6 = 0xc3260610 r7 = 0xc3260600 r8 = 0x00000000 r9 = 0xc31a3280 r10 = 0x00000000 _sx_xlock() at _sx_xlock+0x7c pc = 0xc036c1bc lr = 0xc04fe408 (ufsdirhash_remove+0x38) sp = 0xde6c8b98 fp = 0xde6c8bb0 r4 = 0xc3260600 r5 = 0xc31a024c r6 = 0xce430018 r7 = 0xc31a3280 r8 = 0x00000018 ufsdirhash_remove() at ufsdirhash_remove+0x38 pc = 0xc04fe408 lr = 0xc0501260 (ufs_dirremove+0x14c) sp = 0xde6c8bb8 fp = 0xde6c8be8 r4 = 0xc3048c00 r5 = 0xc31a024c r6 = 0xc31a0240 r7 = 0xce430018 r8 = 0x00000000 ufs_dirremove() at ufs_dirremove+0x14c pc = 0xc0501260 lr = 0xc05076e8 (ufs_remove+0x64) sp = 0xde6c8bf0 fp = 0xde6c8c18 r4 = 0xc3041d80 r5 = 0x00000001 r6 = 0xc31a0240 r7 = 0xc3048c00 r8 = 0xc2e05000 r9 = 0xc3041d80 r10 = 0x00000000 ufs_remove() at ufs_remove+0x64 pc = 0xc05076e8 lr = 0xc056bd5c (VOP_REMOVE_APV+0xd0) sp = 0xde6c8c20 fp = 0xde6c8c30 r4 = 0xde6c8d78 r5 = 0xc066acd0 r6 = 0x00000000 r7 = 0xffffff9c r8 = 0x00000000 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xd0 pc = 0xc056bd5c lr = 0xc04126dc (kern_unlinkat+0x1b4) sp = 0xde6c8c38 fp = 0xde6c8da8 r4 = 0xde6c8cd8 r5 = 0xc2e05000 r6 = 0x2081b358 kern_unlinkat() at kern_unlinkat+0x1b4 pc = 0xc04126dc lr = 0xc04122fc (sys_unlink+0x24) sp = 0xde6c8db0 fp = 0xde6c8db8 r4 = 0xc2e05000 r5 = 0xc2dfb640 r6 = 0x00000000 r7 = 0x00000000 r8 = 0x00000001 r9 = 0xde6c8e10 r10 = 0x00012790 sys_unlink() at sys_unlink+0x24 pc = 0xc04122fc lr = 0xc0557878 (swi_handler+0x284) sp = 0xde6c8dc0 fp = 0xde6c8e58 swi_handler() at swi_handler+0x284 pc = 0xc0557878 lr = 0xc0543d74 (swi_exit) sp = 0xde6c8e60 fp = 0xbffffce0 r4 = 0x20803080 r5 = 0x0000a4ce r6 = 0x00000000 r7 = 0x0000000a r8 = 0x00000001 r9 = 0x00000000 swi_exit() at swi_exit pc = 0xc0543d74 lr = 0xc0543d74 (swi_exit) sp = 0xde6c8e60 fp = 0xbffffce0 Unable to unwind further
Got the same when using the copy-to-emmc.sh script that is supplied with the freebsd-image of 10.1-RELEASE for BBB: Copying the system from SD to eMMC lock order reversal: 1st 0xcd139da0 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:3097 2nd 0xc2f39800 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:285 KDB: stack backtrace: db_trace_self() at db_trace_self pc = 0xc05d62e0 lr = 0xc0233ff4 (db_trace_self_wrapper+0x30) sp = 0xde6eb7f0 fp = 0xde6eb908 r10 = 0xc062db9b db_trace_self_wrapper() at db_trace_self_wrapper+0x30 pc = 0xc0233ff4 lr = 0xc03cdbd4 (witness_checkorder+0xf4c) sp = 0xde6eb910 fp = 0xde6eb960 r4 = 0xc06649a9 r5 = 0xc2f39800 r6 = 0xc06645f7 r7 = 0xc06645f4 witness_checkorder() at witness_checkorder+0xf4c pc = 0xc03cdbd4 lr = 0xc037a5bc (_sx_xlock+0x80) sp = 0xde6eb968 fp = 0xde6eb998 r4 = 0x0000011d r5 = 0xc06645f4 r6 = 0xc2f39810 r7 = 0xc2f39800 r8 = 0x00000000 r9 = 0x0000000c r10 = 0xde6eba60 _sx_xlock() at _sx_xlock+0x80 pc = 0xc037a5bc lr = 0xc058fea8 (ufsdirhash_add+0x3c) sp = 0xde6eb9a0 fp = 0xde6eb9c0 r4 = 0xc2f39800 r5 = 0x00000028 r6 = 0xc2faf880 r7 = 0x00000010 r8 = 0xde6eba60 r10 = 0xde6eba60 ufsdirhash_add() at ufsdirhash_add+0x3c pc = 0xc058fea8 lr = 0xc0592b1c (ufs_direnter+0x46c) sp = 0xde6eb9c8 fp = 0xde6eba30 r4 = 0xc2faf880 r5 = 0xc2faac60 r6 = 0xcd774028 r7 = 0x00000010 r8 = 0x00000000 r9 = 0x0000000c r10 = 0xde6eba60 ufs_direnter() at ufs_direnter+0x46c pc = 0xc0592b1c lr = 0xc059bab4 (ufs_mkdir+0x734) sp = 0xde6eba38 fp = 0xde6ebbc0 r4 = 0xde6eba60 r5 = 0xc2faac60 r6 = 0xde6ebd48 r7 = 0x00000000 r8 = 0xc2fb0380 r9 = 0xc2faf880 r10 = 0xde6ebc80 ufs_mkdir() at ufs_mkdir+0x734 pc = 0xc059bab4 lr = 0xc0602c20 (VOP_MKDIR_APV+0x12c) sp = 0xde6ebbc8 fp = 0xde6ebbe0 r4 = 0xde6ebd48 r5 = 0xc0722db4 r6 = 0x00000000 r7 = 0x20c0c3a0 r8 = 0x00000000 r9 = 0x00000000 r10 = 0xde6ebc88 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x12c pc = 0xc0602c20 lr = 0xc042cee4 (kern_mkdirat+0x194) sp = 0xde6ebbe8 fp = 0xde6ebd80 r4 = 0xde6ebc18 r5 = 0xde6ebcb0 r6 = 0xde6ebd44 r10 = 0xde6ebc88 kern_mkdirat() at kern_mkdirat+0x194 pc = 0xc042cee4 lr = 0xc042cd48 (sys_mkdir+0x24) sp = 0xde6ebd88 fp = 0xde6ebd90 r4 = 0xc2fe0cc0 r5 = 0x00000000 r6 = 0xc07b5840 r7 = 0x00000000 r8 = 0xde6ebdf8 r9 = 0xc2fbb000 r10 = 0x20c14200 sys_mkdir() at sys_mkdir+0x24 pc = 0xc042cd48 lr = 0xc05ea080 (swi_handler+0x2e4) sp = 0xde6ebd98 fp = 0xde6ebe48 swi_handler() at swi_handler+0x2e4 pc = 0xc05ea080 lr = 0xc05d7990 (swi_exit) sp = 0xde6ebe50 fp = 0xbffffa30 r4 = 0x20c14200 r5 = 0x000001ed r6 = 0x20c14364 r7 = 0x00000088 r8 = 0x00000001 r9 = 0xffffffe2 r10 = 0x20c14200 swi_exit() at swi_exit pc = 0xc05d7990 lr = 0xc05d7990 (swi_exit) sp = 0xde6ebe50 fp = 0xbffffa30 lock order reversal: 1st 0xc2faac94 ufs (ufs) @ /usr/src/sys/kern/vfs_lookup.c:509 2nd 0xcd139da0 bufwait (bufwait) @ /usr/src/sys/ufs/ffs/ffs_vnops.c:263 3rd 0xc316e394 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self() at db_trace_self pc = 0xc05d62e0 lr = 0xc0233ff4 (db_trace_self_wrapper+0x30) sp = 0xde6eb408 fp = 0xde6eb520 r10 = 0xc062db9b db_trace_self_wrapper() at db_trace_self_wrapper+0x30 pc = 0xc0233ff4 lr = 0xc03cdbd4 (witness_checkorder+0xf4c) sp = 0xde6eb528 fp = 0xde6eb578 r4 = 0xc06344ca r5 = 0xc316e394 r6 = 0xc064e6c8 r7 = 0xc062db9b witness_checkorder() at witness_checkorder+0xf4c pc = 0xc03cdbd4 lr = 0xc0354628 (__lockmgr_args+0x838) sp = 0xde6eb580 fp = 0xde6eb5e8 r4 = 0xc064e6c5 r5 = 0xc06344ca r6 = 0xc316e394 r7 = 0x00000100 r8 = 0xc316e3b4 r9 = 0x00080100 r10 = 0x00080000 __lockmgr_args() at __lockmgr_args+0x838 pc = 0xc0354628 lr = 0xc058a648 (ffs_lock+0x80) sp = 0xde6eb5f0 fp = 0xde6eb620 r4 = 0xde6eb648 r5 = 0x00080100 r6 = 0xc316e360 r7 = 0xc316e394 r8 = 0xc316e3b4 r9 = 0x00000000 r10 = 0x00000008 ffs_lock() at ffs_lock+0x80 pc = 0xc058a648 lr = 0xc060374c (VOP_LOCK1_APV+0x128) sp = 0xde6eb628 fp = 0xde6eb640 r4 = 0xde6eb648 r5 = 0xc0722850 r6 = 0x00000000 r7 = 0x00080100 r8 = 0xde6eb648 r9 = 0x00000000 r10 = 0x00000880 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x128 pc = 0xc060374c lr = 0xc0430044 (_vn_lock+0x48) sp = 0xde6eb648 fp = 0xde6eb678 r4 = 0xc316e360 r5 = 0x0003ac80 r6 = 0xc064e6c5 r10 = 0x00000880 _vn_lock() at _vn_lock+0x48 pc = 0xc0430044 lr = 0xc0420bf4 (vget+0x60) sp = 0xde6eb680 fp = 0xde6eb6a0 r4 = 0xc316e360 r5 = 0x0003ac80 r6 = 0x00080100 r7 = 0xc07ab29c r8 = 0xc2fe0cc0 r9 = 0x00000000 r10 = 0xc07ab280 vget() at vget+0x60 pc = 0xc0420bf4 lr = 0xc0414cd4 (vfs_hash_get+0xe0) sp = 0xde6eb6a8 fp = 0xde6eb6d8 r4 = 0xc064d903 r5 = 0x0003ac80 r6 = 0xc2d5a2b0 r7 = 0xc07ab29c r8 = 0xc316e360 r10 = 0xc07ab280 vfs_hash_get() at vfs_hash_get+0xe0 pc = 0xc0414cd4 lr = 0xc058581c (ffs_vgetf+0x38) sp = 0xde6eb6e0 fp = 0xde6eb730 r4 = 0x0003ac80 r5 = 0x00080000 r6 = 0xc2d5a2b0 r7 = 0x0003ac80 r8 = 0xc2fce900 r9 = 0xc30c81b0 r10 = 0xde6eb790 ffs_vgetf() at ffs_vgetf+0x38 pc = 0xc058581c lr = 0xc057c408 (softdep_sync_buf+0x32c) sp = 0xde6eb738 fp = 0xde6eb7b0 r4 = 0x0003ac80 r5 = 0xc2d65900 r6 = 0xc2fce900 r7 = 0xc2d65900 r8 = 0xc2fce900 r9 = 0xc30c81b0 r10 = 0xc06602f8 softdep_sync_buf() at softdep_sync_buf+0x32c pc = 0xc057c408 lr = 0xc058b334 (ffs_syncvnode+0x2f4) sp = 0xde6eb7b8 fp = 0xde6eb808 r4 = 0xc06640d1 r5 = 0xc2faac60 r6 = 0x00000000 r7 = 0x00000001 r8 = 0xcd139da0 r9 = 0xcd139d50 r10 = 0x00000010 ffs_syncvnode() at ffs_syncvnode+0x2f4 pc = 0xc058b334 lr = 0xc055ff7c (ffs_truncate+0x754) sp = 0xde6eb810 fp = 0xde6eb9c0 r4 = 0xc2faac60 r5 = 0x00000400 r6 = 0xc2faf880 r7 = 0x00000000 r8 = 0xc2faf8d8 r9 = 0x00000000 r10 = 0xc309b000 ffs_truncate() at ffs_truncate+0x754 pc = 0xc055ff7c lr = 0xc0592edc (ufs_direnter+0x82c) sp = 0xde6eb9c8 fp = 0xde6eba30 r4 = 0xc2faac60 r5 = 0xc2faac60 r6 = 0xc2faf880 r7 = 0xc316e360 r8 = 0x00000000 r9 = 0x0000000c r10 = 0xde6eba60 ufs_direnter() at ufs_direnter+0x82c pc = 0xc0592edc lr = 0xc059bab4 (ufs_mkdir+0x734) sp = 0xde6eba38 fp = 0xde6ebbc0 r4 = 0xde6eba60 r5 = 0xc2faac60 r6 = 0xde6ebd48 r7 = 0x00000000 r8 = 0xc2fb0380 r9 = 0xc2faf880 r10 = 0xde6ebc80 ufs_mkdir() at ufs_mkdir+0x734 pc = 0xc059bab4 lr = 0xc0602c20 (VOP_MKDIR_APV+0x12c) sp = 0xde6ebbc8 fp = 0xde6ebbe0 r4 = 0xde6ebd48 r5 = 0xc0722db4 r6 = 0x00000000 r7 = 0x20c0c3a0 r8 = 0x00000000 r9 = 0x00000000 r10 = 0xde6ebc88 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x12c pc = 0xc0602c20 lr = 0xc042cee4 (kern_mkdirat+0x194) sp = 0xde6ebbe8 fp = 0xde6ebd80 r4 = 0xde6ebc18 r5 = 0xde6ebcb0 r6 = 0xde6ebd44 r10 = 0xde6ebc88 kern_mkdirat() at kern_mkdirat+0x194 pc = 0xc042cee4 lr = 0xc042cd48 (sys_mkdir+0x24) sp = 0xde6ebd88 fp = 0xde6ebd90 r4 = 0xc2fe0cc0 r5 = 0x00000000 r6 = 0xc07b5840 r7 = 0x00000000 r8 = 0xde6ebdf8 r9 = 0xc2fbb000 r10 = 0x20c14200 sys_mkdir() at sys_mkdir+0x24 pc = 0xc042cd48 lr = 0xc05ea080 (swi_handler+0x2e4) sp = 0xde6ebd98 fp = 0xde6ebe48 swi_handler() at swi_handler+0x2e4 pc = 0xc05ea080 lr = 0xc05d7990 (swi_exit) sp = 0xde6ebe50 fp = 0xbffffa30 r4 = 0x20c14200 r5 = 0x000001ed r6 = 0x20c14364 r7 = 0x00000088 r8 = 0x00000001 r9 = 0xffffffe2 r10 = 0x20c14200 swi_exit() at swi_exit pc = 0xc05d7990 lr = 0xc05d7990 (swi_exit) sp = 0xde6ebe50 fp = 0xbffffa30 aintc0: Spurious interrupt detected (0xffffffff) Cleaning up the copied system
Actually I get the same when I do shutdown -p now on the BBB as well: Syncing disks, vnodes remaining...4 4 3 3 0 0 0 done All buffers synced. lock order reversal: 1st 0xc2fa94b4 ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:1229 2nd 0xc2faaa54 devfs (devfs) @ /usr/src/sys/ufs/ffs/ffs_vfsops.c:1375 KDB: stack backtrace: db_trace_self() at db_trace_self pc = 0xc05d62e0 lr = 0xc0233ff4 (db_trace_self_wrapper+0x30) sp = 0xcd2ff980 fp = 0xcd2ffa98 r10 = 0xc062db9b db_trace_self_wrapper() at db_trace_self_wrapper+0x30 pc = 0xc0233ff4 lr = 0xc03cdbd4 (witness_checkorder+0xf4c) sp = 0xcd2ffaa0 fp = 0xcd2ffaf0 r4 = 0xc063999a r5 = 0xc2faaa54 r6 = 0xc066399f r7 = 0xc066399c witness_checkorder() at witness_checkorder+0xf4c pc = 0xc03cdbd4 lr = 0xc0354628 (__lockmgr_args+0x838) sp = 0xcd2ffaf8 fp = 0xcd2ffb60 r4 = 0xc066399c r5 = 0xc063999a r6 = 0xc2faaa54 r7 = 0x00000000 r8 = 0xc2faaa74 r9 = 0x00080400 r10 = 0x00080000 __lockmgr_args() at __lockmgr_args+0x838 pc = 0xc0354628 lr = 0xc0411aa8 (vop_stdlock+0x3c) sp = 0xcd2ffb68 fp = 0xcd2ffb78 r4 = 0xcd2ffba0 r5 = 0xc07140e8 r6 = 0x00000000 r7 = 0x00080400 r8 = 0xcd2ffba0 r9 = 0xc06602f8 r10 = 0x0000055f vop_stdlock() at vop_stdlock+0x3c pc = 0xc0411aa8 lr = 0xc060374c (VOP_LOCK1_APV+0x128) sp = 0xcd2ffb80 fp = 0xcd2ffb98 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x128 pc = 0xc060374c lr = 0xc0430044 (_vn_lock+0x48) sp = 0xcd2ffba0 fp = 0xcd2ffbd0 r4 = 0xc2faaa20 r5 = 0xc2a7d660 r6 = 0xc066399c r10 = 0x0000055f _vn_lock() at _vn_lock+0x48 pc = 0xc0430044 lr = 0xc0585760 (ffs_flushfiles+0x118) sp = 0xcd2ffbd8 fp = 0xcd2ffc10 r4 = 0xc2d65900 r5 = 0xc2a7d660 r6 = 0xc2d5a2b0 r7 = 0x00000000 r8 = 0x0000000a r9 = 0xc06602f8 r10 = 0xc2a7d660 ffs_flushfiles() at ffs_flushfiles+0x118 pc = 0xc0585760 lr = 0xc0569810 (softdep_flushfiles+0xdc) sp = 0xcd2ffc18 fp = 0xcd2ffc68 r4 = 0x00000008 r5 = 0xc2a7d660 r6 = 0x00000002 r7 = 0x0000000a r8 = 0x00000000 r9 = 0xc06602f8 r10 = 0xc2d5a2b0 softdep_flushfiles() at softdep_flushfiles+0xdc pc = 0xc0569810 lr = 0xc05883f4 (ffs_unmount+0x88) sp = 0xcd2ffc70 fp = 0xcd2ffca8 r4 = 0x00000000 r5 = 0xc2d65900 r6 = 0x00000002 r7 = 0xc2a7d660 r8 = 0x00000001 r9 = 0xc2d5a2b0 r10 = 0xc309b000 ffs_unmount() at ffs_unmount+0x88 pc = 0xc05883f4 lr = 0xc041a2e8 (dounmount+0x4c0) sp = 0xcd2ffcb0 fp = 0xcd2ffcf8 r4 = 0x00000000 r5 = 0x00000000 r6 = 0x00080000 r7 = 0x00000000 r8 = 0xc2fa9480 r9 = 0x00080000 r10 = 0xc2a7d660 dounmount() at dounmount+0x4c0 pc = 0xc041a2e8 lr = 0xc0422ea0 (vfs_unmountall+0x58) sp = 0xcd2ffd00 fp = 0xcd2ffd20 r4 = 0xc2a7d660 r5 = 0xc063999a r6 = 0xc07404e0 r7 = 0xc2d5a2b0 r8 = 0xc0714470 r9 = 0xc065e3f8 r10 = 0xc064ed48 vfs_unmountall() at vfs_unmountall+0x58 pc = 0xc0422ea0 lr = 0xc0372510 (kern_reboot+0x4ec) sp = 0xcd2ffd28 fp = 0xcd2ffd80 r4 = 0x00000000 r5 = 0x00000000 r6 = 0xc07404e0 r7 = 0xcd114eb0 r8 = 0x00004008 r9 = 0xc0725614 r10 = 0xc07b5ecc kern_reboot() at kern_reboot+0x4ec pc = 0xc0372510 lr = 0xc0372024 (kern_reboot) sp = 0xcd2ffd88 fp = 0xcd2ffd90 r4 = 0xcd2ffe00 r5 = 0x00000000 r6 = 0xc07b5840 r7 = 0x00000000 r8 = 0xcd2ffdf8 r9 = 0xc2a7a000 r10 = 0x0000001e kern_reboot() at kern_reboot pc = 0xc0372024 lr = 0xc05ea080 (swi_handler+0x2e4) sp = 0xcd2ffd98 fp = 0xcd2ffe48 r4 = 0xcd2ffdf8 r5 = 0xc2a7a000 r6 = 0x0000001e r7 = 0xcd2ffd90 r8 = 0xc0372024 r9 = 0xc2a7d660 r10 = 0x0000001e swi_handler() at swi_handler+0x2e4 pc = 0xc05ea080 lr = 0xc05d7990 (swi_exit) sp = 0xcd2ffe50 fp = 0xbffff938 r4 = 0x00008a18 r5 = 0x000ddd5c r6 = 0x0000003c r7 = 0x00000037 r8 = 0x0000001f r9 = 0x000e0430 r10 = 0x0000001e swi_exit() at swi_exit pc = 0xc05d7990 lr = 0xc05d7990 (swi_exit) sp = 0xcd2ffe50 fp = 0xbffff938 Uptime: 12m56s The operating system has halted. Please press any key to reboot.
batch change: For bugs that match the following - Status Is In progress AND - Untouched since 2018-01-01. AND - Affects Base System OR Documentation DO: Reset to open status. Note: I did a quick pass but if you are getting this email it might be worthwhile to double check to see if this bug ought to be closed.
The vfs_bio/ufs_dirhash pair also appears in bug 206923, where it is described as a known false positive. I saw it installing the latest CURRENT (FreeBSD-13.0-CURRENT-arm64-aarch64-20190221-r344398-memstick.img). Should some of these filesystem lock ordering bugs be closed as duplicates?