Bug 187080 - [panic] sparc64 r261798: Panic String: vm_page_alloc: page 0xfffff8003feea008 is wired
Summary: [panic] sparc64 r261798: Panic String: vm_page_alloc: page 0xfffff8003feea008...
Status: Closed FIXED
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: CURRENT
Hardware: Any Any
: Normal Affects Only Me
Assignee: freebsd-bugs (Nobody)
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2014-02-26 10:30 UTC by Anton Shterenlikht
Modified: 2014-12-28 21:39 UTC (History)
1 user (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Anton Shterenlikht 2014-02-26 10:30:00 UTC
This panic is reproducible,
always triggered by rsync from
another fbsd box.

I set up textdump are these are
the files I collected:

info.last
panic.txt
version.txt
config.txt
msgbuf.txt
ddb.txt

# cat info.last
Dump header from device /dev/ada1a
  Architecture: sparc64
  Architecture Version: 1
  Dump Length: 65536B (0 MB)
  Blocksize: 512
  Dumptime: Wed Feb 26 10:10:51 2014
  Hostname: mech-anton240.men.bris.ac.uk
  Magic: FreeBSD Text Dump
  Version String: FreeBSD 11.0-CURRENT #0 r261798: Wed Feb 26 09:16:52 GMT 2014
    root@mech-anton240.men.bris.ac.uk:/usr/obj/usr/src/sys/QOF
  Panic String: vm_page_alloc: page 0xfffff8003feea008 is wired
  Dump Parity: 823177346
  Bounds: 0
  Dump Status: good
#

# cat panic.txt
vm_page_alloc: page 0xfffff8003feea008 is wired#
#

# cat version.txt
FreeBSD 11.0-CURRENT #0 r261798: Wed Feb 26 09:16:52 GMT 2014
    root@mech-anton240.men.bris.ac.uk:/usr/obj/usr/src/sys/QOF
#

config.txt:

options	CONFIG_AUTOGENERATED
ident	QOF
machine	sparc64
cpu	SUN4U
makeoptions	MODULES_OVERRIDE=
makeoptions	DEBUG=-g
options	USB_DEBUG
options	KBD_INSTALL_CDEV
options	TEXTDUMP_VERBOSE
options	TEXTDUMP_PREFERRED
options	DEBUG_VFS_LOCKS
options	DEBUG_LOCKS
options	MALLOC_DEBUG_MAXZONES=8
options	WITNESS_SKIPSPIN
options	WITNESS
options	INVARIANT_SUPPORT
options	INVARIANTS
options	DEADLKRES
options	GDB
options	DDB
options	KDB_TRACE
options	KDB
options	INCLUDE_CONFIG_FILE
options	MAC
options	CAPABILITIES
options	CAPABILITY_MODE
options	AUDIT
options	HWPMC_HOOKS
options	PRINTF_BUFR_SIZE=128
options	_KPOSIX_PRIORITY_SCHEDULING
options	SYSVSEM
options	SYSVMSG
options	SYSVSHM
options	STACK
options	KTRACE
options	SCSI_DELAY=5000
options	COMPAT_FREEBSD7
options	COMPAT_FREEBSD6
options	COMPAT_FREEBSD5
options	GEOM_LABEL
options	GEOM_PART_GPT
options	PSEUDOFS
options	PROCFS
options	CD9660
options	MSDOSFS
options	NFS_ROOT
options	NFSLOCKD
options	NFSD
options	NFSCL
options	MD_ROOT
options	QUOTA
options	UFS_GJOURNAL
options	UFS_DIRHASH
options	UFS_ACL
options	SOFTUPDATES
options	FFS
options	SCTP
options	INET6
options	INET
options	PREEMPTION
options	SCHED_ULE
options	NEW_PCIB
options	SUNKBD_EMULATE_ATKBD
options	GEOM_PART_VTOC8
options	GEOM_PART_BSD
device	mem
device	uart_ns8250
device	uart_sab82532
device	uart_z8530
device	ebus
device	isa
device	pci
device	sbus
device	central
device	fhc
device	ahci
device	ata
device	scbus
device	da
device	cd
device	pass
device	atkbdc
device	atkbd
device	psm
device	kbdmux
device	sc
device	machfb
device	auxio
device	eeprom
device	mk48txx
device	rtc
device	mc146818
device	epic
device	sbbc
device	puc
device	scc
device	uart
device	ppbus
device	ppc
device	lpt
device	miibus
device	bge
device	loop
device	random
device	ether
device	vlan
device	tun
device	md
device	gif
device	faith
device	firmware
device	bpf
device	uhci
device	ohci
device	ehci
device	usb
device	ukbd
device	umass
device	ums
device	sound
device	snd_t4dwave


msgbuf.txt:

GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.0-CURRENT #0 r261798: Wed Feb 26 09:16:52 GMT 2014
    root@mech-anton240.men.bris.ac.uk:/usr/obj/usr/src/sys/QOF sparc64
gcc version 4.2.1 20070831 patched [FreeBSD]
WARNING: WITNESS option enabled, expect reduced performance.
real memory  = 2147483648 (2048 MB)
avail memory = 2078580736 (1982 MB)
cpu0: Sun Microsystems UltraSparc-IIIi Processor (1503.00 MHz CPU)
random: <Software, Yarrow> initialized
kbd0 at kbdmux0
nexus0: <Open Firmware Nexus device>
pcib0: <Sun Host-PCI bridge> mem 0x4000f600000-0x4000f60afff,0x4000f410000-0x4000f41701f,0x7fe00000000-0x7fe000000ff,0x4000f780000-0x4000f78ffff irq 1970,1968,1969,1972,1953 on nexus0
pcib0: Tomatillo, version 4, IGN 0x1e, bus A, PCI mode, 33MHz
pcib0: DVMA map: 0xc0000000 to 0xdfffffff 65536 entries
pci0: <OFW PCI bus> on pcib0
pcib1: <Sun Host-PCI bridge> mem 0x4000ff00000-0x4000ff0afff,0x4000fc10000-0x4000fc1701f,0x7f600000000-0x7f6000000ff,0x4000ff80000-0x4000ff8ffff irq 2035,2032,2033,2036,2019 on nexus0
pcib1: Tomatillo, version 4, IGN 0x1f, bus B, PCI mode, 66MHz
pcib1: DVMA map: 0xc0000000 to 0xdfffffff 65536 entries
pci1: <OFW PCI bus> on pcib1
nexus0: <memory-controller> mem 0x40000000000-0x40000000007 type memory-controller (no driver attached)
isab0: <PCI-ISA bridge> at device 7.0 on pci0
pcib0: could not route pin 1 for device 7.0
isa0: could not map ISA interrupt 1 for node 0xf0097238: parallel
isa0: <ISA bus> on isab0
pci0: <old, non-VGA display device> at device 6.0 (no driver attached)
pcm0: <Acer Labs M5451> port 0x900-0x9ff mem 0x100000-0x100fff at device 8.0 on pci0
pcm0: <Analog Devices AD1881A AC97 Codec>
pcm0: [GIANT-LOCKED]
ohci0: <AcerLabs M5237 (Aladdin-V) USB controller> mem 0x1000000-0x1000fff at device 10.0 on pci0
usbus0 on ohci0
ohci1: <AcerLabs M5237 (Aladdin-V) USB controller> mem 0x2000000-0x2000fff at device 11.0 on pci0
usbus1 on ohci1
atapci0: <AcerLabs M5229 UDMA100 controller> port 0xa00-0xa07,0xa18-0xa1b,0xa10-0xa17,0xa08-0xa0b,0xa20-0xa2f at device 13.0 on pci0
atapci0: using PIO transfers above 137GB as workaround for 48bit DMA access bug, expect reduced performance
ata2: <ATA channel> at channel 0 on atapci0
ata3: <ATA channel> at channel 1 on atapci0
machfb0: <ATI Rage XL> port 0xb00-0xbff mem 0x3000000-0x3ffffff,0x102000-0x102fff at device 2.0 on pci0
machfb0: console
machfb0: 16 MB aperture at 0xfddcc000 not swapped
machfb0: 8188 KB SGRAM 114.992 MHz, maximum RAMDAC clock 230 MHz, DSP
machfb0: resolution 1280x1024 at 8 bpp
jbusppm0: <JBus power management> mem 0x4000f000000-0x4000f000007,0x4000f410050-0x4000f41005f on nexus0
bge0: <Broadcom BCM5703 A2, ASIC rev. 0x001002> mem 0x200000-0x20ffff at device 2.0 on pci1
bge0: CHIP ID 0x00001002; ASIC REV 0x01; CHIP REV 0x10; PCI on PCI-X 66 MHz; 64bit
miibus0: <MII bus> on bge0
brgphy0: <BCM5703 1000BASE-T media interface> PHY 1 on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge0: Ethernet address: 00:03:ba:d9:a0:07
nexus0: <i2c> mem 0x4000fc64000-0x4000fc6400f type i2c (no driver attached)
syscons0: <System console> on nexus0
syscons0: Unknown <16 virtual consoles, flags=0x300>
rtc0: <Real-Time Clock> at port 0x70-0x71 on isa0
uart0: <16550 or compatible> at port 0x3f8-0x3ff irq 44 on isa0
uart1: <16550 or compatible> at port 0x2e8-0x2ef irq 44 on isa0
ppc0: <ECP parallel printer port> at port 0x378-0x37f,0-0x4ff drq 1 on isa0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/1 bytes threshold
ppbus0: <Parallel port bus> on ppc0
lpt0: <Printer> on ppbus0
lpt0: Polled port
Timecounter "tick" frequency 1503000000 Hz quality 1000
Timecounter "stick" frequency 12000000 Hz quality 1000
Event timer "tick" frequency 1503000000 Hz quality 1000
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
ugen0.1: <AcerLabs> at usbus0
uhub0: <AcerLabs OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <AcerLabs> at usbus1
uhub1: <AcerLabs OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
ada0 at ata2 bus 0 scbus0 target 0 lun 0
ada0: <ST380011A 3.04> ATA-6 device
ada0: Serial Number 3JVA6XG5
ada0: 100.000MB/s transfers (UDMA5, PIO 8192bytes)
ada0: 76319MB (156301488 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad0
ada1 at ata2 bus 0 scbus0 target 1 lun 0
ada1: <ST380011A 8.01> ATA-6 device
ada1: Serial Number 5JVCQK70
ada1: 100.000MB/s transfers (UDMA5, PIO 8192bytes)
ada1: 76319MB (156301488 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad1
cd0 at ata3 bus 0 scbus1 target 0 lun 0
cd0: <TSSTcorp CDW/DVD TS-H492C SI00> Removable CD-ROM SCSI-0 device 
cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
random: unblocking device.
WARNING: WITNESS option enabled, expect reduced performance.
Root mount waiting for: usbus1
ugen1.2: <vendor 0x0430> at usbus1
ukbd0: <vendor 0x0430 product 0x0005, class 0/0, rev 1.10/2.00, addr 2> on usbus1
kbd1 at ukbd0
Root mount waiting for: usbus1
ugen1.3: <vendor 0x0430> at usbus1
ums0: <vendor 0x0430 product 0x0100, class 0/0, rev 2.00/1.07, addr 3> on usbus1
ums0: 3 buttons and [XY] coordinates ID=0
Trying to mount root from ufs:/dev/ada0a [rw]...
<118>Setting hostuuid: d3d68ffc-e130-11de-a08d-020516707c36.
<118>Setting hostid: 0x0274c4bd.
<118>Starting ddb.
<118>Entropy harvesting: interrupts ethernet point_to_point swi.
<118>Starting file system checks:
<118>/dev/ada0a: FILE SYSTEM CLEAN; SKIPPING CHECKS
<118>/dev/ada0a: clean, 1659660 free (716 frags, 207368 blocks, 0.0% fragmentation)
<118>/dev/ada0f: FILE SYSTEM CLEAN; SKIPPING CHECKS
<118>/dev/ada0f: clean, 31379897 free (447361 frags, 3866567 blocks, 1.2% fragmentation)
<118>Mounting local file systems:.
<118>Writing entropy file:.
<118>Setting hostname: mech-anton240.men.bris.ac.uk.
<118>Starting Network: lo0 bge0.
<118>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
<118>	options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
<118>	inet6 ::1 prefixlen 128 
<118>	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 
<118>	inet 127.0.0.1 netmask 0xff000000 
<118>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
<118>bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
<118>	options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
<118>	ether 00:03:ba:d9:a0:07
<118>	inet 137.222.187.240 netmask 0xffffff00 broadcast 137.222.187.255 
<118>	inet6 fe80::203:baff:fed9:a007%bge0 prefixlen 64 scopeid 0x1 
<118>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
<118>	media: Ethernet autoselect (none)
<118>	status: no carrier
<118>Starting devd.
<118>Configuring keyboard: keymap keyrate.
<118>Starting ums0 moused.
<118>Starting pflogd: 
<118>add net default: gateway 137.222.187.250
<118>add net fe80::: gateway ::1
<118>add net ff02::: gateway ::1
<118>add net ::ffff:0.0.0.0: gateway ::1
<118>add net ::0.0.0.0: gateway ::1
<118>ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/R/lib /usr/local/lib/gcc46 /usr/local/lib/gcc47 /usr/local/lib/gcc48 /usr/local/lib/gcc49
<118>Creating and/or trimming log files.
<118>Starting syslogd.
<118>No core dumps found.
<118>Starting casperd.
<118>Clearing /tmp (X related).
<118>Recovering vi editor sessions:.
<118>Starting lpd.
<118>Updating motd:.
<118>Mounting late file systems:.
<118>Starting ntpd.
<118>Starting sendmail_submit.
<118>Starting sendmail_msp_queue.
<118>Starting bsdstats.
<118>Posting monthly OS statistics to rpt.bsdstats.org
<118>Configuring syscons: keymap keyrate blanktime.
<118>Performing sanity check on sshd configuration.
<118>Starting sshd.
<118>Starting cron.
<118>Starting background file system checks in 60 seconds.
<118>
<118>Wed Feb 26 10:03:38 GMT 2014
<118>Feb 26 10:03:53 mech-anton240 login: ROOT LOGIN (root) ON ttyv0
lock order reversal:
 1st 0xc14a8a08 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:3081
 2nd 0xfffff800014e5800 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:284
KDB: stack backtrace:
_witness_debugger() at _witness_debugger+0x38
witness_checkorder() at witness_checkorder+0xe80
_sx_xlock() at _sx_xlock+0xb8
ufsdirhash_acquire() at ufsdirhash_acquire+0x50
ufsdirhash_remove() at ufsdirhash_remove+0x4
ufs_dirremove() at ufs_dirremove+0x138
ufs_rename() at ufs_rename+0x1140
VOP_RENAME_APV() at VOP_RENAME_APV+0x104
kern_renameat() at kern_renameat+0x314
kern_rename() at kern_rename+0x18
sys_rename() at sys_rename+0x10
syscall() at syscall+0x304
-- syscall (128, FreeBSD ELF64, sys_rename) %o7=0x122810 --
userland() at 0x406e11e8
user trace: trap %o7=0x122810
pc 0x406e11e8, sp 0x7fdffff9991
pc 0x11c68c, sp 0x7fdffffa251
pc 0x10c5b8, sp 0x7fdffffa311
pc 0x114ef0, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done
panic: vm_page_alloc: page 0xfffff8003feea008 is wired
KDB: stack backtrace:
vpanic() at vpanic+0xfc
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done
KDB: enter: panic

ddb.txt:


db:0:kdb.enter.panic>  run lockinfo
db:1:lockinfo> show locks
exclusive sleep mutex vm page free queue (vm page free queue) r = 0 (0xc0adb300) locked @ /usr/src/sys/vm/vm_page.c:1484
exclusive rw vm object (vm object) r = 0 (0xfffff8022e274800) locked @ /usr/src/sys/kern/vfs_bio.c:3503
exclusive lockmgr bufwait (bufwait) r = 0 (0xc1814258) locked @ /usr/src/sys/kern/vfs_bio.c:2345
exclusive lockmgr bufwait (bufwait) r = 0 (0xc155a428) locked @ /usr/src/sys/kern/vfs_bio.c:3081
exclusive lockmgr ufs (ufs) r = 0 (0xfffff8022e29d8c8) locked @ /usr/src/sys/kern/vfs_vnops.c:810
db:1:locks>  show alllocks
Process 883 (rsync) thread 0xfffff800018aadb0 (100076)
exclusive sleep mutex vm page free queue (vm page free queue) r = 0 (0xc0adb300) locked @ /usr/src/sys/vm/vm_page.c:1484
exclusive rw vm object (vm object) r = 0 (0xfffff8022e274800) locked @ /usr/src/sys/kern/vfs_bio.c:3503
exclusive lockmgr bufwait (bufwait) r = 0 (0xc1814258) locked @ /usr/src/sys/kern/vfs_bio.c:2345
exclusive lockmgr bufwait (bufwait) r = 0 (0xc155a428) locked @ /usr/src/sys/kern/vfs_bio.c:3081
exclusive lockmgr ufs (ufs) r = 0 (0xfffff8022e29d8c8) locked @ /usr/src/sys/kern/vfs_vnops.c:810
db:1:alllocks>  show lockedvnods
Locked vnodes
db:0:kdb.enter.panic>  show pcpu
cpuid        = 0
dynamic pcpu = 0xfffff7ff4005fb00
curthread    = 0xfffff800018aadb0: pid 883 "rsync"
curpcb       = 0xc1ed7980
fpcurthread  = none
idlethread   = 0xfffff8000107db60: tid 100003 "idle"
spin locks held:
db:0:kdb.enter.panic>  bt
Tracing pid 883 tid 100076 td 0xfffff800018aadb0
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done
db:0:kdb.enter.panic>  ps
  pid  ppid  pgrp   uid   state   wmesg         wchan        cmd
  905   900   905  1001  S+      select   0xfffff800014acb40 ssh
  900   822   900  1001  S+      pause    0xfffff800018a40a8 tcsh
  883   882   879  1001  R       CPU 0                       rsync
  882   879   879  1001  S       select   0xfffff800014acf40 rsync
  879   878   879  1001  Ss      pause    0xfffff800018a4558 tcsh
  878   876   876  1001  R                                   sshd
  876   777   876     0  Ss      select   0xfffff800014accc0 sshd
  845   838   845  1001  S+      select   0xfffff800014ad0c0 ssh
  838   821   838  1001  S+      pause    0xfffff80001822558 tcsh
  830   820   830     0  S+      ttyin    0xfffff8000110cca8 sh
  829     1   829     0  Ss+     ttyin    0xfffff8000110a8a8 getty
  828     1   828     0  Ss+     ttyin    0xfffff8000110aca8 getty
  827     1   827     0  Ss+     ttyin    0xfffff8000110b0a8 getty
  826     1   826     0  Ss+     ttyin    0xfffff8000110b4a8 getty
  825     1   825     0  Ss+     ttyin    0xfffff8000110b8a8 getty
  824     1   824     0  Ss+     ttyin    0xfffff8000110bca8 getty
  823     1   823     0  Ss+     ttyin    0xfffff8000110c0a8 getty
  822     1   822     0  Ss+     wait     0xfffff800017c84b0 login
  821     1   821     0  Ss+     wait     0xfffff80001554960 login
  820     1   820     0  Ss+     wait     0xfffff8000107b2c0 login
  780     1   780     0  Ss      nanslp   0xc07d5200 cron
  777     1   777     0  Ss      select   0xfffff8000119e340 sshd
  711     1   711    25  Ss      pause    0xfffff800017c9368 sendmail
  708     1   708     0  Ss      select   0xfffff8000119e040 sendmail
  690     1   690     0  Ss      select   0xfffff800014adc40 ntpd
  669     1   669     0  Ss      select   0xfffff8000119e640 lpd
  627     1   627     0  Ss      select   0xfffff8000119e1c0 casperd
  626     1    17     0  S+      select   0xfffff8000119e440 casperd
  602     1   602     0  Ss      select   0xfffff8000119e540 syslogd
  476     1   476     0  Ss      select   0xfffff8000119e140 devd
  459     1   459     0  Ss      select   0xfffff800014adac0 moused
  114     1   114     0  Ss      pause    0xfffff80001554558 adjkerntz
   16     0     0     0  DL      sdflush  0xc0ad9e48 [softdepflush]
    9     0     0     0  DL      syncer   0xc0ad1cf8 [syncer]
    8     0     0     0  DL      vlruwt   0xfffff800014964b0 [vnlru]
    7     0     0     0  DL      psleep   0xc0ad1800 [bufdaemon]
    6     0     0     0  DL      pgzero   0xc0adc80c [pagezero]
    5     0     0     0  DL      psleep   0xc0adb49c [vmdaemon]
    4     0     0     0  DL      psleep   0xc0adb4ec [pagedaemon]
    3     0     0     0  DL      waiting_ 0xc0ad47f0 [sctp_iterator]
   15     0     0     0  DL      (threaded)                  [usb]
100029                   D       -        0x1001b3460 [usbus1]
100028                   D       -        0x1001b3408 [usbus1]
100027                   D       -        0x1001b33b0 [usbus1]
100026                   D       -        0x1001b3358 [usbus1]
100024                   D       -        0x1001af460 [usbus0]
100023                   D       -        0x1001af408 [usbus0]
100022                   D       -        0x1001af3b0 [usbus0]
100021                   D       -        0x1001af358 [usbus0]
    2     0     0     0  DL      (threaded)                  [cam]
100036                   D       ccb_scan 0xc07a1540 [scanner]
100018                   D       -        0xc07a1700 [doneq0]
   14     0     0     0  DL      -        0xc07a5160 [rand_harvestq]
   13     0     0     0  DL      (threaded)                  [geom]
100009                   D       -        0xc07cff08 [g_down]
100008                   D       -        0xc07cff00 [g_up]
100007                   D       -        0xc07cfef0 [g_event]
   12     0     0     0  WL      (threaded)                  [intr]
100032                   I                                   [swi0: uart uart]
100031                   I                                   [vec2012: bge0]
100030                   I                                   [vec1944: atapci0]
100025                   I                                   [vec1958: ohci1]
100020                   I                                   [vec1959: ohci0]
100019                   I                                   [vec1956: pcm0]
100017                   I                                   [swi6: task queue]
100016                   I                                   [swi6: Giant taskq]
100014                   I                                   [swi5: fast taskq]
100006                   I                                   [swi3: vm]
100005                   I                                   [swi4: clock]
100004                   I                                   [swi1: netisr 0]
   11     0     0     0  RL                                  [idle]
    1     0     1     0  SLs     wait     0xfffff8000107a4b0 [init]
   10     0     0     0  DL      audit_wo 0xc0ad9218 [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100035                   D       -        0xfffff80001062e00 [CAM taskq]
100033                   D       -        0xc07d3ee8 [deadlkres]
100015                   D       -        0xfffff80001063300 [thread taskq]
100013                   D       -        0xfffff80001063600 [kqueue taskq]
100012                   D       -        0xfffff80001063700 [ffs_trim taskq]
100010                   D       -        0xfffff80001063800 [firmware taskq]
100000                   D       swapin   0xc07d0100 [swapper]
db:0:kdb.enter.panic>  alltrace

Tracing command ssh pid 905 tid 100082 td 0xfffff800017f7240
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
seltdwait() at seltdwait+0x94
kern_select() at kern_select+0x6f8
sys_select() at sys_select+0x44
syscall() at syscall+0x304
-- syscall (93, FreeBSD ELF64, sys_select) %o7=0x1119ac --
userland() at 0x40edf668
user trace: trap %o7=0x1119ac
pc 0x40edf668, sp 0x7fdffffa061
pc 0x28d68a904d3a55d9, sp 0x5a12a353
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x5a12add6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command tcsh pid 900 tid 100081 td 0xfffff800017f76d0
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_sleep() at _sleep+0x4a8
kern_sigsuspend() at kern_sigsuspend+0xc4
sys_sigsuspend() at sys_sigsuspend+0x28
syscall() at syscall+0x304
-- syscall (341, FreeBSD ELF64, sys_sigsuspend) %o7=0x123b50 --
userland() at 0x40743068
user trace: trap %o7=0x123b50
pc 0x40743068, sp 0x7fdffffd581
pc 0x40284400, sp 0x8
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0xdd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command rsync pid 883 tid 100076 td 0xfffff800018aadb0
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command rsync pid 882 tid 100075 td 0xfffff800017f6490
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x8
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x390
seltdwait() at seltdwait+0x84
kern_select() at kern_select+0x6f8
sys_select() at sys_select+0x44
syscall() at syscall+0x304
-- syscall (93, FreeBSD ELF64, sys_select) %o7=0x12d358 --
userland() at 0x406e1668
user trace: trap %o7=0x12d358
pc 0x406e1668, sp 0x7fdffff8e61
pc 0x1ffffa888, sp 0x41400000
pc 0, sp 0x400000000000000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x400000000000dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command tcsh pid 879 tid 100080 td 0xfffff800017f7b60
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_sleep() at _sleep+0x4a8
kern_sigsuspend() at kern_sigsuspend+0xc4
sys_sigsuspend() at sys_sigsuspend+0x28
syscall() at syscall+0x304
-- syscall (341, FreeBSD ELF64, sys_sigsuspend) %o7=0x123b50 --
userland() at 0x40743068
user trace: trap %o7=0x123b50
pc 0x40743068, sp 0x7fdffffd4e1
pc 0x406e27ec, sp 0x7fdffffd591
pc 0x405d2b2c, sp 0x7fdffffd651
pc 0x4026d1a8, sp 0x7fdffffd711
pc 0x4027022c, sp 0x7fdffffd7d1
pc 0x402678f4, sp 0x7fdffffe051
done

Tracing command sshd pid 878 tid 100079 td 0xfffff800018aa000
mi_switch() at mi_switch+0x2d8
ast() at ast+0x32c
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x403b8558 --
userland() at 0x41b845a8
user trace: trap %o7=0x403b8558
pc 0x41b845a8, sp 0x7fdffff8f71
pc 0x1ffff9860, sp 0x41400000
pc 0, sp 0x400000000000000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x400000000000dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command sshd pid 876 tid 100078 td 0xfffff800018aa490
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
seltdwait() at seltdwait+0x94
sys_poll() at sys_poll+0x30c
syscall() at syscall+0x304
-- syscall (209, FreeBSD ELF64, sys_poll) %o7=0x12a5ac --
userland() at 0x41b824e8
user trace: trap %o7=0x12a5ac
pc 0x41b824e8, sp 0x7fdffffd161
done

Tracing command ssh pid 845 tid 100066 td 0xfffff800017f6000
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
seltdwait() at seltdwait+0x94
kern_select() at kern_select+0x6f8
sys_select() at sys_select+0x44
syscall() at syscall+0x304
-- syscall (93, FreeBSD ELF64, sys_select) %o7=0x1119ac --
userland() at 0x40edf668
user trace: trap %o7=0x1119ac
pc 0x40edf668, sp 0x7fdffffa061
pc 0x28d68a904d3a55d9, sp 0x5a12a353
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x5a12add6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command tcsh pid 838 tid 100074 td 0xfffff80001557b60
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_sleep() at _sleep+0x4a8
kern_sigsuspend() at kern_sigsuspend+0xc4
sys_sigsuspend() at sys_sigsuspend+0x28
syscall() at syscall+0x304
-- syscall (341, FreeBSD ELF64, sys_sigsuspend) %o7=0x123b50 --
userland() at 0x40743068
user trace: trap %o7=0x123b50
pc 0x40743068, sp 0x7fdffffd581
pc 0x40284400, sp 0x8
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0xdd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command sh pid 830 tid 100072 td 0xfffff800017f4490
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
tty_wait() at tty_wait+0x84
ttydisc_read() at ttydisc_read+0x2a4
ttydev_read() at ttydev_read+0x84
devfs_read_f() at devfs_read_f+0xa8
dofileread() at dofileread+0x74
kern_readv() at kern_readv+0x58
sys_read() at sys_read+0x74
syscall() at syscall+0x304
-- syscall (3, FreeBSD ELF64, sys_read) %o7=0x4035dc38 --
userland() at 0x4071a5e8
user trace: trap %o7=0x4035dc38
pc 0x4071a5e8, sp 0x7fdffffdc21
pc 0x68acf04, sp 0x1023dd
pc 0, sp 0x1500000000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x1500000dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command getty pid 829 tid 100071 td 0xfffff800017f4920
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
tty_wait() at tty_wait+0x84
ttydisc_read() at ttydisc_read+0x2a4
ttydev_read() at ttydev_read+0x84
devfs_read_f() at devfs_read_f+0xa8
dofileread() at dofileread+0x74
kern_readv() at kern_readv+0x58
sys_read() at sys_read+0x74
syscall() at syscall+0x304
-- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 --
userland() at 0x405945e8
user trace: trap %o7=0x102390
pc 0x405945e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command getty pid 828 tid 100070 td 0xfffff800017f4db0
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
tty_wait() at tty_wait+0x84
ttydisc_read() at ttydisc_read+0x2a4
ttydev_read() at ttydev_read+0x84
devfs_read_f() at devfs_read_f+0xa8
dofileread() at dofileread+0x74
kern_readv() at kern_readv+0x58
sys_read() at sys_read+0x74
syscall() at syscall+0x304
-- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 --
userland() at 0x405945e8
user trace: trap %o7=0x102390
pc 0x405945e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command getty pid 827 tid 100069 td 0xfffff800017f5240
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
tty_wait() at tty_wait+0x84
ttydisc_read() at ttydisc_read+0x2a4
ttydev_read() at ttydev_read+0x84
devfs_read_f() at devfs_read_f+0xa8
dofileread() at dofileread+0x74
kern_readv() at kern_readv+0x58
sys_read() at sys_read+0x74
syscall() at syscall+0x304
-- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 --
userland() at 0x405945e8
user trace: trap %o7=0x102390
pc 0x405945e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command getty pid 826 tid 100068 td 0xfffff800017f56d0
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
tty_wait() at tty_wait+0x84
ttydisc_read() at ttydisc_read+0x2a4
ttydev_read() at ttydev_read+0x84
devfs_read_f() at devfs_read_f+0xa8
dofileread() at dofileread+0x74
kern_readv() at kern_readv+0x58
sys_read() at sys_read+0x74
syscall() at syscall+0x304
-- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 --
userland() at 0x405945e8
user trace: trap %o7=0x102390
pc 0x405945e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command getty pid 825 tid 100067 td 0xfffff800017f5b60
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
tty_wait() at tty_wait+0x84
ttydisc_read() at ttydisc_read+0x2a4
ttydev_read() at ttydev_read+0x84
devfs_read_f() at devfs_read_f+0xa8
dofileread() at dofileread+0x74
kern_readv() at kern_readv+0x58
sys_read() at sys_read+0x74
syscall() at syscall+0x304
-- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 --
userland() at 0x405945e8
user trace: trap %o7=0x102390
pc 0x405945e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command getty pid 824 tid 100061 td 0xfffff800017ca000
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
tty_wait() at tty_wait+0x84
ttydisc_read() at ttydisc_read+0x2a4
ttydev_read() at ttydev_read+0x84
devfs_read_f() at devfs_read_f+0xa8
dofileread() at dofileread+0x74
kern_readv() at kern_readv+0x58
sys_read() at sys_read+0x74
syscall() at syscall+0x304
-- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 --
userland() at 0x405945e8
user trace: trap %o7=0x102390
pc 0x405945e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command getty pid 823 tid 100045 td 0xfffff800011b0490
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
tty_wait() at tty_wait+0x84
ttydisc_read() at ttydisc_read+0x2a4
ttydev_read() at ttydev_read+0x84
devfs_read_f() at devfs_read_f+0xa8
dofileread() at dofileread+0x74
kern_readv() at kern_readv+0x58
sys_read() at sys_read+0x74
syscall() at syscall+0x304
-- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 --
userland() at 0x405945e8
user trace: trap %o7=0x102390
pc 0x405945e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command login pid 822 tid 100059 td 0xfffff800017ca920
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_sleep() at _sleep+0x4a8
kern_wait6() at kern_wait6+0x7b4
kern_wait() at kern_wait+0x80
sys_wait4() at sys_wait4+0x20
syscall() at syscall+0x304
-- syscall (7, FreeBSD ELF64, sys_wait4) %o7=0x103ef4 --
userland() at 0x407c24e8
user trace: trap %o7=0x103ef4
pc 0x407c24e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command login pid 821 tid 100046 td 0xfffff80001557240
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_sleep() at _sleep+0x4a8
kern_wait6() at kern_wait6+0x7b4
kern_wait() at kern_wait+0x80
sys_wait4() at sys_wait4+0x20
syscall() at syscall+0x304
-- syscall (7, FreeBSD ELF64, sys_wait4) %o7=0x103ef4 --
userland() at 0x407c24e8
user trace: trap %o7=0x103ef4
pc 0x407c24e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command login pid 820 tid 100044 td 0xfffff800011b0920
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_sleep() at _sleep+0x4a8
kern_wait6() at kern_wait6+0x7b4
kern_wait() at kern_wait+0x80
sys_wait4() at sys_wait4+0x20
syscall() at syscall+0x304
-- syscall (7, FreeBSD ELF64, sys_wait4) %o7=0x103ef4 --
userland() at 0x407c24e8
user trace: trap %o7=0x103ef4
pc 0x407c24e8, sp 0x7fdffffe251
pc 0xf, sp 0x40264000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command cron pid 780 tid 100057 td 0xfffff800017cb240
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x8
_sleep() at _sleep+0x474
kern_nanosleep() at kern_nanosleep+0x15c
sys_nanosleep() at sys_nanosleep+0x50
syscall() at syscall+0x304
-- syscall (240, FreeBSD ELF64, sys_nanosleep) %o7=0x102fb0 --
userland() at 0x406a4028
user trace: trap %o7=0x102fb0
pc 0x406a4028, sp 0x7fdffffe151
pc 0x7fdffffed53, sp 0x7fdffffed48
done

Tracing command sshd pid 777 tid 100060 td 0xfffff800017ca490
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
seltdwait() at seltdwait+0x94
kern_select() at kern_select+0x6f8
sys_select() at sys_select+0x44
syscall() at syscall+0x304
-- syscall (93, FreeBSD ELF64, sys_select) %o7=0x10f090 --
userland() at 0x41b83668
user trace: trap %o7=0x10f090
pc 0x41b83668, sp 0x7fdffffd311
done

Tracing command sendmail pid 711 tid 100056 td 0xfffff800017cb6d0
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_sleep() at _sleep+0x4a8
kern_sigsuspend() at kern_sigsuspend+0xc4
sys_sigsuspend() at sys_sigsuspend+0x28
syscall() at syscall+0x304
-- syscall (341, FreeBSD ELF64, sys_sigsuspend) %o7=0x40ca0824 --
userland() at 0x40ccd068
user trace: trap %o7=0x40ca0824
pc 0x40ccd068, sp 0x7fdffffc411
done

Tracing command sendmail pid 708 tid 100055 td 0xfffff800017cbb60
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x8
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x390
seltdwait() at seltdwait+0x84
kern_select() at kern_select+0x6f8
sys_select() at sys_select+0x44
syscall() at syscall+0x304
-- syscall (93, FreeBSD ELF64, sys_select) %o7=0x112b0c --
userland() at 0x40ccf668
user trace: trap %o7=0x112b0c
pc 0x40ccf668, sp 0x7fdffffb8b1
pc 0x528, sp 0x40286000
kdb_reenter() at kdb_reenter+0x5c
trap() at trap+0x2fc
-- fast data access mmu miss tar=0x40286dd6 %o7=0xc0652900 --
copyin() at copyin+0xac
db_trace_thread() at db_trace_thread+0x18
db_stack_trace_all() at db_stack_trace_all+0xa4
db_command() at db_command+0x48c
db_command_script() at db_command_script+0x84
db_script_exec() at db_script_exec+0x1e0
db_script_kdbenter() at db_script_kdbenter+0x70
db_trap() at db_trap+0x1a4
kdb_trap() at kdb_trap+0xfc
trap() at trap+0x358
-- breakpoint %o7=0xc036c6a0 --
kdb_enter() at kdb_enter+0x80
vpanic() at vpanic+0x140
kassert_panic() at kassert_panic+0xb0
vm_page_alloc() at vm_page_alloc+0x480
vm_page_grab() at vm_page_grab+0x2cc
allocbuf() at allocbuf+0xb84
getblk() at getblk+0xc2c
ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c
ffs_write() at ffs_write+0x2f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x198
vn_write() at vn_write+0x21c
vn_io_fault() at vn_io_fault+0x1a0
dofilewrite() at dofilewrite+0x8c
kern_writev() at kern_writev+0x58
sys_write() at sys_write+0x74
syscall() at syscall+0x304
-- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 --
userland() at 0x406e25a8
user trace: trap %o7=0x134cc4
pc 0x406e25a8, sp 0x7fdffffa141
pc 0x134ed8, sp 0x7fdffffa201
pc 0x113dd4, sp 0x7fdffffa2c1
pc 0x114e50, sp 0x7fdffffa3d1
pc 0x11e9d4, sp 0x7fdffffb5b1
pc 0x11f420, sp 0x7fdffffba91
pc 0x11fef4, sp 0x7fdffffbb51
pc 0x1037dc, sp 0x7fdffffdfa1
pc 0x402678f4, sp 0x7fdffffe061
done

Tracing command ntpd pid 690 tid 100048 td 0xfffff80001556920
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
seltdwait() at seltdwait+0x94
kern_select() at kern_select+0x6f8
sys_select() at sys_select+0x44
syscall() at syscall+0x304
-- syscall (93, FreeBSD ELF64, sys_select) %o7=0x1283ac --
userland() at 0x40b33668
user trace: trap %o7=0x1283ac
pc 0x40b33668, sp 0x7fdffffe231
done

Tracing command lpd pid 669 tid 100054 td 0xfffff80001498db0
mi_switch() at mi_switch+0x2d8
sleepq_switch() at sleepq_switch+0x22c
sleepq_catch_signals() at sleepq_catch_signals+0x134
sleepq_wait_sig() at sleepq_wait_sig+0x8
_cv_wait_sig() at _cv_wait_sig+0x390
seltdwait() at seltdwai
Comment 1 commit-hook freebsd_committer freebsd_triage 2014-06-11 16:11:52 UTC
A commit references this bug:

Author: alc
Date: Wed Jun 11 16:11:12 UTC 2014
New revision: 267364
URL: http://svnweb.freebsd.org/changeset/base/267364

Log:
  Correct a bug in the management of the population map on big-endian
  machines.  Specifically, there was a mismatch between how the routine
  allocation and deallocation operations accessed the population map
  and how the aggressively optimized reservation-breaking operation
  accessed it.  So, problems only occurred when reservations were broken.
  This change makes the routine operations access the population map in
  the same way as the reservation breaking operation.

  This bug was introduced in r259999.

  PR:		187080
  Tested by:	jmg (on an "armeb" machine)
  Sponsored by:	EMC / Isilon Storage Division

Changes:
  head/sys/vm/vm_reserv.c