Bug 187080
| Summary: | [panic] sparc64 r261798: Panic String: vm_page_alloc: page 0xfffff8003feea008 is wired | ||
|---|---|---|---|
| Product: | Base System | Reporter: | Anton Shterenlikht <as> |
| Component: | kern | Assignee: | freebsd-bugs (Nobody) <bugs> |
| Status: | Closed FIXED | ||
| Severity: | Affects Only Me | CC: | marius |
| Priority: | Normal | ||
| Version: | CURRENT | ||
| Hardware: | Any | ||
| OS: | Any | ||
A commit references this bug: Author: alc Date: Wed Jun 11 16:11:12 UTC 2014 New revision: 267364 URL: http://svnweb.freebsd.org/changeset/base/267364 Log: Correct a bug in the management of the population map on big-endian machines. Specifically, there was a mismatch between how the routine allocation and deallocation operations accessed the population map and how the aggressively optimized reservation-breaking operation accessed it. So, problems only occurred when reservations were broken. This change makes the routine operations access the population map in the same way as the reservation breaking operation. This bug was introduced in r259999. PR: 187080 Tested by: jmg (on an "armeb" machine) Sponsored by: EMC / Isilon Storage Division Changes: head/sys/vm/vm_reserv.c |
This panic is reproducible, always triggered by rsync from another fbsd box. I set up textdump are these are the files I collected: info.last panic.txt version.txt config.txt msgbuf.txt ddb.txt # cat info.last Dump header from device /dev/ada1a Architecture: sparc64 Architecture Version: 1 Dump Length: 65536B (0 MB) Blocksize: 512 Dumptime: Wed Feb 26 10:10:51 2014 Hostname: mech-anton240.men.bris.ac.uk Magic: FreeBSD Text Dump Version String: FreeBSD 11.0-CURRENT #0 r261798: Wed Feb 26 09:16:52 GMT 2014 root@mech-anton240.men.bris.ac.uk:/usr/obj/usr/src/sys/QOF Panic String: vm_page_alloc: page 0xfffff8003feea008 is wired Dump Parity: 823177346 Bounds: 0 Dump Status: good # # cat panic.txt vm_page_alloc: page 0xfffff8003feea008 is wired# # # cat version.txt FreeBSD 11.0-CURRENT #0 r261798: Wed Feb 26 09:16:52 GMT 2014 root@mech-anton240.men.bris.ac.uk:/usr/obj/usr/src/sys/QOF # config.txt: options CONFIG_AUTOGENERATED ident QOF machine sparc64 cpu SUN4U makeoptions MODULES_OVERRIDE= makeoptions DEBUG=-g options USB_DEBUG options KBD_INSTALL_CDEV options TEXTDUMP_VERBOSE options TEXTDUMP_PREFERRED options DEBUG_VFS_LOCKS options DEBUG_LOCKS options MALLOC_DEBUG_MAXZONES=8 options WITNESS_SKIPSPIN options WITNESS options INVARIANT_SUPPORT options INVARIANTS options DEADLKRES options GDB options DDB options KDB_TRACE options KDB options INCLUDE_CONFIG_FILE options MAC options CAPABILITIES options CAPABILITY_MODE options AUDIT options HWPMC_HOOKS options PRINTF_BUFR_SIZE=128 options _KPOSIX_PRIORITY_SCHEDULING options SYSVSEM options SYSVMSG options SYSVSHM options STACK options KTRACE options SCSI_DELAY=5000 options COMPAT_FREEBSD7 options COMPAT_FREEBSD6 options COMPAT_FREEBSD5 options GEOM_LABEL options GEOM_PART_GPT options PSEUDOFS options PROCFS options CD9660 options MSDOSFS options NFS_ROOT options NFSLOCKD options NFSD options NFSCL options MD_ROOT options QUOTA options UFS_GJOURNAL options UFS_DIRHASH options UFS_ACL options SOFTUPDATES options FFS options SCTP options INET6 options INET options PREEMPTION options SCHED_ULE options NEW_PCIB options SUNKBD_EMULATE_ATKBD options GEOM_PART_VTOC8 options GEOM_PART_BSD device mem device uart_ns8250 device uart_sab82532 device uart_z8530 device ebus device isa device pci device sbus device central device fhc device ahci device ata device scbus device da device cd device pass device atkbdc device atkbd device psm device kbdmux device sc device machfb device auxio device eeprom device mk48txx device rtc device mc146818 device epic device sbbc device puc device scc device uart device ppbus device ppc device lpt device miibus device bge device loop device random device ether device vlan device tun device md device gif device faith device firmware device bpf device uhci device ohci device ehci device usb device ukbd device umass device ums device sound device snd_t4dwave msgbuf.txt: GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2014 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #0 r261798: Wed Feb 26 09:16:52 GMT 2014 root@mech-anton240.men.bris.ac.uk:/usr/obj/usr/src/sys/QOF sparc64 gcc version 4.2.1 20070831 patched [FreeBSD] WARNING: WITNESS option enabled, expect reduced performance. real memory = 2147483648 (2048 MB) avail memory = 2078580736 (1982 MB) cpu0: Sun Microsystems UltraSparc-IIIi Processor (1503.00 MHz CPU) random: <Software, Yarrow> initialized kbd0 at kbdmux0 nexus0: <Open Firmware Nexus device> pcib0: <Sun Host-PCI bridge> mem 0x4000f600000-0x4000f60afff,0x4000f410000-0x4000f41701f,0x7fe00000000-0x7fe000000ff,0x4000f780000-0x4000f78ffff irq 1970,1968,1969,1972,1953 on nexus0 pcib0: Tomatillo, version 4, IGN 0x1e, bus A, PCI mode, 33MHz pcib0: DVMA map: 0xc0000000 to 0xdfffffff 65536 entries pci0: <OFW PCI bus> on pcib0 pcib1: <Sun Host-PCI bridge> mem 0x4000ff00000-0x4000ff0afff,0x4000fc10000-0x4000fc1701f,0x7f600000000-0x7f6000000ff,0x4000ff80000-0x4000ff8ffff irq 2035,2032,2033,2036,2019 on nexus0 pcib1: Tomatillo, version 4, IGN 0x1f, bus B, PCI mode, 66MHz pcib1: DVMA map: 0xc0000000 to 0xdfffffff 65536 entries pci1: <OFW PCI bus> on pcib1 nexus0: <memory-controller> mem 0x40000000000-0x40000000007 type memory-controller (no driver attached) isab0: <PCI-ISA bridge> at device 7.0 on pci0 pcib0: could not route pin 1 for device 7.0 isa0: could not map ISA interrupt 1 for node 0xf0097238: parallel isa0: <ISA bus> on isab0 pci0: <old, non-VGA display device> at device 6.0 (no driver attached) pcm0: <Acer Labs M5451> port 0x900-0x9ff mem 0x100000-0x100fff at device 8.0 on pci0 pcm0: <Analog Devices AD1881A AC97 Codec> pcm0: [GIANT-LOCKED] ohci0: <AcerLabs M5237 (Aladdin-V) USB controller> mem 0x1000000-0x1000fff at device 10.0 on pci0 usbus0 on ohci0 ohci1: <AcerLabs M5237 (Aladdin-V) USB controller> mem 0x2000000-0x2000fff at device 11.0 on pci0 usbus1 on ohci1 atapci0: <AcerLabs M5229 UDMA100 controller> port 0xa00-0xa07,0xa18-0xa1b,0xa10-0xa17,0xa08-0xa0b,0xa20-0xa2f at device 13.0 on pci0 atapci0: using PIO transfers above 137GB as workaround for 48bit DMA access bug, expect reduced performance ata2: <ATA channel> at channel 0 on atapci0 ata3: <ATA channel> at channel 1 on atapci0 machfb0: <ATI Rage XL> port 0xb00-0xbff mem 0x3000000-0x3ffffff,0x102000-0x102fff at device 2.0 on pci0 machfb0: console machfb0: 16 MB aperture at 0xfddcc000 not swapped machfb0: 8188 KB SGRAM 114.992 MHz, maximum RAMDAC clock 230 MHz, DSP machfb0: resolution 1280x1024 at 8 bpp jbusppm0: <JBus power management> mem 0x4000f000000-0x4000f000007,0x4000f410050-0x4000f41005f on nexus0 bge0: <Broadcom BCM5703 A2, ASIC rev. 0x001002> mem 0x200000-0x20ffff at device 2.0 on pci1 bge0: CHIP ID 0x00001002; ASIC REV 0x01; CHIP REV 0x10; PCI on PCI-X 66 MHz; 64bit miibus0: <MII bus> on bge0 brgphy0: <BCM5703 1000BASE-T media interface> PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bge0: Ethernet address: 00:03:ba:d9:a0:07 nexus0: <i2c> mem 0x4000fc64000-0x4000fc6400f type i2c (no driver attached) syscons0: <System console> on nexus0 syscons0: Unknown <16 virtual consoles, flags=0x300> rtc0: <Real-Time Clock> at port 0x70-0x71 on isa0 uart0: <16550 or compatible> at port 0x3f8-0x3ff irq 44 on isa0 uart1: <16550 or compatible> at port 0x2e8-0x2ef irq 44 on isa0 ppc0: <ECP parallel printer port> at port 0x378-0x37f,0-0x4ff drq 1 on isa0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/1 bytes threshold ppbus0: <Parallel port bus> on ppc0 lpt0: <Printer> on ppbus0 lpt0: Polled port Timecounter "tick" frequency 1503000000 Hz quality 1000 Timecounter "stick" frequency 12000000 Hz quality 1000 Event timer "tick" frequency 1503000000 Hz quality 1000 Timecounters tick every 1.000 msec usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 ugen0.1: <AcerLabs> at usbus0 uhub0: <AcerLabs OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 ugen1.1: <AcerLabs> at usbus1 uhub1: <AcerLabs OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered ada0 at ata2 bus 0 scbus0 target 0 lun 0 ada0: <ST380011A 3.04> ATA-6 device ada0: Serial Number 3JVA6XG5 ada0: 100.000MB/s transfers (UDMA5, PIO 8192bytes) ada0: 76319MB (156301488 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad0 ada1 at ata2 bus 0 scbus0 target 1 lun 0 ada1: <ST380011A 8.01> ATA-6 device ada1: Serial Number 5JVCQK70 ada1: 100.000MB/s transfers (UDMA5, PIO 8192bytes) ada1: 76319MB (156301488 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad1 cd0 at ata3 bus 0 scbus1 target 0 lun 0 cd0: <TSSTcorp CDW/DVD TS-H492C SI00> Removable CD-ROM SCSI-0 device cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed random: unblocking device. WARNING: WITNESS option enabled, expect reduced performance. Root mount waiting for: usbus1 ugen1.2: <vendor 0x0430> at usbus1 ukbd0: <vendor 0x0430 product 0x0005, class 0/0, rev 1.10/2.00, addr 2> on usbus1 kbd1 at ukbd0 Root mount waiting for: usbus1 ugen1.3: <vendor 0x0430> at usbus1 ums0: <vendor 0x0430 product 0x0100, class 0/0, rev 2.00/1.07, addr 3> on usbus1 ums0: 3 buttons and [XY] coordinates ID=0 Trying to mount root from ufs:/dev/ada0a [rw]... <118>Setting hostuuid: d3d68ffc-e130-11de-a08d-020516707c36. <118>Setting hostid: 0x0274c4bd. <118>Starting ddb. <118>Entropy harvesting: interrupts ethernet point_to_point swi. <118>Starting file system checks: <118>/dev/ada0a: FILE SYSTEM CLEAN; SKIPPING CHECKS <118>/dev/ada0a: clean, 1659660 free (716 frags, 207368 blocks, 0.0% fragmentation) <118>/dev/ada0f: FILE SYSTEM CLEAN; SKIPPING CHECKS <118>/dev/ada0f: clean, 31379897 free (447361 frags, 3866567 blocks, 1.2% fragmentation) <118>Mounting local file systems:. <118>Writing entropy file:. <118>Setting hostname: mech-anton240.men.bris.ac.uk. <118>Starting Network: lo0 bge0. <118>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384 <118> options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6> <118> inet6 ::1 prefixlen 128 <118> inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 <118> inet 127.0.0.1 netmask 0xff000000 <118> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> <118>bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 <118> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE> <118> ether 00:03:ba:d9:a0:07 <118> inet 137.222.187.240 netmask 0xffffff00 broadcast 137.222.187.255 <118> inet6 fe80::203:baff:fed9:a007%bge0 prefixlen 64 scopeid 0x1 <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> <118> media: Ethernet autoselect (none) <118> status: no carrier <118>Starting devd. <118>Configuring keyboard: keymap keyrate. <118>Starting ums0 moused. <118>Starting pflogd: <118>add net default: gateway 137.222.187.250 <118>add net fe80::: gateway ::1 <118>add net ff02::: gateway ::1 <118>add net ::ffff:0.0.0.0: gateway ::1 <118>add net ::0.0.0.0: gateway ::1 <118>ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/R/lib /usr/local/lib/gcc46 /usr/local/lib/gcc47 /usr/local/lib/gcc48 /usr/local/lib/gcc49 <118>Creating and/or trimming log files. <118>Starting syslogd. <118>No core dumps found. <118>Starting casperd. <118>Clearing /tmp (X related). <118>Recovering vi editor sessions:. <118>Starting lpd. <118>Updating motd:. <118>Mounting late file systems:. <118>Starting ntpd. <118>Starting sendmail_submit. <118>Starting sendmail_msp_queue. <118>Starting bsdstats. <118>Posting monthly OS statistics to rpt.bsdstats.org <118>Configuring syscons: keymap keyrate blanktime. <118>Performing sanity check on sshd configuration. <118>Starting sshd. <118>Starting cron. <118>Starting background file system checks in 60 seconds. <118> <118>Wed Feb 26 10:03:38 GMT 2014 <118>Feb 26 10:03:53 mech-anton240 login: ROOT LOGIN (root) ON ttyv0 lock order reversal: 1st 0xc14a8a08 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:3081 2nd 0xfffff800014e5800 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: _witness_debugger() at _witness_debugger+0x38 witness_checkorder() at witness_checkorder+0xe80 _sx_xlock() at _sx_xlock+0xb8 ufsdirhash_acquire() at ufsdirhash_acquire+0x50 ufsdirhash_remove() at ufsdirhash_remove+0x4 ufs_dirremove() at ufs_dirremove+0x138 ufs_rename() at ufs_rename+0x1140 VOP_RENAME_APV() at VOP_RENAME_APV+0x104 kern_renameat() at kern_renameat+0x314 kern_rename() at kern_rename+0x18 sys_rename() at sys_rename+0x10 syscall() at syscall+0x304 -- syscall (128, FreeBSD ELF64, sys_rename) %o7=0x122810 -- userland() at 0x406e11e8 user trace: trap %o7=0x122810 pc 0x406e11e8, sp 0x7fdffff9991 pc 0x11c68c, sp 0x7fdffffa251 pc 0x10c5b8, sp 0x7fdffffa311 pc 0x114ef0, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done panic: vm_page_alloc: page 0xfffff8003feea008 is wired KDB: stack backtrace: vpanic() at vpanic+0xfc kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done KDB: enter: panic ddb.txt: db:0:kdb.enter.panic> run lockinfo db:1:lockinfo> show locks exclusive sleep mutex vm page free queue (vm page free queue) r = 0 (0xc0adb300) locked @ /usr/src/sys/vm/vm_page.c:1484 exclusive rw vm object (vm object) r = 0 (0xfffff8022e274800) locked @ /usr/src/sys/kern/vfs_bio.c:3503 exclusive lockmgr bufwait (bufwait) r = 0 (0xc1814258) locked @ /usr/src/sys/kern/vfs_bio.c:2345 exclusive lockmgr bufwait (bufwait) r = 0 (0xc155a428) locked @ /usr/src/sys/kern/vfs_bio.c:3081 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8022e29d8c8) locked @ /usr/src/sys/kern/vfs_vnops.c:810 db:1:locks> show alllocks Process 883 (rsync) thread 0xfffff800018aadb0 (100076) exclusive sleep mutex vm page free queue (vm page free queue) r = 0 (0xc0adb300) locked @ /usr/src/sys/vm/vm_page.c:1484 exclusive rw vm object (vm object) r = 0 (0xfffff8022e274800) locked @ /usr/src/sys/kern/vfs_bio.c:3503 exclusive lockmgr bufwait (bufwait) r = 0 (0xc1814258) locked @ /usr/src/sys/kern/vfs_bio.c:2345 exclusive lockmgr bufwait (bufwait) r = 0 (0xc155a428) locked @ /usr/src/sys/kern/vfs_bio.c:3081 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8022e29d8c8) locked @ /usr/src/sys/kern/vfs_vnops.c:810 db:1:alllocks> show lockedvnods Locked vnodes db:0:kdb.enter.panic> show pcpu cpuid = 0 dynamic pcpu = 0xfffff7ff4005fb00 curthread = 0xfffff800018aadb0: pid 883 "rsync" curpcb = 0xc1ed7980 fpcurthread = none idlethread = 0xfffff8000107db60: tid 100003 "idle" spin locks held: db:0:kdb.enter.panic> bt Tracing pid 883 tid 100076 td 0xfffff800018aadb0 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done db:0:kdb.enter.panic> ps pid ppid pgrp uid state wmesg wchan cmd 905 900 905 1001 S+ select 0xfffff800014acb40 ssh 900 822 900 1001 S+ pause 0xfffff800018a40a8 tcsh 883 882 879 1001 R CPU 0 rsync 882 879 879 1001 S select 0xfffff800014acf40 rsync 879 878 879 1001 Ss pause 0xfffff800018a4558 tcsh 878 876 876 1001 R sshd 876 777 876 0 Ss select 0xfffff800014accc0 sshd 845 838 845 1001 S+ select 0xfffff800014ad0c0 ssh 838 821 838 1001 S+ pause 0xfffff80001822558 tcsh 830 820 830 0 S+ ttyin 0xfffff8000110cca8 sh 829 1 829 0 Ss+ ttyin 0xfffff8000110a8a8 getty 828 1 828 0 Ss+ ttyin 0xfffff8000110aca8 getty 827 1 827 0 Ss+ ttyin 0xfffff8000110b0a8 getty 826 1 826 0 Ss+ ttyin 0xfffff8000110b4a8 getty 825 1 825 0 Ss+ ttyin 0xfffff8000110b8a8 getty 824 1 824 0 Ss+ ttyin 0xfffff8000110bca8 getty 823 1 823 0 Ss+ ttyin 0xfffff8000110c0a8 getty 822 1 822 0 Ss+ wait 0xfffff800017c84b0 login 821 1 821 0 Ss+ wait 0xfffff80001554960 login 820 1 820 0 Ss+ wait 0xfffff8000107b2c0 login 780 1 780 0 Ss nanslp 0xc07d5200 cron 777 1 777 0 Ss select 0xfffff8000119e340 sshd 711 1 711 25 Ss pause 0xfffff800017c9368 sendmail 708 1 708 0 Ss select 0xfffff8000119e040 sendmail 690 1 690 0 Ss select 0xfffff800014adc40 ntpd 669 1 669 0 Ss select 0xfffff8000119e640 lpd 627 1 627 0 Ss select 0xfffff8000119e1c0 casperd 626 1 17 0 S+ select 0xfffff8000119e440 casperd 602 1 602 0 Ss select 0xfffff8000119e540 syslogd 476 1 476 0 Ss select 0xfffff8000119e140 devd 459 1 459 0 Ss select 0xfffff800014adac0 moused 114 1 114 0 Ss pause 0xfffff80001554558 adjkerntz 16 0 0 0 DL sdflush 0xc0ad9e48 [softdepflush] 9 0 0 0 DL syncer 0xc0ad1cf8 [syncer] 8 0 0 0 DL vlruwt 0xfffff800014964b0 [vnlru] 7 0 0 0 DL psleep 0xc0ad1800 [bufdaemon] 6 0 0 0 DL pgzero 0xc0adc80c [pagezero] 5 0 0 0 DL psleep 0xc0adb49c [vmdaemon] 4 0 0 0 DL psleep 0xc0adb4ec [pagedaemon] 3 0 0 0 DL waiting_ 0xc0ad47f0 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100029 D - 0x1001b3460 [usbus1] 100028 D - 0x1001b3408 [usbus1] 100027 D - 0x1001b33b0 [usbus1] 100026 D - 0x1001b3358 [usbus1] 100024 D - 0x1001af460 [usbus0] 100023 D - 0x1001af408 [usbus0] 100022 D - 0x1001af3b0 [usbus0] 100021 D - 0x1001af358 [usbus0] 2 0 0 0 DL (threaded) [cam] 100036 D ccb_scan 0xc07a1540 [scanner] 100018 D - 0xc07a1700 [doneq0] 14 0 0 0 DL - 0xc07a5160 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100009 D - 0xc07cff08 [g_down] 100008 D - 0xc07cff00 [g_up] 100007 D - 0xc07cfef0 [g_event] 12 0 0 0 WL (threaded) [intr] 100032 I [swi0: uart uart] 100031 I [vec2012: bge0] 100030 I [vec1944: atapci0] 100025 I [vec1958: ohci1] 100020 I [vec1959: ohci0] 100019 I [vec1956: pcm0] 100017 I [swi6: task queue] 100016 I [swi6: Giant taskq] 100014 I [swi5: fast taskq] 100006 I [swi3: vm] 100005 I [swi4: clock] 100004 I [swi1: netisr 0] 11 0 0 0 RL [idle] 1 0 1 0 SLs wait 0xfffff8000107a4b0 [init] 10 0 0 0 DL audit_wo 0xc0ad9218 [audit] 0 0 0 0 DLs (threaded) [kernel] 100035 D - 0xfffff80001062e00 [CAM taskq] 100033 D - 0xc07d3ee8 [deadlkres] 100015 D - 0xfffff80001063300 [thread taskq] 100013 D - 0xfffff80001063600 [kqueue taskq] 100012 D - 0xfffff80001063700 [ffs_trim taskq] 100010 D - 0xfffff80001063800 [firmware taskq] 100000 D swapin 0xc07d0100 [swapper] db:0:kdb.enter.panic> alltrace Tracing command ssh pid 905 tid 100082 td 0xfffff800017f7240 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 seltdwait() at seltdwait+0x94 kern_select() at kern_select+0x6f8 sys_select() at sys_select+0x44 syscall() at syscall+0x304 -- syscall (93, FreeBSD ELF64, sys_select) %o7=0x1119ac -- userland() at 0x40edf668 user trace: trap %o7=0x1119ac pc 0x40edf668, sp 0x7fdffffa061 pc 0x28d68a904d3a55d9, sp 0x5a12a353 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x5a12add6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command tcsh pid 900 tid 100081 td 0xfffff800017f76d0 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _sleep() at _sleep+0x4a8 kern_sigsuspend() at kern_sigsuspend+0xc4 sys_sigsuspend() at sys_sigsuspend+0x28 syscall() at syscall+0x304 -- syscall (341, FreeBSD ELF64, sys_sigsuspend) %o7=0x123b50 -- userland() at 0x40743068 user trace: trap %o7=0x123b50 pc 0x40743068, sp 0x7fdffffd581 pc 0x40284400, sp 0x8 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0xdd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command rsync pid 883 tid 100076 td 0xfffff800018aadb0 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command rsync pid 882 tid 100075 td 0xfffff800017f6490 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x8 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x390 seltdwait() at seltdwait+0x84 kern_select() at kern_select+0x6f8 sys_select() at sys_select+0x44 syscall() at syscall+0x304 -- syscall (93, FreeBSD ELF64, sys_select) %o7=0x12d358 -- userland() at 0x406e1668 user trace: trap %o7=0x12d358 pc 0x406e1668, sp 0x7fdffff8e61 pc 0x1ffffa888, sp 0x41400000 pc 0, sp 0x400000000000000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x400000000000dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command tcsh pid 879 tid 100080 td 0xfffff800017f7b60 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _sleep() at _sleep+0x4a8 kern_sigsuspend() at kern_sigsuspend+0xc4 sys_sigsuspend() at sys_sigsuspend+0x28 syscall() at syscall+0x304 -- syscall (341, FreeBSD ELF64, sys_sigsuspend) %o7=0x123b50 -- userland() at 0x40743068 user trace: trap %o7=0x123b50 pc 0x40743068, sp 0x7fdffffd4e1 pc 0x406e27ec, sp 0x7fdffffd591 pc 0x405d2b2c, sp 0x7fdffffd651 pc 0x4026d1a8, sp 0x7fdffffd711 pc 0x4027022c, sp 0x7fdffffd7d1 pc 0x402678f4, sp 0x7fdffffe051 done Tracing command sshd pid 878 tid 100079 td 0xfffff800018aa000 mi_switch() at mi_switch+0x2d8 ast() at ast+0x32c -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x403b8558 -- userland() at 0x41b845a8 user trace: trap %o7=0x403b8558 pc 0x41b845a8, sp 0x7fdffff8f71 pc 0x1ffff9860, sp 0x41400000 pc 0, sp 0x400000000000000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x400000000000dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command sshd pid 876 tid 100078 td 0xfffff800018aa490 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 seltdwait() at seltdwait+0x94 sys_poll() at sys_poll+0x30c syscall() at syscall+0x304 -- syscall (209, FreeBSD ELF64, sys_poll) %o7=0x12a5ac -- userland() at 0x41b824e8 user trace: trap %o7=0x12a5ac pc 0x41b824e8, sp 0x7fdffffd161 done Tracing command ssh pid 845 tid 100066 td 0xfffff800017f6000 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 seltdwait() at seltdwait+0x94 kern_select() at kern_select+0x6f8 sys_select() at sys_select+0x44 syscall() at syscall+0x304 -- syscall (93, FreeBSD ELF64, sys_select) %o7=0x1119ac -- userland() at 0x40edf668 user trace: trap %o7=0x1119ac pc 0x40edf668, sp 0x7fdffffa061 pc 0x28d68a904d3a55d9, sp 0x5a12a353 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x5a12add6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command tcsh pid 838 tid 100074 td 0xfffff80001557b60 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _sleep() at _sleep+0x4a8 kern_sigsuspend() at kern_sigsuspend+0xc4 sys_sigsuspend() at sys_sigsuspend+0x28 syscall() at syscall+0x304 -- syscall (341, FreeBSD ELF64, sys_sigsuspend) %o7=0x123b50 -- userland() at 0x40743068 user trace: trap %o7=0x123b50 pc 0x40743068, sp 0x7fdffffd581 pc 0x40284400, sp 0x8 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0xdd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command sh pid 830 tid 100072 td 0xfffff800017f4490 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 tty_wait() at tty_wait+0x84 ttydisc_read() at ttydisc_read+0x2a4 ttydev_read() at ttydev_read+0x84 devfs_read_f() at devfs_read_f+0xa8 dofileread() at dofileread+0x74 kern_readv() at kern_readv+0x58 sys_read() at sys_read+0x74 syscall() at syscall+0x304 -- syscall (3, FreeBSD ELF64, sys_read) %o7=0x4035dc38 -- userland() at 0x4071a5e8 user trace: trap %o7=0x4035dc38 pc 0x4071a5e8, sp 0x7fdffffdc21 pc 0x68acf04, sp 0x1023dd pc 0, sp 0x1500000000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x1500000dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command getty pid 829 tid 100071 td 0xfffff800017f4920 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 tty_wait() at tty_wait+0x84 ttydisc_read() at ttydisc_read+0x2a4 ttydev_read() at ttydev_read+0x84 devfs_read_f() at devfs_read_f+0xa8 dofileread() at dofileread+0x74 kern_readv() at kern_readv+0x58 sys_read() at sys_read+0x74 syscall() at syscall+0x304 -- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 -- userland() at 0x405945e8 user trace: trap %o7=0x102390 pc 0x405945e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command getty pid 828 tid 100070 td 0xfffff800017f4db0 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 tty_wait() at tty_wait+0x84 ttydisc_read() at ttydisc_read+0x2a4 ttydev_read() at ttydev_read+0x84 devfs_read_f() at devfs_read_f+0xa8 dofileread() at dofileread+0x74 kern_readv() at kern_readv+0x58 sys_read() at sys_read+0x74 syscall() at syscall+0x304 -- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 -- userland() at 0x405945e8 user trace: trap %o7=0x102390 pc 0x405945e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command getty pid 827 tid 100069 td 0xfffff800017f5240 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 tty_wait() at tty_wait+0x84 ttydisc_read() at ttydisc_read+0x2a4 ttydev_read() at ttydev_read+0x84 devfs_read_f() at devfs_read_f+0xa8 dofileread() at dofileread+0x74 kern_readv() at kern_readv+0x58 sys_read() at sys_read+0x74 syscall() at syscall+0x304 -- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 -- userland() at 0x405945e8 user trace: trap %o7=0x102390 pc 0x405945e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command getty pid 826 tid 100068 td 0xfffff800017f56d0 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 tty_wait() at tty_wait+0x84 ttydisc_read() at ttydisc_read+0x2a4 ttydev_read() at ttydev_read+0x84 devfs_read_f() at devfs_read_f+0xa8 dofileread() at dofileread+0x74 kern_readv() at kern_readv+0x58 sys_read() at sys_read+0x74 syscall() at syscall+0x304 -- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 -- userland() at 0x405945e8 user trace: trap %o7=0x102390 pc 0x405945e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command getty pid 825 tid 100067 td 0xfffff800017f5b60 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 tty_wait() at tty_wait+0x84 ttydisc_read() at ttydisc_read+0x2a4 ttydev_read() at ttydev_read+0x84 devfs_read_f() at devfs_read_f+0xa8 dofileread() at dofileread+0x74 kern_readv() at kern_readv+0x58 sys_read() at sys_read+0x74 syscall() at syscall+0x304 -- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 -- userland() at 0x405945e8 user trace: trap %o7=0x102390 pc 0x405945e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command getty pid 824 tid 100061 td 0xfffff800017ca000 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 tty_wait() at tty_wait+0x84 ttydisc_read() at ttydisc_read+0x2a4 ttydev_read() at ttydev_read+0x84 devfs_read_f() at devfs_read_f+0xa8 dofileread() at dofileread+0x74 kern_readv() at kern_readv+0x58 sys_read() at sys_read+0x74 syscall() at syscall+0x304 -- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 -- userland() at 0x405945e8 user trace: trap %o7=0x102390 pc 0x405945e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command getty pid 823 tid 100045 td 0xfffff800011b0490 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 tty_wait() at tty_wait+0x84 ttydisc_read() at ttydisc_read+0x2a4 ttydev_read() at ttydev_read+0x84 devfs_read_f() at devfs_read_f+0xa8 dofileread() at dofileread+0x74 kern_readv() at kern_readv+0x58 sys_read() at sys_read+0x74 syscall() at syscall+0x304 -- syscall (3, FreeBSD ELF64, sys_read) %o7=0x102390 -- userland() at 0x405945e8 user trace: trap %o7=0x102390 pc 0x405945e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command login pid 822 tid 100059 td 0xfffff800017ca920 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _sleep() at _sleep+0x4a8 kern_wait6() at kern_wait6+0x7b4 kern_wait() at kern_wait+0x80 sys_wait4() at sys_wait4+0x20 syscall() at syscall+0x304 -- syscall (7, FreeBSD ELF64, sys_wait4) %o7=0x103ef4 -- userland() at 0x407c24e8 user trace: trap %o7=0x103ef4 pc 0x407c24e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command login pid 821 tid 100046 td 0xfffff80001557240 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _sleep() at _sleep+0x4a8 kern_wait6() at kern_wait6+0x7b4 kern_wait() at kern_wait+0x80 sys_wait4() at sys_wait4+0x20 syscall() at syscall+0x304 -- syscall (7, FreeBSD ELF64, sys_wait4) %o7=0x103ef4 -- userland() at 0x407c24e8 user trace: trap %o7=0x103ef4 pc 0x407c24e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command login pid 820 tid 100044 td 0xfffff800011b0920 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _sleep() at _sleep+0x4a8 kern_wait6() at kern_wait6+0x7b4 kern_wait() at kern_wait+0x80 sys_wait4() at sys_wait4+0x20 syscall() at syscall+0x304 -- syscall (7, FreeBSD ELF64, sys_wait4) %o7=0x103ef4 -- userland() at 0x407c24e8 user trace: trap %o7=0x103ef4 pc 0x407c24e8, sp 0x7fdffffe251 pc 0xf, sp 0x40264000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40264dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command cron pid 780 tid 100057 td 0xfffff800017cb240 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x8 _sleep() at _sleep+0x474 kern_nanosleep() at kern_nanosleep+0x15c sys_nanosleep() at sys_nanosleep+0x50 syscall() at syscall+0x304 -- syscall (240, FreeBSD ELF64, sys_nanosleep) %o7=0x102fb0 -- userland() at 0x406a4028 user trace: trap %o7=0x102fb0 pc 0x406a4028, sp 0x7fdffffe151 pc 0x7fdffffed53, sp 0x7fdffffed48 done Tracing command sshd pid 777 tid 100060 td 0xfffff800017ca490 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 seltdwait() at seltdwait+0x94 kern_select() at kern_select+0x6f8 sys_select() at sys_select+0x44 syscall() at syscall+0x304 -- syscall (93, FreeBSD ELF64, sys_select) %o7=0x10f090 -- userland() at 0x41b83668 user trace: trap %o7=0x10f090 pc 0x41b83668, sp 0x7fdffffd311 done Tracing command sendmail pid 711 tid 100056 td 0xfffff800017cb6d0 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _sleep() at _sleep+0x4a8 kern_sigsuspend() at kern_sigsuspend+0xc4 sys_sigsuspend() at sys_sigsuspend+0x28 syscall() at syscall+0x304 -- syscall (341, FreeBSD ELF64, sys_sigsuspend) %o7=0x40ca0824 -- userland() at 0x40ccd068 user trace: trap %o7=0x40ca0824 pc 0x40ccd068, sp 0x7fdffffc411 done Tracing command sendmail pid 708 tid 100055 td 0xfffff800017cbb60 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x8 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x390 seltdwait() at seltdwait+0x84 kern_select() at kern_select+0x6f8 sys_select() at sys_select+0x44 syscall() at syscall+0x304 -- syscall (93, FreeBSD ELF64, sys_select) %o7=0x112b0c -- userland() at 0x40ccf668 user trace: trap %o7=0x112b0c pc 0x40ccf668, sp 0x7fdffffb8b1 pc 0x528, sp 0x40286000 kdb_reenter() at kdb_reenter+0x5c trap() at trap+0x2fc -- fast data access mmu miss tar=0x40286dd6 %o7=0xc0652900 -- copyin() at copyin+0xac db_trace_thread() at db_trace_thread+0x18 db_stack_trace_all() at db_stack_trace_all+0xa4 db_command() at db_command+0x48c db_command_script() at db_command_script+0x84 db_script_exec() at db_script_exec+0x1e0 db_script_kdbenter() at db_script_kdbenter+0x70 db_trap() at db_trap+0x1a4 kdb_trap() at kdb_trap+0xfc trap() at trap+0x358 -- breakpoint %o7=0xc036c6a0 -- kdb_enter() at kdb_enter+0x80 vpanic() at vpanic+0x140 kassert_panic() at kassert_panic+0xb0 vm_page_alloc() at vm_page_alloc+0x480 vm_page_grab() at vm_page_grab+0x2cc allocbuf() at allocbuf+0xb84 getblk() at getblk+0xc2c ffs_balloc_ufs2() at ffs_balloc_ufs2+0x163c ffs_write() at ffs_write+0x2f8 VOP_WRITE_APV() at VOP_WRITE_APV+0x198 vn_write() at vn_write+0x21c vn_io_fault() at vn_io_fault+0x1a0 dofilewrite() at dofilewrite+0x8c kern_writev() at kern_writev+0x58 sys_write() at sys_write+0x74 syscall() at syscall+0x304 -- syscall (4, FreeBSD ELF64, sys_write) %o7=0x134cc4 -- userland() at 0x406e25a8 user trace: trap %o7=0x134cc4 pc 0x406e25a8, sp 0x7fdffffa141 pc 0x134ed8, sp 0x7fdffffa201 pc 0x113dd4, sp 0x7fdffffa2c1 pc 0x114e50, sp 0x7fdffffa3d1 pc 0x11e9d4, sp 0x7fdffffb5b1 pc 0x11f420, sp 0x7fdffffba91 pc 0x11fef4, sp 0x7fdffffbb51 pc 0x1037dc, sp 0x7fdffffdfa1 pc 0x402678f4, sp 0x7fdffffe061 done Tracing command ntpd pid 690 tid 100048 td 0xfffff80001556920 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 seltdwait() at seltdwait+0x94 kern_select() at kern_select+0x6f8 sys_select() at sys_select+0x44 syscall() at syscall+0x304 -- syscall (93, FreeBSD ELF64, sys_select) %o7=0x1283ac -- userland() at 0x40b33668 user trace: trap %o7=0x1283ac pc 0x40b33668, sp 0x7fdffffe231 done Tracing command lpd pid 669 tid 100054 td 0xfffff80001498db0 mi_switch() at mi_switch+0x2d8 sleepq_switch() at sleepq_switch+0x22c sleepq_catch_signals() at sleepq_catch_signals+0x134 sleepq_wait_sig() at sleepq_wait_sig+0x8 _cv_wait_sig() at _cv_wait_sig+0x390 seltdwait() at seltdwai