storage-01-portlane.mytaste.name dumped core - see /var/crash/vmcore.0 Mon Nov 2 14:49:41 CET 2015 FreeBSD storage-01-portlane.mytaste.name 10.2-RELEASE FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 panic: vm_fault: fault on nofault entry, addr: fffffe03e53f6000 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: panic: vm_fault: fault on nofault entry, addr: fffffe03e53f6000 cpuid = 3 KDB: stack backtrace: #0 0xffffffff80984e30 at kdb_backtrace+0x60 #1 0xffffffff809489e6 at vpanic+0x126 #2 0xffffffff809488b3 at panic+0x43 #3 0xffffffff80bc485b at vm_fault_hold+0x1bbb #4 0xffffffff80bc2c57 at vm_fault+0x77 #5 0xffffffff80d4ac8c at trap_pfault+0x19c #6 0xffffffff80d4a47a at trap+0x47a #7 0xffffffff80d307f2 at calltrap+0x8 #8 0xffffffff80640877 at mps_ioctl+0x2587 #9 0xffffffff8063e03b at mps_ioctl_devsw+0x9b #10 0xffffffff8082ffe9 at devfs_ioctl_f+0x139 #11 0xffffffff8099cd25 at kern_ioctl+0x255 #12 0xffffffff8099ca20 at sys_ioctl+0x140 #13 0xffffffff80d4b3f7 at amd64_syscall+0x357 #14 0xffffffff80d30adb at Xfast_syscall+0xfb Uptime: 10d4h52m38s Dumping 907 out of 16318 MB:..2%..11%..22%..32%..41%..52%..62%..71%..82%..92% Reading symbols from /boot/kernel/zfs.ko.symbols...done. Loaded symbols for /boot/kernel/zfs.ko.symbols Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. Loaded symbols for /boot/kernel/opensolaris.ko.symbols Reading symbols from /boot/kernel/ums.ko.symbols...done. Loaded symbols for /boot/kernel/ums.ko.symbols #0 doadump (textdump=) at pcpu.h:219 219 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=) at pcpu.h:219 #1 0xffffffff80948642 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:451 #2 0xffffffff80948a25 in vpanic (fmt=, ap=) at /usr/src/sys/kern/kern_shutdown.c:758 #3 0xffffffff809488b3 in panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:687 #4 0xffffffff80bc485b in vm_fault_hold (map=, vaddr=, fault_type=, fault_flags=, m_hold=) at /usr/src/sys/vm/vm_fault.c:338 #5 0xffffffff80bc2c57 in vm_fault (map=0xfffff80002000000, vaddr=, fault_type=1 '\001', fault_flags=0) at /usr/src/sys/vm/vm_fault.c:282 #6 0xffffffff80d4ac8c in trap_pfault (frame=0xfffffe046896c450, usermode=0) at /usr/src/sys/amd64/amd64/trap.c:750 #7 0xffffffff80d4a47a in trap (frame=0xfffffe046896c450) at /usr/src/sys/amd64/amd64/trap.c:440 #8 0xffffffff80d307f2 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236 #9 0xffffffff80d4887f in copyout () at /usr/src/sys/amd64/amd64/support.S:262 #10 0xffffffff80640877 in mps_ioctl () at /usr/src/sys/dev/mps/mps_user.c:1050 #11 0xffffffff8063e03b in mps_ioctl_devsw (dev=0xfffff800074c5c00, com=3224914180, arg=0x12c

, flag=5, td=0x30) at /usr/src/sys/dev/mps/mps_user.c:2441 #12 0xffffffff8082ffe9 in devfs_ioctl_f (fp=0xfffff80014908e60, com=3224914180, data=0xfffffe046896c8e0, cred=, td=0xfffff80014a16000) at /usr/src/sys/fs/devfs/devfs_vnops.c:785 #13 0xffffffff8099cd25 in kern_ioctl (td=0xfffff80014a16000, fd=, com=18446741891417333760) at file.h:320 #14 0xffffffff8099ca20 in sys_ioctl (td=0xfffff80014a16000, uap=0xfffffe046896ca40) at /usr/src/sys/kern/sys_generic.c:718 #15 0xffffffff80d4b3f7 in amd64_syscall (td=0xfffff80014a16000, traced=0) at subr_syscall.c:134 #16 0xffffffff80d30adb in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 #17 0x00000000004468ac in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) ------------------------------------------------------------------------ ps -axlww UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 0 -8 0 0 18014389993337504 - DLs - 0:00.45 [kernel] 0 1 0 0 33 0 9476 17979215514508288 wait DLs - 0:00.00 [init] 0 2 0 0 -16 0 0 18014389993337504 - DL - 0:00.32 [cam] 0 3 0 0 -16 0 0 18014389993337504 waiting_ DL - 0:00.00 [sctp_iterator] 0 4 0 0 -16 0 0 18014389993337504 idle DL - 0:01.83 [enc_daemon0] 0 5 0 0 -16 0 0 18014389993337504 idle DL - 0:00.15 [enc_daemon1] 0 6 0 0 -16 0 0 18014389993337504 umarcl DL - 0:00.44 [pagedaemon] 0 7 0 0 -16 0 0 18014389993337504 psleep DL - 0:00.00 [vmdaemon] 0 8 0 0 155 0 0 18014389993337504 pgzero DL - 0:00.00 [pagezero] 0 9 0 0 20 0 0 18014389993337504 sdflush DL - 0:01.28 [bufdaemon] 0 10 0 0 -16 0 0 18014389993337504 audit_wo DL - 0:00.00 [audit] 0 11 0 0 155 0 0 18014389993337504 - RL - 117526:41.68 [idle] 0 12 0 0 -76 0 0 18014389993337504 - WL - 3:21.24 [intr] 0 13 0 0 -8 0 0 18014389993337504 - DL - 0:00.00 [geom] 0 14 0 0 -16 0 0 18014389993337504 - DL - 0:31.58 [rand_harvestq] 0 15 0 0 -68 0 0 18014389993337504 - DL - 0:23.37 [usb] 0 16 0 0 -16 0 0 18014389993337504 tzpoll DL - 0:03.51 [acpi_thermal] 0 17 0 0 -16 0 0 18014389993337504 cooling DL - 0:00.35 [acpi_cooling1] 0 18 0 0 -16 0 0 18014389993337504 vlruwt DL - 0:00.40 [vnlru] 0 19 0 0 16 0 0 18014389993337504 syncer DL - 1:01.65 [syncer] 0 38 0 0 -8 0 0 18014389993337504 tx->tx_s DL - 0:06.61 [zfskern] 0 134 1 0 52 0 12352 0 pause Ds - 0:00.00 [adjkerntz] 0 439 1 0 52 0 16728 17979214623220480 select Ds - 0:00.00 [moused] 0 456 1 0 20 0 13624 17979215519953152 select Ds - 0:00.09 [devd] 0 542 1 0 20 0 14520 17979215517983488 select Ds - 0:00.42 [syslogd] 0 667 1 0 20 0 66780 17979216574658560 select D - 2:30.56 [snmpd] 0 695 1 0 20 0 26152 17979215514480896 select Ds - 0:06.02 [ntpd] 0 781 1 0 20 0 32360 17979216571534848 kqread Ds - 0:00.88 [master] 125 783 781 0 20 0 32484 17979214623233280 kqread D - 0:00.34 [qmgr] 0 816 1 0 20 0 61224 17979215520763392 select Ds - 0:00.00 [sshd] 0 820 1 0 20 0 16612 17979215516651008 nanslp Ds - 0:00.65 [cron] 0 866 1 0 52 0 14508 17979215524433408 ttyin Ds+ - 0:00.00 [getty] 0 867 1 0 52 0 14508 17979215514486528 ttyin Ds+ - 0:00.00 [getty] 0 868 1 0 52 0 14508 17979215520270848 ttyin Ds+ - 0:00.00 [getty] 0 869 1 0 52 0 14508 17979216574232576 ttyin Ds+ - 0:00.00 [getty] 0 870 1 0 52 0 14508 17979216571086848 ttyin Ds+ - 0:00.00 [getty] 0 871 1 0 52 0 14508 17979216571092480 ttyin Ds+ - 0:00.00 [getty] 0 872 1 0 52 0 14508 17979216571101440 ttyin Ds+ - 0:00.00 [getty] 0 873 1 0 52 0 14508 0 ttyin Ds+ - 0:00.00 [getty] 0 28865 816 0 20 0 86492 0 select Ds - 0:00.01 [sshd] 1001 28868 28865 0 20 0 86492 17979215517987072 select D - 0:00.01 [sshd] 1001 28869 28868 0 20 0 17844 17979215516625408 wait Ds - 0:00.00 [bash] 0 28871 28869 0 20 0 47736 17979214623264256 wait D - 0:00.00 [su] 0 28872 28871 0 52 0 17844 17979214623236864 ttyin D+ - 0:00.01 [bash] 125 28929 781 0 20 0 32428 17979216573695744 kqread D - 0:00.00 [pickup] 181 28984 1 0 20 0 14484 17979215518003456 select Ds - 0:00.00 [nrpe2] 181 29278 1 0 20 0 14484 0 wait D - 0:00.00 [nrpe2] 181 29282 29278 0 20 0 14484 17979220299894272 piperd D - 0:00.00 [nrpe2] 0 29283 29282 0 20 0 50360 17979215519931392 select D - 0:00.00 [sudo] 0 29284 29283 0 21 0 24912 17979220297786112 piperd D - 0:00.00 [perl] 0 29285 29284 0 20 0 2180 17979215516632832 - R - 0:00.00 [sas2ircu] ------------------------------------------------------------------------ vmstat -s 105209491 cpu context switches 8536667 device interrupts 17659435 software interrupts 5332416 traps 19572429 system calls 20 kernel threads created 9623 fork() calls 19642 vfork() calls 0 rfork() calls 0 swap pager pageins 0 swap pager pages paged in 0 swap pager pageouts 0 swap pager pages paged out 1203 vnode pager pageins 9572 vnode pager pages paged in 0 vnode pager pageouts 0 vnode pager pages paged out 0 page daemon wakeups 0 pages examined by the page daemon 838 pages reactivated 792458 copy-on-write faults 818 copy-on-write optimized faults 1858451 zero fill pages zeroed 0 zero fill pages prezeroed 1 intransit blocking page faults 3226002 total VM faults taken 947 page faults requiring I/O 0 pages affected by kernel thread creation 334457 pages affected by fork() 682680 pages affected by vfork() 0 pages affected by rfork() 0 pages cached 3459129 pages freed 0 pages freed by daemon 0 pages freed by exiting processes 1796 pages active 11122 pages inactive 0 pages in VM cache 130855 pages wired down 3923687 pages free 4096 bytes per page 4757062 total name lookups cache hits (93% pos + 3% neg) system 0% per-directory deletions 0%, falsehits 0%, toolong 0% ------------------------------------------------------------------------ vmstat -m Type InUse MemUse HighUse Requests Size(s) acpiintr 1 1K - 1 64 cdev 4 1K - 4 256 acpica 7736 755K - 1472907 16,32,64,128,256,512,1024,2048,4096 filedesc 67 203K - 30395 16,32,2048,4096,8192,16384 sigio 1 1K - 1 64 filecaps 0 0K - 14 16,64 kdtrace 422 96K - 29821 64,256 kenv 89 12K - 97 16,32,64,128,8192 kqueue 6 7K - 1484 256,512,2048 proc-args 29 2K - 33198 16,32,64,128,256 hhook 2 1K - 2 256 ithread 117 20K - 117 32,128,256 KTRACE 100 13K - 100 128 CAM path 25 1K - 152 32 linker 200 1028K - 220 16,32,64,128,256,512,1024,2048,4096,8192,16384,65536 lockf 20 3K - 17930 64,128 loginclass 3 1K - 4803 64 devbuf 17579 37001K - 17776 16,32,64,128,256,512,1024,2048,4096,8192,32768,65536 temp 47 2K - 642553 16,32,64,128,256,512,1024,2048,16384 ip6opt 3 1K - 3 256 ip6ndp 4 1K - 4 64,128 module 489 62K - 490 128 mtx_pool 2 16K - 2 8192 osd 3 1K - 8 16,32,64 pmchooks 1 1K - 1 128 pgrp 24 3K - 4909 128 session 21 3K - 4814 128 proc 2 64K - 2 32768 subproc 196 277K - 29431 512,4096 cred 158 25K - 308208 64,256 feeder 7 1K - 7 32 plimit 17 5K - 5315 256 uidinfo 5 9K - 4558 128,8192 mps 13 488K - 112 16,32,64,128,256,512,1024,2048,4096,16384,65536 mps_user 1 1K - 1184 16,32,64,128,256,512,8192,65536 acpitask 1 16K - 1 16384 sysctl 0 0K - 772687 16,32,64 sysctloid 5461 273K - 5566 16,32,64,128 sysctltmp 0 0K - 1390 16,32,64,128,256 tidhash 1 64K - 1 65536 callout 9 3208K - 9 umtx 792 99K - 792 128 p1003.1b 1 1K - 1 16 SWAP 2 209K - 2 64 bus 1277 113K - 5569 16,32,64,128,256,1024 bus-sc 90 1841K - 3116 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 devstat 10 21K - 10 32,4096 eventhandler 97 8K - 97 64,128 kobj 330 1320K - 618 4096 Per-cpu 1 1K - 1 32 DEVFS3 153 39K - 181 256 DEVFS1 133 67K - 148 512 rman 236 28K - 627 32,128 sbuf 0 0K - 1195 16,32,64,128,256,512,1024,2048,4096,8192,16384 DEVFS_RULE 55 26K - 55 64,512 DEVFS 21 1K - 22 16,128 taskqueue 83 13K - 135 16,32,64,128,256 Unitno 23 2K - 12215 32,64 vmem 3 264K - 7 1024,2048,4096,8192,32768 ioctlops 0 0K - 11879 256,512,1024 select 107 14K - 107 128 iov 0 0K - 322855 16,64,128,256,512 msg 4 30K - 4 2048,4096,8192,16384 sem 4 106K - 4 2048,4096 shm 1 32K - 1 32768 tty 20 20K - 21 1024 pts 1 1K - 2 256 mbuf_tag 0 0K - 9 32 shmfd 1 8K - 1 8192 soname 27 3K - 121573 16,32,128 pcb 22 663K - 9245 16,32,128,1024,2048,8192 DEVFSP 1 1K - 1 64 vfscache 1 4096K - 1 cl_savebuf 0 0K - 38 64 vfs_hash 1 2048K - 1 vnodes 1 1K - 1 256 mount 26 2K - 109 16,32,64,128,256 vnodemarker 0 0K - 109278 512 BPF 3 1K - 3 128 ifnet 4 7K - 4 128,2048 ifaddr 47 14K - 47 32,64,128,256,512,2048,4096 ether_multi 17 1K - 18 16,32,64 clone 7 1K - 7 128 arpcom 2 1K - 2 16 lltable 10 4K - 637 256,512 NFSD V4client 1 1K - 1 256 NFSD lckfile 1 1K - 1 256 routetbl 32 6K - 647696 32,64,128,256,512 igmp 3 1K - 3 256 in_mfilter 1 1K - 1 1024 in_multi 2 1K - 2 256 ip_moptions 2 1K - 2 64,256 sctp_a_it 0 0K - 3 16 sctp_vrf 1 1K - 1 64 sctp_ifa 4 1K - 4 128 sctp_ifn 2 1K - 2 128 sctp_iter 0 0K - 3 256 hostcache 1 896K - 1 syncache 1 2048K - 1 in6_mfilter 1 1K - 1 1024 in6_multi 15 2K - 15 32,256 ip6_moptions 2 1K - 2 32,256 mld 3 1K - 3 128 rpc 2 16K - 2 8192 audit_evclass 187 6K - 229 32 pagedep 3 513K - 2085 256 inodedep 6 2051K - 16546 512 bmsafemap 2 9K - 3894 256,8192 newblk 3 4097K - 3813 256 indirdep 0 0K - 14 128 freefrag 1 1K - 252 128 freeblks 0 0K - 2226 256 freefile 2 1K - 2058 64 diradd 2 1K - 12959 128 mkdir 1 1K - 38 128 dirrem 0 0K - 12919 128 newdirblk 1 1K - 19 64 freework 1 1K - 2537 64,128 freedep 0 0K - 8 64 jaddref 0 0K - 12997 128 jremref 0 0K - 12939 128 jnewblk 0 0K - 3812 128 jfreefrag 0 0K - 252 128 jseg 3 1K - 3534 128 jsegdep 7 1K - 30000 64 sbdep 0 0K - 5743 64 savedino 0 0K - 1832 256 jblocks 2 1K - 2 128,256 softdep 1 1K - 1 512 ufs_dirhash 456 87K - 456 16,32,64,128,256,512,1024 ufs_quota 1 2048K - 1 ufs_mount 3 13K - 3 512,4096,8192 vm_pgdata 2 2049K - 2 128 UMAHash 9 17K - 20 512,1024,2048,4096,8192 NFSD session 1 1K - 1 1024 memdesc 1 4K - 1 4096 acpisem 115 15K - 115 128 CAM periph 18 5K - 43 16,32,64,128,256 pfs_nodes 21 6K - 21 256 GEOM 101 21K - 1115 16,32,64,128,256,512,1024,2048,8192,16384 acpidev 63 4K - 63 64 CAM queue 26 118K - 109 16,32,64,128,256,512,16384 CAM dev queue 9 1K - 9 64 UART 6 5K - 6 16,1024 raid_data 0 0K - 150 32,128,256 CAM SIM 9 3K - 9 256 scsi_da 0 0K - 59 32,64,512 CAM XPT 82 8K - 258 16,32,64,128,256,512,1024,2048,65536 SCSI ENC 131 240K - 1556898 16,64,256,2048,32768,65536 pci_link 16 2K - 16 64,128 acpi_perf 8 4K - 8 512 acpipwr 5 1K - 5 64 CAM DEV 17 34K - 42 2048 CAM CCB 0 0K - 140394 2048 kbdmux 6 22K - 6 16,512,1024,2048,16384 LED 28 2K - 28 16,128 apmdev 1 1K - 1 128 madt_table 0 0K - 1 4096 USB 51 68K - 56 16,128,256,512,1024,2048,4096 USBdev 41 10K - 41 32,64,128,256,512,4096 io_apic 1 2K - 1 2048 MCA 18 3K - 18 64,128 entropy 1027 65K - 2521 32,64,4096 msi 17 3K - 17 128 nexusdev 3 1K - 3 16 isadev 7 1K - 7 128 solaris 3245 52327K - 721332 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768 kstat_data 6 1K - 6 64 ------------------------------------------------------------------------ vmstat -z ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP UMA Kegs: 384, 0, 229, 1, 229, 0, 0 UMA Zones: 1664, 0, 229, 1, 229, 0, 0 UMA Slabs: 80, 0, 3062, 38, 3187, 0, 0 UMA RCntSlabs: 88, 0, 3685, 5, 3685, 0, 0 UMA Hash: 256, 0, 94, 11, 103, 0, 0 4 Bucket: 32, 0, 392, 1733, 4274, 0, 0 6 Bucket: 48, 0, 49, 2026, 302, 0, 0 8 Bucket: 64, 0, 48, 2494, 18551, 11, 0 12 Bucket: 96, 0, 64, 961, 210, 0, 0 16 Bucket: 128, 0, 455, 940, 2989, 0, 0 32 Bucket: 256, 0, 130, 440, 3829, 51, 0 64 Bucket: 512, 0, 227, 269, 7596, 51, 0 128 Bucket: 1024, 0, 161, 103, 7445, 0, 0 256 Bucket: 2048, 0, 238, 44, 793, 0, 0 vmem btag: 56, 0, 21520, 703, 21610, 157, 0 VM OBJECT: 256, 0, 15293, 697, 415095, 0, 0 RADIX NODE: 144, 0, 7302, 1176, 682536, 0, 0 MAP: 240, 0, 3, 61, 3, 0, 0 KMAP ENTRY: 128, 0, 8, 271, 8, 0, 0 MAP ENTRY: 128, 0, 1063, 1448, 2031395, 0, 0 VMSPACE: 448, 0, 31, 383, 29267, 0, 0 fakepg: 104, 0, 0, 0, 0, 0, 0 mt_zone: 4112, 0, 364, 0, 364, 0, 0 16: 16, 0, 2829, 1689, 1685651, 0, 0 32: 32, 0, 2852, 1773, 851284, 0, 0 64: 64, 0, 14463, 2277, 1406778, 0, 0 128: 128, 0, 8387, 1254, 388849, 0, 0 256: 256, 0, 1184, 646, 1367352, 0, 0 512: 512, 0, 618, 286, 149250, 0, 0 1024: 1024, 0, 2824, 244, 209908, 0, 0 2048: 2048, 0, 198, 82, 185584, 0, 0 4096: 4096, 0, 461, 27, 203794, 0, 0 8192: 8192, 0, 25, 16, 923, 0, 0 16384: 16384, 0, 21, 14, 581, 0, 0 32768: 32768, 0, 31, 37, 44278, 0, 0 65536: 65536, 0, 16, 8, 690436, 0, 0 SLEEPQUEUE: 80, 0, 397, 874, 397, 0, 0 64 pcpu: 8, 0, 1766, 1306, 1766, 0, 0 Files: 80, 0, 178, 1072, 1578827, 0, 0 TURNSTILE: 136, 0, 397, 343, 397, 0, 0 rl_entry: 40, 0, 126, 1974, 126, 0, 0 umtx pi: 96, 0, 0, 0, 0, 0, 0 MAC labels: 40, 0, 0, 0, 0, 0, 0 PROC: 1256, 0, 50, 94, 29285, 0, 0 THREAD: 1176, 0, 370, 26, 534, 0, 0 cpuset: 72, 0, 247, 413, 410, 0, 0 audit_record: 1248, 0, 0, 0, 0, 0, 0 mbuf_packet: 256, 6507945, 4092, 3254, 98852, 0, 0 mbuf: 256, 6507945, 1, 3297, 79434, 0, 0 mbuf_cluster: 2048, 1016866, 7337, 19, 7337, 0, 0 mbuf_jumbo_page: 4096, 508432, 0, 7, 69, 0, 0 mbuf_jumbo_9k: 9216, 451938, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 338952, 0, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0, 0 DMAR_MAP_ENTRY: 120, 0, 0, 0, 0, 0, 0 g_bio: 248, 0, 0, 736, 282353, 0, 0 ttyinq: 160, 0, 180, 320, 600, 0, 0 ttyoutq: 256, 0, 95, 400, 318, 0, 0 nvme_request: 128, 0, 0, 0, 0, 0, 0 ata_request: 336, 0, 0, 0, 0, 0, 0 vtnet_tx_hdr: 24, 0, 0, 0, 0, 0, 0 FPU_save_area: 832, 0, 0, 0, 0, 0, 0 VNODE: 472, 0, 95258, 214, 97321, 0, 0 VNODEPOLL: 112, 0, 0, 0, 0, 0, 0 BUF TRIE: 144, 0, 327, 104784, 44389, 0, 0 S VFS Cache: 108, 0, 102398, 992, 130626, 0, 0 STS VFS Cache: 148, 0, 0, 0, 0, 0, 0 L VFS Cache: 328, 0, 747, 129, 747, 0, 0 LTS VFS Cache: 368, 0, 0, 0, 0, 0, 0 NAMEI: 1024, 0, 0, 132, 3686624, 0, 0 DIRHASH: 1024, 0, 579, 45, 579, 0, 0 NCLNODE: 528, 0, 0, 0, 0, 0, 0 pipe: 744, 0, 35, 135, 13227, 0, 0 procdesc: 128, 0, 0, 0, 0, 0, 0 Mountpoints: 816, 0, 3, 27, 3, 0, 0 ksiginfo: 112, 0, 134, 1756, 911093, 0, 0 itimer: 352, 0, 0, 0, 0, 0, 0 KNOTE: 128, 0, 57, 966, 134252, 0, 0 socket: 696, 522205, 54, 156, 939816, 0, 0 ipq: 56, 31808, 0, 0, 0, 0, 0 udp_inpcb: 392, 522210, 9, 341, 894738, 0, 0 udpcb: 24, 522209, 9, 2329, 894738, 0, 0 tcp_inpcb: 392, 522210, 12, 228, 753, 0, 0 tcpcb: 1032, 522207, 8, 64, 753, 0, 0 tcptw: 88, 81945, 4, 536, 45, 0, 0 syncache: 160, 2097175, 0, 250, 19, 0, 0 hostcache: 136, 2097164, 1, 260, 13, 0, 0 sackhole: 32, 0, 0, 375, 1, 0, 0 tcpreass: 40, 63600, 0, 300, 32, 0, 0 sctp_ep: 1424, 522206, 0, 0, 0, 0, 0 sctp_asoc: 2416, 40000, 0, 0, 0, 0, 0 sctp_laddr: 48, 80012, 0, 581, 3, 0, 0 sctp_raddr: 728, 80000, 0, 0, 0, 0, 0 sctp_chunk: 136, 400026, 0, 0, 0, 0, 0 sctp_readq: 104, 400026, 0, 0, 0, 0, 0 sctp_stream_msg_out: 104, 400026, 0, 0, 0, 0, 0 sctp_asconf: 40, 400000, 0, 0, 0, 0, 0 sctp_asconf_ack: 48, 400060, 0, 0, 0, 0, 0 udplite_inpcb: 392, 522210, 0, 0, 0, 0, 0 ripcb: 392, 522210, 0, 240, 10, 0, 0 unpcb: 240, 522208, 36, 764, 44309, 0, 0 rtentry: 200, 0, 13, 367, 13, 0, 0 selfd: 56, 0, 197, 1862, 8180685, 0, 0 SWAPMETA: 288, 2033733, 0, 0, 0, 0, 0 FFS inode: 176, 0, 95211, 379, 97269, 0, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 95211, 384, 97269, 0, 0 taskq_zone: 48, 0, 0, 1577, 117, 0, 0 range_seg_cache: 64, 0, 25, 2021, 470, 0, 0 zio_cache: 920, 0, 8, 2228, 1552926, 0, 0 zio_link_cache: 48, 0, 0, 3071, 19598, 0, 0 zio_buf_512: 512, 0, 21, 299, 3032, 0, 0 zio_data_buf_512: 512, 0, 0, 32, 2, 0, 0 zio_buf_1024: 1024, 0, 2, 2054, 5114, 0, 0 zio_data_buf_1024: 1024, 0, 0, 16, 5, 0, 0 zio_buf_1536: 1536, 0, 1, 81, 147, 0, 0 zio_data_buf_1536: 1536, 0, 0, 10, 1, 0, 0 zio_buf_2048: 2048, 0, 2, 48, 194, 0, 0 zio_data_buf_2048: 2048, 0, 0, 0, 0, 0, 0 zio_buf_2560: 2560, 0, 0, 24, 55, 0, 0 zio_data_buf_2560: 2560, 0, 0, 0, 0, 0, 0 zio_buf_3072: 3072, 0, 0, 30, 101, 0, 0 zio_data_buf_3072: 3072, 0, 0, 0, 0, 0, 0 zio_buf_3584: 3584, 0, 0, 13, 91, 0, 0 zio_data_buf_3584: 3584, 0, 0, 0, 0, 0, 0 zio_buf_4096: 4096, 0, 3, 127, 622, 0, 0 zio_data_buf_4096: 4096, 0, 0, 0, 0, 0, 0 zio_buf_5120: 5120, 0, 0, 13, 148, 0, 0 zio_data_buf_5120: 5120, 0, 0, 0, 0, 0, 0 zio_buf_6144: 6144, 0, 0, 13, 78, 0, 0 zio_data_buf_6144: 6144, 0, 0, 0, 0, 0, 0 zio_buf_7168: 7168, 0, 0, 0, 0, 0, 0 zio_data_buf_7168: 7168, 0, 0, 0, 0, 0, 0 zio_buf_8192: 8192, 0, 0, 23, 69, 0, 0 zio_data_buf_8192: 8192, 0, 0, 0, 0, 0, 0 zio_buf_10240: 10240, 0, 0, 10, 13, 0, 0 zio_data_buf_10240: 10240, 0, 0, 0, 0, 0, 0 zio_buf_12288: 12288, 0, 0, 1, 1, 0, 0 zio_data_buf_12288: 12288, 0, 0, 0, 0, 0, 0 zio_buf_14336: 14336, 0, 0, 0, 0, 0, 0 zio_data_buf_14336: 14336, 0, 0, 0, 0, 0, 0 zio_buf_16384: 16384, 0, 15, 16, 228, 0, 0 zio_data_buf_16384: 16384, 0, 0, 0, 0, 0, 0 zio_buf_20480: 20480, 0, 0, 2, 2, 0, 0 zio_data_buf_20480: 20480, 0, 0, 0, 0, 0, 0 zio_buf_24576: 24576, 0, 0, 0, 0, 0, 0 zio_data_buf_24576: 24576, 0, 0, 0, 0, 0, 0 zio_buf_28672: 28672, 0, 0, 0, 0, 0, 0 zio_data_buf_28672: 28672, 0, 0, 0, 0, 0, 0 zio_buf_32768: 32768, 0, 0, 5, 6, 0, 0 zio_data_buf_32768: 32768, 0, 0, 0, 0, 0, 0 zio_buf_40960: 40960, 0, 0, 11, 16, 0, 0 zio_data_buf_40960: 40960, 0, 0, 0, 0, 0, 0 zio_buf_49152: 49152, 0, 0, 0, 0, 0, 0 zio_data_buf_49152: 49152, 0, 0, 0, 0, 0, 0 zio_buf_57344: 57344, 0, 0, 0, 0, 0, 0 zio_data_buf_57344: 57344, 0, 0, 0, 0, 0, 0 zio_buf_65536: 65536, 0, 0, 0, 0, 0, 0 zio_data_buf_65536: 65536, 0, 0, 0, 0, 0, 0 zio_buf_81920: 81920, 0, 0, 0, 0, 0, 0 zio_data_buf_81920: 81920, 0, 0, 0, 0, 0, 0 zio_buf_98304: 98304, 0, 0, 0, 0, 0, 0 zio_data_buf_98304: 98304, 0, 0, 0, 0, 0, 0 zio_buf_114688: 114688, 0, 0, 2, 13, 0, 0 zio_data_buf_114688: 114688, 0, 0, 0, 0, 0, 0 zio_buf_131072: 131072, 0, 1, 2, 3, 0, 0 zio_data_buf_131072: 131072, 0, 0, 0, 0, 0, 0 zio_buf_163840: 163840, 0, 0, 0, 0, 0, 0 zio_data_buf_163840: 163840, 0, 0, 0, 0, 0, 0 zio_buf_196608: 196608, 0, 0, 0, 0, 0, 0 zio_data_buf_196608: 196608, 0, 0, 0, 0, 0, 0 zio_buf_229376: 229376, 0, 0, 0, 0, 0, 0 zio_data_buf_229376: 229376, 0, 0, 0, 0, 0, 0 zio_buf_262144: 262144, 0, 0, 0, 0, 0, 0 zio_data_buf_262144: 262144, 0, 0, 0, 0, 0, 0 zio_buf_327680: 327680, 0, 0, 0, 0, 0, 0 zio_data_buf_327680: 327680, 0, 0, 0, 0, 0, 0 zio_buf_393216: 393216, 0, 0, 0, 0, 0, 0 zio_data_buf_393216: 393216, 0, 0, 0, 0, 0, 0 zio_buf_458752: 458752, 0, 0, 0, 0, 0, 0 zio_data_buf_458752: 458752, 0, 0, 0, 0, 0, 0 zio_buf_524288: 524288, 0, 0, 0, 0, 0, 0 zio_data_buf_524288: 524288, 0, 0, 0, 0, 0, 0 zio_buf_655360: 655360, 0, 0, 0, 0, 0, 0 zio_data_buf_655360: 655360, 0, 0, 0, 0, 0, 0 zio_buf_786432: 786432, 0, 0, 0, 0, 0, 0 zio_data_buf_786432: 786432, 0, 0, 0, 0, 0, 0 zio_buf_917504: 917504, 0, 0, 0, 0, 0, 0 zio_data_buf_917504: 917504, 0, 0, 0, 0, 0, 0 zio_buf_1048576: 1048576, 0, 0, 0, 0, 0, 0 zio_data_buf_1048576: 1048576, 0, 0, 0, 0, 0, 0 zio_buf_1310720: 1310720, 0, 0, 0, 0, 0, 0 zio_data_buf_1310720: 1310720, 0, 0, 0, 0, 0, 0 zio_buf_1572864: 1572864, 0, 0, 0, 0, 0, 0 zio_data_buf_1572864: 1572864, 0, 0, 0, 0, 0, 0 zio_buf_1835008: 1835008, 0, 0, 0, 0, 0, 0 zio_data_buf_1835008: 1835008, 0, 0, 0, 0, 0, 0 zio_buf_2097152: 2097152, 0, 0, 0, 0, 0, 0 zio_data_buf_2097152: 2097152, 0, 0, 0, 0, 0, 0 zio_buf_2621440: 2621440, 0, 0, 0, 0, 0, 0 zio_data_buf_2621440: 2621440, 0, 0, 0, 0, 0, 0 zio_buf_3145728: 3145728, 0, 0, 0, 0, 0, 0 zio_data_buf_3145728: 3145728, 0, 0, 0, 0, 0, 0 zio_buf_3670016: 3670016, 0, 0, 0, 0, 0, 0 zio_data_buf_3670016: 3670016, 0, 0, 0, 0, 0, 0 zio_buf_4194304: 4194304, 0, 0, 0, 0, 0, 0 zio_data_buf_4194304: 4194304, 0, 0, 0, 0, 0, 0 zio_buf_5242880: 5242880, 0, 0, 0, 0, 0, 0 zio_data_buf_5242880: 5242880, 0, 0, 0, 0, 0, 0 zio_buf_6291456: 6291456, 0, 0, 0, 0, 0, 0 zio_data_buf_6291456: 6291456, 0, 0, 0, 0, 0, 0 zio_buf_7340032: 7340032, 0, 0, 0, 0, 0, 0 zio_data_buf_7340032: 7340032, 0, 0, 0, 0, 0, 0 zio_buf_8388608: 8388608, 0, 0, 0, 0, 0, 0 zio_data_buf_8388608: 8388608, 0, 0, 0, 0, 0, 0 zio_buf_10485760: 10485760, 0, 0, 0, 0, 0, 0 zio_data_buf_10485760: 10485760, 0, 0, 0, 0, 0, 0 zio_buf_12582912: 12582912, 0, 0, 0, 0, 0, 0 zio_data_buf_12582912: 12582912, 0, 0, 0, 0, 0, 0 zio_buf_14680064: 14680064, 0, 0, 0, 0, 0, 0 zio_data_buf_14680064: 14680064, 0, 0, 0, 0, 0, 0 zio_buf_16777216: 16777216, 0, 0, 0, 0, 0, 0 zio_data_buf_16777216: 16777216, 0, 0, 0, 0, 0, 0 lz4_ctx: 16384, 0, 0, 8, 405, 0, 0 sa_cache: 80, 0, 1, 149, 1, 0, 0 dnode_t: 752, 0, 50, 45, 101, 0, 0 dmu_buf_impl_t: 224, 0, 41, 401, 802, 0, 0 arc_buf_hdr_t: 216, 0, 27, 405, 796, 0, 0 arc_buf_t: 72, 0, 27, 853, 799, 0, 0 zil_lwb_cache: 192, 0, 0, 0, 0, 0, 0 zfs_znode_cache: 368, 0, 1, 29, 1, 0, 0 ------------------------------------------------------------------------ vmstat -i interrupt total rate irq16: ehci0 948438 31614 irq22: ehci1 1925279 64175 cpu0:timer 17791256 593041 irq264: xhci0 1970963 65698 irq266: igb0:que 0 956279 31875 irq267: igb0:que 1 868356 28945 irq268: igb0:que 2 872053 29068 irq269: igb0:que 3 868580 28952 irq270: igb0:link 2 0 irq271: mps0 36963 1232 irq272: ahci0 89754 2991 cpu1:timer 2254104 75136 cpu2:timer 1938217 64607 cpu3:timer 1941423 64714 cpu7:timer 2610790 87026 cpu5:timer 2600678 86689 cpu4:timer 2599221 86640 cpu6:timer 2587689 86256 Total 42860045 1428668 ------------------------------------------------------------------------ pstat -T 178/102400 files 0M/1526M swap space ------------------------------------------------------------------------ pstat -s Device 512-blocks Used Avail Capacity /dev/ada0p3 3127040 0 3127040 0% ------------------------------------------------------------------------ iostat iostat: kvm_read(_tk_nin): invalid address (0x0) iostat: disabling TTY statistics da0 da1 da2 cpu KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 10.36 10 0.11 2.99 49 0.14 2.38 49 0.11 0 0 0 0 100 ------------------------------------------------------------------------ ipcs -a Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME ------------------------------------------------------------------------ ipcs -T msginfo: msgmax: 16384 (max characters in a message) msgmni: 40 (# of message queues) msgmnb: 2048 (max characters in a message queue) msgtql: 40 (max # of messages in system) msgssz: 8 (size of a message segment) msgseg: 2048 (# of message segments in system) shminfo: shmmax: 536870912 (max shared memory segment size) shmmin: 1 (min shared memory segment size) shmmni: 192 (max number of shared memory identifiers) shmseg: 128 (max shared memory segments per process) shmall: 131072 (max amount of shared memory in pages) seminfo: semmni: 50 (# of semaphore identifiers) semmns: 340 (# of semaphores in system) semmnu: 150 (# of undo structures in system) semmsl: 340 (max # of semaphores per id) semopm: 100 (max # of operations per semop call) semume: 50 (max # of undo entries per process) semusz: 632 (size in bytes of undo structure) semvmx: 32767 (semaphore maximum value) semaem: 16384 (adjust on exit max value) ------------------------------------------------------------------------ nfsstat Client Info: Rpc Counts: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Rpc Info: TimedOut Invalid X Replies Retries Requests 0 0 0 0 0 Cache Info: Attr Hits Misses Lkup Hits Misses BioR Hits Misses BioW Hits Misses 0 0 0 0 0 0 0 0 BioRLHits Misses BioD Hits Misses DirE Hits Misses Accs Hits Misses 0 0 0 0 0 0 0 0 Server Info: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Server Ret-Failed 0 Server Faults 0 Server Cache Stats: Inprog Idem Non-idem Misses 0 0 0 0 Server Write Gathering: WriteOps WriteRPC Opsaved 0 0 0 ------------------------------------------------------------------------ netstat -s tcp: 3333 packets sent 1858 data packets (665875 bytes) 1 data packet (52 bytes) retransmitted 0 data packets unnecessarily retransmitted 0 resends initiated by MTU discovery 1299 ack-only packets (162 delayed) 0 URG only packets 0 window probe packets 2 window update packets 173 control packets 4224 packets received 1665 acks (for 665943 bytes) 31 duplicate acks 0 acks for unsent data 3494 packets (2458706 bytes) received in-sequence 0 completely duplicate packets (0 bytes) 0 old duplicate packets 0 packets with some dup. data (0 bytes duped) 32 out-of-order packets (13952 bytes) 0 packets (0 bytes) of data after window 0 window probes 16 window update packets 0 packets received after close 0 discarded for bad checksums 0 discarded for bad header offset fields 0 discarded because packet too short 0 discarded due to memory problems 123 connection requests 19 connection accepts 0 bad connection attempts 0 listen queue overflows 0 ignored RSTs in the windows 52 connections established (including accepts) 741 connections closed (including 1 drop) 30 connections updated cached RTT on close 30 connections updated cached RTT variance on close 0 connections updated cached ssthresh on close 90 embryonic connections dropped 1625 segments updated rtt (of 1694 attempts) 0 retransmit timeouts 0 connections dropped by rexmit timeout 0 persist timeouts 0 connections dropped by persist timeout 0 Connections (fin_wait_2) dropped because of timeout 9 keepalive timeouts 8 keepalive probes sent 1 connection dropped by keepalive 174 correct ACK header predictions 2338 correct data packet header predictions 19 syncache entries added 0 retransmitted 0 dupsyn 0 dropped 19 completed 0 bucket overflow 0 cache overflow 0 reset 0 stale 0 aborted 0 badack 0 unreach 0 zone failures 19 cookies sent 0 cookies received 13 hostcache entries added 0 bucket overflow 1 SACK recovery episode 1 segment rexmit in SACK recovery episodes 52 byte rexmits in SACK recovery episodes 3 SACK options (SACK blocks) received 16 SACK options (SACK blocks) sent 0 SACK scoreboard overflow 0 packets with ECN CE bit set 0 packets with ECN ECT(0) bit set 0 packets with ECN ECT(1) bit set 0 successful ECN handshakes 0 times ECN reduced the congestion window 0 packets with valid tcp-md5 signature received 0 packets with invalid tcp-md5 signature received 0 packets with tcp-md5 signature mismatch 0 packets with unexpected tcp-md5 signature received 0 packets without expected tcp-md5 signature received udp: 8630 datagrams received 0 with incomplete header 0 with bad data length field 0 with bad checksum 0 with no checksum 0 dropped due to no socket 0 broadcast/multicast datagrams undelivered 0 dropped due to full socket buffers 0 not for hashed pcb 8630 delivered 8846 datagrams output 0 times multicast source filter matched ip: 12873 total packets received 0 bad header checksums 0 with size smaller than minimum 0 with data size < data length 0 with ip length > max ip packet size 0 with header length < data size 0 with data length < header length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 packets reassembled ok 12873 packets for this host 0 packets for unknown/unsupported protocol 0 packets forwarded (0 packets fast forwarded) 0 packets not forwardable 0 packets received for unknown multicast group 0 redirects sent 12206 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 0 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 tunneling packets that can't find gif 0 datagrams with bad address in header icmp: 0 calls to icmp_error 0 errors not generated in response to an icmp message Output histogram: echo reply: 19 0 messages with bad code fields 0 messages less than the minimum length 0 messages with bad checksum 0 messages with bad length 0 multicast echo requests ignored 0 multicast timestamp requests ignored Input histogram: echo: 19 19 message responses generated 0 invalid return addresses 0 no return routes igmp: 0 messages received 0 messages received with too few bytes 0 messages received with wrong TTL 0 messages received with bad checksum 0 V1/V2 membership queries received 0 V3 membership queries received 0 membership queries received with invalid field(s) 0 general queries received 0 group queries received 0 group-source queries received 0 group-source queries dropped 0 membership reports received 0 membership reports received with invalid field(s) 0 membership reports received for groups to which we belong 0 V3 reports received without Router Alert 0 membership reports sent arp: 672 ARP requests sent 27 ARP replies sent 79780 ARP requests received 606 ARP replies received 80386 ARP packets received 70 total packets dropped due to no ARP entry 627 ARP entrys timed out 0 Duplicate IPs seen ip6: 0 total packets received 0 with size smaller than minimum 0 with data size < data length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 fragments that exceeded limit 0 packets reassembled ok 0 packets for this host 0 packets forwarded 0 packets not forwardable 0 redirects sent 0 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 8 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 packets that violated scope rules 0 multicast packets which we don't join Mbuf statistics: 0 one mbuf 0 one ext mbuf 0 two or more ext mbuf 0 packets whose headers are not contiguous 0 tunneling packets that can't find gif 0 packets discarded because of too many headers 1 failure of source address selection source addresses on a non-outgoing I/F 1 addresses scope=f Source addresses selection rule applied: 1 same address icmp6: 0 calls to icmp6_error 0 errors not generated in response to an icmp6 message 0 errors not generated because of rate limitation 0 messages with bad code fields 0 messages < minimum length 0 bad checksums 0 messages with bad length Histogram of error messages to be generated: 0 no route 0 administratively prohibited 0 beyond scope 0 address unreachable 0 port unreachable 0 packet too big 0 time exceed transit 0 time exceed reassembly 0 erroneous header field 0 unrecognized next header 0 unrecognized option 0 redirect 0 unknown 0 message responses generated 0 messages with too many ND options 0 messages with bad ND options 0 bad neighbor solicitation messages 0 bad neighbor advertisement messages 0 bad router solicitation messages 0 bad router advertisement messages 0 bad redirect messages 0 path MTU changes rip6: 0 messages received 0 checksum calculations on inbound 0 messages with bad checksum 0 messages dropped due to no socket 0 multicast messages dropped due to no socket 0 messages dropped due to full socket buffers 0 delivered 0 datagrams output ------------------------------------------------------------------------ netstat -m netstat: invalid address (0x0) 4093/6551/10644 mbufs in use (current/cache/total) 4083/3273/7356/1016866 mbuf clusters in use (current/cache/total/max) 4092/3254 mbuf+clusters out of packet secondary zone in use (current/cache) 0/7/7/508432 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/451938 9k jumbo clusters in use (current/cache/total/max) 0/0/0/338952 16k jumbo clusters in use (current/cache/total/max) 9189K/8211K/17401K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) ------------------------------------------------------------------------ netstat -anr Routing tables Internet: Destination Gateway Flags Netif Expire default 10.0.8.1 UGS igb0 10.0.8.0/24 link#2 U igb0 10.0.8.51 link#2 UHS lo0 127.0.0.1 link#3 UH lo0 Internet6: Destination Gateway Flags Netif Expire ::/96 ::1 UGRS lo0 ::1 link#3 UH lo0 ::ffff:0.0.0.0/96 ::1 UGRS lo0 fe80::/10 ::1 UGRS lo0 fe80::%lo0/64 link#3 U lo0 fe80::1%lo0 link#3 UHS lo0 ff01::%lo0/32 ::1 U lo0 ff02::/16 ::1 UGRS lo0 ff02::%lo0/32 ::1 U lo0 ------------------------------------------------------------------------ netstat -anA Active Internet connections (including servers) Tcpcb Proto Recv-Q Send-Q Local Address Foreign Address (state) fffff8005b34b810 tcp4 0 0 10.0.8.51.5666 10.0.0.19.65165 ESTABLISHED fffff800bb5af058 tcp4 0 0 10.0.8.51.5666 10.0.0.19.65146 TIME_WAIT fffff800bb67a058 tcp4 0 0 10.0.8.51.5666 10.0.0.19.65004 TIME_WAIT fffff800bb67a160 tcp4 0 0 10.0.8.51.5666 10.0.0.19.65001 TIME_WAIT fffff800bb5af318 tcp4 0 0 10.0.8.51.5666 10.0.0.19.65002 TIME_WAIT fffff8005b393000 tcp4 0 0 *.5666 *.* LISTEN fffff8005b393408 tcp6 0 0 *.5666 *.* LISTEN fffff8005b339810 tcp4 0 0 10.0.8.51.22 10.0.0.49.49839 ESTABLISHED fffff8005b385408 tcp4 0 0 *.22 *.* LISTEN fffff8005b385810 tcp6 0 0 *.22 *.* LISTEN fffff8005b33a810 tcp4 0 0 *.25 *.* LISTEN fffff8005b265810 tcp4 0 0 *.199 *.* LISTEN fffff80024514000 udp4 0 0 127.0.0.1.123 *.* fffff80024514188 udp6 0 0 fe80::1%lo0.123 *.* fffff80024514310 udp6 0 0 ::1.123 *.* fffff80024514498 udp4 0 0 10.0.8.51.123 *.* fffff80024514620 udp4 0 0 *.123 *.* fffff800245147a8 udp6 0 0 *.123 *.* fffff8002449a7a8 udp4 0 0 *.161 *.* fffff8002449a930 udp4 0 0 *.514 *.* fffff8002449aab8 udp6 0 0 *.514 *.* Active UNIX domain sockets Address Type Recv-Q Send-Q Inode Conn Refs Nextref Addr fffff8005bc7e0f0 stream 0 0 0 0 0 0 fffff80024f7fd20 stream 0 0 0 fffff800bb4a6780 0 0 fffff800bb4a6780 stream 0 0 0 fffff80024f7fd20 0 0 fffff80024ee85a0 stream 0 0 fffff8005b3d0000 0 0 0 private/scache fffff80024ee8690 stream 0 0 fffff8005b3d01d8 0 0 0 private/anvil fffff80024ee8780 stream 0 0 fffff8005b3d03b0 0 0 0 private/lmtp fffff80024ee8870 stream 0 0 fffff8005b3d0588 0 0 0 private/virtual fffff80024ee8960 stream 0 0 fffff8005b3d0760 0 0 0 private/local fffff80024ee8a50 stream 0 0 fffff8005b3d0938 0 0 0 private/discard fffff80024ee8b40 stream 0 0 fffff8005b3d0b10 0 0 0 private/retry fffff80024ee8c30 stream 0 0 fffff8005b3d0ce8 0 0 0 private/error fffff80024ee8d20 stream 0 0 fffff8005b3d1000 0 0 0 public/showq fffff80024ee8e10 stream 0 0 fffff8005b3d11d8 0 0 0 private/relay fffff80024ee9000 stream 0 0 fffff8005b3d13b0 0 0 0 private/smtp fffff80024ee90f0 stream 0 0 fffff8005b3d1588 0 0 0 private/proxywrite fffff80024ee91e0 stream 0 0 fffff8005b3d1760 0 0 0 private/proxymap fffff80024ee92d0 stream 0 0 fffff8005b3d1938 0 0 0 public/flush fffff80024ee93c0 stream 0 0 fffff8005b3d1b10 0 0 0 private/verify fffff80024ee94b0 stream 0 0 fffff8005b3d1ce8 0 0 0 private/trace fffff80024ee95a0 stream 0 0 fffff8005b3d2000 0 0 0 private/defer fffff80024ee9690 stream 0 0 fffff8005b3d21d8 0 0 0 private/bounce fffff80024ee9780 stream 0 0 fffff8005b3d23b0 0 0 0 private/rewrite fffff80024ee9870 stream 0 0 fffff8005b3d2588 0 0 0 private/tlsmgr fffff80024ee9b40 stream 0 0 fffff8005b3d2760 0 0 0 public/qmgr fffff80024ee9c30 stream 0 0 fffff8005b3d2938 0 0 0 public/cleanup fffff80024eea000 stream 0 0 fffff8005b3d2b10 0 0 0 public/pickup fffff80024ed5870 stream 0 0 fffff800149e23b0 0 0 0 /var/run/devd.pipe fffff80024f683c0 dgram 0 0 0 fffff80024f191e0 0 fffff80024ed4e10 fffff80024ed4e10 dgram 0 0 0 fffff80024f191e0 0 fffff80024ee24b0 fffff80024ee24b0 dgram 0 0 0 fffff80024f191e0 0 fffff80024f1bb40 fffff80024f1bb40 dgram 0 0 0 fffff80024f191e0 0 fffff80024f190f0 fffff80024f190f0 dgram 0 0 0 fffff80024f191e0 0 fffff80024f69690 fffff80024f69690 dgram 0 0 0 fffff80024f191e0 0 0 fffff80024f191e0 dgram 0 0 fffff800148fd760 0 fffff80024f683c0 0 /var/run/logpriv fffff80024f192d0 dgram 0 0 fffff800148fd938 0 0 0 /var/run/log fffff80024ee25a0 seqpac 0 0 fffff800149e21d8 0 0 0 /var/run/devd.seqpacket.pipe ------------------------------------------------------------------------ netstat -aL Current listen queue sizes (qlen/incqlen/maxqlen) Proto Listen Local Address tcp4 0/0/5 *.5666 tcp6 0/0/5 *.5666 tcp4 0/0/128 *.ssh tcp6 0/0/128 *.ssh tcp4 0/0/100 *.smtp tcp4 0/0/128 *.smux unix 0/0/100 private/scache unix 0/0/100 private/anvil unix 0/0/100 private/lmtp unix 0/0/100 private/virtual unix 0/0/100 private/local unix 0/0/100 private/discard unix 0/0/100 private/retry unix 0/0/100 private/error unix 0/0/100 public/showq unix 0/0/100 private/relay unix 0/0/100 private/smtp unix 0/0/100 private/proxywrite unix 0/0/100 private/proxymap unix 0/0/100 public/flush unix 0/0/100 private/verify unix 0/0/100 private/trace unix 0/0/100 private/defer unix 0/0/100 private/bounce unix 0/0/100 private/rewrite unix 0/0/100 private/tlsmgr unix 0/0/100 public/qmgr unix 0/0/100 public/cleanup unix 0/0/100 public/pickup unix 0/0/4 /var/run/devd.pipe unix 0/0/4 /var/run/devd.seqpacket.pipe ------------------------------------------------------------------------ fstat fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x1200000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x1200000000 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x1200000000 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x1200000000 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x600000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0x600000000 fstat: can't read file 13 at 0x200007fffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 17 at 0x600000000 fstat: can't read file 19 at 0x200007fffffffff fstat: can't read file 20 at 0x4000000001fffff fstat: can't read file 22 at 0x780000ffff fstat: can't read file 23 at 0x3a00000001 fstat: can't read file 25 at 0x200007fffffffff fstat: can't read file 26 at 0x4000000001fffff fstat: can't read file 28 at 0x780000ffff fstat: can't read file 29 at 0x800000001 fstat: can't read file 31 at 0x200007fffffffff fstat: can't read file 32 at 0x4000000001fffff fstat: can't read file 34 at 0x780000ffff fstat: can't read file 35 at 0x800000001 fstat: can't read file 37 at 0x200007fffffffff fstat: can't read file 38 at 0x4000000001fffff fstat: can't read file 40 at 0x780000ffff fstat: can't read file 41 at 0x400000001 fstat: can't read file 43 at 0x200007fffffffff fstat: can't read file 44 at 0x4000000001fffff fstat: can't read file 46 at 0x780000ffff fstat: can't read file 47 at 0x3a00000001 fstat: can't read file 49 at 0x200007fffffffff fstat: can't read file 50 at 0x4000000001fffff fstat: can't read file 52 at 0x780000ffff fstat: can't read file 53 at 0x2e00000000 fstat: can't read file 55 at 0x200007fffffffff fstat: can't read file 56 at 0x4000000001fffff fstat: can't read file 58 at 0x780000ffff fstat: can't read file 59 at 0x600000000 fstat: can't read file 61 at 0x200007fffffffff fstat: can't read file 62 at 0x4000000001fffff fstat: can't read file 64 at 0x780000ffff fstat: can't read file 65 at 0x2a00000000 fstat: can't read file 71 at 0x2800000000 fstat: can't read file 77 at 0x2c00000000 fstat: can't read file 83 at 0x3000000000 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0xa00000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0xa00000000 fstat: can't read file 13 at 0x200007fffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 17 at 0x800000000 fstat: can't read file 23 at 0x12000000000 fstat: can't read file 29 at 0x2800000000 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0xa00000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0xa00000000 fstat: can't read file 13 at 0x200007fffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 17 at 0x800000000 fstat: can't read file 23 at 0x11000000000 fstat: can't read file 29 at 0x6000000000 fstat: can't read file 35 at 0x3200000000 fstat: can't read file 41 at 0x400000000 fstat: can't read file 47 at 0x1a00000000 fstat: can't read file 53 at 0x600000000 fstat: can't read file 59 at 0x400000000 fstat: can't read file 65 at 0x400000000 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x800000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0xe00000000 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x600000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0x600000000 fstat: can't read file 13 at 0x200007fffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 17 at 0x600000000 fstat: can't read file 19 at 0x200007fffffffff fstat: can't read file 20 at 0x4000000001fffff fstat: can't read file 22 at 0x780000ffff fstat: can't read file 23 at 0x3a00000001 fstat: can't read file 25 at 0x200007fffffffff fstat: can't read file 26 at 0x4000000001fffff fstat: can't read file 28 at 0x780000ffff fstat: can't read file 29 at 0x800000001 fstat: can't read file 31 at 0x200007fffffffff fstat: can't read file 32 at 0x4000000001fffff fstat: can't read file 34 at 0x780000ffff fstat: can't read file 35 at 0x800000001 fstat: can't read file 37 at 0x200007fffffffff fstat: can't read file 38 at 0x4000000001fffff fstat: can't read file 40 at 0x780000ffff fstat: can't read file 41 at 0x400000001 fstat: can't read file 43 at 0x200007fffffffff fstat: can't read file 44 at 0x4000000001fffff fstat: can't read file 46 at 0x780000ffff fstat: can't read file 47 at 0x3a00000001 fstat: can't read file 49 at 0x200007fffffffff fstat: can't read file 50 at 0x4000000001fffff fstat: can't read file 52 at 0x780000ffff fstat: can't read file 53 at 0x2e00000000 fstat: can't read file 59 at 0x5cc000000000 fstat: can't read file 65 at 0x1b55400000000 fstat: can't read file 67 at 0x200007fffffffff fstat: can't read file 68 at 0x4000000001fffff fstat: can't read file 70 at 0x780000ffff fstat: can't read file 71 at 0x600000000 fstat: can't read file 73 at 0x200007fffffffff fstat: can't read file 74 at 0x4000000001fffff fstat: can't read file 76 at 0x780000ffff fstat: can't read file 77 at 0xa00000000 fstat: can't read file 83 at 0x7c800000000 fstat: can't read file 89 at 0xf800000000 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x600000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0x600000000 fstat: can't read file 13 at 0x200007fffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 17 at 0x600000000 fstat: can't read file 19 at 0x200007fffffffff fstat: can't read file 20 at 0x4000000001fffff fstat: can't read file 22 at 0x780000ffff fstat: can't read file 23 at 0x3600000001 fstat: can't read file 25 at 0x200007fffffffff fstat: can't read file 26 at 0x4000000001fffff fstat: can't read file 28 at 0x780000ffff fstat: can't read file 29 at 0x600000001 fstat: can't read file 31 at 0x200007fffffffff fstat: can't read file 32 at 0x4000000001fffff fstat: can't read file 34 at 0x780000ffff fstat: can't read file 35 at 0x600000000 fstat: can't read file 37 at 0x200007fffffffff fstat: can't read file 38 at 0x4000000001fffff fstat: can't read file 40 at 0x780000ffff fstat: can't read file 41 at 0x200000001 fstat: can't read file 43 at 0x200007fffffffff fstat: can't read file 44 at 0x4000000001fffff fstat: can't read file 46 at 0x780000ffff fstat: can't read file 47 at 0x200000001 fstat: can't read file 49 at 0x200007fffffffff fstat: can't read file 50 at 0x4000000001fffff fstat: can't read file 52 at 0x780000ffff fstat: can't read file 53 at 0x200000001 fstat: can't read file 55 at 0x200007fffffffff fstat: can't read file 56 at 0x4000000001fffff fstat: can't read file 58 at 0x780000ffff fstat: can't read file 59 at 0x200000001 fstat: can't read file 61 at 0x200007fffffffff fstat: can't read file 62 at 0x4000000001fffff fstat: can't read file 64 at 0x780000ffff fstat: can't read file 65 at 0x2600000001 fstat: can't read file 67 at 0x200007fffffffff fstat: can't read file 68 at 0x4000000001fffff fstat: can't read file 70 at 0x780000ffff fstat: can't read file 71 at 0x200000001 fstat: can't read file 73 at 0x200007fffffffff fstat: can't read file 74 at 0x4000000001fffff fstat: can't read file 76 at 0x780000ffff fstat: can't read file 77 at 0x600000001 fstat: can't read file 79 at 0x200007fffffffff fstat: can't read file 80 at 0x4000000001fffff fstat: can't read file 82 at 0x780000ffff fstat: can't read file 83 at 0x2e00000001 fstat: can't read file 85 at 0x200007fffffffff fstat: can't read file 86 at 0x4000000001fffff fstat: can't read file 88 at 0x780000ffff fstat: can't read file 89 at 0x200000000 fstat: can't read file 91 at 0x200007fffffffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x600000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0x600000000 fstat: can't read file 13 at 0x200007fffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 17 at 0x600000000 fstat: can't read file 19 at 0x200007fffffffff fstat: can't read file 20 at 0x4000000001fffff fstat: can't read file 22 at 0x780000ffff fstat: can't read file 23 at 0x2e00000001 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x600000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x400000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0x400000000 fstat: can't read file 13 at 0x200007fffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 17 at 0x400000000 fstat: can't read file 19 at 0x200007fffffffff fstat: can't read file 20 at 0x4000000001fffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x800000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x800000000 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff USER CMD PID FD MOUNT INUM MODE SZ|DV R/W root sas2ircu 29285 root / 2 drwxr-xr-x 1024 r root sas2ircu 29285 wd / 2 drwxr-xr-x 1024 r root sas2ircu 29285 text / 1685424 -rwxr-xr-x 858043 r root sas2ircu 29285 0 /dev 11 crw-rw-rw- null r root perl 29284 root / 2 drwxr-xr-x 1024 r root perl 29284 wd / 2 drwxr-xr-x 1024 r root perl 29284 text / 1381649 -rwxr-xr-x 7536 r root perl 29284 0 /dev 11 crw-rw-rw- null r root sudo 29283 root / 2 drwxr-xr-x 1024 r root sudo 29283 wd / 2 drwxr-xr-x 1024 r root sudo 29283 text / 1381725 -rwsr-xr-x 108280 r root sudo 29283 0 /dev 11 crw-rw-rw- null r root sudo 29283 6* pipe fffff80014909448 <-> fffff800149092e8 0 rw nagios nrpe2 29282 root / 2 drwxr-xr-x 1024 r nagios nrpe2 29282 wd / 2 drwxr-xr-x 1024 r nagios nrpe2 29282 text / 1451210 -r-xr-xr-x 47216 r nagios nrpe2 29282 0 /dev 11 crw-rw-rw- null r nagios nrpe2 29282 6 /dev 11 crw-rw-rw- null w nagios nrpe2 29278 root / 2 drwxr-xr-x 1024 r nagios nrpe2 29278 wd / 2 drwxr-xr-x 1024 r nagios nrpe2 29278 text / 1451210 -r-xr-xr-x 47216 r nagios nrpe2 29278 0 /dev 11 crw-rw-rw- null r nagios nrpe2 29278 6 /dev 11 crw-rw-rw- null w nagios nrpe2 28984 root / 2 drwxr-xr-x 1024 r nagios nrpe2 28984 wd / 2 drwxr-xr-x 1024 r nagios nrpe2 28984 text / 1451210 -r-xr-xr-x 47216 r nagios nrpe2 28984 0 /dev 11 crw-rw-rw- null r postfix pickup 28929 root / 2 drwxr-xr-x 1024 r postfix pickup 28929 wd / 722893 drwxr-xr-x 512 r postfix pickup 28929 text / 1526522 -rwxr-xr-x 210448 r postfix pickup 28929 0 /dev 11 crw-rw-rw- null rw postfix pickup 28929 6 /dev 11 crw-rw-rw- null rw postfix pickup 28929 12 /dev 11 crw-rw-rw- null rw postfix pickup 28929 18* pipe fffff8005b403ba0 <-> fffff8005b403d00 100 rw postfix pickup 28929 24* pipe fffff8005b403d00 <-> fffff8005b403ba0 0 rw postfix pickup 28929 30* pipe fffff80014ab7730 <-> fffff80014ab75d0 0 rw postfix pickup 28929 36* local stream fffff80024eea000 postfix pickup 28929 42* local dgram fffff80024ed4e10 <-> fffff80024f191e0 postfix pickup 28929 54* pipe fffff8005bbae000 <-> fffff8005bbae160 0 rw postfix pickup 28929 60* pipe fffff8005bbae160 <-> fffff8005bbae000 0 rw root bash 28872 root / 2 drwxr-xr-x 1024 r root bash 28872 wd / 1526928 drwxr-xr-x 512 r root bash 28872 text / 1381717 -rwxr-xr-x 1011784 r root bash 28872 ctty /dev 129 crw--w---- pts/0 rw root bash 28872 0 /dev 129 crw--w---- pts/0 rw root bash 28872 6 /dev 129 crw--w---- pts/0 rw root bash 28872 12 /dev 129 crw--w---- pts/0 rw root su 28871 root / 2 drwxr-xr-x 1024 r root su 28871 wd / 1444643 drwxr-xr-x 512 r root su 28871 text / 966834 -r-sr-xr-x 17656 r root su 28871 ctty /dev 129 crw--w---- pts/0 rw root su 28871 0 /dev 129 crw--w---- pts/0 rw daniel bash 28869 root / 2 drwxr-xr-x 1024 r daniel bash 28869 wd / 1444643 drwxr-xr-x 512 r daniel bash 28869 text / 1381717 -rwxr-xr-x 1011784 r daniel bash 28869 ctty /dev 129 crw--w---- pts/0 rw daniel bash 28869 0 /dev 129 crw--w---- pts/0 rw daniel bash 28869 6 /dev 129 crw--w---- pts/0 rw daniel bash 28869 12 /dev 129 crw--w---- pts/0 rw daniel sshd 28868 root / 2 drwxr-xr-x 1024 r daniel sshd 28868 wd / 2 drwxr-xr-x 1024 r daniel sshd 28868 text / 963969 -r-xr-xr-x 297792 r daniel sshd 28868 0 /dev 11 crw-rw-rw- null rw daniel sshd 28868 6 /dev 11 crw-rw-rw- null rw root sshd 28865 root / 2 drwxr-xr-x 1024 r root sshd 28865 wd / 2 drwxr-xr-x 1024 r root sshd 28865 text / 963969 -r-xr-xr-x 297792 r root sshd 28865 0 /dev 11 crw-rw-rw- null r root getty 873 root / 2 drwxr-xr-x 1024 r root getty 873 wd / 2 drwxr-xr-x 1024 r root getty 873 text / 967467 -r-xr-xr-x 28360 r root getty 873 ctty /dev 70 crw------- ttyv7 rw root getty 873 0 /dev 70 crw------- ttyv7 rw root getty 872 root / 2 drwxr-xr-x 1024 r root getty 872 wd / 2 drwxr-xr-x 1024 r root getty 872 text / 967467 -r-xr-xr-x 28360 r root getty 872 ctty /dev 69 crw------- ttyv6 rw root getty 872 0 /dev 69 crw------- ttyv6 rw root getty 871 root / 2 drwxr-xr-x 1024 r root getty 871 wd / 2 drwxr-xr-x 1024 r root getty 871 text / 967467 -r-xr-xr-x 28360 r root getty 871 ctty /dev 68 crw------- ttyv5 rw root getty 871 0 /dev 68 crw------- ttyv5 rw root getty 870 root / 2 drwxr-xr-x 1024 r root getty 870 wd / 2 drwxr-xr-x 1024 r root getty 870 text / 967467 -r-xr-xr-x 28360 r root getty 870 ctty /dev 67 crw------- ttyv4 rw root getty 870 0 /dev 67 crw------- ttyv4 rw root getty 869 root / 2 drwxr-xr-x 1024 r root getty 869 wd / 2 drwxr-xr-x 1024 r root getty 869 text / 967467 -r-xr-xr-x 28360 r root getty 869 ctty /dev 66 crw------- ttyv3 rw root getty 869 0 /dev 66 crw------- ttyv3 rw root getty 868 root / 2 drwxr-xr-x 1024 r root getty 868 wd / 2 drwxr-xr-x 1024 r root getty 868 text / 967467 -r-xr-xr-x 28360 r root getty 868 ctty /dev 65 crw------- ttyv2 rw root getty 868 0 /dev 65 crw------- ttyv2 rw root getty 867 root / 2 drwxr-xr-x 1024 r root getty 867 wd / 2 drwxr-xr-x 1024 r root getty 867 text / 967467 -r-xr-xr-x 28360 r root getty 867 ctty /dev 64 crw------- ttyv1 rw root getty 867 0 /dev 64 crw------- ttyv1 rw root getty 866 root / 2 drwxr-xr-x 1024 r root getty 866 wd / 2 drwxr-xr-x 1024 r root getty 866 text / 967467 -r-xr-xr-x 28360 r root getty 866 ctty /dev 63 crw------- ttyv0 rw root getty 866 0 /dev 63 crw------- ttyv0 rw root cron 820 root / 2 drwxr-xr-x 1024 r root cron 820 wd / 722305 drwxr-x--- 512 r root cron 820 text / 963902 -r-xr-xr-x 41352 r root cron 820 0 /dev 11 crw-rw-rw- null rw root sshd 816 root / 2 drwxr-xr-x 1024 r root sshd 816 wd / 2 drwxr-xr-x 1024 r root sshd 816 text / 963969 -r-xr-xr-x 297792 r root sshd 816 0 /dev 11 crw-rw-rw- null rw postfix qmgr 783 root / 2 drwxr-xr-x 1024 r postfix qmgr 783 wd / 722893 drwxr-xr-x 512 r postfix qmgr 783 text / 1526520 -rwxr-xr-x 270352 r postfix qmgr 783 0 /dev 11 crw-rw-rw- null rw postfix qmgr 783 6 /dev 11 crw-rw-rw- null rw postfix qmgr 783 12 /dev 11 crw-rw-rw- null rw postfix qmgr 783 18* pipe fffff8005b403ba0 <-> fffff8005b403d00 100 rw postfix qmgr 783 24* pipe fffff8005b403d00 <-> fffff8005b403ba0 0 rw postfix qmgr 783 30* pipe fffff80014ab7160 <-> fffff80014ab7000 0 rw postfix qmgr 783 36* local stream fffff80024ee9b40 postfix qmgr 783 42* local dgram fffff80024f1bb40 <-> fffff80024f191e0 postfix qmgr 783 66* pipe fffff800148daba0 <-> fffff800148dad00 0 rw postfix qmgr 783 72* pipe fffff800148dad00 <-> fffff800148daba0 0 rw root master 781 root / 2 drwxr-xr-x 1024 r root master 781 wd / 722893 drwxr-xr-x 512 r root master 781 text / 1526518 -rwxr-xr-x 142432 r root master 781 0 /dev 11 crw-rw-rw- null rw root master 781 6 /dev 11 crw-rw-rw- null rw root master 781 12 /dev 11 crw-rw-rw- null rw root master 781 18* local dgram fffff80024f190f0 <-> fffff80024f191e0 root master 781 24 /dev 11 crw-rw-rw- null rw root master 781 30* pipe fffff8005b4038b8 <-> fffff8005b403a18 0 rw root master 781 36 /dev 11 crw-rw-rw- null rw root master 781 42 /dev 11 crw-rw-rw- null rw root master 781 48 /dev 11 crw-rw-rw- null rw root master 781 54 /dev 11 crw-rw-rw- null rw root master 781 60 / 722931 -rw------- 33 rw root master 781 66 / 722932 -rw------- 33 rw root master 781 72* pipe fffff8005b404000 <-> fffff8005b404160 0 rw root master 781 78* internet stream tcp fffff8005b33a810 root master 781 90* pipe fffff8002453b000 <-> fffff8002453b160 0 rw root ntpd 695 root / 2 drwxr-xr-x 1024 r root ntpd 695 wd / 2 drwxr-xr-x 1024 r root ntpd 695 text / 963893 -r-xr-xr-x 810664 r root ntpd 695 0 /dev 11 crw-rw-rw- null r root ntpd 695 6 /dev 11 crw-rw-rw- null r root ntpd 695 12 /dev 11 crw-rw-rw- null r root ntpd 695 18* local dgram fffff80024f69690 <-> fffff80024f191e0 root snmpd 667 root / 2 drwxr-xr-x 1024 r root snmpd 667 wd / 2 drwxr-xr-x 1024 r root snmpd 667 text / 1451048 -rwxr-xr-x 29176 r root snmpd 667 0 /dev 11 crw-rw-rw- null rw root snmpd 667 6 /dev 11 crw-rw-rw- null rw root syslogd 542 root / 2 drwxr-xr-x 1024 r root syslogd 542 wd / 2 drwxr-xr-x 1024 r root syslogd 542 text / 963983 -r-xr-xr-x 40352 r root syslogd 542 0 /dev 11 crw-rw-rw- null rw root syslogd 542 6 /dev 11 crw-rw-rw- null rw root syslogd 542 12 /dev 11 crw-rw-rw- null rw root syslogd 542 18 / 722815 -rw------- 3 w root devd 456 root / 2 drwxr-xr-x 1024 r root devd 456 wd / 2 drwxr-xr-x 1024 r root devd 456 text / 401352 -r-xr-xr-x 1107624 r root devd 456 0 /dev 11 crw-rw-rw- null rw root devd 456 6 /dev 11 crw-rw-rw- null rw root moused 439 root / 2 drwxr-xr-x 1024 r root moused 439 wd / 2 drwxr-xr-x 1024 r root moused 439 text / 963883 -r-xr-xr-x 39248 r root moused 439 0 /dev 11 crw-rw-rw- null rw root adjkerntz 134 root / 2 drwxr-xr-x 1024 r root adjkerntz 134 wd / 2 drwxr-xr-x 1024 r root adjkerntz 134 text / 401285 -r-xr-xr-x 9280 r root adjkerntz 134 0 /dev 11 crw-rw-rw- null rw root zfskern 38 root / 2 drwxr-xr-x 1024 r root zfskern 38 wd / 2 drwxr-xr-x 1024 r root init 1 root / 2 drwxr-xr-x 1024 r root init 1 wd / 2 drwxr-xr-x 1024 r root init 1 text / 401327 -r-xr-xr-x 986560 r root kernel 0 root / 2 drwxr-xr-x 1024 r root kernel 0 wd / 2 drwxr-xr-x 1024 r ------------------------------------------------------------------------ dmesg Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306c3 Family=0x6 Model=0x3c Stepping=3 Features=0xbfebfbff Features2=0x7ffafbff,FMA,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND> AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x27ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 17179869184 (16384 MB) avail memory = 16556404736 (15789 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 ioapic0 irqs 0-23 on motherboard random: initialized module_register_init: MOD_LOAD (vesa, 0xffffffff80db8eb0, 0) error 19 kbd1 at kbdmux0 acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 550 atrtc0: port 0x70-0x77 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 xhci0: mem 0xf7420000-0xf742ffff irq 16 at device 20.0 on pci0 xhci0: 32 bytes context size, 64-bit DMA xhci0: Port routing mask set to 0xffffffff usbus0 on xhci0 em0: port 0xf020-0xf03f mem 0xf7400000-0xf741ffff,0xf7435000-0xf7435fff irq 20 at device 25.0 on pci0 em0: Using an MSI interrupt em0: Ethernet address: 00:25:90:b5:34:5d ehci0: mem 0xf7434000-0xf74343ff irq 16 at device 26.0 on pci0 usbus1: EHCI version 1.0 usbus1 on ehci0 pcib1: irq 16 at device 28.0 on pci0 pci1: on pcib1 pcib2: at device 0.0 on pci1 pci2: on pcib2 vgapci0: port 0xe000-0xe07f mem 0xf6000000-0xf6ffffff,0xf7000000-0xf701ffff irq 16 at device 0.0 on pci2 vgapci0: Boot video device pcib3: irq 17 at device 28.1 on pci0 pci3: on pcib3 igb0: port 0xd000-0xd01f mem 0xf7300000-0xf737ffff,0xf7380000-0xf7383fff irq 17 at device 0.0 on pci3 igb0: Using MSIX interrupts with 5 vectors igb0: Ethernet address: 00:25:90:b5:34:5c igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 igb0: Bound queue 2 to cpu 2 igb0: Bound queue 3 to cpu 3 pcib4: irq 16 at device 28.4 on pci0 pci4: on pcib4 mps0: port 0xc000-0xc0ff mem 0xf7240000-0xf724ffff,0xf7200000-0xf723ffff irq 16 at device 0.0 on pci4 mps0: Firmware: 20.00.04.00, Driver: 20.00.00.00-fbsd mps0: IOCCapabilities: 4185c ehci1: mem 0xf7433000-0xf74333ff irq 22 at device 29.0 on pci0 usbus2: EHCI version 1.0 usbus2 on ehci1 isab0: at device 31.0 on pci0 isa0: on isab0 ahci0: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xf7432000-0xf74327ff irq 19 at device 31.2 on pci0 ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahcich4: at channel 4 on ahci0 ahcich5: at channel 5 on ahci0 ahciem0: on ahci0 acpi_button0: on acpi0 acpi_button1: on acpi0 acpi_tz0: on acpi0 acpi_tz1: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 orm0: at iomem 0xc0000-0xc7fff,0xce000-0xcefff on isa0 sc0: at flags 0x100 on isa0 sc0: CGA <16 virtual consoles, flags=0x300> vga0: at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0 ppc0: cannot reserve I/O port range est0: on cpu0 est1: on cpu1 est2: on cpu2 est3: on cpu3 est4: on cpu4 est5: on cpu5 est6: on cpu6 est7: on cpu7 random: unblocking device. usbus0: 5.0Gbps Super Speed USB v3.0 Timecounters tick every 1.000 msec usbus1: 480Mbps High Speed USB v2.0 usbus2: 480Mbps High Speed USB v2.0 ugen1.1: at usbus1 uhub0: on usbus1 ugen0.1: <0x8086> at usbus0 uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen2.1: at usbus2 uhub2: on usbus2 uhub1: 17 ports with 17 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered ugen0.2: at usbus0 uhub3: on usbus0 uhub3: 4 ports with 3 removable, self powered ugen1.2: at usbus1 uhub4: on usbus1 ugen2.2: at usbus2 uhub5: on usbus2 mps0: SAS Address for SATA device = 8e7f4b28e3b4a3c3 mps0: SAS Address from SATA device = 8e7f4b28e3b4a3c3 uhub4: 4 ports with 4 removable, self powered uhub5: 6 ports with 6 removable, self powered ugen0.3: at usbus0 ukbd0: on usbus0 kbd0 at ukbd0 mps0: SAS Address for SATA device = 371b835268894a4e mps0: SAS Address for SATA device = 371b83528c7d5b3a mps0: SAS Address for SATA device = 371b835181745e5b mps0: SAS Address for SATA device = 371b835285865b50 mps0: SAS Address from SATA device = 371b835268894a4e mps0: SAS Address from SATA device = 371b83528c7d5b3a mps0: SAS Address from SATA device = 371b835181745e5b mps0: SAS Address from SATA device = 371b835285865b50 mps0: SAS Address for SATA device = 967a4b28e3b4a3c3 mps0: SAS Address from SATA device = 967a4b28e3b4a3c3 ses0 at mps0 bus 0 scbus0 target 14 lun 0 ses0: Fixed Enclosure Services SPC-3 SCSI device ses0: Serial Number ses0: 600.000MB/s transfers ses0: Command Queueing enabled ses0: SCSI-3 ENC Device ses1 at ahciem0 bus 0 scbus7 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device da0 at mps0 bus 0 scbus0 target 0 lun 0 da2 at mps0 bus 0 scbus0 target 11 lun 0 da2: Fixed Direct Access SPC-4 SCSI device da2: Serial Number Z1Z7XAC6 da2: 600.000MB/s transfers da2: Command Queueing enabled da2: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da4 at mps0 bus 0 scbus0 target 13 lun 0 da4: Fixed Direct Access SPC-4 SCSI device da4: Serial Number Z1Z7QJCL da0: Fixed Direct Access SPC-4 SCSI device da0: Serial Number 3806456074184962356 da0: 150.000MB/s transfers da0: Command Queueing enabled da0: 113487MB (232421376 512 byte sectors: 255H 63S/T 14467C) da1 at mps0 bus 0 scbus0 target 10 lun 0 da4: 600.000MB/s transfers da4: Command Queueing enabled da4: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da1: Fixed Direct Access SPC-4 SCSI device da1: Serial Number Z1Z74M2J da1: 600.000MB/s transfers da1: Command Queueing enabled da1: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da3 at mps0 bus 0 scbus0 target 12 lun 0 da3: Fixed Direct Access SPC-4 SCSI device da3: Serial Number Z1Z6M8FW da3: 600.000MB/s transfers da3: Command Queueing enabled da3: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) ada0 at ahcich0 bus 0 scbus1 target 0 lun 0 ada0: ACS-3 ATA SATA 3.x device ada0: Serial Number 67F407560D2400150411 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 30533MB (62533296 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #6 Launched! Timecounter "TSC-low" frequency 1750035332 Hz quality 1000 Trying to mount root from ufs:/dev/ada0p2 [rw]... Setting hostuuid: 00000000-0000-0000-0000-002590b5345c. Setting hostid: 0x8cd1e179. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Entropy harvesting: interrupts ethernet point_to_point swi. Starting file system checks: /dev/ada0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0p2: clean, 6511560 free (1352 frags, 813776 blocks, 0.0% fragmentation) Mounting local file systems:. Writing entropy file:. Setting hostname: storage-01-portlane.mytaste.name. Starting Network: lo0 em0 igb0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 em0: flags=8c02 metric 0 mtu 1500 options=4019b ether 00:25:90:b5:34:5d nd6 options=29 media: Ethernet autoselect status: no carrier igb0: flags=8843 metric 0 mtu 1500 options=403bb ether 00:25:90:b5:34:5c inet 10.0.8.51 netmask 0xffffff00 broadcast 10.0.8.255 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: em0. em0: flags=8c02 metric 0 mtu 1500 options=4019b ether 00:25:90:b5:34:5d nd6 options=29 media: Ethernet autoselect status: no carrier Configuring syscons: keymap. ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. add net default: gateway 10.0.8.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/mysql 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Clearing /tmp (X related). Starting snmpd. Updating motd:. Mounting late file systems:. Starting ntpd. postfix/postfix-script: starting the Postfix mail system Starting nrpe2. Configuring syscons: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Starting background file system checks in 60 seconds. Fri Oct 23 10:55:08 CEST 2015 igb0: link state changed to UP Oct 23 10:55:31 storage-01-portlane su: daniel to root on /dev/pts/0 arp: 10.0.8.1 moved from 00:25:90:c8:00:28 to 00:25:90:c8:00:ce on igb0 arp: 10.0.8.1 moved from 00:25:90:c8:00:28 to 00:25:90:c8:00:ce on igb0 arp: 10.0.8.1 moved from 00:25:90:c8:00:ce to 00:25:90:c8:00:28 on igb0 Nov 2 14:15:19 storage-01-portlane su: BAD SU daniel to root on /dev/pts/0 Nov 2 14:15:26 storage-01-portlane su: daniel to root on /dev/pts/0 panic: vm_fault: fault on nofault entry, addr: fffffe03e53f6000 cpuid = 3 KDB: stack backtrace: #0 0xffffffff80984e30 at kdb_backtrace+0x60 #1 0xffffffff809489e6 at vpanic+0x126 #2 0xffffffff809488b3 at panic+0x43 #3 0xffffffff80bc485b at vm_fault_hold+0x1bbb #4 0xffffffff80bc2c57 at vm_fault+0x77 #5 0xffffffff80d4ac8c at trap_pfault+0x19c #6 0xffffffff80d4a47a at trap+0x47a #7 0xffffffff80d307f2 at calltrap+0x8 #8 0xffffffff80640877 at mps_ioctl+0x2587 #9 0xffffffff8063e03b at mps_ioctl_devsw+0x9b #10 0xffffffff8082ffe9 at devfs_ioctl_f+0x139 #11 0xffffffff8099cd25 at kern_ioctl+0x255 #12 0xffffffff8099ca20 at sys_ioctl+0x140 #13 0xffffffff80d4b3f7 at amd64_syscall+0x357 #14 0xffffffff80d30adb at Xfast_syscall+0xfb Uptime: 10d4h52m38s Dumping 907 out of 16318 MB:..2%..11%..22%..32%..41%..52%..62%..71%..82%..92% ------------------------------------------------------------------------ kernel config options CONFIG_AUTOGENERATED ident GENERIC machine amd64 cpu HAMMER makeoptions WITH_CTF=1 makeoptions DEBUG=-g options XENHVM options HYPERV options USB_DEBUG options ATH_ENABLE_11N options AH_AR5416_INTERRUPT_MITIGATION options AH_SUPPORT_AR5416 options IEEE80211_SUPPORT_MESH options IEEE80211_AMPDU_AGE options IEEE80211_DEBUG options SC_PIXEL_MODE options VESA options AHD_REG_PRETTY_PRINT options AHC_REG_PRETTY_PRINT options ATA_STATIC_ID options ACPI_DMAR options SMP options KDB_TRACE options KDB options RCTL options RACCT_DEFAULT_TO_DISABLED options RACCT options INCLUDE_CONFIG_FILE options DDB_CTF options KDTRACE_HOOKS options KDTRACE_FRAME options MAC options PROCDESC options CAPABILITIES options CAPABILITY_MODE options AUDIT options HWPMC_HOOKS options KBD_INSTALL_CDEV options PRINTF_BUFR_SIZE=128 options _KPOSIX_PRIORITY_SCHEDULING options SYSVSEM options SYSVMSG options SYSVSHM options STACK options KTRACE options SCSI_DELAY=5000 options COMPAT_FREEBSD7 options COMPAT_FREEBSD6 options COMPAT_FREEBSD5 options COMPAT_FREEBSD4 options COMPAT_FREEBSD32 options GEOM_LABEL options GEOM_RAID options GEOM_PART_GPT options PSEUDOFS options PROCFS options CD9660 options MSDOSFS options NFS_ROOT options NFSLOCKD options NFSD options NFSCL options MD_ROOT options QUOTA options UFS_GJOURNAL options UFS_DIRHASH options UFS_ACL options SOFTUPDATES options FFS options SCTP options TCP_OFFLOAD options INET6 options INET options PREEMPTION options SCHED_ULE options NEW_PCIB options GEOM_PART_MBR options GEOM_PART_EBR_COMPAT options GEOM_PART_EBR options GEOM_PART_BSD device isa device mem device io device uart_ns8250 device cpufreq device acpi device pci device fdc device ahci device ata device mvs device siis device ahc device ahd device esp device hptiop device isp device mpt device mps device mpr device sym device trm device adv device adw device aic device bt device isci device scbus device ch device da device sa device cd device pass device ses device amr device arcmsr device ciss device dpt device hptmv device hptnr device hptrr device hpt27xx device iir device ips device mly device twa device tws device aac device aacp device aacraid device ida device mfi device mlx device mrsas device twe device nvme device nvd device atkbdc device atkbd device psm device kbdmux device vga device splash device sc device vt device vt_vga device vt_efifb device agp device cbb device pccard device cardbus device uart device ppc device ppbus device lpt device ppi device puc device bxe device de device em device igb device ix device ixv device ixl device ixlv device le device ti device txp device vx device miibus device ae device age device alc device ale device bce device bfe device bge device cas device dc device et device fxp device gem device hme device jme device lge device msk device nfe device nge device pcn device re device rl device sf device sge device sis device sk device ste device stge device tl device tx device vge device vr device wb device xl device cs device ed device ex device ep device fe device sn device xe device wlan device wlan_wep device wlan_ccmp device wlan_tkip device wlan_amrr device an device ath device ath_pci device ath_hal device ath_rate_sample device ipw device iwi device iwn device malo device mwl device ral device wi device wpi device loop device random device padlock_rng device rdrand_rng device ether device vlan device tun device md device gif device faith device firmware device bpf device uhci device ohci device ehci device xhci device usb device ukbd device umass device sound device snd_cmi device snd_csa device snd_emu10kx device snd_es137x device snd_hda device snd_ich device snd_via8233 device mmc device mmcsd device sdhci device virtio device virtio_pci device vtnet device virtio_blk device virtio_scsi device virtio_balloon device hyperv device xenpci device vmx ------------------------------------------------------------------------ ddb capture buffer ddb: ddb_capture: kvm_nlist