example.com dumped core - see /var/crash/vmcore.2 Tue Aug 23 17:16:52 CEST 2016 FreeBSD example.com 11.0-RC1 FreeBSD 11.0-RC1 #0: Tue Aug 23 13:15:46 CEST 2016 root@freebsd:/usr/src/sys/amd64/compile/FREEBSD amd64 panic: page fault GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x0 fault code = supervisor read instruction, page not present instruction pointer = 0x20:0x0 stack pointer = 0x28:0xfffffe002b475470 frame pointer = 0x28:0xfffffe002b4754a0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 12 (swi1: netisr 0) trap number = 12 panic: page fault cpuid = 0 KDB: stack backtrace: #0 0xffffffff80b24347 at kdb_backtrace+0x67 #1 0xffffffff80adb8b2 at vpanic+0x182 #2 0xffffffff80adb723 at panic+0x43 #3 0xffffffff80fdcd31 at trap_fatal+0x351 #4 0xffffffff80fdcf23 at trap_pfault+0x1e3 #5 0xffffffff80fdc4cc at trap+0x26c #6 0xffffffff80fbfc71 at calltrap+0x8 #7 0xffffffff80d7f4d8 at ipfw_chk+0x3068 #8 0xffffffff80d85a4b at ipfw_check_packet+0xeb #9 0xffffffff80bfe943 at pfil_run_hooks+0x83 #10 0xffffffff80c6beff at ip_input+0x42f #11 0xffffffff80bfd8cf at netisr_dispatch_src+0xff #12 0xffffffff80be601a at ether_demux+0x13a #13 0xffffffff80be6d35 at ether_nh_input+0x345 #14 0xffffffff80bfd8cf at netisr_dispatch_src+0xff #15 0xffffffff80be62d4 at ether_input+0x54 #16 0xffffffff80bfe1bc at swi_net+0x1ac #17 0xffffffff80a9559f at intr_event_execute_handlers+0x20f Uptime: 8m11s Dumping 89 out of 479 MB:..18%..36%..54%..72%..90% Reading symbols from /boot/kernel/if_bridge.ko...Reading symbols from /usr/lib/debug//boot/kernel/if_bridge.ko.debug...done. done. Loaded symbols for /boot/kernel/if_bridge.ko Reading symbols from /boot/kernel/bridgestp.ko...Reading symbols from /usr/lib/debug//boot/kernel/bridgestp.ko.debug...done. done. Loaded symbols for /boot/kernel/bridgestp.ko Reading symbols from /boot/kernel/if_epair.ko...Reading symbols from /usr/lib/debug//boot/kernel/if_epair.ko.debug...done. done. Loaded symbols for /boot/kernel/if_epair.ko Reading symbols from /boot/kernel/nullfs.ko...Reading symbols from /usr/lib/debug//boot/kernel/nullfs.ko.debug...done. done. Loaded symbols for /boot/kernel/nullfs.ko Reading symbols from /boot/kernel/fdescfs.ko...Reading symbols from /usr/lib/debug//boot/kernel/fdescfs.ko.debug...done. done. Loaded symbols for /boot/kernel/fdescfs.ko #0 doadump (textdump=) at pcpu.h:221 221 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=) at pcpu.h:221 #1 0xffffffff80adb339 in kern_reboot (howto=260) at ../../../kern/kern_shutdown.c:366 #2 0xffffffff80adb8eb in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:759 #3 0xffffffff80adb723 in panic (fmt=0x0) at ../../../kern/kern_shutdown.c:690 #4 0xffffffff80fdcd31 in trap_fatal (frame=0xfffffe002b4753c0, eva=0) at ../../../amd64/amd64/trap.c:841 #5 0xffffffff80fdcf23 in trap_pfault (frame=0xfffffe002b4753c0, usermode=0) at ../../../amd64/amd64/trap.c:691 #6 0xffffffff80fdc4cc in trap (frame=0xfffffe002b4753c0) at ../../../amd64/amd64/trap.c:442 #7 0xffffffff80fbfc71 in calltrap () at ../../../amd64/amd64/exception.S:236 #8 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) ------------------------------------------------------------------------ ps -axlww UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 0 -16 0 0 0 swapin DLs - 0:00.10 [kernel] 0 1 0 0 20 0 5388 960 wait DLs - 0:00.02 [init] 0 2 0 0 -16 0 0 0 crypto_w DL - 0:00.00 [crypto] 0 3 0 0 -16 0 0 0 crypto_r DL - 0:00.00 [crypto returns] 0 4 0 0 -16 0 0 0 - RL - 0:00.07 [cam] 0 5 0 0 -16 0 0 0 waiting_ DL - 0:00.00 [sctp_iterator] 0 6 0 0 -16 0 0 0 - DL - 0:00.06 [rand_harvestq] 0 7 0 0 -16 0 0 0 - DL - 0:00.00 [soaiod1] 0 8 0 0 -16 0 0 0 - DL - 0:00.00 [soaiod2] 0 9 0 0 -16 0 0 0 - DL - 0:00.00 [soaiod3] 0 10 0 0 -16 0 0 0 audit_wo DL - 0:00.00 [audit] 0 11 0 0 155 0 0 0 - RL - 6:42.50 [idle] 0 12 0 0 -60 0 0 0 - WL - 0:01.35 [intr] 0 13 0 0 -8 0 0 0 - DL - 0:00.02 [geom] 0 14 0 0 -68 0 0 0 - DL - 0:00.02 [usb] 0 15 0 0 -16 0 0 0 - DL - 0:00.00 [soaiod4] 0 16 0 0 -16 0 0 0 psleep DL - 0:00.01 [pagedaemon] 0 17 0 0 -16 0 0 0 psleep DL - 0:00.00 [vmdaemon] 0 18 0 0 155 0 0 0 pgzero DL - 0:00.00 [pagezero] 0 19 0 0 -16 0 0 0 psleep DL - 0:00.06 [bufdaemon] 0 20 0 0 -16 0 0 0 - DL - 0:00.00 [bufspacedaemon] 0 21 0 0 16 0 0 0 syncer DL - 0:00.03 [syncer] 0 22 0 0 -16 0 0 0 vlruwt DL - 0:00.01 [vnlru] 0 301 1 0 52 0 10592 2360 select Ds - 0:00.02 [dhclient] 65 347 1 0 20 0 10592 2464 select Ds - 0:00.01 [dhclient] 0 360 1 0 20 0 9512 4956 select Ds - 0:00.04 [devd] 0 433 1 0 20 0 10464 2376 select Ds - 0:00.06 [syslogd] 0 601 1 0 52 0 8756 2568 select Ds - 0:00.00 [rsync] 0 620 1 0 52 0 55672 7016 select Ds - 0:00.01 [sshd] 0 759 1 0 21 0 20224 4120 kqread D - 0:00.10 [cbsd] 0 785 1 0 20 0 12564 2412 nanslp Ds - 0:00.01 [cron] 0 881 1 0 20 0 43732 2928 wait Ds - 0:00.03 [login] 0 882 1 0 52 0 10460 2064 ttyin Ds+ - 0:00.01 [getty] 0 883 1 0 52 0 10460 2064 ttyin Ds+ - 0:00.01 [getty] 0 884 1 0 52 0 10460 2064 ttyin Ds+ - 0:00.01 [getty] 0 885 1 0 52 0 10460 2064 ttyin Ds+ - 0:00.00 [getty] 0 886 1 0 52 0 10460 2064 ttyin Ds+ - 0:00.01 [getty] 0 887 1 0 52 0 10460 2064 ttyin Ds+ - 0:00.01 [getty] 0 888 1 0 52 0 10460 2064 ttyin Ds+ - 0:00.01 [getty] 0 993 881 0 20 0 19600 3684 pause D - 0:00.10 [csh] 0 1968 1 0 20 0 10464 2304 select Ds - 0:00.01 [syslogd] 0 2024 1 0 20 0 20608 6020 select Ds - 0:00.01 [sendmail] 25 2027 1 0 52 0 20608 5916 pause Ds - 0:00.01 [sendmail] 0 2031 1 0 20 0 12564 2372 nanslp Ds - 0:00.01 [cron] 0 2114 993 0 31 0 46340 3520 select D - 0:00.03 [sudo] 0 2117 2114 0 52 0 20224 4096 wait D - 0:00.00 [cbsd] 0 2192 2117 0 52 0 43732 2908 wait D - 0:00.00 [login] 0 2193 2192 0 21 0 19600 3572 ttyin D+ - 0:00.02 [csh] ------------------------------------------------------------------------ vmstat -s 55024 cpu context switches 5723 device interrupts 9190 software interrupts 213853 traps 628081 system calls 22 kernel threads created 1519 fork() calls 656 vfork() calls 0 rfork() calls 0 swap pager pageins 0 swap pager pages paged in 0 swap pager pageouts 0 swap pager pages paged out 778 vnode pager pageins 5992 vnode pager pages paged in 0 vnode pager pageouts 0 vnode pager pages paged out 0 page daemon wakeups 0 pages examined by the page daemon 0 pages reactivated 75033 copy-on-write faults 313 copy-on-write optimized faults 108005 zero fill pages zeroed 0 zero fill pages prezeroed 0 intransit blocking page faults 202706 total VM faults taken 562 page faults requiring I/O 0 pages affected by kernel thread creation 55480 pages affected by fork() 23258 pages affected by vfork() 0 pages affected by rfork() 0 pages cached 247473 pages freed 0 pages freed by daemon 0 pages freed by exiting processes 5249 pages active 5857 pages inactive 0 pages in VM cache 10050 pages wired down 98114 pages free 4096 bytes per page 0 total name lookups cache hits (0% pos + 0% neg) system 0% per-directory deletions 0%, falsehits 0%, toolong 0% ------------------------------------------------------------------------ vmstat -m Type InUse MemUse HighUse Requests Size(s) feeder 12 1K - 14 32,128 mixer 1 4K - 1 4096 acpiintr 1 1K - 1 64 acpica 2113 236K - 25291 16,32,64,128,256,1024,4096 acpitask 1 64K - 1 65536 USB 6 5K - 6 16,128,512,4096 USBdev 5 1K - 5 32,64,128,512 acpisem 18 3K - 18 128 acpidev 25 2K - 25 64 CAM SIM 3 1K - 3 256 CAM XPT 22 2K - 88 32,64,128,256,512,1024,2048,65536 CAM DEV 5 10K - 10 2048 CAM CCB 0 0K - 2972 2048 CAM path 7 1K - 43 32 CAM periph 6 2K - 191 16,32,64,128,256 CAM I/O Scheduler 1 1K - 1 128 vtbuf 24 1968K - 46 4096 vt 11 6K - 11 512 DEVFS2 72 2K - 72 16 DEVFS3 182 46K - 201 256 DEVFS1 72 36K - 81 512 DEVFS_RULE 55 26K - 55 64,512 DEVFS 20 1K - 21 16,128 DEVFSP 2 1K - 2 64 NFSD V4client 1 1K - 1 256 NFSD lckfile 1 1K - 1 256 NFSD session 1 1K - 1 1024 pfs_nodes 21 6K - 21 256 GEOM 58 11K - 669 16,32,64,128,256,512,1024,2048,8192,16384 raid_data 0 0K - 96 32,128,256 isadev 8 1K - 8 128 pci_link 8 1K - 8 16,128 cdev 4 1K - 4 256 sigio 1 1K - 1 64 filecaps 1 1K - 3 16 kdtrace 135 25K - 2285 64,256 kenv 109 12K - 112 16,32,64,128,8192 kqueue 50 6K - 2222 64,256,512,2048 proc-args 26 2K - 1144 16,32,64,128,256 hhook 26 7K - 26 256 ithread 57 10K - 57 32,128,256 prison 1 4K - 1 4096 KTRACE 100 13K - 100 128 CAM queue 8 3K - 25 16,32,512 linker 235 126K - 263 16,32,64,128,256,512,1024,2048,4096,8192,16384 scsi_cd 0 0K - 5 16 lockf 26 3K - 2078 64,128 loginclass 3 1K - 3 64 cache 1 1K - 1 32 devbuf 361 603K - 427 16,32,64,128,256,512,1024,2048,4096,8192,16384 temp 35 2K - 3018 16,32,64,128,256,1024,2048,4096,16384,32768,65536 module 492 62K - 493 128 mtx_pool 2 16K - 2 8192 osd 4 1K - 12 16,32,64,128,256 pmchooks 1 1K - 1 128 pgrp 24 3K - 68 128 session 21 3K - 32 128 proc 2 8K - 2 4096 subproc 112 224K - 2262 512,4096 cred 46 12K - 402 256 CAM dev queue 3 1K - 3 64 plimit 23 6K - 440 256 uidinfo 4 2K - 105 128,1024 dumper 1 1K - 1 512 sysctl 0 0K - 1819 16,32,64 sysctloid 1849 96K - 1885 16,32,64,128 sysctltmp 0 0K - 223 16,64,256,1024 kbdmux 6 22K - 6 16,512,1024,2048,16384 tidhash 1 8K - 1 8192 callout 2 1416K - 2 umtx 180 23K - 180 128 p1003.1b 1 1K - 1 16 SWAP 2 209K - 2 64 bus 991 81K - 3176 16,32,64,128,256,1024 bus-sc 30 49K - 1299 16,32,128,256,512,1024,2048,4096,8192,16384,32768,65536 devstat 6 13K - 6 32,4096 eventhandler 106 9K - 106 64,128 kobj 338 1352K - 534 4096 Per-cpu 1 1K - 1 32 rman 90 11K - 412 32,128 sbuf 0 0K - 806 16,32,64,128,256,512,1024,2048,4096,8192,32768 LED 2 1K - 2 16,128 taskqueue 29 19K - 29 16,32,256,8192 terminal 11 3K - 11 256 Unitno 35 2K - 1129 32,64 vmem 3 10K - 5 1024,2048,4096 ioctlops 0 0K - 135 256,512,1024 select 14 2K - 14 128 iov 0 0K - 29188 16,32,64,128,256,512,1024 msg 4 30K - 4 2048,4096,8192,16384 sem 4 106K - 4 2048,4096 shm 1 32K - 1 32768 tty 12 12K - 12 1024 mbuf_tag 0 0K - 39 32 shmfd 1 8K - 1 8192 soname 6 1K - 7591 16,32,128 pcb 33 429K - 56 16,32,128,1024,2048,8192,32768 vfscache 1 256K - 1 vfs_hash 1 128K - 1 vnodes 1 1K - 1 256 mount 221 11K - 604 16,32,64,128,256,1024 vnodemarker 0 0K - 77 512 BPF 14 18K - 14 128,512,4096 ifdescr 2 1K - 2 16 ifnet 8 13K - 8 128,2048 ifaddr 77 26K - 83 32,64,128,256,512,2048,4096 ether_multi 98 6K - 103 16,32,64 clone 15 2K - 15 128 lltable 31 10K - 35 256,512 routetbl 61 9K - 72 32,64,128,256,512 vnet 2 1K - 2 64 vnet_data 2 128K - 2 65536 vnet_data_free 1 1K - 1 32 igmp 6 1K - 7 128 in_multi 3 1K - 4 256 encap_export_host 2 2K - 2 1024 sctp_a_it 0 0K - 8 16 sctp_vrf 2 1K - 2 64 sctp_ifa 11 2K - 11 128 sctp_ifn 5 1K - 5 128 sctp_iter 0 0K - 8 256 hostcache 2 64K - 2 32768 tcpfunc 1 1K - 1 32 syncache 2 128K - 2 65536 in6_multi 65 8K - 65 32,256 ip6opt 0 0K - 1 32 mld 6 1K - 7 128 ip6ndp 14 2K - 19 32,64,128,256 inpcbpolicy 8 1K - 187 32 ipsecpolicy 16 4K - 374 256 IpFw/IpAcct 49 100K - 58 16,32,64,128,256,512,1024,2048,4096,8192,16384 crypto 1 1K - 1 512 rpc 2 16K - 2 8192 audit_evclass 187 6K - 231 32 pagedep 4 33K - 65 256,32768 inodedep 10 133K - 224 512 bmsafemap 2 9K - 144 256,8192 newblk 2 257K - 152 256 freefrag 1 1K - 28 128 freeblks 0 0K - 69 256 freefile 1 1K - 87 64 diradd 7 1K - 106 128 mkdir 0 0K - 28 128 dirrem 0 0K - 92 128 newdirblk 0 0K - 14 64 freework 1 1K - 70 128,1024 jaddref 0 0K - 134 128 jremref 0 0K - 120 128 jnewblk 0 0K - 151 128 jfreefrag 0 0K - 28 128 jseg 13 2K - 53 128 jsegdep 14 1K - 433 64 sbdep 0 0K - 12 64 savedino 0 0K - 37 256 jblocks 2 1K - 2 128,256 softdep 1 1K - 1 512 ufs_dirhash 63 12K - 63 16,32,64,128,512 ufs_quota 1 128K - 1 ufs_mount 3 13K - 3 512,4096,8192 vm_pgdata 2 65K - 2 128,65536 UMAHash 2 3K - 4 512,1024,2048 atkbddev 2 1K - 2 64 entropy 0 0K - 30 4096 ata_pci 1 1K - 1 64 apmdev 1 1K - 1 128 madt_table 0 0K - 1 4096 io_apic 1 2K - 1 2048 MCA 1 1K - 1 128 nexusdev 5 1K - 5 16 ac97 2 1K - 2 16,512 epair 2 1K - 2 128 nullfs_hash 1 128K - 1 nullfs_node 383 24K - 397 64 nullfs_mount 11 1K - 11 32 fdesc_mount 1 1K - 1 16 ------------------------------------------------------------------------ vmstat -z ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP UMA Kegs: 384, 0, 137, 3, 137, 0, 0 UMA Zones: 768, 0, 138, 2, 138, 0, 0 UMA Slabs: 80, 0, 988, 12, 1060, 0, 0 UMA Hash: 256, 0, 11, 4, 13, 0, 0 4 Bucket: 32, 0, 14, 361, 1277, 0, 0 6 Bucket: 48, 0, 4, 328, 50, 0, 0 8 Bucket: 64, 0, 4, 306, 119, 11, 0 12 Bucket: 96, 0, 7, 157, 29, 0, 0 16 Bucket: 128, 0, 14, 141, 97, 0, 0 32 Bucket: 256, 0, 14, 61, 220, 137, 0 64 Bucket: 512, 0, 20, 12, 134, 137, 0 128 Bucket: 1024, 0, 17, 11, 78, 0, 0 256 Bucket: 2048, 0, 24, 4, 74, 0, 0 vmem btag: 56, 0, 988, 219, 988, 9, 0 VM OBJECT: 264, 0, 1520, 55, 30355, 0, 0 RADIX NODE: 144, 0, 2006, 100, 60693, 0, 0 MAP: 240, 0, 3, 61, 3, 0, 0 KMAP ENTRY: 128, 0, 9, 146, 9, 0, 0 MAP ENTRY: 128, 0, 707, 316, 73543, 0, 0 VMSPACE: 2512, 0, 26, 10, 2177, 0, 0 fakepg: 104, 0, 0, 0, 0, 0, 0 mt_zone: 16400, 0, 408, 0, 408, 0, 0 16: 16, 0, 1141, 365, 15051, 0, 0 32: 32, 0, 1291, 334, 5914, 0, 0 64: 64, 0, 2180, 114, 39395, 0, 0 128: 128, 0, 3596, 155, 24121, 0, 0 256: 256, 0, 688, 47, 3758, 0, 0 512: 512, 0, 315, 37, 1187, 0, 0 1024: 1024, 0, 46, 46, 2353, 0, 0 2048: 2048, 0, 43, 7, 3106, 0, 0 4096: 4096, 0, 447, 8, 2926, 0, 0 8192: 8192, 0, 29, 0, 204, 0, 0 16384: 16384, 0, 9, 1, 234, 0, 0 32768: 32768, 0, 8, 1, 135, 0, 0 65536: 65536, 0, 6, 1, 254, 0, 0 SLEEPQUEUE: 80, 0, 91, 64, 91, 0, 0 64 pcpu: 8, 0, 4935, 185, 4993, 0, 0 Files: 80, 0, 97, 53, 13272, 0, 0 filedesc0: 1104, 0, 48, 15, 2198, 0, 0 rl_entry: 40, 0, 36, 264, 36, 0, 0 TURNSTILE: 136, 0, 91, 49, 91, 0, 0 umtx pi: 96, 0, 0, 0, 0, 0, 0 umtx_shm: 88, 0, 0, 0, 0, 0, 0 MAC labels: 40, 0, 0, 0, 0, 0, 0 PROC: 1320, 0, 47, 16, 2197, 0, 0 THREAD: 1272, 0, 86, 4, 86, 0, 0 cpuset: 96, 0, 53, 111, 55, 0, 0 audit_record: 1248, 0, 0, 0, 0, 0, 0 mbuf_packet: 256, 190845, 256, 256, 2788, 0, 0 mbuf: 256, 190845, 9, 250, 3593, 0, 0 mbuf_cluster: 2048, 29818, 506, 4, 506, 0, 0 mbuf_jumbo_page: 4096, 14908, 0, 0, 0, 0, 0 mbuf_jumbo_9k: 9216, 13251, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 9936, 0, 0, 0, 0, 0 g_bio: 376, 0, 0, 120, 8100, 0, 0 DMAR_MAP_ENTRY: 120, 0, 0, 0, 0, 0, 0 ttyinq: 160, 0, 120, 5, 255, 0, 0 ttyoutq: 256, 0, 64, 71, 136, 0, 0 nvme_request: 128, 0, 0, 0, 0, 0, 0 vtnet_tx_hdr: 24, 0, 0, 0, 0, 0, 0 cryptop: 88, 0, 0, 0, 0, 0, 0 cryptodesc: 72, 0, 0, 0, 0, 0, 0 FPU_save_area: 512, 0, 0, 0, 0, 0, 0 VNODE: 472, 0, 1450, 30, 1553, 0, 0 VNODEPOLL: 120, 0, 1, 131, 1, 0, 0 BUF TRIE: 144, 0, 89, 3664, 589, 0, 0 NAMEI: 1024, 0, 0, 16, 35133, 0, 0 S VFS Cache: 108, 0, 1057, 98, 3929, 0, 0 STS VFS Cache: 148, 0, 0, 0, 0, 0, 0 L VFS Cache: 328, 0, 0, 0, 0, 0, 0 LTS VFS Cache: 368, 0, 0, 0, 0, 0, 0 DIRHASH: 1024, 0, 81, 11, 81, 0, 0 NCLNODE: 528, 0, 0, 0, 0, 0, 0 Mountpoints: 816, 0, 15, 15, 15, 0, 0 pipe: 760, 0, 2, 13, 1248, 0, 0 procdesc: 136, 0, 0, 0, 0, 0, 0 AIO: 224, 0, 0, 0, 0, 0, 0 AIOP: 32, 0, 0, 0, 0, 0, 0 AIOCB: 752, 0, 0, 0, 0, 0, 0 AIOL: 128, 0, 0, 0, 0, 0, 0 AIOLIO: 280, 0, 0, 0, 0, 0, 0 ksiginfo: 112, 0, 48, 1002, 74, 0, 0 itimer: 352, 0, 0, 0, 0, 0, 0 KNOTE: 128, 0, 2, 153, 30, 0, 0 socket: 864, 15340, 23, 5, 1413, 0, 0 unpcb: 240, 15344, 14, 50, 1204, 0, 0 ipq: 56, 994, 0, 0, 0, 0, 0 udp_inpcb: 464, 15344, 2, 30, 120, 0, 0 udpcb: 32, 15375, 2, 373, 120, 0, 0 tcp_inpcb: 464, 15344, 4, 28, 4, 0, 0 tcpcb: 1040, 15342, 4, 5, 4, 0, 0 tcptw: 88, 3105, 0, 0, 0, 0, 0 syncache: 168, 15364, 0, 0, 0, 0, 0 hostcache: 128, 15376, 0, 0, 0, 0, 0 sackhole: 32, 0, 0, 0, 0, 0, 0 tcpreass: 40, 1900, 0, 0, 0, 0, 0 sctp_ep: 1488, 15340, 0, 0, 0, 0, 0 sctp_asoc: 2408, 40000, 0, 0, 0, 0, 0 sctp_laddr: 48, 80012, 0, 332, 6, 0, 0 sctp_raddr: 736, 80000, 0, 0, 0, 0, 0 sctp_chunk: 152, 400010, 0, 0, 0, 0, 0 sctp_readq: 160, 400000, 0, 0, 0, 0, 0 sctp_stream_msg_out: 112, 400015, 0, 0, 0, 0, 0 sctp_asconf: 40, 400000, 0, 0, 0, 0, 0 sctp_asconf_ack: 48, 400060, 0, 0, 0, 0, 0 udplite_inpcb: 464, 15344, 0, 0, 0, 0, 0 ripcb: 464, 15344, 1, 31, 11, 0, 0 rtentry: 208, 0, 18, 58, 21, 0, 0 IPFW counters: 16, 0, 5, 251, 5, 0, 0 IPFW dynamic rule: 120, 16401, 0, 0, 0, 0, 0 selfd: 64, 0, 36, 274, 2709, 0, 0 SWAPMETA: 288, 59644, 0, 0, 0, 0, 0 FFS inode: 176, 0, 1022, 34, 1109, 0, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 1022, 28, 1109, 0, 0 bridge_rtnode: 64, 0, 62, 248, 62, 0, 0 ipq: 56, 994, 0, 0, 0, 0, 0 udp_inpcb: 464, 15344, 0, 32, 47, 0, 0 udpcb: 32, 15375, 0, 375, 47, 0, 0 tcp_inpcb: 464, 15344, 1, 31, 3, 0, 0 tcpcb: 1040, 15342, 1, 8, 3, 0, 0 tcptw: 88, 3105, 0, 0, 0, 0, 0 syncache: 168, 15364, 0, 0, 0, 0, 0 hostcache: 128, 15376, 0, 0, 0, 0, 0 sackhole: 32, 0, 0, 0, 0, 0, 0 sctp_ep: 1488, 15340, 0, 0, 0, 0, 0 sctp_asoc: 2408, 40000, 0, 0, 0, 0, 0 sctp_laddr: 48, 80012, 0, 332, 3, 0, 0 sctp_raddr: 736, 80000, 0, 0, 0, 0, 0 sctp_chunk: 152, 400010, 0, 0, 0, 0, 0 sctp_readq: 160, 400000, 0, 0, 0, 0, 0 sctp_stream_msg_out: 112, 400015, 0, 0, 0, 0, 0 sctp_asconf: 40, 400000, 0, 0, 0, 0, 0 sctp_asconf_ack: 48, 400060, 0, 0, 0, 0, 0 udplite_inpcb: 464, 15344, 0, 0, 0, 0, 0 ripcb: 464, 15344, 0, 32, 2, 0, 0 rtentry: 208, 0, 10, 66, 12, 0, 0 IPFW counters: 16, 0, 2, 254, 2, 0, 0 IPFW dynamic rule: 120, 16401, 0, 0, 0, 0, 0 ------------------------------------------------------------------------ vmstat -i interrupt total rate irq1: atkbd0 890 36 irq14: ata0 2601 106 irq15: ata1 343 14 irq19: em0 1889 77 cpu0:timer 24414 994 Total 30137 1227 ------------------------------------------------------------------------ pstat -T 97/15337 files 0M/1024M swap space ------------------------------------------------------------------------ pstat -s Device 512-blocks Used Avail Capacity /dev/ada0p3 2098856 0 2098856 0% ------------------------------------------------------------------------ iostat tty ada0 cd0 pass0 cpu tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 1 17 19.40 5 0.10 0.00 0 0.00 0.00 0 0.00 0 0 3 0 97 ------------------------------------------------------------------------ ipcs -a Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME ------------------------------------------------------------------------ ipcs -T msginfo: msgmax: 16384 (max characters in a message) msgmni: 40 (# of message queues) msgmnb: 2048 (max characters in a message queue) msgtql: 40 (max # of messages in system) msgssz: 8 (size of a message segment) msgseg: 2048 (# of message segments in system) shminfo: shmmax: 536870912 (max shared memory segment size) shmmin: 1 (min shared memory segment size) shmmni: 192 (max number of shared memory identifiers) shmseg: 128 (max shared memory segments per process) shmall: 131072 (max amount of shared memory in pages) seminfo: semmni: 50 (# of semaphore identifiers) semmns: 340 (# of semaphores in system) semmnu: 150 (# of undo structures in system) semmsl: 340 (max # of semaphores per id) semopm: 100 (max # of operations per semop call) semume: 50 (max # of undo entries per process) semusz: 632 (size in bytes of undo structure) semvmx: 32767 (semaphore maximum value) semaem: 16384 (adjust on exit max value) ------------------------------------------------------------------------ nfsstat Client Info: Rpc Counts: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Rpc Info: TimedOut Invalid X Replies Retries Requests 0 0 0 0 0 Cache Info: Attr Hits Misses Lkup Hits Misses BioR Hits Misses BioW Hits Misses 0 0 0 0 0 0 0 0 BioRLHits Misses BioD Hits Misses DirE Hits Misses Accs Hits Misses 0 0 0 0 0 0 0 0 Server Info: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Server Ret-Failed 0 Server Faults 0 Server Cache Stats: Inprog Idem Non-idem Misses 0 0 0 0 Server Write Gathering: WriteOps WriteRPC Opsaved 0 0 0 ------------------------------------------------------------------------ netstat -s tcp: 0 packets sent 0 data packets (0 bytes) 0 data packets (0 bytes) retransmitted 0 data packets unnecessarily retransmitted 0 resends initiated by MTU discovery 0 ack-only packets (0 delayed) 0 URG only packets 0 window probe packets 0 window update packets 0 control packets 0 packets received 0 acks (for 0 bytes) 0 duplicate acks 0 acks for unsent data 0 packets (0 bytes) received in-sequence 0 completely duplicate packets (0 bytes) 0 old duplicate packets 0 packets with some dup. data (0 bytes duped) 0 out-of-order packets (0 bytes) 0 packets (0 bytes) of data after window 0 window probes 0 window update packets 0 packets received after close 0 discarded for bad checksums 0 discarded for bad header offset fields 0 discarded because packet too short 0 discarded due to memory problems 0 connection requests 0 connection accepts 0 bad connection attempts 0 listen queue overflows 0 ignored RSTs in the windows 0 connections established (including accepts) 0 connections closed (including 0 drops) 0 connections updated cached RTT on close 0 connections updated cached RTT variance on close 0 connections updated cached ssthresh on close 0 embryonic connections dropped 0 segments updated rtt (of 0 attempts) 0 retransmit timeouts 0 connections dropped by rexmit timeout 0 persist timeouts 0 connections dropped by persist timeout 0 Connections (fin_wait_2) dropped because of timeout 0 keepalive timeouts 0 keepalive probes sent 0 connections dropped by keepalive 0 correct ACK header predictions 0 correct data packet header predictions 0 syncache entries added 0 retransmitted 0 dupsyn 0 dropped 0 completed 0 bucket overflow 0 cache overflow 0 reset 0 stale 0 aborted 0 badack 0 unreach 0 zone failures 0 cookies sent 0 cookies received 0 hostcache entries added 0 bucket overflow 0 SACK recovery episodes 0 segment rexmits in SACK recovery episodes 0 byte rexmits in SACK recovery episodes 0 SACK options (SACK blocks) received 0 SACK options (SACK blocks) sent 0 SACK scoreboard overflow 0 packets with ECN CE bit set 0 packets with ECN ECT(0) bit set 0 packets with ECN ECT(1) bit set 0 successful ECN handshakes 0 times ECN reduced the congestion window TCP connection count by state: 0 connections in CLOSED state 4 connections in LISTEN state 0 connections in SYN_SENT state 0 connections in SYN_RCVD state 0 connections in ESTABLISHED state 0 connections in CLOSE_WAIT state 0 connections in FIN_WAIT_1 state 0 connections in CLOSING state 0 connections in LAST_ACK state 0 connections in FIN_WAIT_2 state 0 connections in TIME_WAIT state udp: 217 datagrams received 0 with incomplete header 0 with bad data length field 0 with bad checksum 5 with no checksum 13 dropped due to no socket 204 broadcast/multicast datagrams undelivered 0 dropped due to full socket buffers 0 not for hashed pcb 0 delivered 0 datagrams output 0 times multicast source filter matched ip: 234 total packets received 0 bad header checksums 0 with size smaller than minimum 2 with data size < data length 0 with ip length > max ip packet size 0 with header length < data size 0 with data length < header length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 packets reassembled ok 205 packets for this host 0 packets for unknown/unsupported protocol 0 packets forwarded (0 packets fast forwarded) 27 packets not forwardable 0 packets received for unknown multicast group 0 redirects sent 1 packet sent from this host 1 packet sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 0 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 tunneling packets that can't find gif 0 datagrams with bad address in header icmp: 1 call to icmp_error 0 errors not generated in response to an icmp message Output histogram: destination unreachable: 1 0 messages with bad code fields 0 messages less than the minimum length 0 messages with bad checksum 0 messages with bad length 0 multicast echo requests ignored 0 multicast timestamp requests ignored 0 message responses generated 0 invalid return addresses 0 no return routes ipsec: 0 inbound packets violated process security policy 0 inbound packets failed due to insufficient memory 0 invalid inbound packets 0 outbound packets violated process security policy 0 outbound packets with no SA available 0 outbound packets failed due to insufficient memory 0 outbound packets with no route available 0 invalid outbound packets 0 outbound packets with bundled SAs 0 mbufs coalesced during clone 0 clusters coalesced during clone 0 clusters copied during clone 0 mbufs inserted during makespace ah: 0 packets shorter than header shows 0 packets dropped; protocol family not supported 0 packets dropped; no TDB 0 packets dropped; bad KCR 0 packets dropped; queue full 0 packets dropped; no transform 0 replay counter wraps 0 packets dropped; bad authentication detected 0 packets dropped; bad authentication length 0 possible replay packets detected 0 packets in 0 packets out 0 packets dropped; invalid TDB 0 bytes in 0 bytes out 0 packets dropped; larger than IP_MAXPACKET 0 packets blocked due to policy 0 crypto processing failures 0 tunnel sanity check failures esp: 0 packets shorter than header shows 0 packets dropped; protocol family not supported 0 packets dropped; no TDB 0 packets dropped; bad KCR 0 packets dropped; queue full 0 packets dropped; no transform 0 packets dropped; bad ilen 0 replay counter wraps 0 packets dropped; bad encryption detected 0 packets dropped; bad authentication detected 0 possible replay packets detected 0 packets in 0 packets out 0 packets dropped; invalid TDB 0 bytes in 0 bytes out 0 packets dropped; larger than IP_MAXPACKET 0 packets blocked due to policy 0 crypto processing failures 0 tunnel sanity check failures ipcomp: 0 packets shorter than header shows 0 packets dropped; protocol family not supported 0 packets dropped; no TDB 0 packets dropped; bad KCR 0 packets dropped; queue full 0 packets dropped; no transform 0 replay counter wraps 0 packets in 0 packets out 0 packets dropped; invalid TDB 0 bytes in 0 bytes out 0 packets dropped; larger than IP_MAXPACKET 0 packets blocked due to policy 0 crypto processing failures 0 packets sent uncompressed; size < compr. algo. threshold 0 packets sent uncompressed; compression was useless carp: 0 packets received (IPv4) 0 packets received (IPv6) 0 packets discarded for wrong TTL 0 packets shorter than header 0 discarded for bad checksums 0 discarded packets with a bad version 0 discarded because packet too short 0 discarded for bad authentication 0 discarded for bad vhid 0 discarded because of a bad address list 0 packets sent (IPv4) 0 packets sent (IPv6) 0 send failed due to mbuf memory error arp: 2 ARP requests sent 1 ARP reply sent 934 ARP requests received 28 ARP replies received 1234 ARP packets received 0 total packets dropped due to no ARP entry 0 ARP entrys timed out 0 Duplicate IPs seen ip6: 44 total packets received 0 with size smaller than minimum 0 with data size < data length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 fragments that exceeded limit 0 packets reassembled ok 21 packets for this host 0 packets forwarded 0 packets not forwardable 0 redirects sent 10 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 0 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 packets that violated scope rules 8 multicast packets which we don't join Input histogram: hop by hop: 7 UDP: 12 ICMP6: 25 Mbuf statistics: 1 one mbuf two or more mbuf: (null)= 22 (null)= 2 41 one ext mbuf 0 two or more ext mbuf 0 packets whose headers are not contiguous 0 tunneling packets that can't find gif 0 packets discarded because of too many headers 0 failures of source address selection source addresses on an outgoing I/F 1 link-local source addresses of a different scope 1 link-local Source addresses selection rule applied: 1 first candidate icmp6: 0 calls to icmp6_error 0 errors not generated in response to an icmp6 message 0 errors not generated because of rate limitation Output histogram: router solicitation: 1 neighbor solicitation: 3 MLDv2 listener report: 6 0 messages with bad code fields 0 messages < minimum length 0 bad checksums 0 messages with bad length Input histogram: router advertisement: 1 neighbor advertisement: 23 Histogram of error messages to be generated: 0 no route 0 administratively prohibited 0 beyond scope 0 address unreachable 0 port unreachable 0 packet too big 0 time exceed transit 0 time exceed reassembly 0 erroneous header field 0 unrecognized next header 0 unrecognized option 0 redirect 0 unknown 0 message responses generated 0 messages with too many ND options 0 messages with bad ND options 0 bad neighbor solicitation messages 0 bad neighbor advertisement messages 0 bad router solicitation messages 0 bad router advertisement messages 0 bad redirect messages 0 path MTU changes ipsec6: 0 inbound packets violated process security policy 0 inbound packets failed due to insufficient memory 0 invalid inbound packets 0 outbound packets violated process security policy 0 outbound packets with no SA available 0 outbound packets failed due to insufficient memory 0 outbound packets with no route available 0 invalid outbound packets 0 outbound packets with bundled SAs 0 mbufs coalesced during clone 0 clusters coalesced during clone 0 clusters copied during clone 0 mbufs inserted during makespace rip6: 0 messages received 0 checksum calculations on inbound 0 messages with bad checksum 0 messages dropped due to no socket 0 multicast messages dropped due to no socket 0 messages dropped due to full socket buffers 0 delivered 0 datagrams output pfkey: 0 requests sent from userland 0 bytes sent from userland 0 messages with invalid length field 0 messages with invalid version field 0 messages with invalid message type field 0 messages too short 0 messages with memory allocation failure 0 messages with duplicate extension 0 messages with invalid extension type 0 messages with invalid sa type 0 messages with invalid address extension 0 requests sent to userland 0 bytes sent to userland 0 messages toward single socket 0 messages toward all sockets 0 messages toward registered sockets 0 messages with memory allocation failure ------------------------------------------------------------------------ netstat -m 265/506/771 mbufs in use (current/cache/total) 250/260/510/29818 mbuf clusters in use (current/cache/total/max) 256/256 mbuf+clusters out of packet secondary zone in use (current/cache) 0/0/0/14908 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/13251 9k jumbo clusters in use (current/cache/total/max) 0/0/0/9936 16k jumbo clusters in use (current/cache/total/max) 566K/646K/1212K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) ------------------------------------------------------------------------ netstat -anA Active Internet connections (including servers) Tcpcb Proto Recv-Q Send-Q Local Address Foreign Address (state) fffff800037f7820 tcp4 0 0 *.22222 *.* LISTEN fffff800037b0000 tcp6 0 0 *.22222 *.* LISTEN fffff800037b0410 tcp4 0 0 *.1873 *.* LISTEN fffff800037b0820 tcp6 0 0 *.1873 *.* LISTEN fffff80003610570 udp4 0 0 *.514 *.* fffff80003610740 udp6 0 0 *.514 *.* Active UNIX domain sockets Address Type Recv-Q Send-Q Inode Conn Refs Nextref Addr fffff800037a94b0 stream 0 0 0 0 0 0 fffff800037a9b40 stream 0 0 fffff800035f8938 0 0 0 /var/run/devd.pipe fffff800037a8e10 dgram 0 0 0 fffff800037a92d0 0 fffff800037a9000 fffff800037a9000 dgram 0 0 0 fffff800037a92d0 0 fffff800037a91e0 fffff800037a90f0 dgram 0 0 0 fffff800037a93c0 0 0 fffff800037a91e0 dgram 0 0 0 fffff800037a92d0 0 0 fffff800037a92d0 dgram 0 0 fffff80003c06b10 0 fffff800037a8e10 0 /var/run/logpriv fffff800037a93c0 dgram 0 0 fffff80003c07000 0 fffff800037a90f0 0 /var/run/log fffff800037a95a0 dgram 0 0 0 fffff800037a9870 0 fffff800037a9690 fffff800037a9690 dgram 0 0 0 fffff800037a9870 0 fffff800037a9780 fffff800037a9780 dgram 0 0 0 fffff800037a9870 0 0 fffff800037a9870 dgram 0 0 fffff8000365c588 0 fffff800037a95a0 0 /var/run/logpriv fffff800037a9960 dgram 0 0 fffff8000365c760 0 0 0 /var/run/log fffff800037a9a50 seqpac 0 0 fffff800035f8760 0 0 0 /var/run/devd.seqpacket.pipe ------------------------------------------------------------------------ netstat -aL Current listen queue sizes (qlen/incqlen/maxqlen) Proto Listen Local Address tcp4 0/0/128 *.22222 tcp6 0/0/128 *.22222 tcp4 0/0/5 *.1873 tcp6 0/0/5 *.1873 unix 0/0/4 /var/run/devd.pipe unix 0/0/4 /var/run/devd.seqpacket.pipe ------------------------------------------------------------------------ fstat fstat: can't read file 5 at 0x9c00000000 fstat: can't read file 11 at 0x7c00000000 fstat: can't read file 17 at 0x7c00000000 fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x200000000 fstat: can't read file 7 at 0x20007ffffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x200000000 fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x600000000 fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x400000000 fstat: can't read file 7 at 0x20007ffffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0x400000000 fstat: can't read file 13 at 0x20007ffffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 5 at 0x11c00000001 fstat: can't read file 11 at 0x8400000000 fstat: can't read file 17 at 0x8800000000 fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x600000000 fstat: can't read file 7 at 0x20007ffffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0x2c00000000 fstat: can't read file 13 at 0x20007ffffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x600000000 fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x400000000 fstat: can't read file 7 at 0x20007ffffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0x400000000 fstat: can't read file 13 at 0x20007ffffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 17 at 0x400000000 fstat: can't read file 19 at 0x20007ffffffffff fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x800000000 fstat: can't read file 7 at 0x20007ffffffffff fstat: can't read file 1 at 0x200000000000000 fstat: can't read file 2 at 0x400000000000000 fstat: can't read file 5 at 0x800000000 fstat: can't read file 7 at 0x200000000000002 fstat: can't read file 8 at 0x400000000000000 fstat: can't read file 1 at 0x20007ffffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x800000000 fstat: can't read file 7 at 0x20007ffffffffff fstat: can't read file 8 at 0x4000000001fffff USER CMD PID FD MOUNT INUM MODE SZ|DV R/W root csh 2193 root - - ?(null) - root csh 2193 wd - - ?(null) - root csh 2193 jail - - ?(null) - root csh 2193 text - - ?(null) - root csh 2193 ctty /dev 60 crw------- ttyv0 rw root login 2192 root - - ?(null) - root login 2192 wd - - ?(null) - root login 2192 jail - - ?(null) - root login 2192 text - - ?(null) - root login 2192 ctty /dev 60 crw------- ttyv0 rw root login 2192 0 /dev 60 crw------- ttyv0 rw root cbsd 2117 root / 2 drwxr-xr-x 1024 r root cbsd 2117 wd / 2166914 dr-xr-xr-x 512 r root cbsd 2117 text / 82112 -r-x------ 166008 r root cbsd 2117 ctty /dev 60 crw------- ttyv0 rw root cbsd 2117 0 /dev 60 crw------- ttyv0 rw root cbsd 2117 6 /dev 60 crw------- ttyv0 rw root sudo 2114 root / 2 drwxr-xr-x 1024 r root sudo 2114 wd / 2166914 dr-xr-xr-x 512 r root sudo 2114 text / 1148029 -rwsr-xr-x 112408 r root sudo 2114 ctty /dev 60 crw------- ttyv0 rw root sudo 2114 0 /dev 60 crw------- ttyv0 rw root cron 2031 root - - ?(null) - root cron 2031 wd - - ?(null) - root cron 2031 jail - - ?(null) - root cron 2031 text - - ?(null) - root cron 2031 0 /usr/jails/jails/vnet1/dev 24 crw-rw-rw- null rw smmsp sendmail 2027 root - - ?(null) - smmsp sendmail 2027 wd - - ?(null) - smmsp sendmail 2027 jail - - ?(null) - smmsp sendmail 2027 text - - ?(null) - smmsp sendmail 2027 0 /usr/jails/jails/vnet1/dev 24 crw-rw-rw- null r root sendmail 2024 root - - ?(null) - root sendmail 2024 wd - - ?(null) - root sendmail 2024 jail - - ?(null) - root sendmail 2024 text - - ?(null) - root sendmail 2024 0 /usr/jails/jails/vnet1/dev 24 crw-rw-rw- null r root syslogd 1968 root - - ?(null) - root syslogd 1968 wd - - ?(null) - root syslogd 1968 jail - - ?(null) - root syslogd 1968 text - - ?(null) - root syslogd 1968 0 /usr/jails/jails/vnet1/dev 24 crw-rw-rw- null rw root syslogd 1968 6 /usr/jails/jails/vnet1/dev 24 crw-rw-rw- null rw root syslogd 1968 12 /usr/jails/jails/vnet1/dev 24 crw-rw-rw- null rw root csh 993 root / 2 drwxr-xr-x 1024 r root csh 993 wd / 240768 drwxr-xr-x 512 r root csh 993 text / 642060 -r-xr-xr-x 394744 r root csh 993 ctty /dev 60 crw------- ttyv0 rw root getty 888 root / 2 drwxr-xr-x 1024 r root getty 888 wd / 2 drwxr-xr-x 1024 r root getty 888 text / 963134 -r-xr-xr-x 31872 r root getty 888 ctty /dev 67 crw------- ttyv7 rw root getty 888 0 /dev 67 crw------- ttyv7 rw root getty 887 root / 2 drwxr-xr-x 1024 r root getty 887 wd / 2 drwxr-xr-x 1024 r root getty 887 text / 963134 -r-xr-xr-x 31872 r root getty 887 ctty /dev 66 crw------- ttyv6 rw root getty 887 0 /dev 66 crw------- ttyv6 rw root getty 886 root / 2 drwxr-xr-x 1024 r root getty 886 wd / 2 drwxr-xr-x 1024 r root getty 886 text / 963134 -r-xr-xr-x 31872 r root getty 886 ctty /dev 65 crw------- ttyv5 rw root getty 886 0 /dev 65 crw------- ttyv5 rw root getty 885 root / 2 drwxr-xr-x 1024 r root getty 885 wd / 2 drwxr-xr-x 1024 r root getty 885 text / 963134 -r-xr-xr-x 31872 r root getty 885 ctty /dev 64 crw------- ttyv4 rw root getty 885 0 /dev 64 crw------- ttyv4 rw root getty 884 root / 2 drwxr-xr-x 1024 r root getty 884 wd / 2 drwxr-xr-x 1024 r root getty 884 text / 963134 -r-xr-xr-x 31872 r root getty 884 ctty /dev 63 crw------- ttyv3 rw root getty 884 0 /dev 63 crw------- ttyv3 rw root getty 883 root / 2 drwxr-xr-x 1024 r root getty 883 wd / 2 drwxr-xr-x 1024 r root getty 883 text / 963134 -r-xr-xr-x 31872 r root getty 883 ctty /dev 62 crw------- ttyv2 rw root getty 883 0 /dev 62 crw------- ttyv2 rw root getty 882 root / 2 drwxr-xr-x 1024 r root getty 882 wd / 2 drwxr-xr-x 1024 r root getty 882 text / 963134 -r-xr-xr-x 31872 r root getty 882 ctty /dev 61 crw------- ttyv1 rw root getty 882 0 /dev 61 crw------- ttyv1 rw root login 881 root / 2 drwxr-xr-x 1024 r root login 881 wd / 240768 drwxr-xr-x 512 r root login 881 text / 964150 -r-sr-xr-x 26320 r root login 881 ctty /dev 60 crw------- ttyv0 rw root login 881 0 /dev 60 crw------- ttyv0 rw root cron 785 root / 2 drwxr-xr-x 1024 r root cron 785 wd / 2166929 drwxr-x--- 512 r root cron 785 text / 963688 -r-xr-xr-x 42168 r root cron 785 0 /dev 24 crw-rw-rw- null rw root cbsd 759 root / 2 drwxr-xr-x 1024 r root cbsd 759 wd / 2166914 dr-xr-xr-x 512 r root cbsd 759 text / 82112 -r-x------ 166008 r root cbsd 759 0 /dev 24 crw-rw-rw- null r root cbsd 759 6 /dev 24 crw-rw-rw- null w root cbsd 759 12 /dev 24 crw-rw-rw- null w root sshd 620 root / 2 drwxr-xr-x 1024 r root sshd 620 wd / 2 drwxr-xr-x 1024 r root sshd 620 text / 963756 -r-xr-xr-x 288496 r root sshd 620 0 /dev 24 crw-rw-rw- null rw root rsync 601 root / 2 drwxr-xr-x 1024 r root rsync 601 wd / 2 drwxr-xr-x 1024 r root rsync 601 text / 1148136 -rwxr-xr-x 457608 r root rsync 601 0 /dev 24 crw-rw-rw- null rw root syslogd 433 root / 2 drwxr-xr-x 1024 r root syslogd 433 wd / 2 drwxr-xr-x 1024 r root syslogd 433 text / 963743 -r-xr-xr-x 45280 r root syslogd 433 0 /dev 24 crw-rw-rw- null rw root syslogd 433 6 /dev 24 crw-rw-rw- null rw root syslogd 433 12 /dev 24 crw-rw-rw- null rw root syslogd 433 18 / 2168781 -rw------- 3 w root devd 360 root / 2 drwxr-xr-x 1024 r root devd 360 wd / 2 drwxr-xr-x 1024 r root devd 360 text / 321113 -r-xr-xr-x 1153312 r root devd 360 0 /dev 24 crw-rw-rw- null rw root devd 360 6 /dev 24 crw-rw-rw- null rw _dhcp dhclient 347 root / 2166914 dr-xr-xr-x 512 r _dhcp dhclient 347 wd / 2166914 dr-xr-xr-x 512 r _dhcp dhclient 347 jail / 2166914 dr-xr-xr-x 512 r _dhcp dhclient 347 text / 321030 -r-xr-xr-x 95992 r _dhcp dhclient 347 0 /dev 24 crw-rw-rw- null rw _dhcp dhclient 347 6 /dev 24 crw-rw-rw- null rw root dhclient 301 root / 2 drwxr-xr-x 1024 r root dhclient 301 wd / 2 drwxr-xr-x 1024 r root dhclient 301 text / 321030 -r-xr-xr-x 95992 r root dhclient 301 0 /dev 24 crw-rw-rw- null rw root dhclient 301 6 /dev 24 crw-rw-rw- null rw root init 1 root / 2 drwxr-xr-x 1024 r root init 1 wd / 2 drwxr-xr-x 1024 r root init 1 text / 321049 -r-xr-xr-x 1060912 r root kernel 0 root / 2 drwxr-xr-x 1024 r root kernel 0 wd / 2 drwxr-xr-x 1024 r ------------------------------------------------------------------------ dmesg Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-RC1 #0: Tue Aug 23 13:15:46 CEST 2016 root@freebsd:/usr/src/sys/amd64/compile/FREEBSD amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) VT(vga): text 80x25 CPU: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz (2992.36-MHz K8-class CPU) Origin="GenuineIntel" Id=0x1067a Family=0x6 Model=0x17 Stepping=10 Features=0x783fbff Features2=0x80209 AMD Features=0x20100800 AMD Features2=0x1 real memory = 536805376 (511 MB) avail memory = 476282880 (454 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: random: unblocking device. WARNING: VIMAGE (virtualized network stack) is a highly experimental feature. ioapic0 irqs 0-23 on motherboard random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff81058920, 0) error 19 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) cpu0: on acpi0 attimer0: port 0x40-0x43,0x50-0x53 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 1.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xd000-0xd00f at device 1.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 vgapci0: mem 0xe0000000-0xe0ffffff irq 18 at device 2.0 on pci0 vgapci0: Boot video device em0: port 0xd010-0xd017 mem 0xf0000000-0xf001ffff irq 19 at device 3.0 on pci0 em0: Ethernet address: 08:00:27:e6:70:93 em0: netmap queues/slots: TX 1/256, RX 1/256 pcm0: port 0xd100-0xd1ff,0xd200-0xd23f irq 21 at device 5.0 on pci0 pcm0: ohci0: mem 0xf0804000-0xf0804fff irq 22 at device 6.0 on pci0 usbus0 on ohci0 pci0: at device 7.0 (no driver attached) acpi_acad0: on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 orm0: at iomem 0xc0000-0xc7fff on isa0 vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atrtc0: at port 0x70 irq 8 on isa0 Event timer "RTC" frequency 32768 Hz quality 0 ppc0: cannot reserve I/O port range Timecounters tick every 1.000 msec ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to accept, logging disabled nvme cam probe device init pcm0: measured ac97 link rate at 28664 Hz em0: link state changed to UP usbus0: 12Mbps Full Speed USB v1.0 ugen0.1: at usbus0 uhub0: on usbus0 cd0 at ata1 bus 0 scbus1 target 0 lun 0 cd0: Removable CD-ROM SCSI device cd0: Serial Number VB2-01700376 cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present ada0 at ata0 bus 0 scbus0 target 0 lun 0 ada0: ATA-6 device ada0: Serial Number VB5698b0e9-56ddb43b ada0: 33.300MB/s transfers (UDMA2, PIO 65536bytes) ada0: 21505MB (44042240 512 byte sectors) taskqgroup_adjust failed cnt: 1 stride: 1 mp_ncpus: 1 smp_started: 0 Timecounter "TSC-low" frequency 1496178097 Hz quality 800 taskqgroup_adjust failed cnt: 1 stride: 1 mp_ncpus: 1 smp_started: 0 Trying to mount root from ufs:/dev/ada0p2 [rw]... uhub0: 12 ports with 12 removable, self powered Setting hostuuid: d537cf04-5eb9-4503-aeff-20169ba11207. Setting hostid: 0x80f91c18. Starting file system checks: /dev/ada0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0p2: clean, 3609747 free (1179 frags, 451071 blocks, 0.0% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Setting hostname: example.com. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Starting Network: lo0 em0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo em0: flags=8843 metric 0 mtu 1500 options=9b ether 08:00:27:e6:70:93 inet6 fe80::a00:27ff:fee6:7093%em0 prefixlen 64 scopeid 0x1 inet6 2001:1a68:9:1:a00:27ff:fee6:7093 prefixlen 64 autoconf nd6 options=23 media: Ethernet autoselect (1000baseT ) status: active Starting devd. Starting dhclient. DHCPREQUEST on em0 to 255.255.255.255 port 67 DHCPACK from 10.8.1.11 bound to 10.8.1.218 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. No core dumps found. Clearing /tmp. Updating motd:. Mounting late filesystems:. Starting cbsdrsyncd. Performing sanity check on sshd configuration. Starting sshd. Starting cbsdd. Configuring vt: blanktime. Starting cron. Starting background file system checks in 60 seconds. Tue Aug 23 17:08:06 CEST 2016 Aug 23 17:13:32 example login: ROOT LOGIN (root) ON ttyv0 bridge1: Ethernet address: 02:80:f9:1c:18:01 bridge1: link state changed to UP em0: promiscuous mode enabled epair1a: Ethernet address: 02:ff:90:00:04:0a epair1b: Ethernet address: 02:ff:e0:00:05:0b epair1a: link state changed to UP epair1b: link state changed to UP epair1a: promiscuous mode enabled epair1b: changing name to 'eth0' nd6_dad_timer: cancel DAD on eth0 because of ND6_IFF_IFDISABLED. Aug 23 17:14:52 example kernel: nd6_dad_timer: cancel DAD on eth0 because of ND6_IFF_IFDISABLED. Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x0 fault code = supervisor read instruction, page not present instruction pointer = 0x20:0x0 stack pointer = 0x28:0xfffffe002b475470 frame pointer = 0x28:0xfffffe002b4754a0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 12 (swi1: netisr 0) trap number = 12 panic: page fault cpuid = 0 KDB: stack backtrace: #0 0xffffffff80b24347 at kdb_backtrace+0x67 #1 0xffffffff80adb8b2 at vpanic+0x182 #2 0xffffffff80adb723 at panic+0x43 #3 0xffffffff80fdcd31 at trap_fatal+0x351 #4 0xffffffff80fdcf23 at trap_pfault+0x1e3 #5 0xffffffff80fdc4cc at trap+0x26c #6 0xffffffff80fbfc71 at calltrap+0x8 #7 0xffffffff80d7f4d8 at ipfw_chk+0x3068 #8 0xffffffff80d85a4b at ipfw_check_packet+0xeb #9 0xffffffff80bfe943 at pfil_run_hooks+0x83 #10 0xffffffff80c6beff at ip_input+0x42f #11 0xffffffff80bfd8cf at netisr_dispatch_src+0xff #12 0xffffffff80be601a at ether_demux+0x13a #13 0xffffffff80be6d35 at ether_nh_input+0x345 #14 0xffffffff80bfd8cf at netisr_dispatch_src+0xff #15 0xffffffff80be62d4 at ether_input+0x54 #16 0xffffffff80bfe1bc at swi_net+0x1ac #17 0xffffffff80a9559f at intr_event_execute_handlers+0x20f Uptime: 8m11s Dumping 89 out of 479 MB:..18%..36%..54%..72%..90% ------------------------------------------------------------------------ kernel config options CONFIG_AUTOGENERATED ident GENERIC machine amd64 cpu HAMMER makeoptions WITH_CTF=1 makeoptions DEBUG=-g options IPFIREWALL_DEFAULT_TO_ACCEPT options IPFIREWALL_VERBOSE_LIMIT=100 options IPFIREWALL_VERBOSE options IPFIREWALL options VIMAGE options XENHVM options USB_DEBUG options ATH_ENABLE_11N options AH_AR5416_INTERRUPT_MITIGATION options AH_SUPPORT_AR5416 options IEEE80211_SUPPORT_MESH options IEEE80211_AMPDU_AGE options IEEE80211_DEBUG options SC_PIXEL_MODE options VESA options AHD_REG_PRETTY_PRINT options AHC_REG_PRETTY_PRINT options PCI_IOV options PCI_HP options ACPI_DMAR options DEVICE_NUMA options SMP options KDB_TRACE options KDB options RCTL options RACCT_DEFAULT_TO_DISABLED options RACCT options INCLUDE_CONFIG_FILE options DDB_CTF options KDTRACE_HOOKS options KDTRACE_FRAME options MAC options CAPABILITIES options CAPABILITY_MODE options AUDIT options HWPMC_HOOKS options KBD_INSTALL_CDEV options PRINTF_BUFR_SIZE=128 options _KPOSIX_PRIORITY_SCHEDULING options SYSVSEM options SYSVMSG options SYSVSHM options STACK options KTRACE options SCSI_DELAY=5000 options COMPAT_FREEBSD10 options COMPAT_FREEBSD9 options COMPAT_FREEBSD7 options COMPAT_FREEBSD6 options COMPAT_FREEBSD5 options COMPAT_FREEBSD4 options COMPAT_FREEBSD32 options GEOM_LABEL options GEOM_RAID options GEOM_PART_GPT options PSEUDOFS options PROCFS options CD9660 options MSDOSFS options NFS_ROOT options NFSLOCKD options NFSD options NFSCL options MD_ROOT options QUOTA options UFS_GJOURNAL options UFS_DIRHASH options UFS_ACL options SOFTUPDATES options FFS options SCTP options TCP_OFFLOAD options IPSEC options INET6 options INET options PREEMPTION options SCHED_ULE options NEW_PCIB options GEOM_PART_MBR options GEOM_PART_EBR_COMPAT options GEOM_PART_EBR options GEOM_PART_BSD device isa device mem device io device uart_ns8250 device cpufreq device acpi device pci device fdc device ahci device ata device mvs device siis device ahc device ahd device esp device hptiop device isp device mpt device mps device mpr device sym device trm device adv device adw device aic device bt device isci device scbus device ch device da device sa device cd device pass device ses device amr device arcmsr device ciss device dpt device hptmv device hptnr device hptrr device hpt27xx device iir device ips device mly device twa device tws device aac device aacp device aacraid device ida device mfi device mlx device mrsas device pmspcv device twe device nvme device nvd device atkbdc device atkbd device psm device kbdmux device vga device splash device sc device vt device vt_vga device vt_efifb device agp device cbb device pccard device cardbus device uart device ppc device ppbus device lpt device ppi device puc device bxe device de device em device igb device ix device ixv device ixl device ixlv device le device ti device txp device vx device miibus device ae device age device alc device ale device bce device bfe device bge device cas device dc device et device fxp device gem device hme device jme device lge device msk device nfe device nge device pcn device re device rl device sf device sge device sis device sk device ste device stge device tl device tx device vge device vr device wb device xl device wlan device wlan_wep device wlan_ccmp device wlan_tkip device wlan_amrr device an device ath device ath_pci device ath_hal device ath_rate_sample device ipw device iwi device iwn device malo device mwl device ral device wi device wpi device loop device random device padlock_rng device rdrand_rng device ether device vlan device tun device md device gif device firmware device bpf device uhci device ohci device ehci device xhci device usb device ukbd device umass device sound device snd_cmi device snd_csa device snd_emu10kx device snd_es137x device snd_hda device snd_ich device snd_via8233 device mmc device mmcsd device sdhci device virtio device virtio_pci device vtnet device virtio_blk device virtio_scsi device virtio_balloon device hyperv device xenpci device vmx device netmap device crypto device carp ------------------------------------------------------------------------ ddb capture buffer ddb: ddb_capture: kvm_nlist