Attachment 182770 Details for Bug 219356 – Core.txt file from FreeBSD 12 (r318563).

Core.txt file from FreeBSD 12 (r318563).

core.txt.2 (text/plain), 82.36 KB, created by lab on 2017-05-21 05:53:09 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: lab

Created: 2017-05-21 05:53:09 UTC

Size: 82.36 KB

patch

obsolete

>phoenix.gta.com dumped core - see /var/crash/vmcore.2
>
>Sun May 21 01:32:17 EDT 2017
>
>FreeBSD phoenix.gta.com 12.0-CURRENT FreeBSD 12.0-CURRENT #1 r318563: Sat May 20 15:02:15 EDT 2017     lab@phoenix.gta.com:/usr/obj/usr/src/sys/GENERIC  amd64
>
>panic: attempt to free non DEAD SA 0xfffff8000367a700
>
>GNU gdb 6.1.1 [FreeBSD]
>Copyright 2004 Free Software Foundation, Inc.
>GDB is free software, covered by the GNU General Public License, and you are
>welcome to change it and/or distribute copies of it under certain conditions.
>Type "show copying" to see the conditions.
>There is absolutely no warranty for GDB.  Type "show warranty" for details.
>This GDB was configured as "amd64-marcel-freebsd"...
>
>Unread portion of the kernel message buffer:
>
>esp_input_cb: crypto error 89
>panic: attempt to free non DEAD SA 0xfffff8000367a700
>cpuid = 0
>time = 1495344697
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe003c977510
>vpanic() at vpanic+0x19c/frame 0xfffffe003c977590
>kassert_panic() at kassert_panic+0x126/frame 0xfffffe003c977600
>key_freesav() at key_freesav+0x13e/frame 0xfffffe003c977630
>ipsec_common_input() at ipsec_common_input+0x3e4/frame 0xfffffe003c9776e0
>ipsec4_input() at ipsec4_input+0x39/frame 0xfffffe003c977700
>ip_input() at ip_input+0xed/frame 0xfffffe003c977760
>netisr_dispatch_src() at netisr_dispatch_src+0x80/frame 0xfffffe003c9777c0
>ether_demux() at ether_demux+0x15e/frame 0xfffffe003c9777f0
>ether_nh_input() at ether_nh_input+0x30f/frame 0xfffffe003c977830
>netisr_dispatch_src() at netisr_dispatch_src+0x80/frame 0xfffffe003c977890
>ether_input() at ether_input+0x62/frame 0xfffffe003c9778c0
>vtnet_rxq_eof() at vtnet_rxq_eof+0x6ec/frame 0xfffffe003c977970
>vtnet_rx_vq_intr() at vtnet_rx_vq_intr+0x4e/frame 0xfffffe003c9779a0
>vtpci_legacy_intr() at vtpci_legacy_intr+0xb0/frame 0xfffffe003c9779e0
>intr_event_execute_handlers() at intr_event_execute_handlers+0x99/frame 0xfffffe003c977a20
>ithread_loop() at ithread_loop+0xb6/frame 0xfffffe003c977a70
>fork_exit() at fork_exit+0x84/frame 0xfffffe003c977ab0
>fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003c977ab0
>--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
>KDB: enter: panic
>Uptime: 2m50s
>Dumping 118 out of 990 MB:..14%..28%..41%..55%..68%..82%..95%
>
>Reading symbols from /boot/kernel/aesni.ko...Reading symbols from /usr/lib/debug//boot/kernel/aesni.ko.debug...done.
>done.
>Loaded symbols for /boot/kernel/aesni.ko
>#0  doadump (textdump=1) at pcpu.h:232
>232	pcpu.h: No such file or directory.
>	in pcpu.h
>(kgdb) #0  doadump (textdump=1) at pcpu.h:232
>#1  0xffffffff80a547d5 in kern_reboot (howto=260)
>    at /usr/src/sys/kern/kern_shutdown.c:386
>#2  0xffffffff80a54dc6 in vpanic (fmt=<value optimized out>, 
>    ap=<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:779
>#3  0xffffffff80a54be6 in kassert_panic (fmt=<value optimized out>)
>    at /usr/src/sys/kern/kern_shutdown.c:669
>#4  0xffffffff80c97e3e in key_freesav (psav=0xfffffe003c977648)
>    at /usr/src/sys/netipsec/key.c:2969
>#5  0xffffffff80c910d4 in ipsec_common_input ()
>    at /usr/src/sys/netipsec/ipsec_input.c:227
>#6  0xffffffff80c90ca9 in ipsec4_input (m=0xfffff8001f6d1800, 
>    offset=<value optimized out>, proto=<value optimized out>)
>    at /usr/src/sys/netipsec/ipsec_input.c:249
>#7  0xffffffff80bcd77d in ip_input (m=<value optimized out>)
>    at /usr/src/sys/netinet/ip_input.c:813
>#8  0xffffffff80b668e0 in netisr_dispatch_src (proto=1, source=0, 
>    m=0xfffff8001f6d1800) at /usr/src/sys/net/netisr.c:1120
>#9  0xffffffff80b4ddfe in ether_demux (ifp=0xfffff800038f3000, 
>    m=<value optimized out>) at /usr/src/sys/net/if_ethersubr.c:848
>#10 0xffffffff80b4ec0f in ether_nh_input (m=<value optimized out>)
>    at /usr/src/sys/net/if_ethersubr.c:637
>#11 0xffffffff80b668e0 in netisr_dispatch_src (proto=5, source=0, 
>    m=0xfffff8001f6d1800) at /usr/src/sys/net/netisr.c:1120
>#12 0xffffffff80b4e192 in ether_input (ifp=0xfffff800038f3000, m=0x0)
>    at /usr/src/sys/net/if_ethersubr.c:757
>#13 0xffffffff808c7b9c in vtnet_rxq_eof (rxq=<value optimized out>)
>    at /usr/src/sys/dev/virtio/network/if_vtnet.c:1745
>#14 0xffffffff808c8a0e in vtnet_rx_vq_intr (xrxq=0xfffff8000367fd00)
>    at /usr/src/sys/dev/virtio/network/if_vtnet.c:1876
>#15 0xffffffff808c4d50 in vtpci_legacy_intr (xsc=0xfffff80003811980)
>    at /usr/src/sys/dev/virtio/pci/virtio_pci.c:1258
>#16 0xffffffff80a19379 in intr_event_execute_handlers (
>    p=<value optimized out>, ie=0xfffff80003681e00)
>    at /usr/src/sys/kern/kern_intr.c:1336
>#17 0xffffffff80a19a16 in ithread_loop (arg=0xfffff80003563a40)
>    at /usr/src/sys/kern/kern_intr.c:1349
>#18 0xffffffff80a167b4 in fork_exit (
>    callout=0xffffffff80a19960 <ithread_loop>, arg=0xfffff80003563a40, 
>    frame=0xfffffe003c977ac0) at /usr/src/sys/kern/kern_fork.c:1038
>#19 0xffffffff80ebbe6e in fork_trampoline ()
>    at /usr/src/sys/amd64/amd64/exception.S:611
>#20 0x0000000000000000 in ?? ()
>Current language:  auto; currently minimal
>(kgdb) 
>
>------------------------------------------------------------------------
>ps -axlww
>
> UID PID PPID CPU PRI NI    VSZ   RSS MWCHAN   STAT TT     TIME COMMAND
>   0   0    0   0 -16  0      0     0 swapin   DLs   -  0:00.00 [kernel]
>   0   1    0   0  20  0   5444  1004 wait     DLs   -  0:00.01 [init]
>   0   2    0   0 -16  0      0     0 crypto_w DL    -  0:00.00 [crypto]
>   0   3    0   0 -16  0      0     0 crypto_r DL    -  0:00.00 [crypto returns]
>   0   4    0   0 -16  0      0     0 -        RL    -  0:00.04 [cam]
>   0   5    0   0 -16  0      0     0 -        DL    -  0:00.00 [soaiod1]
>   0   6    0   0 -16  0      0     0 -        DL    -  0:00.00 [soaiod2]
>   0   7    0   0 -16  0      0     0 -        DL    -  0:00.00 [soaiod3]
>   0   8    0   0 -16  0      0     0 -        DL    -  0:00.00 [soaiod4]
>   0   9    0   0 -16  0      0     0 waiting_ DL    -  0:00.00 [sctp_iterator]
>   0  10    0   0 -16  0      0     0 audit_wo DL    -  0:00.00 [audit]
>   0  11    0   0 155  0      0     0 -        RL    -  0:07.06 [idle]
>   0  12    0   0 -64  0      0     0 -        WL    -  0:00.42 [intr]
>   0  13    0   0  -8  0      0     0 -        DL    -  0:00.03 [geom]
>   0  14    0   0 -68  0      0     0 -        DL    -  0:00.00 [usb]
>   0  15    0   0 -16  0      0     0 -        DL    -  0:00.00 [rand_harvestq]
>   0  16    0   0 -16  0      0     0 psleep   DL    -  0:00.00 [pagedaemon]
>   0  17    0   0 -16  0      0     0 psleep   DL    -  0:00.00 [vmdaemon]
>   0  18    0   0 -16  0      0     0 psleep   DL    -  0:00.00 [bufdaemon]
>   0  19    0   0 -16  0      0     0 -        DL    -  0:00.00 [bufspacedaemon]
>   0  20    0   0  16  0      0     0 syncer   DL    -  0:00.00 [syncer]
>   0  21    0   0 -16  0      0     0 vlruwt   DL    -  0:00.00 [vnlru]
>   0 405    1   0  20  0   9608  5408 select   Ds    -  0:00.00 [devd]
>   0 484    1   0  20  0  10540  2628 select   Ds    -  0:00.01 [syslogd]
>   0 611    1   0  52  0  24292  3508 select   Ds    -  0:00.00 [starter]
>   0 612  611   0  52  0 142596  9232 sigwait  Ds    -  0:00.04 [charon]
>   0 649    1   0  20  0  20608 12504 select   Ds    -  0:00.02 [ntpd]
>   0 681    1   0  20  0  57840  7760 select   Ds    -  0:00.00 [sshd]
>   0 684    1   0  20  0  20676  6860 select   Ds    -  0:00.01 [sendmail]
>  25 687    1   0  52  0  20676  6628 pause    Ds    -  0:00.00 [sendmail]
>   0 691    1   0  20  0  12632  2840 nanslp   Ds    -  0:00.00 [cron]
>   0 738    1   0  52  0  10524  2300 ttyin    Ds+   -  0:00.00 [getty]
>   0 739    1   0  52  0  10524  2300 ttyin    Ds+   -  0:00.01 [getty]
>   0 740    1   0  52  0  10524  2300 ttyin    Ds+   -  0:00.00 [getty]
>   0 741    1   0  52  0  10524  2300 ttyin    Ds+   -  0:00.01 [getty]
>   0 742    1   0  52  0  10524  2300 ttyin    Ds+   -  0:00.00 [getty]
>   0 743    1   0  52  0  10524  2300 ttyin    Ds+   -  0:00.00 [getty]
>   0 744    1   0  52  0  10524  2300 ttyin    Ds+   -  0:00.00 [getty]
>   0 745    1   0  52  0  10524  2300 ttyin    Ds+   -  0:00.00 [getty]
>   0 746  681   0  21  0  82696  8412 select   Ds    -  0:00.00 [sshd]
>1001 750  746   0  20  0  82696  8660 select   D     -  0:00.00 [sshd]
>1001 751  750   0  48  0  13220  3488 wait     Ds    -  0:00.00 [sh]
>   0 758  751   0  22  0  43780  3300 wait     D     -  0:00.00 [su]
>   0 759  758   0  20  0  13220  3520 ttyin    D+    -  0:00.01 [sh]
>
>------------------------------------------------------------------------
>vmstat -s
>
>    70670 cpu context switches
>     3626 device interrupts
>    22607 software interrupts
>   125569 traps
>   373497 system calls
>       21 kernel threads created
>      562  fork() calls
>      197 vfork() calls
>        0 rfork() calls
>        0 swap pager pageins
>        0 swap pager pages paged in
>        0 swap pager pageouts
>        0 swap pager pages paged out
>      594 vnode pager pageins
>     3247 vnode pager pages paged in
>        0 vnode pager pageouts
>        0 vnode pager pages paged out
>        0 page daemon wakeups
>        0 pages examined by the page daemon
>        0 clean page reclamation shortfalls
>        0 pages reactivated by the page daemon
>    25253 copy-on-write faults
>      141 copy-on-write optimized faults
>    40204 zero fill pages zeroed
>        0 zero fill pages prezeroed
>        0 intransit blocking page faults
>    75637 total VM faults taken
>      504 page faults requiring I/O
>        0 pages affected by kernel thread creation
>    20707 pages affected by  fork()
>     6890 pages affected by vfork()
>        0 pages affected by rfork()
>    93464 pages freed
>        0 pages freed by daemon
>        0 pages freed by exiting processes
>        0 pages active
>        0 pages inactive
>        0 pages in the laundry queue
>        0 pages wired down
>        0 pages free
>        0 bytes per page
>        0 total name lookups
>          cache hits (0% pos + 0% neg) system 0% per-directory
>          deletions 0%, falsehits 0%, toolong 0%
>
>------------------------------------------------------------------------
>vmstat -m
>
>         Type InUse MemUse HighUse Requests  Size(s)
>         ac97     2     1K       -        2  16,512
>       feeder    12     1K       -       14  32,128
>        mixer     1     4K       -        1  4096
>      ata_pci     1     1K       -        1  64
>          USB    12    10K       -       12  16,128,512,4096
>       USBdev    10     2K       -       10  32,64,128,512
>  ddb_capture     1    64K       -        1  65536
>     acpiintr     1     1K       -        1  64
>        vtbuf    24  1968K       -       46  4096
>           vt    11     6K       -       11  512
>       DEVFS3    95    24K       -      114  256
>       DEVFS1    75    38K       -       84  512
>   DEVFS_RULE    55    26K       -       55  64,512
>        DEVFS    12     1K       -       13  16,128
>NFSD V4client     1     1K       -        1  256
> NFSD lckfile     1     1K       -        1  256
> NFSD session     1     1K       -        1  1024
>    pfs_nodes    20     5K       -       20  256
>         GEOM    58    11K       -      679  16,32,64,128,256,512,1024,2048,8192,16384
>    raid_data     0     0K       -       96  32,128,256
>       isadev     8     1K       -        8  128
>       acpica  2162   240K       -    30979  16,32,64,128,256,1024,4096
>     acpitask     1    64K       -        1  65536
>      acpisem    18     3K       -       18  128
>         cdev     4     1K       -        4  256
>     filedesc     3    12K       -        3  4096
>        sigio     0     0K       -        1  64
>     filecaps     0     0K       -       51  16,64
>      kdtrace   156    31K       -     1630  64,256
>         kenv   110    12K       -      113  16,32,64,128,8192
>       kqueue    44     3K       -      781  64
>    proc-args    38     2K       -      413  16,32,64,128
>        hhook    13     4K       -       13  256
>      ithread    66    11K       -       66  32,128,256
>       KTRACE   100    13K       -      100  128
>      acpidev    28     2K       -       28  64
>       linker   166    12K       -      169  16,32,64,128,512
>      CAM SIM     3     1K       -        3  256
>        lockf    17     2K       -       33  64,128
>   loginclass     3     1K       -        3  64
>       devbuf   785  1069K       -      859  16,32,64,128,256,512,1024,2048,4096,8192,16384,65536
>         temp    18    17K       -     1018  16,32,64,128,256,512,1024,2048,16384,65536
>      CAM XPT    22     2K       -       88  32,64,128,256,512,1024,2048,65536
>      CAM DEV     5    10K       -       10  2048
>      CAM CCB     0     0K       -     1734  2048
>       module   496    62K       -      497  128
>     mtx_pool     2    16K       -        2  8192
>          osd     3     1K       -        9  16,32,64,128,256
>     pmchooks     1     1K       -        1  128
>         pgrp    22     3K       -       36  128
>      session    20     3K       -       23  128
>         proc     2    16K       -        2  8192
>      subproc   108   208K       -      845  512,4096
>         cred    30     8K       -      240  256
>     CAM path     7     1K       -       43  32
>   CAM periph     6     2K       -       86  16,32,64,128,256
>       kbdmux     6    22K       -        6  16,512,1024,2048,16384
>       plimit    19     5K       -      322  256
>      uidinfo     5     3K       -        8  128,2048
>       dumper     1     1K       -        1  512
>       sysctl     0     0K       -      531  16,32,64
>    sysctloid  2358   122K       -     2404  16,32,64,128
>    sysctltmp     0     0K       -       62  16,32,64,256,1024
>      tidhash     1    16K       -        1  16384
>      callout     3  1672K       -        3  
>         umtx   270    34K       -      270  128
>     p1003.1b     1     1K       -        1  16
>         SWAP     2   549K       -        2  64
>          bus  1051    87K       -     3669  16,32,64,128,256,1024
>       bus-sc    39   100K       -     1893  16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536
>      devstat     6    13K       -        6  32,4096
> eventhandler   115    10K       -      115  64,128
>    taskqueue    18    26K       -       18  16,32,256,8192
>         kobj   346  1384K       -      544  4096
>      Per-cpu     1     1K       -        1  32
>         rman    97    12K       -      416  16,32,128
>         sbuf     0     0K       -      841  16,32,64,128,256,512,1024,2048,4096,8192,32768
>       sglist     6     7K       -        6  32,2048
>    toponodes    10     2K       -       10  128
>    taskqueue    42     5K       -       42  16,32,256
>     terminal    11     3K       -       11  256
>       Unitno    23     2K       -      207  32,64
>         vmem     3     8K       -        3  2048,4096
>      Witness  1539  3282K       -     1539  2048,16384
>     ioctlops     0     0K       -       93  256,512,1024
>       select    14     2K       -       14  128
>          iov     0     0K       -    17959  16,64,128,256,512
>          msg     4    30K       -        4  2048,4096,8192,16384
>          sem     4   106K       -        4  2048,4096
>          shm     1    32K       -        1  32768
>          tty    13    13K       -       13  1024
>          pts     1     1K       -        1  256
>     mbuf_tag     7     1K       -    98364  32,64
>        shmfd     1     8K       -        1  8192
>       soname     7     1K       -     8116  16,32,128
>          pcb    24   279K       -       81  16,32,64,128,1024,2048,8192,65536
>     vfscache     4   553K       -        4  512,8192,32768
>     vfs_hash     1   256K       -        1  
>       vnodes     1     1K       -        1  256
>        mount    16     1K       -       86  16,32,64,128,256
>       statfs     0     0K       -      104  512
>  vnodemarker     0     0K       -       21  512
>chacha20random     1     1K       -        1  512
>          BPF     4     1K       -        4  128
>        ifnet     5     9K       -        5  128,2048
>       ifaddr    47    15K       -       47  16,32,64,128,256,512,2048,4096
>  ether_multi    27     2K       -       27  16,32,64
>        clone     7     1K       -        7  128
>        ipsec     1     1K       -        1  256
>      lltable    24     8K       -       24  256,512
>     routetbl    32     4K       -       37  32,64,128,512
>         igmp     4     1K       -        4  128
>   in_mfilter     3     3K       -        3  1024
>     in_multi     4     1K       -        4  256
>  ip_moptions     6     1K       -        6  64,256
>encap_export_host     2     2K       -        2  1024
>    sctp_a_it     0     0K       -        5  16
>     sctp_vrf     1     1K       -        1  64
>     sctp_ifa     6     1K       -        6  128
>     sctp_ifn     4     1K       -        4  128
>    sctp_iter     0     0K       -        5  256
>    hostcache     1    32K       -        1  32768
>      tcpfunc     1     1K       -        1  32
>     syncache     1    68K       -        1  
>  in6_mfilter     1     1K       -        1  1024
>    in6_multi    15     2K       -       15  32,256
> ip6_moptions     2     1K       -        2  32,256
>       ip6opt     3     1K       -        3  256
>          mld     4     1K       -        4  128
>       ip6ndp     5     1K       -        5  64,256
>  inpcbpolicy    18     1K       -      177  32
>     secasvar     3     2K       -        4  256,1024
>       sahead     3     2K       -        4  256,1024
>  ipsecpolicy    12     4K       -       14  256,1024
> ipsecrequest     2     1K       -        4  128
>   ipsec-misc    13     1K       -       14  16,32,64
>    ipsec-saq     2     2K       -        2  1024
>    ipsec-reg     2     1K       -        2  32
>       crypto     1     1K       -        1  512
>        xform     0     0K       -    49177  64
>          rpc     2    16K       -        2  8192
>audit_evclass   230     8K       -      276  32
>      pagedep     1    64K       -       16  256,65536
>     inodedep     1   256K       -       69  512
>    bmsafemap     1     8K       -       41  256,8192
>       newblk     1   512K       -       27  256
>     freefrag     0     0K       -        1  128
>     freeblks     0     0K       -       18  256
>     freefile     0     0K       -       27  64
>       diradd     0     0K       -       36  128
>        mkdir     0     0K       -       12  128
>       dirrem     0     0K       -       30  128
>    newdirblk     0     0K       -        6  64
>     freework     1     1K       -       19  16,128
>      jaddref     0     0K       -       48  128
>      jremref     0     0K       -       42  128
>      jnewblk     0     0K       -       26  128
>    jfreefrag     0     0K       -        1  128
>         jseg     0     0K       -        9  128
>      jsegdep     0     0K       -      117  64
>        sbdep     0     0K       -        7  64
>     savedino     0     0K       -       18  256
>      jblocks     2     1K       -        2  128,256
>      softdep     1     1K       -        1  512
>  ufs_dirhash    33     7K       -       33  16,32,64,512
>    ufs_quota     1   256K       -        1  
>    ufs_mount     3    13K       -        3  512,4096,8192
>    vm_pgdata     2   129K       -        2  128
>      UMAHash     2     9K       -        6  512,1024,2048,4096,8192
>  fpukern_ctx     2     2K       -        2  1024
>     pci_link     8     1K       -        8  16,128
>     atkbddev     2     1K       -        2  64
>CAM I/O Scheduler     1     1K       -        1  128
>    CAM queue     8     3K       -       25  16,32,512
>      entropy     0     0K       -       12  4096
>      scsi_cd     0     0K       -        6  16
>       apmdev     1     1K       -        1  128
>   madt_table     0     0K       -        1  4096
>      io_apic     1     2K       -        1  2048
>CAM dev queue     3     1K       -        3  64
>          MCA     3     1K       -        3  32,128
>     nexusdev     6     1K       -        6  16
>   aesni_data     4     3K       -        4  16,256,1024
>
>------------------------------------------------------------------------
>vmstat -z
>
>ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP
>
>UMA Kegs:               384,      0,     204,       6,     204,   0,   0
>UMA Zones:              896,      0,     205,       3,     205,   0,   0
>UMA Slabs:              112,      0,    3078,       2,    3180,   0,   0
>UMA Hash:               256,      0,       8,       7,      10,   0,   0
>4 Bucket:                32,      0,      59,     561,    1011,   0,   0
>6 Bucket:                48,      0,       5,     576,      75,   0,   0
>8 Bucket:                64,      0,      26,     532,    1207,  11,   0
>12 Bucket:               96,      0,      10,     277,      55,   0,   0
>16 Bucket:              128,      0,      43,     236,     147,   0,   0
>32 Bucket:              256,      0,      37,     158,     163, 142,   0
>64 Bucket:              512,      0,      53,      10,     148, 142,   0
>128 Bucket:            1024,      0,      47,       5,     111,   0,   0
>256 Bucket:            2048,      0,      95,      15,   17519,   0,   0
>vmem btag:               56,      0,     933,     274,     933,   9,   0
>VM OBJECT:              240,      0,    1288,     184,    9490,   0,   0
>RADIX NODE:             144,      0,    1944,     162,   22987,   0,   0
>MAP:                    240,      0,       3,      61,       3,   0,   0
>KMAP ENTRY:             128,      0,       4,     151,       4,   0,   0
>MAP ENTRY:              128,      0,     926,     469,   22567,   0,   0
>VMSPACE:               2504,      0,      23,      10,     761,   0,   0
>fakepg:                 104,      0,       0,       0,       0,   0,   0
>mt_zone:              16400,      0,     408,       0,     408,   0,   0
>16:                      16,      0,      14,     733,      63,   0,   0
>16:                      16,      0,      27,     720,   12882,   0,   0
>16:                      16,      0,     214,     533,    1651,   0,   0
>16:                      16,      0,       2,     745,     961,   0,   0
>16:                      16,      0,      32,     715,      46,   0,   0
>16:                      16,      0,      49,     698,     383,   0,   0
>16:                      16,      0,      18,     480,      21,   0,   0
>16:                      16,      0,     780,     465,     873,   0,   0
>32:                      32,      0,      15,     605,      72,   0,   0
>32:                      32,      0,     271,     597,    2660,   0,   0
>32:                      32,      0,      68,     552,     955,   0,   0
>32:                      32,      0,      10,     610,     127,   0,   0
>32:                      32,      0,      94,     526,     339,   0,   0
>32:                      32,      0,      43,     577,     309,   0,   0
>32:                      32,      0,      87,     285,      87,   0,   0
>32:                      32,      0,     854,     510,     880,   0,   0
>64:                      64,      0,       7,     551,   49303,   0,   0
>64:                      64,      0,     627,     675,  117977,   0,   0
>64:                      64,      0,     480,     326,     953,   0,   0
>64:                      64,      0,      47,     511,     797,   0,   0
>64:                      64,      0,     277,     529,     316,   0,   0
>64:                      64,      0,      96,     462,    1284,   0,   0
>64:                      64,      0,      42,     268,      42,   0,   0
>64:                      64,      0,     152,     406,     183,   0,   0
>128:                    128,      0,       1,     154,       1,   0,   0
>128:                    128,      0,    1744,     147,   13000,   0,   0
>128:                    128,      0,     339,     188,     489,   0,   0
>128:                    128,      0,     125,     278,    7720,   0,   0
>128:                    128,      0,     392,     259,     481,   0,   0
>128:                    128,      0,     530,     245,    1103,   0,   0
>128:                    128,      0,      40,     239,     135,   0,   0
>128:                    128,      0,     610,     165,     704,   0,   0
>256:                    256,      0,      34,     101,     408,   0,   0
>256:                    256,      0,      32,     103,     787,   0,   0
>256:                    256,      0,      73,     122,     270,   0,   0
>256:                    256,      0,       9,     126,      98,   0,   0
>256:                    256,      0,     576,      39,     652,   0,   0
>256:                    256,      0,     186,     129,    1222,   0,   0
>256:                    256,      0,       2,     133,      46,   0,   0
>256:                    256,      0,      24,     111,     148,   0,   0
>512:                    512,      0,      14,      49,      44,   0,   0
>512:                    512,      0,      11,      52,      12,   0,   0
>512:                    512,      0,      10,      53,     513,   0,   0
>512:                    512,      0,      66,      25,     170,   0,   0
>512:                    512,      0,     159,      16,     170,   0,   0
>512:                    512,      0,      18,      73,      96,   0,   0
>512:                    512,      0,      11,      24,      11,   0,   0
>512:                    512,      0,       0,      35,     169,   0,   0
>1024:                  1024,      0,       4,      24,      13,   0,   0
>1024:                  1024,      0,       8,      20,     999,   0,   0
>1024:                  1024,      0,       2,      78,     318,   0,   0
>1024:                  1024,      0,       4,      24,       4,   0,   0
>1024:                  1024,      0,      30,      10,      56,   0,   0
>1024:                  1024,      0,       3,      25,     374,   0,   0
>1024:                  1024,      0,       0,       0,       0,   0,   0
>1024:                  1024,      0,       5,      23,      47,   0,   0
>2048:                  2048,      0,       1,       9,       2,   0,   0
>2048:                  2048,      0,       5,       5,       5,   0,   0
>2048:                  2048,      0,       2,      18,    1794,   0,   0
>2048:                  2048,      0,    1544,       6,    1544,   0,   0
>2048:                  2048,      0,       6,       4,       9,   0,   0
>2048:                  2048,      0,       3,       7,       8,   0,   0
>2048:                  2048,      0,       5,       5,      10,   0,   0
>2048:                  2048,      0,       1,       9,      27,   0,   0
>4096:                  4096,      0,       0,       1,       1,   0,   0
>4096:                  4096,      0,       2,       3,      14,   0,   0
>4096:                  4096,      0,     346,       3,     662,   0,   0
>4096:                  4096,      0,      49,       5,     786,   0,   0
>4096:                  4096,      0,      15,       0,      16,   0,   0
>4096:                  4096,      0,       6,       1,      11,   0,   0
>4096:                  4096,      0,      12,       1,      23,   0,   0
>4096:                  4096,      0,       0,       0,       0,   0,   0
>8192:                  8192,      0,       4,       0,       4,   0,   0
>8192:                  8192,      0,       0,       0,       0,   0,   0
>8192:                  8192,      0,       3,       0,     150,   0,   0
>8192:                  8192,      0,       1,       0,       1,   0,   0
>8192:                  8192,      0,       2,       0,       4,   0,   0
>8192:                  8192,      0,       6,       2,      10,   0,   0
>8192:                  8192,      0,       1,       0,       1,   0,   0
>8192:                  8192,      0,       4,       2,      68,   0,   0
>16384:                16384,      0,       1,       0,       1,   0,   0
>16384:                16384,      0,       0,       0,       0,   0,   0
>16384:                16384,      0,       1,       1,     236,   0,   0
>16384:                16384,      0,       2,       0,       2,   0,   0
>16384:                16384,      0,       8,       0,       8,   0,   0
>16384:                16384,      0,       2,       0,       2,   0,   0
>16384:                16384,      0,       0,       0,       0,   0,   0
>16384:                16384,      0,       0,       3,      12,   0,   0
>32768:                32768,      0,       1,       0,       1,   0,   0
>32768:                32768,      0,       0,       0,       0,   0,   0
>32768:                32768,      0,       0,       1,     171,   0,   0
>32768:                32768,      0,       2,       0,       2,   0,   0
>32768:                32768,      0,       0,       0,       0,   0,   0
>32768:                32768,      0,       0,       1,       1,   0,   0
>32768:                32768,      0,       0,       0,       0,   0,   0
>32768:                32768,      0,       0,       0,       0,   0,   0
>65536:                65536,      0,       3,       0,       3,   0,   0
>65536:                65536,      0,       0,       0,       0,   0,   0
>65536:                65536,      0,       1,       1,     130,   0,   0
>65536:                65536,      0,       1,       0,       1,   0,   0
>65536:                65536,      0,       4,       2,      12,   0,   0
>65536:                65536,      0,       0,       2,      68,   0,   0
>65536:                65536,      0,       0,       0,       0,   0,   0
>65536:                65536,      0,       0,       0,       0,   0,   0
>SLEEPQUEUE:              88,      0,     136,     143,     136,   0,   0
>64 pcpu:                  8,      0,    2639,     177,    2639,   0,   0
>Files:                   80,      0,      91,     203,    5736,   0,   0
>filedesc0:             1104,      0,      44,      28,     781,   0,   0
>rl_entry:                40,      0,      39,     555,      39,   0,   0
>TURNSTILE:              136,      0,     136,      64,     136,   0,   0
>umtx pi:                 96,      0,       0,       0,       0,   0,   0
>umtx_shm:                88,      0,       0,       0,       0,   0,   0
>MAC labels:              40,      0,       0,       0,       0,   0,   0
>PROC:                  1344,      0,      43,      20,     780,   0,   0
>THREAD:                1280,      0,     125,      10,     125,   0,   0
>cpuset:                  96,      0,      73,     214,      77,   0,   0
>audit_record:          1280,      0,       0,       0,       0,   0,   0
>mbuf_packet:            256, 395250,    2510,     526,  102346,   0,   0
>mbuf:                   256, 395250,       1,     758,   50336,   0,   0
>mbuf_cluster:          2048,  61756,    3036,       4,    3038,   0,   0
>mbuf_jumbo_page:       4096,  30877,       0,       3,       7,   0,   0
>mbuf_jumbo_9k:         9216,  27447,       0,       0,       0,   0,   0
>mbuf_jumbo_16k:       16384,  20584,       0,       0,       0,   0,   0
>DMAR_MAP_ENTRY:         120,      0,       0,       0,       0,   0,   0
>g_bio:                  384,      0,       0,     210,    5018,   0,   0
>ttyinq:                 160,      0,     180,      84,     315,   0,   0
>ttyoutq:                256,      0,      95,      40,     167,   0,   0
>nvme_request:           128,      0,       0,       0,       0,   0,   0
>cryptop:                 88,      0,       0,     270,   49177,   0,   0
>cryptodesc:              72,      0,       0,     275,   98354,   0,   0
>vtnet_tx_hdr:            24,      0,       6,     658,   49362,   0,   0
>FPU_save_area:          832,      0,       0,       0,       0,   0,   0
>VNODE:                  472,      0,     668,      28,     697,   0,   0
>VNODEPOLL:              120,      0,       0,       0,       0,   0,   0
>BUF TRIE:               144,      0,     158,    6862,     339,   0,   0
>S VFS Cache:            108,      0,     666,     104,    1568,   0,   0
>STS VFS Cache:          148,      0,       0,       0,       0,   0,   0
>L VFS Cache:            328,      0,       0,       0,       0,   0,   0
>LTS VFS Cache:          368,      0,       0,       0,       0,   0,   0
>NAMEI:                 1024,      0,       0,      40,   14894,   0,   0
>rentr:                   24,      0,       0,       0,       0,   0,   0
>NCLNODE:                528,      0,       0,       0,       0,   0,   0
>DIRHASH:               1024,      0,      41,      11,      41,   0,   0
>Mountpoints:            872,      0,       2,      26,       2,   0,   0
>AIO:                    224,      0,       0,       0,       0,   0,   0
>AIOP:                    32,      0,       0,       0,       0,   0,   0
>AIOCB:                  752,      0,       0,       0,       0,   0,   0
>AIOL:                   128,      0,       0,       0,       0,   0,   0
>AIOLIO:                 280,      0,       0,       0,       0,   0,   0
>pipe:                   760,      0,       4,      36,     300,   0,   0
>procdesc:               136,      0,       0,       0,       0,   0,   0
>ksiginfo:               112,      0,      44,    1006,     222,   0,   0
>itimer:                 352,      0,       0,       0,       0,   0,   0
>KNOTE:                  128,      0,       0,       0,       0,   0,   0
>socket:                 872,  31704,      39,      29,    1511,   0,   0
>ipq:                     56,   1988,    1735,     253,   50912,2198,   0
>udp_inpcb:              416,  31707,      14,      49,     168,   0,   0
>udpcb:                   32,  31744,      14,     606,     168,   0,   0
>tcp_inpcb:              416,  31707,       4,      59,       9,   0,   0
>tcpcb:                  872,  31704,       4,      24,       9,   0,   0
>tcptw:                   88,   6345,       0,       0,       0,   0,   0
>syncache:               168,  15364,       0,      69,       1,   0,   0
>hostcache:               96,  15375,       0,       0,       0,   0,   0
>sackhole:                32,      0,       0,       0,       0,   0,   0
>tcpreass:                40,   3861,       0,       0,       0,   0,   0
>sctp_ep:               1424,  31704,       0,       0,       0,   0,   0
>sctp_asoc:             2408,  40000,       0,       0,       0,   0,   0
>sctp_laddr:              48,  80012,       0,     581,       5,   0,   0
>sctp_raddr:             736,  80000,       0,       0,       0,   0,   0
>sctp_chunk:             152, 400010,       0,       0,       0,   0,   0
>sctp_readq:             152, 400010,       0,       0,       0,   0,   0
>sctp_stream_msg_out:    112, 400015,       0,       0,       0,   0,   0
>sctp_asconf:             40, 400059,       0,       0,       0,   0,   0
>sctp_asconf_ack:         48, 400060,       0,       0,       0,   0,   0
>udplite_inpcb:          416,  31707,       0,       0,       0,   0,   0
>ripcb:                  416,  31707,       0,       0,       0,   0,   0
>IPsec SA lft_c:          16,      0,       2,     510,       3,   0,   0
>unpcb:                  240,  31712,      17,     111,    1321,   0,   0
>rtentry:                208,      0,      17,     116,      21,   0,   0
>selfd:                   64,      0,      48,     510,    4888,   0,   0
>SWAPMETA:               288, 123513,       0,       0,       0,   0,   0
>FFS inode:              152,      0,     638,      38,     665,   0,   0
>FFS1 dinode:            128,      0,       0,       0,       0,   0,   0
>FFS2 dinode:            256,      0,     638,      37,     665,   0,   0
>
>
>------------------------------------------------------------------------
>vmstat -i
>
>interrupt                          total       rate
>irq1: atkbd0                           2          0
>irq14: ata0                         1571         83
>irq15: ata1                          135          7
>irq16: virtio_pci1                     6          0
>irq17: virtio_pci2                  1649         87
>irq19: virtio_pci0+                  263         14
>cpu0:timer                         13966        740
>cpu1:timer                         10299        546
>Total                              27891       1479
>
>------------------------------------------------------------------------
>pstat -T
>
> 91/31703 files
>0M/4095M swap space
>
>------------------------------------------------------------------------
>pstat -s
>
>Device          512-blocks     Used    Avail Capacity
>/dev/ada0p3        8388264        0  8388264     0%
>
>------------------------------------------------------------------------
>iostat
>
>       tty            ada0              cd0            pass0             cpu
> tin  tout  KB/t tps  MB/s   KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
>   0    42 17.46   9  0.16   0.00   0  0.00   0.00   0  0.00   0  0  2  3 95
>
>------------------------------------------------------------------------
>ipcs -a
>
>Message Queues:
>T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP                 CBYTES                 QNUM               QBYTES        LSPID        LRPID STIME    RTIME    CTIME   
>
>Shared Memory:
>T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP         NATTCH        SEGSZ         CPID         LPID ATIME    DTIME    CTIME   
>
>Semaphores:
>T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP          NSEMS OTIME    CTIME   
>
>
>------------------------------------------------------------------------
>ipcs -T
>
>msginfo:
>	msgmax:        16384	(max characters in a message)
>	msgmni:           40	(# of message queues)
>	msgmnb:         2048	(max characters in a message queue)
>	msgtql:           40	(max # of messages in system)
>	msgssz:            8	(size of a message segment)
>	msgseg:         2048	(# of message segments in system)
>
>shminfo:
>	shmmax:    536870912	(max shared memory segment size)
>	shmmin:            1	(min shared memory segment size)
>	shmmni:          192	(max number of shared memory identifiers)
>	shmseg:          128	(max shared memory segments per process)
>	shmall:       131072	(max amount of shared memory in pages)
>
>seminfo:
>	semmni:           50	(# of semaphore identifiers)
>	semmns:          340	(# of semaphores in system)
>	semmnu:          150	(# of undo structures in system)
>	semmsl:          340	(max # of semaphores per id)
>	semopm:          100	(max # of operations per semop call)
>	semume:           50	(max # of undo entries per process)
>	semusz:          632	(size in bytes of undo structure)
>	semvmx:        32767	(semaphore maximum value)
>	semaem:        16384	(adjust on exit max value)
>
>
>------------------------------------------------------------------------
>nfsstat
>
>Client Info:
>Rpc Counts:
>  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
>        0         0         0         0         0         0         0         0
>   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
>        0         0         0         0         0         0         0         0
>    Mknod    Fsstat    Fsinfo  PathConf    Commit
>        0         0         0         0         0
>Rpc Info:
> TimedOut   Invalid X Replies   Retries  Requests
>        0         0         0         0         0
>Cache Info:
>Attr Hits    Misses Lkup Hits    Misses BioR Hits    Misses BioW Hits    Misses
>        0         0         0         0         0         0         0         0
>BioRLHits    Misses BioD Hits    Misses DirE Hits    Misses Accs Hits    Misses
>        0         0         0         0         0         0         0         0
>
>Server Info:
>  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
>        0         0         0         0         0         0         0         0
>   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
>        0         0         0         0         0         0         0         0
>    Mknod    Fsstat    Fsinfo  PathConf    Commit
>        0         0         0         0         0
>Server Ret-Failed
>                0
>Server Faults
>            0
>Server Cache Stats:
>   Inprog      Idem  Non-idem    Misses
>        0         0         0         0
>Server Write Gathering:
> WriteOps  WriteRPC   Opsaved
>        0         0         0
>
>------------------------------------------------------------------------
>netstat -s
>
>tcp:
>	118 packets sent
>		113 data packets (9657 bytes)
>		0 data packets (0 bytes) retransmitted
>		0 data packets unnecessarily retransmitted
>		0 resends initiated by MTU discovery
>		5 ack-only packets (2 delayed)
>		0 URG only packets
>		0 window probe packets
>		0 window update packets
>		0 control packets
>	155 packets received
>		94 acks (for 9658 bytes)
>		0 duplicate acks
>		0 acks for unsent data
>		82 packets (5254 bytes) received in-sequence
>		0 completely duplicate packets (0 bytes)
>		0 old duplicate packets
>		0 packets with some dup. data (0 bytes duped)
>		0 out-of-order packets (0 bytes)
>		0 packets (0 bytes) of data after window
>		0 window probes
>		0 window update packets
>		0 packets received after close
>		0 discarded for bad checksums
>		0 discarded for bad header offset fields
>		0 discarded because packet too short
>		0 discarded due to memory problems
>	0 connection requests
>	1 connection accept
>	0 bad connection attempts
>	0 listen queue overflows
>	0 ignored RSTs in the windows
>	1 connection established (including accepts)
>		0 times used RTT from hostcache
>		0 times used RTT variance from hostcache
>		0 times used slow-start threshold from hostcache
>	5 connections closed (including 0 drops)
>		0 connections updated cached RTT on close
>		0 connections updated cached RTT variance on close
>		0 connections updated cached ssthresh on close
>	0 embryonic connections dropped
>	94 segments updated rtt (of 89 attempts)
>	0 retransmit timeouts
>		0 connections dropped by rexmit timeout
>	0 persist timeouts
>		0 connections dropped by persist timeout
>	0 Connections (fin_wait_2) dropped because of timeout
>	0 keepalive timeouts
>		0 keepalive probes sent
>		0 connections dropped by keepalive
>	52 correct ACK header predictions
>	56 correct data packet header predictions
>	1 syncache entry added
>		0 retransmitted
>		0 dupsyn
>		0 dropped
>		1 completed
>		0 bucket overflow
>		0 cache overflow
>		0 reset
>		0 stale
>		0 aborted
>		0 badack
>		0 unreach
>		0 zone failures
>	1 cookie sent
>	1 cookie received
>	0 hostcache entries added
>		0 bucket overflow
>	0 SACK recovery episodes
>	0 segment rexmits in SACK recovery episodes
>	0 byte rexmits in SACK recovery episodes
>	0 SACK options (SACK blocks) received
>	0 SACK options (SACK blocks) sent
>	0 SACK scoreboard overflow
>	0 packets with ECN CE bit set
>	0 packets with ECN ECT(0) bit set
>	0 packets with ECN ECT(1) bit set
>	0 successful ECN handshakes
>	0 times ECN reduced the congestion window
>	0 packets with matching signature received
>	0 packets with bad signature received
>	0 times failed to make signature due to no SA
>	0 times unexpected signature received
>	0 times no signature provided by segment
>TCP connection count by state:
>	0 connections in CLOSED state
>	3 connections in LISTEN state
>	0 connections in SYN_SENT state
>	0 connections in SYN_RCVD state
>	1 connection  in ESTABLISHED state
>	0 connections in CLOSE_WAIT state
>	0 connections in FIN_WAIT_1 state
>	0 connections in CLOSING state
>	0 connections in LAST_ACK state
>	0 connections in FIN_WAIT_2 state
>	0 connections in TIME_WAIT state
>udp:
>	91 datagrams received
>	0 with incomplete header
>	0 with bad data length field
>	0 with bad checksum
>	0 with no checksum
>	0 dropped due to no socket
>	16 broadcast/multicast datagrams undelivered
>	0 dropped due to full socket buffers
>	0 not for hashed pcb
>	75 delivered
>	75 datagrams output
>	0 times multicast source filter matched
>ip:
>	150610 total packets received
>	0 bad header checksums
>	0 with size smaller than minimum
>	0 with data size < data length
>	0 with ip length > max ip packet size
>	0 with header length < data size
>	0 with data length < header length
>	0 with bad options
>	0 with incorrect version number
>	101189 fragments received
>	1 fragment dropped (dup or out of space)
>	1099 fragments dropped after timeout
>	49177 packets reassembled ok
>	246 packets for this host
>	0 packets for unknown/unsupported protocol
>	49175 packets forwarded (0 packets fast forwarded)
>	0 packets not forwardable
>	0 packets received for unknown multicast group
>	0 redirects sent
>	193 packets sent from this host
>	0 packets sent with fabricated ip header
>	0 output packets dropped due to no bufs, etc.
>	0 output packets discarded due to no route
>	0 output datagrams fragmented
>	0 fragments created
>	0 datagrams that can't be fragmented
>	0 tunneling packets that can't find gif
>	0 datagrams with bad address in header
>icmp:
>	0 calls to icmp_error
>	0 errors not generated in response to an icmp message
>	0 messages with bad code fields
>	0 messages less than the minimum length
>	0 messages with bad checksum
>	0 messages with bad length
>	0 multicast echo requests ignored
>	0 multicast timestamp requests ignored
>	0 message responses generated
>	0 invalid return addresses
>	0 no return routes
>ipsec:
>	0 inbound packets violated process security policy
>	0 inbound packets failed due to insufficient memory
>	0 invalid inbound packets
>	0 outbound packets violated process security policy
>	0 outbound packets with no SA available
>	0 outbound packets failed due to insufficient memory
>	0 outbound packets with no route available
>	0 invalid outbound packets
>	0 outbound packets with bundled SAs
>	0 mbufs coalesced during clone
>	0 clusters coalesced during clone
>	0 clusters copied during clone
>	0 mbufs inserted during makespace
>ah:
>	0 packets shorter than header shows
>	0 packets dropped; protocol family not supported
>	0 packets dropped; no TDB
>	0 packets dropped; bad KCR
>	0 packets dropped; queue full
>	0 packets dropped; no transform
>	0 replay counter wraps
>	0 packets dropped; bad authentication detected
>	0 packets dropped; bad authentication length
>	0 possible replay packets detected
>	0 packets in
>	0 packets out
>	0 packets dropped; invalid TDB
>	0 bytes in
>	0 bytes out
>	0 packets dropped; larger than IP_MAXPACKET
>	0 packets blocked due to policy
>	0 crypto processing failures
>	0 tunnel sanity check failures
>	AH output histogram:
>		#13: 49176
>esp:
>	0 packets shorter than header shows
>	0 packets dropped; protocol family not supported
>	0 packets dropped; no TDB
>	0 packets dropped; bad KCR
>	0 packets dropped; queue full
>	1 packet dropped; no transform
>	0 packets dropped; bad ilen
>	0 replay counter wraps
>	0 packets dropped; bad encryption detected
>	0 packets dropped; bad authentication detected
>	0 possible replay packets detected
>	49177 packets in
>	0 packets out
>	0 packets dropped; invalid TDB
>	73765500 bytes in
>	0 bytes out
>	0 packets dropped; larger than IP_MAXPACKET
>	0 packets blocked due to policy
>	0 crypto processing failures
>	0 tunnel sanity check failures
>	ESP output histogram:
>		aes-gcm-16: 49176
>ipcomp:
>	0 packets shorter than header shows
>	0 packets dropped; protocol family not supported
>	0 packets dropped; no TDB
>	0 packets dropped; bad KCR
>	0 packets dropped; queue full
>	0 packets dropped; no transform
>	0 replay counter wraps
>	0 packets in
>	0 packets out
>	0 packets dropped; invalid TDB
>	0 bytes in
>	0 bytes out
>	0 packets dropped; larger than IP_MAXPACKET
>	0 packets blocked due to policy
>	0 crypto processing failures
>	0 packets sent uncompressed; size < compr. algo. threshold
>	0 packets sent uncompressed; compression was useless
>arp:
>	8 ARP requests sent
>	0 ARP replies sent
>	36 ARP requests received
>	5 ARP replies received
>	41 ARP packets received
>	14 total packets dropped due to no ARP entry
>	0 ARP entrys timed out
>	0 Duplicate IPs seen
>ip6:
>	0 total packets received
>	0 with size smaller than minimum
>	0 with data size < data length
>	0 with bad options
>	0 with incorrect version number
>	0 fragments received
>	0 fragments dropped (dup or out of space)
>	0 fragments dropped after timeout
>	0 fragments that exceeded limit
>	0 packets reassembled ok
>	0 packets for this host
>	0 packets forwarded
>	0 packets not forwardable
>	0 redirects sent
>	0 packets sent from this host
>	0 packets sent with fabricated ip header
>	0 output packets dropped due to no bufs, etc.
>	0 output packets discarded due to no route
>	0 output datagrams fragmented
>	0 fragments created
>	0 datagrams that can't be fragmented
>	0 packets that violated scope rules
>	0 multicast packets which we don't join
>	Mbuf statistics:
>		0 one mbuf
>		0 one ext mbuf
>		0 two or more ext mbuf
>	0 packets whose headers are not contiguous
>	0 tunneling packets that can't find gif
>	0 packets discarded because of too many headers
>	1 failure of source address selection
>	source addresses on a non-outgoing I/F
>		1 addresses scope=0xf
>	Source addresses selection rule applied:
>		1 same address
>icmp6:
>	0 calls to icmp6_error
>	0 errors not generated in response to an icmp6 message
>	0 errors not generated because of rate limitation
>	0 messages with bad code fields
>	0 messages < minimum length
>	0 bad checksums
>	0 messages with bad length
>	Histogram of error messages to be generated:
>		0 no route
>		0 administratively prohibited
>		0 beyond scope
>		0 address unreachable
>		0 port unreachable
>		0 packet too big
>		0 time exceed transit
>		0 time exceed reassembly
>		0 erroneous header field
>		0 unrecognized next header
>		0 unrecognized option
>		0 redirect
>		0 unknown
>	0 message responses generated
>	0 messages with too many ND options
>	0 messages with bad ND options
>	0 bad neighbor solicitation messages
>	0 bad neighbor advertisement messages
>	0 bad router solicitation messages
>	0 bad router advertisement messages
>	0 bad redirect messages
>	0 path MTU changes
>ipsec6:
>	0 inbound packets violated process security policy
>	0 inbound packets failed due to insufficient memory
>	0 invalid inbound packets
>	0 outbound packets violated process security policy
>	0 outbound packets with no SA available
>	0 outbound packets failed due to insufficient memory
>	0 outbound packets with no route available
>	0 invalid outbound packets
>	0 outbound packets with bundled SAs
>	0 mbufs coalesced during clone
>	0 clusters coalesced during clone
>	0 clusters copied during clone
>	0 mbufs inserted during makespace
>rip6:
>	0 messages received
>	0 checksum calculations on inbound
>	0 messages with bad checksum
>	0 messages dropped due to no socket
>	0 multicast messages dropped due to no socket
>	0 messages dropped due to full socket buffers
>	0 delivered
>	0 datagrams output
>pfkey:
>	14 requests sent from userland
>	1536 bytes sent from userland
>	histogram by message type:
>		getspi: 1
>		add: 2
>		delete: 1
>		register: 2
>		x_spdupdate: 2
>		x_spdadd: 2
>		x_spdget: 4
>	0 messages with invalid length field
>	0 messages with invalid version field
>	0 messages with invalid message type field
>	0 messages too short
>	0 messages with memory allocation failure
>	0 messages with duplicate extension
>	0 messages with invalid extension type
>	0 messages with invalid sa type
>	0 messages with invalid address extension
>	14 requests sent to userland
>	2240 bytes sent to userland
>	histogram by message type:
>		getspi: 1
>		add: 2
>		delete: 1
>		register: 2
>		x_spdupdate: 2
>		x_spdadd: 2
>		x_spdget: 4
>	5 messages toward single socket
>	7 messages toward all sockets
>	2 messages toward registered sockets
>	0 messages with memory allocation failure
>
>------------------------------------------------------------------------
>netstat -m
>
>2511/1284/3795 mbufs in use (current/cache/total)
>2510/530/3040/61756 mbuf clusters in use (current/cache/total/max)
>2510/526 mbuf+clusters out of packet secondary zone in use (current/cache)
>0/3/3/30877 4k (page size) jumbo clusters in use (current/cache/total/max)
>0/0/0/27447 9k jumbo clusters in use (current/cache/total/max)
>0/0/0/20584 16k jumbo clusters in use (current/cache/total/max)
>5648K/1393K/7041K bytes allocated to network (current/cache/total)
>0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
>0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
>0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
>0/0/0 requests for jumbo clusters denied (4k/9k/16k)
>0 sendfile syscalls
>0 sendfile syscalls completed without I/O request
>0 requests for I/O initiated by sendfile
>0 pages read by sendfile as part of a request
>0 pages were valid at time of a sendfile request
>0 pages were valid and substituted to bogus page
>0 pages were requested for read ahead by applications
>0 pages were read ahead by sendfile
>0 times sendfile encountered an already busy page
>0 requests for sfbufs denied
>0 requests for sfbufs delayed
>
>------------------------------------------------------------------------
>netstat -anA
>
>Active Internet connections (including servers)
>Tcpcb            Proto Recv-Q Send-Q Local Address      Foreign Address    (state)
>fffff80003f75000 udp4       0      0 *.514              *.*                
>fffff80003f751a0 udp6       0      0 *.514              *.*                
>Active UNIX domain sockets
>Address          Type   Recv-Q Send-Q            Inode             Conn             Refs          Nextref Addr
>fffff8001f262e10 stream      0      0                0 fffff8001f263000                0                0
>fffff8001f263000 stream      0      0                0 fffff8001f262e10                0                0
>fffff8001f2b74b0 stream      0      0                0 fffff8001f2b75a0                0                0
>fffff8001f2b75a0 stream      0      0                0 fffff8001f2b74b0                0                0
>fffff8001f263690 stream      0      0 fffff80003eff588                0                0                0 /var/run/charon.vici
>fffff8001f263780 stream      0      0 fffff80003eff760                0                0                0 /var/run/charon.ctl
>fffff8001f2b7780 stream      0      0 fffff8001f331588                0                0                0 /var/run/charon.wlst
>fffff8001f263b40 stream      0      0 fffff8001f2b3588                0                0                0 /var/run/devd.pipe
>fffff8001f262870 dgram       0      0                0 fffff8001f263870                0 fffff8001f2633c0
>fffff8001f2b7690 dgram       0      0                0 fffff8001f263960                0                0
>fffff8001f2633c0 dgram       0      0                0 fffff8001f263870                0 fffff8001f2634b0
>fffff8001f2634b0 dgram       0      0                0 fffff8001f263870                0 fffff8001f2635a0
>fffff8001f2635a0 dgram       0      0                0 fffff8001f263870                0 fffff8001f2b7870
>fffff8001f2b7870 dgram       0      0                0 fffff8001f263870                0                0
>fffff8001f263870 dgram       0      0 fffff80003f5d000                0 fffff8001f262870                0 /var/run/logpriv
>fffff8001f263960 dgram       0      0 fffff80003f5d1d8                0 fffff8001f2b7690                0 /var/run/log
>fffff8001f263a50 seqpac      0      0 fffff8001f2b33b0                0                0                0 /var/run/devd.seqpacket.pipe
>
>------------------------------------------------------------------------
>netstat -aL
>
>Current listen queue sizes (qlen/incqlen/maxqlen)
>Proto Listen                           Local Address         
>unix  0/0/3                            /var/run/charon.vici
>unix  0/0/10                           /var/run/charon.ctl
>unix  0/0/10                           /var/run/charon.wlst
>unix  0/0/4                            /var/run/devd.pipe
>unix  0/0/4                            /var/run/devd.seqpacket.pipe
>
>------------------------------------------------------------------------
>fstat
>
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0xa600000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read file 8 at 0x4000000001fffff
>fstat: can't read file 10 at 0x780000ffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0xa00000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read file 8 at 0x4000000001fffff
>fstat: can't read file 10 at 0x780000ffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x800000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read file 8 at 0x4000000001fffff
>fstat: can't read file 10 at 0x780000ffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0xe00000000
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x600000000
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x600000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read file 8 at 0x4000000001fffff
>fstat: can't read file 10 at 0x780000ffff
>fstat: can't read file 11 at 0x600000000
>fstat: can't read file 13 at 0x20007ffffffffff
>fstat: can't read file 14 at 0x4000000001fffff
>fstat: can't read file 16 at 0x780000ffff
>fstat: can't read file 17 at 0x600000000
>fstat: can't read file 19 at 0x20007ffffffffff
>fstat: can't read file 20 at 0x4000000001fffff
>fstat: can't read file 22 at 0x780000ffff
>fstat: can't read file 23 at 0x4200000001
>fstat: can't read file 29 at 0x27400000000
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x400000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read file 8 at 0x4000000001fffff
>fstat: can't read file 10 at 0x780000ffff
>fstat: can't read file 11 at 0x400000000
>fstat: can't read file 13 at 0x20007ffffffffff
>fstat: can't read file 14 at 0x4000000001fffff
>fstat: can't read file 16 at 0x780000ffff
>fstat: can't read file 17 at 0x400000000
>fstat: can't read file 19 at 0x20007ffffffffff
>fstat: can't read file 20 at 0x4000000001fffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x400000000
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x400000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read file 8 at 0x4000000001fffff
>fstat: can't read file 10 at 0x780000ffff
>fstat: can't read file 11 at 0x400000000
>fstat: can't read file 13 at 0x20007ffffffffff
>fstat: can't read file 14 at 0x4000000001fffff
>fstat: can't read file 16 at 0x780000ffff
>fstat: can't read file 17 at 0x400000000
>fstat: can't read file 19 at 0x20007ffffffffff
>fstat: can't read file 20 at 0x4000000001fffff
>fstat: can't read file 22 at 0x780000ffff
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x800000000
>fstat: can't read file 7 at 0x20007ffffffffff
>USER     CMD          PID   FD MOUNT      INUM MODE         SZ|DV R/W
>root     sh           759 root /             2 drwxr-xr-x    1024  r
>root     sh           759   wd /        16945292 drwxr-xr-x     512  r
>root     sh           759 text /        19583101 -r-xr-xr-x  161664  r
>root     sh           759 ctty /dev         84 crw--w----   pts/0 rw
>root     sh           759    0 /dev         84 crw--w----   pts/0 rw
>root     sh           759    6 /dev         84 crw--w----   pts/0 rw
>root     su           758 root /             2 drwxr-xr-x    1024  r
>root     su           758   wd /        16945292 drwxr-xr-x     512  r
>root     su           758 text /        19583462 -r-sr-xr-x   17544  r
>root     su           758 ctty /dev         84 crw--w----   pts/0 rw
>root     su           758    0 /dev         84 crw--w----   pts/0 rw
>lab      sh           751 root /             2 drwxr-xr-x    1024  r
>lab      sh           751   wd /        16945292 drwxr-xr-x     512  r
>lab      sh           751 text /        19583101 -r-xr-xr-x  161664  r
>lab      sh           751 ctty /dev         84 crw--w----   pts/0 rw
>lab      sh           751    0 /dev         84 crw--w----   pts/0 rw
>lab      sh           751    6 /dev         84 crw--w----   pts/0 rw
>lab      sshd         750 root /             2 drwxr-xr-x    1024  r
>lab      sshd         750   wd /             2 drwxr-xr-x    1024  r
>lab      sshd         750 text /        19583295 -r-xr-xr-x  296512  r
>lab      sshd         750    0 /dev         14 crw-rw-rw-    null rw
>lab      sshd         750    6 /dev         14 crw-rw-rw-    null rw
>root     sshd         746 root /             2 drwxr-xr-x    1024  r
>root     sshd         746   wd /             2 drwxr-xr-x    1024  r
>root     sshd         746 text /        19583295 -r-xr-xr-x  296512  r
>root     sshd         746    0 /dev         14 crw-rw-rw-    null  r
>root     getty        745 root /             2 drwxr-xr-x    1024  r
>root     getty        745   wd /             2 drwxr-xr-x    1024  r
>root     getty        745 text /        19583004 -r-xr-xr-x   31008  r
>root     getty        745 ctty /dev         68 crw-------   ttyv7 rw
>root     getty        745    0 /dev         68 crw-------   ttyv7 rw
>root     getty        744 root /             2 drwxr-xr-x    1024  r
>root     getty        744   wd /             2 drwxr-xr-x    1024  r
>root     getty        744 text /        19583004 -r-xr-xr-x   31008  r
>root     getty        744 ctty /dev         67 crw-------   ttyv6 rw
>root     getty        744    0 /dev         67 crw-------   ttyv6 rw
>root     getty        743 root /             2 drwxr-xr-x    1024  r
>root     getty        743   wd /             2 drwxr-xr-x    1024  r
>root     getty        743 text /        19583004 -r-xr-xr-x   31008  r
>root     getty        743 ctty /dev         66 crw-------   ttyv5 rw
>root     getty        743    0 /dev         66 crw-------   ttyv5 rw
>root     getty        742 root /             2 drwxr-xr-x    1024  r
>root     getty        742   wd /             2 drwxr-xr-x    1024  r
>root     getty        742 text /        19583004 -r-xr-xr-x   31008  r
>root     getty        742 ctty /dev         65 crw-------   ttyv4 rw
>root     getty        742    0 /dev         65 crw-------   ttyv4 rw
>root     getty        741 root /             2 drwxr-xr-x    1024  r
>root     getty        741   wd /             2 drwxr-xr-x    1024  r
>root     getty        741 text /        19583004 -r-xr-xr-x   31008  r
>root     getty        741 ctty /dev         64 crw-------   ttyv3 rw
>root     getty        741    0 /dev         64 crw-------   ttyv3 rw
>root     getty        740 root /             2 drwxr-xr-x    1024  r
>root     getty        740   wd /             2 drwxr-xr-x    1024  r
>root     getty        740 text /        19583004 -r-xr-xr-x   31008  r
>root     getty        740 ctty /dev         63 crw-------   ttyv2 rw
>root     getty        740    0 /dev         63 crw-------   ttyv2 rw
>root     getty        739 root /             2 drwxr-xr-x    1024  r
>root     getty        739   wd /             2 drwxr-xr-x    1024  r
>root     getty        739 text /        19583004 -r-xr-xr-x   31008  r
>root     getty        739 ctty /dev         62 crw-------   ttyv1 rw
>root     getty        739    0 /dev         62 crw-------   ttyv1 rw
>root     getty        738 root /             2 drwxr-xr-x    1024  r
>root     getty        738   wd /             2 drwxr-xr-x    1024  r
>root     getty        738 text /        19583004 -r-xr-xr-x   31008  r
>root     getty        738 ctty /dev         61 crw-------   ttyv0 rw
>root     getty        738    0 /dev         61 crw-------   ttyv0 rw
>root     cron         691 root /             2 drwxr-xr-x    1024  r
>root     cron         691   wd /        13402768 drwxr-x---     512  r
>root     cron         691 text /        19583645 -r-xr-xr-x   45264  r
>root     cron         691    0 /dev         14 crw-rw-rw-    null rw
>smmsp    sendmail     687 root /             2 drwxr-xr-x    1024  r
>smmsp    sendmail     687   wd /        13403236 drwxrwx---     512  r
>smmsp    sendmail     687 text /        19585307 -r-xr-sr-x  729768  r
>smmsp    sendmail     687    0 /dev         14 crw-rw-rw-    null  r
>root     sendmail     684 root /             2 drwxr-xr-x    1024  r
>root     sendmail     684   wd /        13403235 drwxr-xr-x     512  r
>root     sendmail     684 text /        19585307 -r-xr-sr-x  729768  r
>root     sendmail     684    0 /dev         14 crw-rw-rw-    null  r
>root     sshd         681 root /             2 drwxr-xr-x    1024  r
>root     sshd         681   wd /             2 drwxr-xr-x    1024  r
>root     sshd         681 text /        19583295 -r-xr-xr-x  296512  r
>root     sshd         681    0 /dev         14 crw-rw-rw-    null rw
>root     ntpd         649 root /             2 drwxr-xr-x    1024  r
>root     ntpd         649   wd /             2 drwxr-xr-x    1024  r
>root     ntpd         649 text /        19585282 -r-xr-xr-x  806800  r
>root     ntpd         649    0 /dev         14 crw-rw-rw-    null  r
>root     ntpd         649    6 /dev         14 crw-rw-rw-    null  r
>root     ntpd         649   12 /dev         14 crw-rw-rw-    null  r
>root     ntpd         649   18* local dgram fffff8001f2635a0 <-> fffff8001f263870
>root     charon       612 root /             2 drwxr-xr-x    1024  r
>root     charon       612   wd /             2 drwxr-xr-x    1024  r
>root     charon       612 text /        17016707 -rwxr-xr-x   15584  r
>root     charon       612    0 /dev         14 crw-rw-rw-    null rw
>root     charon       612    6 /dev         14 crw-rw-rw-    null rw
>root     charon       612   12 /dev         14 crw-rw-rw-    null rw
>root     charon       612   18* pipe fffff80003e54000 <-> fffff80003e54168      0 rw
>root     starter      611 root /             2 drwxr-xr-x    1024  r
>root     starter      611   wd /             2 drwxr-xr-x    1024  r
>root     starter      611 text /        17016708 -rwxr-xr-x   78312  r
>root     starter      611    0 /dev         14 crw-rw-rw-    null rw
>root     syslogd      484 root /             2 drwxr-xr-x    1024  r
>root     syslogd      484   wd /             2 drwxr-xr-x    1024  r
>root     syslogd      484 text /        19583745 -r-xr-xr-x   45152  r
>root     syslogd      484    0 /dev         14 crw-rw-rw-    null rw
>root     syslogd      484    6 /dev         14 crw-rw-rw-    null rw
>root     syslogd      484   12 /dev         14 crw-rw-rw-    null rw
>root     syslogd      484   18* pipe fffff80003e592f8 <-> fffff80003e59460      0 rw
>root     devd         405 root /             2 drwxr-xr-x    1024  r
>root     devd         405   wd /             2 drwxr-xr-x    1024  r
>root     devd         405 text /        19583247 -r-xr-xr-x  1253504  r
>root     devd         405    0 /dev         14 crw-rw-rw-    null rw
>root     devd         405    6 /dev         14 crw-rw-rw-    null rw
>root     init           1 root /             2 drwxr-xr-x    1024  r
>root     init           1   wd /             2 drwxr-xr-x    1024  r
>root     init           1 text /        19583179 -r-xr-xr-x  1115600  r
>root     kernel         0 root /             2 drwxr-xr-x    1024  r
>root     kernel         0   wd /             2 drwxr-xr-x    1024  r
>
>------------------------------------------------------------------------
>dmesg
>
>Copyright (c) 1992-2017 The FreeBSD Project.
>Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>	The Regents of the University of California. All rights reserved.
>FreeBSD is a registered trademark of The FreeBSD Foundation.
>FreeBSD 12.0-CURRENT #1 r318563: Sat May 20 15:02:15 EDT 2017
>    lab@phoenix.gta.com:/usr/obj/usr/src/sys/GENERIC amd64
>FreeBSD clang version 4.0.0 (tags/RELEASE_400/final 297347) (based on LLVM 4.0.0)
>WARNING: WITNESS option enabled, expect reduced performance.
>VT(vga): text 80x25
>CPU: AMD FX(tm)-8150 Eight-Core Processor            (3612.11-MHz K8-class CPU)
>  Origin="AuthenticAMD"  Id=0x600f12  Family=0x15  Model=0x1  Stepping=2
>  Features=0x1783fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,HTT>
>  Features2=0x1e982203<SSE3,PCLMULQDQ,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,OSXSAVE,AVX>
>  AMD Features=0x2a500800<SYSCALL,NX,MMX+,FFXSR,RDTSCP,LM>
>  AMD Features2=0x1f3<LAHF,CMP,CR8,ABM,SSE4A,MAS,Prefetch>
>real memory  = 1073676288 (1023 MB)
>avail memory = 990883840 (944 MB)
>Event timer "LAPIC" quality 100
>ACPI APIC Table: <VBOX   VBOXAPIC>
>FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
>FreeBSD/SMP: 1 package(s) x 2 core(s)
>random: unblocking device.
>ioapic0: Changing APIC ID to 2
>ioapic0 <Version 2.0> irqs 0-23 on motherboard
>SMP: AP CPU #1 Launched!
>random: entropy device external interface
>netmap: loaded module
>module_register_init: MOD_LOAD (vesa, 0xffffffff80f57f70, 0) error 19
>kbd1 at kbdmux0
>nexus0
>vtvga0: <VT VGA driver> on motherboard
>cryptosoft0: <software crypto> on motherboard
>aesni0: <AES-CBC,AES-XTS,AES-GCM,AES-ICM> on motherboard
>acpi0: <VBOX VBOXXSDT> on motherboard
>acpi0: Power Button (fixed)
>acpi0: Sleep Button (fixed)
>cpu0: <ACPI CPU> on acpi0
>cpu1: <ACPI CPU> on acpi0
>attimer0: <AT timer> port 0x40-0x43,0x50-0x53 on acpi0
>Timecounter "i8254" frequency 1193182 Hz quality 0
>Event timer "i8254" frequency 1193182 Hz quality 100
>Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
>acpi_timer0: <32-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0
>pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
>pci0: <ACPI PCI bus> on pcib0
>isab0: <PCI-ISA bridge> at device 1.0 on pci0
>isa0: <ISA bus> on isab0
>atapci0: <Intel PIIX4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xd000-0xd00f at device 1.1 on pci0
>ata0: <ATA channel> at channel 0 on atapci0
>ata1: <ATA channel> at channel 1 on atapci0
>vgapci0: <VGA-compatible display> mem 0xe0000000-0xe0ffffff irq 18 at device 2.0 on pci0
>vgapci0: Boot video device
>virtio_pci0: <VirtIO PCI Network adapter> port 0xd020-0xd03f irq 19 at device 3.0 on pci0
>vtnet0: <VirtIO Networking Adapter> on virtio_pci0
>vtnet0: Ethernet address: 08:00:27:d5:de:e6
>000.000051 [ 421] vtnet_netmap_attach       max rings 1
>vtnet0: netmap queues/slots: TX 1/1024, RX 1/1024
>000.000052 [ 426] vtnet_netmap_attach       virtio attached txq=1, txd=1024 rxq=1, rxd=1024
>pcm0: <Intel ICH (82801AA)> port 0xd100-0xd1ff,0xd200-0xd23f irq 21 at device 5.0 on pci0
>pcm0: <SigmaTel STAC9700/83/84 AC97 Codec>
>ohci0: <Apple KeyLargo/Intrepid USB controller> mem 0xf0404000-0xf0404fff irq 22 at device 6.0 on pci0
>usbus0 on ohci0
>usbus0: 12Mbps Full Speed USB v1.0
>pci0: <bridge> at device 7.0 (no driver attached)
>virtio_pci1: <VirtIO PCI Network adapter> port 0xd240-0xd25f irq 16 at device 8.0 on pci0
>vtnet1: <VirtIO Networking Adapter> on virtio_pci1
>vtnet1: Ethernet address: 08:00:27:ae:fc:0c
>000.000058 [ 421] vtnet_netmap_attach       max rings 1
>vtnet1: netmap queues/slots: TX 1/1024, RX 1/1024
>000.000059 [ 426] vtnet_netmap_attach       virtio attached txq=1, txd=1024 rxq=1, rxd=1024
>virtio_pci2: <VirtIO PCI Network adapter> port 0xd260-0xd27f irq 17 at device 9.0 on pci0
>vtnet2: <VirtIO Networking Adapter> on virtio_pci2
>vtnet2: Ethernet address: 08:00:27:13:7d:72
>000.000060 [ 421] vtnet_netmap_attach       max rings 1
>vtnet2: netmap queues/slots: TX 1/1024, RX 1/1024
>000.000061 [ 426] vtnet_netmap_attach       virtio attached txq=1, txd=1024 rxq=1, rxd=1024
>ehci0: <Intel 82801FB (ICH6) USB 2.0 controller> mem 0xf0405000-0xf0405fff irq 19 at device 11.0 on pci0
>usbus1: EHCI version 1.0
>usbus1 on ehci0
>usbus1: 480Mbps High Speed USB v2.0
>acpi_acad0: <AC Adapter> on acpi0
>atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
>atkbd0: <AT Keyboard> irq 1 on atkbdc0
>kbd0 at atkbd0
>atkbd0: [GIANT-LOCKED]
>psm0: <PS/2 Mouse> irq 12 on atkbdc0
>psm0: [GIANT-LOCKED]
>psm0: model IntelliMouse Explorer, device ID 4
>orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xe2000-0xe2fff on isa0
>vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
>atrtc0: <AT realtime clock> at port 0x70 irq 8 on isa0
>Event timer "RTC" frequency 32768 Hz quality 0
>ppc0: cannot reserve I/O port range
>Timecounters tick every 1.000 msec
>pcm0: ac97 link rate calibration timed out after 1978989 us
>ugen1.1: <Intel EHCI root HUB> at usbus1
>ugen0.1: <Apple OHCI root HUB> at usbus0
>uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
>uhub1: <Apple OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
>ada0 at ata0 bus 0 scbus0 target 0 lun 0
>ada0: <VBOX HARDDISK 1.0> ATA-6 device
>ada0: Serial Number VB7d1bdd58-8affc297
>ada0: 33.300MB/s transfers (UDMA2, PIO 65536bytes)
>ada0: 163840MB (335544320 512 byte sectors)
>cd0 at ata1 bus 0 scbus1 target 0 lun 0
>cd0: <VBOX CD-ROM 1.0> Removable CD-ROM SCSI device
>cd0: Serial Number VB2-01700376
>cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes)
>cd0: Attempt
>WARNING: WITNESS option enabled, expect reduced performance.
>Trying to mount root from ufs:/dev/ada0p2 [rw]...
>uhub1: 12 ports with 12 removable, self powered
>Setting hostuuid: d7337d4a-effd-4d5b-adcf-f34e184be2cd.
>Setting hostid: 0x142cc986.
>Starting file system checks:
>/dev/ada0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS
>/dev/ada0p2: clean, 36198495 free (108831 frags, 4511208 blocks, 0.3% fragmentation)
>Mounting local filesystems:.
>lock order reversal:
> 1st 0xfffff80003dbc240 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2602
> 2nd 0xfffffe003ca425e0 bufwait (bufwait) @ /usr/src/sys/ufs/ffs/ffs_vnops.c:280
> 3rd 0xfffff80003ed9d50 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2602
>stack backtrace:
>#0 0xffffffff80ab5d80 at witness_debugger+0x70
>#1 0xffffffff80ab5c73 at witness_checkorder+0xe23
>#2 0xffffffff80a2b075 at __lockmgr_args+0x875
>#3 0xffffffff80d2ca95 at ffs_lock+0xa5
>#4 0xffffffff81050fa0 at VOP_LOCK1_APV+0xe0
>#5 0xffffffff80b2b6fa at _vn_lock+0x6a
>#6 0xffffffff80b1b902 at vget+0x82
>#7 0xffffffff80b0dc0c at vfs_hash_get+0xdc
>#8 0xffffffff80d2881e at ffs_vgetf+0x3e
>#9 0xffffffff80d1ef99 at softdep_sync_buf+0xb89
>#10 0xffffffff80d2d7a2 at ffs_syncvnode+0x292
>#11 0xffffffff80d046fd at ffs_truncate+0x6bd
>#12 0xffffffff80d35068 at ufs_direnter+0x8f8
>#13 0xffffffff80d3dd6e at ufs_makeinode+0x61e
>#14 0xffffffff80d39a84 at ufs_create+0x34
>#15 0xffffffff8104e89a at VOP_CREATE_APV+0xda
>#16 0xffffffff80b2afe8 at vn_open_cred+0x2a8
>#17 0xffffffff80b2447e at kern_openat+0x1fe
>ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/ipsec
>32-bit compatibility ldconfig path: /usr/lib32
>Setting hostname: phoenix.gta.com.
>Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
>Feeding entropy: .
>vtnet0: link state changed to UP
>vtnet1: link state changed to UP
>vtnet2: link state changed to UP
>Starting Network: lo0 vtnet0 vtnet1 vtnet2.
>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
>	options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
>	inet6 ::1 prefixlen 128 
>	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 
>	inet 127.0.0.1 netmask 0xff000000 
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>	groups: lo 
>vtnet0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>	options=6c07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
>	ether 08:00:27:d5:de:e6
>	hwaddr 08:00:27:d5:de:e6
>	inet 10.10.1.83 netmask 0xffffff00 broadcast 10.10.1.255 
>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>	media: Ethernet 10Gbase-T <full-duplex>
>	status: active
>vtnet1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>	options=6c07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
>	ether 08:00:27:ae:fc:0c
>	hwaddr 08:00:27:ae:fc:0c
>	inet 172.16.74.83 netmask 0xffffff00 broadcast 172.16.74.255 
>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>	media: Ethernet 10Gbase-T <full-duplex>
>	status: active
>vtnet2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>	options=6c07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
>	ether 08:00:27:13:7d:72
>	hwaddr 08:00:27:13:7d:72
>	inet 172.16.72.83 netmask 0xffffff00 broadcast 172.16.72.255 
>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>	media: Ethernet 10Gbase-T <full-duplex>
>	status: active
>Starting devd.
>add host 127.0.0.1: gateway lo0 fib 0: route already in table
>add net 172.16.73.0: gateway 172.16.72.254
>add net 172.16.67.0: gateway 172.16.72.254
>add net default: gateway 10.10.1.8
>Additional inet routing options: gateway=YES.
>add host ::1: gateway lo0 fib 0: route already in table
>add net fe80::: gateway ::1
>add net ff02::: gateway ::1
>add net ::ffff:0.0.0.0: gateway ::1
>add net ::0.0.0.0: gateway ::1
>Creating and/or trimming log files.
>Starting syslogd.
>No core dumps found.
>Clearing /tmp (X related).
>Starting strongSwan 5.5.2 IPsec [starter]...
>no netkey IPsec stack detected
>no KLIPS IPsec stack detected
>no known IPsec stack detected, ignoring!
>Updating motd:.
>Mounting late filesystems:.
>Starting ntpd.
>Configuring vt: blanktime.
>Performing sanity check on sshd configuration.
>uhub0: 12 ports with 12 removable, self powered
>Starting sshd.
>Starting sendmail_submit.
>Starting sendmail_msp_queue.
>Starting cron.
>Starting background file system checks in 60 seconds.
>
>Sun May 21 01:28:55 EDT 2017
>May 21 01:29:10 phoenix sshd[746]: error: PAM: Authentication error for lab from spider.gta.com
>May 21 01:29:16 phoenix su: lab to root on /dev/pts/0
>key_acqdone: ACQ 5 is not found.key_acqdone: ACQ 7 is not found.key_acqdone: ACQ 8 is not found.
>esp_input_cb: crypto error 89
>panic: attempt to free non DEAD SA 0xfffff8000367a700
>cpuid = 0
>time = 1495344697
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe003c977510
>vpanic() at vpanic+0x19c/frame 0xfffffe003c977590
>kassert_panic() at kassert_panic+0x126/frame 0xfffffe003c977600
>key_freesav() at key_freesav+0x13e/frame 0xfffffe003c977630
>ipsec_common_input() at ipsec_common_input+0x3e4/frame 0xfffffe003c9776e0
>ipsec4_input() at ipsec4_input+0x39/frame 0xfffffe003c977700
>ip_input() at ip_input+0xed/frame 0xfffffe003c977760
>netisr_dispatch_src() at netisr_dispatch_src+0x80/frame 0xfffffe003c9777c0
>ether_demux() at ether_demux+0x15e/frame 0xfffffe003c9777f0
>ether_nh_input() at ether_nh_input+0x30f/frame 0xfffffe003c977830
>netisr_dispatch_src() at netisr_dispatch_src+0x80/frame 0xfffffe003c977890
>ether_input() at ether_input+0x62/frame 0xfffffe003c9778c0
>vtnet_rxq_eof() at vtnet_rxq_eof+0x6ec/frame 0xfffffe003c977970
>vtnet_rx_vq_intr() at vtnet_rx_vq_intr+0x4e/frame 0xfffffe003c9779a0
>vtpci_legacy_intr() at vtpci_legacy_intr+0xb0/frame 0xfffffe003c9779e0
>intr_event_execute_handlers() at intr_event_execute_handlers+0x99/frame 0xfffffe003c977a20
>ithread_loop() at ithread_loop+0xb6/frame 0xfffffe003c977a70
>fork_exit() at fork_exit+0x84/frame 0xfffffe003c977ab0
>fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003c977ab0
>--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
>KDB: enter: panic
>Uptime: 2m50s
>Dumping 118 out of 990 MB:..14%..28%..41%..55%..68%..82%..95%
>
>------------------------------------------------------------------------
>kernel config
>
>options	CONFIG_AUTOGENERATED
>ident	GENERIC
>machine	amd64
>cpu	HAMMER
>makeoptions	WITH_CTF=1
>makeoptions	DEBUG=-g
>options	XENHVM
>options	USB_DEBUG
>options	ATH_ENABLE_11N
>options	AH_AR5416_INTERRUPT_MITIGATION
>options	AH_SUPPORT_AR5416
>options	IEEE80211_SUPPORT_MESH
>options	IEEE80211_AMPDU_AGE
>options	IEEE80211_DEBUG
>options	IXL_IW
>options	SC_PIXEL_MODE
>options	VESA
>options	AHD_REG_PRETTY_PRINT
>options	AHC_REG_PRETTY_PRINT
>options	PCI_IOV
>options	PCI_HP
>options	ACPI_DMAR
>options	EARLY_AP_STARTUP
>options	DEVICE_NUMA
>options	SMP
>options	MALLOC_DEBUG_MAXZONES=8
>options	WITNESS_SKIPSPIN
>options	WITNESS
>options	INVARIANT_SUPPORT
>options	INVARIANTS
>options	DEADLKRES
>options	GDB
>options	FULL_BUF_TRACKING
>options	DDB
>options	BUF_TRACKING
>options	KDB_TRACE
>options	KDB
>options	RCTL
>options	RACCT_DEFAULT_TO_DISABLED
>options	RACCT
>options	INCLUDE_CONFIG_FILE
>options	DDB_CTF
>options	KDTRACE_HOOKS
>options	KDTRACE_FRAME
>options	MAC
>options	CAPABILITIES
>options	CAPABILITY_MODE
>options	AUDIT
>options	HWPMC_HOOKS
>options	KBD_INSTALL_CDEV
>options	PRINTF_BUFR_SIZE=128
>options	_KPOSIX_PRIORITY_SCHEDULING
>options	SYSVSEM
>options	SYSVMSG
>options	SYSVSHM
>options	STACK
>options	KTRACE
>options	SCSI_DELAY=5000
>options	COMPAT_FREEBSD11
>options	COMPAT_FREEBSD10
>options	COMPAT_FREEBSD9
>options	COMPAT_FREEBSD7
>options	COMPAT_FREEBSD6
>options	COMPAT_FREEBSD5
>options	COMPAT_FREEBSD4
>options	COMPAT_FREEBSD32
>options	GEOM_LABEL
>options	GEOM_RAID
>options	GEOM_PART_GPT
>options	PSEUDOFS
>options	PROCFS
>options	CD9660
>options	MSDOSFS
>options	NFS_ROOT
>options	NFSLOCKD
>options	NFSD
>options	NFSCL
>options	MD_ROOT
>options	QUOTA
>options	UFS_GJOURNAL
>options	UFS_DIRHASH
>options	UFS_ACL
>options	SOFTUPDATES
>options	FFS
>options	SCTP
>options	TCP_HHOOK
>options	TCP_OFFLOAD
>options	IPSEC
>options	INET6
>options	INET
>options	PREEMPTION
>options	SCHED_ULE
>options	NEW_PCIB
>options	GEOM_PART_MBR
>options	GEOM_PART_EBR_COMPAT
>options	GEOM_PART_EBR
>options	GEOM_PART_BSD
>device	isa
>device	mem
>device	io
>device	uart_ns8250
>device	cpufreq
>device	acpi
>device	pci
>device	fdc
>device	ahci
>device	ata
>device	mvs
>device	siis
>device	ahc
>device	ahd
>device	esp
>device	hptiop
>device	isp
>device	mpt
>device	mps
>device	mpr
>device	sym
>device	trm
>device	adv
>device	adw
>device	aic
>device	bt
>device	isci
>device	scbus
>device	ch
>device	da
>device	sa
>device	cd
>device	pass
>device	ses
>device	amr
>device	arcmsr
>device	ciss
>device	dpt
>device	hptmv
>device	hptnr
>device	hptrr
>device	hpt27xx
>device	iir
>device	ips
>device	mly
>device	twa
>device	tws
>device	aac
>device	aacp
>device	aacraid
>device	ida
>device	mfi
>device	mlx
>device	mrsas
>device	pmspcv
>device	twe
>device	nvme
>device	nvd
>device	atkbdc
>device	atkbd
>device	psm
>device	kbdmux
>device	vga
>device	splash
>device	sc
>device	vt
>device	vt_vga
>device	vt_efifb
>device	agp
>device	cbb
>device	pccard
>device	cardbus
>device	uart
>device	ppc
>device	ppbus
>device	lpt
>device	ppi
>device	puc
>device	bxe
>device	de
>device	em
>device	ix
>device	ixv
>device	ixl
>device	ixlv
>device	le
>device	ti
>device	txp
>device	vx
>device	miibus
>device	ae
>device	age
>device	alc
>device	ale
>device	bce
>device	bfe
>device	bge
>device	cas
>device	dc
>device	et
>device	fxp
>device	gem
>device	hme
>device	jme
>device	lge
>device	msk
>device	nfe
>device	nge
>device	pcn
>device	re
>device	rl
>device	sf
>device	sge
>device	sis
>device	sk
>device	ste
>device	stge
>device	tl
>device	tx
>device	vge
>device	vr
>device	wb
>device	xl
>device	wlan
>device	wlan_wep
>device	wlan_ccmp
>device	wlan_tkip
>device	wlan_amrr
>device	an
>device	ath
>device	ath_pci
>device	ath_hal
>device	ath_rate_sample
>device	ipw
>device	iwi
>device	iwn
>device	malo
>device	mwl
>device	ral
>device	wi
>device	wpi
>device	loop
>device	random
>device	padlock_rng
>device	rdrand_rng
>device	ether
>device	vlan
>device	tun
>device	md
>device	gif
>device	firmware
>device	bpf
>device	uhci
>device	ohci
>device	ehci
>device	xhci
>device	usb
>device	ukbd
>device	umass
>device	sound
>device	snd_cmi
>device	snd_csa
>device	snd_emu10kx
>device	snd_es137x
>device	snd_hda
>device	snd_ich
>device	snd_via8233
>device	mmc
>device	mmcsd
>device	sdhci
>device	virtio
>device	virtio_pci
>device	vtnet
>device	virtio_blk
>device	virtio_scsi
>device	virtio_balloon
>device	hyperv
>device	xenpci
>device	vmx
>device	netmap
>device	crypto
>
>------------------------------------------------------------------------
>ddb capture buffer
>
>

Actions: View

Attachments on bug 219356: 182666 | 182770 | 182793