Attachment 200887 Details for Bug 233535 – debug info

debug info

core.txt (text/plain), 100.41 KB, created by Andrey V. Elsukov on 2019-01-07 21:07:59 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Andrey V. Elsukov

Created: 2019-01-07 21:07:59 UTC

Size: 100.41 KB

patch

obsolete

>btr-test.yandex.net dumped core - see /var/crash/vmcore.2
>
>Mon Jan  7 23:42:12 MSK 2019
>
>FreeBSD btr-test.yandex.net 13.0-CURRENT FreeBSD 13.0-CURRENT #39 r342190M: Mon Jan  7 23:28:59 MSK 2019     butcher@btr-test.yandex.net:/usr/obj/home/devel/freebsd/base/head/amd64.amd64/sys/GENERIC  amd64
>
>panic: Assertion inm->in6m_refcount > 0 failed at /home/devel/freebsd/base/head/sys/netinet6/in6_mcast.c:641
>
>GNU gdb (GDB) 8.1 [GDB v8.1 for FreeBSD]
>Copyright (C) 2018 Free Software Foundation, Inc.
>License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
>This is free software: you are free to change and redistribute it.
>There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
>and "show warranty" for details.
>This GDB was configured as "x86_64-portbld-freebsd12.0".
>Type "show configuration" for configuration details.
>For bug reporting instructions, please see:
><http://www.gnu.org/software/gdb/bugs/>.
>Find the GDB manual and other documentation resources online at:
><http://www.gnu.org/software/gdb/documentation/>.
>For help, type "help".
>Type "apropos word" to search for commands related to "word"...
>Reading symbols from /boot/kernel/kernel...Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug...done.
>done.
>
>Unread portion of the kernel message buffer:
>list remove - post dec - inm=0xfffff800038f6e00 - in6m_refcount = 0
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00779ce800
>in6m_disconnect() at in6m_disconnect+0x1cc/frame 0xfffffe00779ce830
>mld_fasttimo() at mld_fasttimo+0x515/frame 0xfffffe00779ce900
>pffasttimo() at pffasttimo+0x54/frame 0xfffffe00779ce930
>softclock_call_cc() at softclock_call_cc+0x141/frame 0xfffffe00779ce9e0
>softclock() at softclock+0x7c/frame 0xfffffe00779cea10
>ithread_loop() at ithread_loop+0x187/frame 0xfffffe00779cea70
>fork_exit() at fork_exit+0x84/frame 0xfffffe00779ceab0
>fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00779ceab0
>--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
>panic: Assertion inm->in6m_refcount > 0 failed at /home/devel/freebsd/base/head/sys/netinet6/in6_mcast.c:641
>cpuid = 0
>time = 1546893553
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00779ce740
>vpanic() at vpanic+0x1a3/frame 0xfffffe00779ce7a0
>panic() at panic+0x43/frame 0xfffffe00779ce800
>in6m_disconnect() at in6m_disconnect+0x25e/frame 0xfffffe00779ce830
>mld_fasttimo() at mld_fasttimo+0x515/frame 0xfffffe00779ce900
>pffasttimo() at pffasttimo+0x54/frame 0xfffffe00779ce930
>softclock_call_cc() at softclock_call_cc+0x141/frame 0xfffffe00779ce9e0
>softclock() at softclock+0x7c/frame 0xfffffe00779cea10
>ithread_loop() at ithread_loop+0x187/frame 0xfffffe00779cea70
>fork_exit() at fork_exit+0x84/frame 0xfffffe00779ceab0
>fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00779ceab0
>--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
>KDB: enter: panic
>
>__curthread () at ./machine/pcpu.h:230
>230		__asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (OFFSETOF_CURTHREAD));
>(kgdb) #0  __curthread () at ./machine/pcpu.h:230
>#1  doadump (textdump=-1791238144)
>    at /home/devel/freebsd/base/head/sys/kern/kern_shutdown.c:371
>#2  0xffffffff80466d7c in db_fncall_generic (addr=<optimized out>, 
>    rv=<optimized out>, nargs=<optimized out>, args=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/ddb/db_command.c:609
>#3  db_fncall (dummy1=<optimized out>, dummy2=<optimized out>, 
>    dummy3=<optimized out>, dummy4=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/ddb/db_command.c:657
>#4  0xffffffff804668b9 in db_command (last_cmdp=<optimized out>, 
>    cmd_table=<optimized out>, dopager=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/ddb/db_command.c:481
>#5  0xffffffff80466634 in db_command_loop ()
>    at /home/devel/freebsd/base/head/sys/ddb/db_command.c:534
>#6  0xffffffff8046984f in db_trap (type=<optimized out>, code=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/ddb/db_main.c:252
>#7  0xffffffff80bf1365 in kdb_trap (type=3, code=0, tf=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/kern/subr_kdb.c:692
>#8  0xffffffff81076f76 in trap (frame=0xfffffe00779ce670)
>    at /home/devel/freebsd/base/head/sys/amd64/amd64/trap.c:619
>#9  <signal handler called>
>#10 kdb_enter (why=0xffffffff8130f418 "panic", msg=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/kern/subr_kdb.c:479
>#11 0xffffffff80ba8e10 in vpanic (fmt=<optimized out>, ap=0xfffffe00779ce7e0)
>    at /home/devel/freebsd/base/head/sys/kern/kern_shutdown.c:866
>#12 0xffffffff80ba8bb3 in panic (
>    fmt=0xffffffff81e95368 <cnputs_mtx> ":7-\201\377\377\377\377")
>    at /home/devel/freebsd/base/head/sys/kern/kern_shutdown.c:804
>#13 0xffffffff80dee41e in in6m_disconnect (inm=0xfffff800038f6e00)
>    at /home/devel/freebsd/base/head/sys/netinet6/in6_mcast.c:641
>#14 0xffffffff80e02045 in mld_v1_process_group_timer (inmh=<optimized out>, 
>    inm=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/netinet6/mld6.c:1487
>#15 mld_fasttimo_vnet ()
>    at /home/devel/freebsd/base/head/sys/netinet6/mld6.c:1406
>#16 mld_fasttimo () at /home/devel/freebsd/base/head/sys/netinet6/mld6.c:1317
>#17 0xffffffff80c36a04 in pffasttimo (arg=0xffffffff81e95368 <cnputs_mtx>)
>    at /home/devel/freebsd/base/head/sys/kern/uipc_domain.c:521
>#18 0xffffffff80bc2101 in softclock_call_cc (c=0xffffffff81314c0a, 
>    cc=0xffffffff820acb40 <cc_cpu>, direct=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/kern/kern_timeout.c:731
>#19 0xffffffff80bc24bc in softclock (arg=0xffffffff820acb40 <cc_cpu>)
>    at /home/devel/freebsd/base/head/sys/kern/kern_timeout.c:869
>#20 0xffffffff80b6bb07 in intr_event_execute_handlers (p=<optimized out>, 
>    ie=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/kern/kern_intr.c:1119
>#21 ithread_execute_handlers (p=<optimized out>, ie=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/kern/kern_intr.c:1132
>#22 ithread_loop (arg=<optimized out>)
>    at /home/devel/freebsd/base/head/sys/kern/kern_intr.c:1212
>#23 0xffffffff80b687f4 in fork_exit (
>    callout=0xffffffff80b6b980 <ithread_loop>, arg=0xfffff800035f1dc0, 
>    frame=0xfffffe00779ceac0)
>    at /home/devel/freebsd/base/head/sys/kern/kern_fork.c:1009
>#24 <signal handler called>
>(kgdb) 
>
>------------------------------------------------------------------------
>ps -axlww
>
>UID  PID PPID CPU PRI NI   VSZ  RSS MWCHAN   STAT TT     TIME COMMAND
>  0    0    0   0 -16 -1     0    0 swapin   D<L   -  0:00.53 []
>  0    1    0   0  52 -1 10020 1124 wait     D<L   -  0:00.19 []
>  0    2    0   0 -16 -1     0    0 crypto_w D<L   -  0:00.00 []
>  0    3    0   0 -16 -1     0    0 crypto_r D<L   -  0:00.00 []
>  0    4    0   0 -16 -1     0    0 crypto_r D<L   -  0:00.00 []
>  0    5    0   0 -16 -1     0    0 crypto_r D<L   -  0:00.00 []
>  0    6    0   0 -16 -1     0    0 crypto_r D<L   -  0:00.00 []
>  0    7    0   0 -16 -1     0    0 -        R<L   -  0:00.03 []
>  0    8    0   0 -16 -1     0    0 -        D<L   -  0:00.00 []
>  0    9    0   0 -16 -1     0    0 -        D<L   -  0:00.00 []
>  0   10    0   0 -16 -1     0    0 audit_wo D<L   -  0:00.00 []
>  0   11    0   0 155 -1     0    0 -        R<L   -  1:06.18 []
>  0   12    0   0 -52 -1     0    0 -        W<L   -  0:00.37 []
>  0   13    0   0  -8 -1     0    0 -        D<L   -  0:00.01 []
>  0   14    0   0 -16 -1     0    0 seqstate D<L   -  0:00.00 []
>  0   15    0   0 -68 -1     0    0 -        D<L   -  0:00.01 []
>  0   16    0   0 -16 -1     0    0 -        D<L   -  0:00.00 []
>  0   17    0   0 -16 -1     0    0 -        D<L   -  0:00.00 []
>  0   18    0   0  -8 -1     0    0 arc_recl D<L   -  0:00.05 []
>  0   19    0   0 -16 -1     0    0 waiting_ D<L   -  0:00.00 []
>  0   20    0   0 -16 -1     0    0 -        D<L   -  0:00.00 []
>  0   21    0   0 -16 -1     0    0 idle     D<L   -  0:00.00 []
>  0   22    0   0 -16 -1     0    0 psleep   D<L   -  0:00.00 []
>  0   23    0   0 -16 -1     0    0 psleep   D<L   -  0:00.00 []
>  0   24    0   0 -16 -1     0    0 qsleep   D<L   -  0:00.00 []
>  0   25    0   0 -16 -1     0    0 vlruwt   D<L   -  0:00.00 []
>  0   26    0   0  16 -1     0    0 syncer   D<L   -  0:00.00 []
>  0  686    1   0  52 -1 11448 2792 select   D<    -  0:00.00 []
>  0  689    1   0  52 -1 11608 2864 select   D<    -  0:00.00 []
> 65  735    1   0  52 -1 11776 2988 select   D<C   -  0:00.00 []
>  0  736    1   0  52 -1 10588 1500 select   D<    -  0:00.00 []
>  0  811    1   0  28 -1 11420 2812 select   D<    -  0:00.06 []
>  0  973    1   0  21 -1 10948 2368 select   D<    -  0:00.00 []
>  0 1017    1   0  52 -1 19820 8708 select   D<    -  0:00.00 []
>  0 1020    1   0  29 -1 17228 7516 select   D<    -  0:00.01 []
> 25 1023    1   0  52 -1 16948 7076 pause    D<    -  0:00.00 []
>  0 1027    1   0  52 -1 11412 2712 nanslp   D<    -  0:00.00 []
>  0 1083    1   0  52 -1 12332 3032 wait     D<+   -  0:00.00 []
>  0 1084    1   0  52 -1 10960 2440 piperd   D<+   -  0:00.00 []
>  0 1085 1083   0  52 -1 10748 2252 nanslp   D<C+  -  0:00.00 []
>  0 1087    1   0  52 60 10948 2400 ttyin    DN+   -  0:00.00 []
>  0 1088    1   0  52 60 10948 2400 ttyin    DN+   -  0:00.00 []
>  0 1089    1   0  52 60 10948 2400 ttyin    DN+   -  0:00.00 []
>  0 1090    1   0  52 60 10948 2400 ttyin    DN+   -  0:00.00 []
>  0 1091    1   0  52 60 10948 2400 ttyin    DN+   -  0:00.00 []
>  0 1092    1   0  52 60 10948 2400 ttyin    DN+   -  0:00.00 []
>  0 1093    1   0  52 60 10948 2400 ttyin    DN+   -  0:00.00 []
>  0 1094    1   0  52 60 10948 2400 ttyin    DN+   -  0:00.00 []
>
>------------------------------------------------------------------------
>vmstat -s
>
>    47255 cpu context switches
>     4166 device interrupts
>      603 software interrupts
>   104022 traps
>   443547 system calls
>       26 kernel threads created
>      849  fork() calls
>      217 vfork() calls
>        2 rfork() calls
>        0 swap pager pageins
>        0 swap pager pages paged in
>        0 swap pager pageouts
>        0 swap pager pages paged out
>      539 vnode pager pageins
>     3785 vnode pager pages paged in
>        0 vnode pager pageouts
>        0 vnode pager pages paged out
>        0 page daemon wakeups
>        0 pages examined by the page daemon
>        0 clean page reclamation shortfalls
>        0 pages reactivated by the page daemon
>    36807 copy-on-write faults
>       39 copy-on-write optimized faults
>    53919 zero fill pages zeroed
>        0 zero fill pages prezeroed
>        0 intransit blocking page faults
>   103365 total VM faults taken
>      384 page faults requiring I/O
>        0 pages affected by kernel thread creation
>    55337 pages affected by  fork()
>     7812 pages affected by vfork()
>      114 pages affected by rfork()
>   156556 pages freed
>        0 pages freed by daemon
>        0 pages freed by exiting processes
>        0 pages active
>        0 pages inactive
>        0 pages in the laundry queue
>        0 pages wired down
>        0 pages free
>        0 bytes per page
>        0 total name lookups
>          cache hits (0% pos + 0% neg) system 0% per-directory
>          deletions 0%, falsehits 0%, toolong 0%
>
>------------------------------------------------------------------------
>vmstat -m
>
>         Type InUse MemUse HighUse Requests  Size(s)
>     CAM path    14     1K       -       87  32
>   CAM periph     8     2K       -       35  16,32,64,128,256
>    acpi_perf     4     1K       -        4  256
>         hdaa    10    64K       -       10  256,512,2048,4096,16384,32768
>         hdac     1     1K       -        1  1024
>        hdacc     2     1K       -        2  32
>       feeder    23     3K       -       30  32,128
>        mixer     5    20K       -        5  4096
>CAM I/O Scheduler     1     1K       -        1  128
>    CAM queue    19     6K       -       64  16,32,512
>         UART     6     5K       -        6  16,1024
>      scsi_cd     0     0K       -        6  16
>          USB    45    65K       -       50  16,128,256,512,1024,2048,4096,8192
>       USBdev    35     5K       -       37  32,64,128,256,512
>CAM dev queue     8     1K       -        8  64
>        vtbuf    24  1968K       -       46  4096
>           vt    11     6K       -       11  512
>       DEVFS3   148    37K       -      158  256
>       DEVFS1   125    63K       -      137  512
>   DEVFS_RULE    56    27K       -       56  64,512
>        DEVFS    17     1K       -       18  16,128
>       DEVFSP     2     1K       -        2  64
>NFSD V4client     1     1K       -        1  256
> NFSD lckfile     1     1K       -        1  256
> NFSD session     1     1K       -        1  1024
>    pfs_nodes    20     5K       -       20  256
>  pfs_vncache     1     1K       -        1  64
>         GEOM    58    11K       -      626  16,32,64,128,256,512,1024,2048,8192,16384
>    raid_data     0     0K       -       84  32,128,256
>       isadev     7     1K       -        7  128
>     SCSI ENC    25   100K       -       27  16,64,256,2048,32768
>  ddb_capture     1    64K       -        1  65536
>         cdev     3     1K       -        3  256
>     filedesc     1     4K       -        1  4096
>        sigio     0     0K       -        1  64
>     filecaps     4     1K       -       56  16,32,64
>      kdtrace   437   101K       -     2548  64,256
>         kenv   116    13K       -      120  16,32,64,128,8192
>       kqueue    48     3K       -     1095  64
>    proc-args    54     3K       -      627  16,32,64,128,256
>        hhook    17     4K       -       17  32,256
>      ithread    96    17K       -       96  32,128,256
>       prison     8     1K       -        8  16,32
>       KTRACE   100    13K       -      100  128
>       linker   250    73K       -      269  16,32,64,128,256,512,1024,2048,4096,8192
>        evdev     4     4K       -        4  1024
>        lockf    24     3K       -       27  64,128
>   loginclass     2     1K       -        2  64
>        cache     1     1K       -        1  32
>       devbuf 17767 36848K       -    17975  16,32,64,128,256,512,1024,2048,4096,8192,65536
>         temp    48    50K       -     2916  16,32,64,128,256,512,1024,2048,8192,16384,65536
>       module   511    64K       -      512  128
>     mtx_pool     2    16K       -        2  8192
>          osd     6     1K       -       36  16,32,64,128,256
>     pmchooks     1     1K       -        1  128
>          pmc     1     1K       -        1  64
>         pgrp    20     3K       -       20  128
>      session    20     3K       -       20  128
>         proc     3    66K       -        3  2048,32768
>      subproc   121   229K       -     1168  512,4096
>         cred    38    10K       -       67  256
>     acpiintr     1     1K       -        1  64
>       acpica  3931   398K       -   110318  16,32,64,128,256,512,1024,2048
>       plimit    18     5K       -      270  256
>      uidinfo     4     9K       -        4  128,8192
>       dumper     1     1K       -        1  512
>     acpitask     1    64K       -        1  65536
>       sysctl     0     0K       -        1  64
>    sysctloid  5483   278K       -     5582  16,32,64,128
>    sysctltmp     0     0K       -     1100  16,32,64,128,256,1024
>       kbdmux     7    22K       -        7  16,512,1024,2048,16384
>      tidhash     1    64K       -        1  65536
>      callout     5  2184K       -        5  
>         umtx   848   106K       -      848  128
>     p1003.1b     1     1K       -        1  16
>         SWAP     1  2084K       -        1  
>          bus  1315   111K       -     8877  16,32,64,128,256,512,1024,4096
>       bus-sc    81  1926K       -     3445  16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536
>          LED    16     2K       -       16  16,128
>      devstat     6    13K       -        6  32,4096
>        epoch   429    14K       -      429  32,128
> eventhandler   128    11K       -      128  64,128
>   gtaskqueue    34    35K       -       34  16,32,256,8192
>         kobj   346  1384K       -      520  4096
>      Per-cpu     1     1K       -        1  32
>         rman   238    28K       -      534  16,32,128
>         sbuf     0     0K       -      868  16,32,64,128,256,512,1024,2048,4096,8192,32768
>    toponodes    18     3K       -       18  128
>    taskqueue   141    17K       -      156  16,32,64,128,256
>     terminal    11     3K       -       11  256
>       Unitno    24     2K       -       42  32,64
>         vmem     2   132K       -        2  4096
>     ioctlops     0     0K       -       91  256,512,1024
>       select    10     2K       -       10  128
>          iov     0     0K       -    17679  16,64,128,256,512
>          msg     4    30K       -        4  2048,4096,8192,16384
>          sem     4   106K       -        4  2048,4096
>          shm     1    32K       -        1  32768
>          tty    14    14K       -       14  1024
>     mbuf_tag     0     0K       -       16  32
>        shmfd     1     8K       -        1  8192
>       soname     4     1K       -    12234  16,32,128
>          pcb    22  3225K       -       39  16,32,64,128,1024,2048,8192
>     vfscache     4  4145K       -        4  256,16384,32768
>     vfs_hash     1  2048K       -        1  
>       vnodes     1     1K       -        1  256
>        mount   220     9K       -      471  16,32,64,128,256
>       statfs     0     0K       -      173  4096
>  vnodemarker     0     0K       -       12  512
>chacha20random     1     1K       -        1  1024
>          BPF    12    18K       -       12  128,512,4096
>        ifnet     5     9K       -        5  128,2048
>       ifaddr    65    16K       -       65  16,32,64,128,256,512,2048,4096
>  ether_multi    38     3K       -       45  16,32,64,128
>        clone    10     2K       -       10  128
>        ipsec     3     1K       -        3  256
>      lltable    19     6K       -       19  256,512
>        iflib    15   104K       -       19  16,64,128,1024,4096,8192,16384,32768
>     routetbl    28     4K       -       33  32,64,128,512
>         vnet     1     1K       -        1  64
>    vnet_data     1   240K       -        1  
>vnet_data_free     1     1K       -        1  32
>         igmp     4     1K       -        4  128
>     in_multi     2     1K       -        3  256
>encap_export_host    12     1K       -       12  32,64
>    sctp_a_it     0     0K       -        4  16
>     sctp_vrf     1     1K       -        1  64
>     sctp_ifa     5     1K       -        5  128
>     sctp_ifn     2     1K       -        2  128
>    sctp_iter     0     0K       -        4  256
>   tfo_ccache     1   128K       -        1  
>    hostcache     1    32K       -        1  32768
>          LRO     2    40K       -        2  8192,32768
>      tcpfunc     1     1K       -        1  64
>     syncache     1    68K       -        1  
>    in6_multi    25     3K       -       25  32,256
>          mld     4     1K       -        4  128
>       ip6ndp     6     1K       -        7  64,256
>  inpcbpolicy     6     1K       -       91  32
>     secasvar     1     1K       -        1  1024
>       sahead     1     1K       -        1  1024
>  ipsecpolicy     2     2K       -        2  256,1024
>    ipsec-saq     2     2K       -        2  1024
>       crypto     2     2K       -        2  512,1024
>          rpc     2     8K       -        2  4096
>audit_evclass   230     8K       -      285  32
>    ufs_quota     1  2048K       -        1  
>    vm_pgdata     1     1K       -        1  128
>      UMAHash     9     5K       -        9  512
>      memdesc     1     4K       -        1  4096
>     pci_link    16     2K       -       16  64,128
>     atkbddev     2     1K       -        2  64
>      acpisem    26     4K       -       26  128
>      acpidev    38     3K       -       38  64
>      CAM SIM     8     2K       -        8  256
>       apmdev     1     1K       -        1  128
>   madt_table     0     0K       -        2  64,4096
>         intr     4   388K       -        4  65536
>      io_apic     1     2K       -        1  2048
>   local_apic     1     8K       -        1  8192
>      CAM XPT    38     3K       -      122  16,32,64,128,256,512,1024,2048,65536
>          MCA    14     3K       -       14  32,128,256
>         cpus     2     1K       -        2  32
>          msi    13     2K       -       13  128
>     nexusdev     5     1K       -        5  16
>      entropy     0     0K       -       14  4096
>      CAM DEV    11    22K       -       25  2048
>      CAM CCB     0     0K       -     3849  2048
>      solaris 16211 103270K       -   398001  16,32,64,128,256,512,1024,2048,4096,8192,16384,32768
>   kstat_data     8     1K       -        8  64
>    sfs_nodes    30    15K       -       30  512
>  fdesc_mount     1     1K       -        1  16
>
>------------------------------------------------------------------------
>vmstat -z
>
>vmstat: memstat_kvm_uma: invalid address (0xfffff8063e5e3e00)
>ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP
>
>
>
>------------------------------------------------------------------------
>vmstat -i
>
>interrupt                          total       rate
>irq16: re0 ehci0                     189          2
>irq23: ehci1                         115          1
>cpu0:timer                          2492         22
>cpu1:timer                          4792         42
>cpu2:timer                          2491         22
>cpu3:timer                          2058         18
>irq34: hdac0                          93          1
>irq36: ahci0                        3769         33
>Total                              15999        141
>
>------------------------------------------------------------------------
>pstat -T
>
> 74/782381 files
>0M/0M swap space
>
>------------------------------------------------------------------------
>pstat -s
>
>Device          512-blocks     Used    Avail Capacity
>
>------------------------------------------------------------------------
>iostat
>
>       tty            ada0              cd0            pass0             cpu
> tin  tout  KB/t tps  MB/s   KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
>   0   113 12.61 125  1.53   0.00   0  0.00   0.00   0  0.00   1  0  6  1 92
>
>------------------------------------------------------------------------
>ipcs -a
>
>Message Queues:
>T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP                 CBYTES                 QNUM               QBYTES        LSPID        LRPID STIME    RTIME    CTIME   
>
>Shared Memory:
>T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP         NATTCH        SEGSZ         CPID         LPID ATIME    DTIME    CTIME   
>
>Semaphores:
>T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP          NSEMS OTIME    CTIME   
>
>
>------------------------------------------------------------------------
>ipcs -T
>
>msginfo:
>	msgmax:        16384	(max characters in a message)
>	msgmni:           40	(# of message queues)
>	msgmnb:         2048	(max characters in a message queue)
>	msgtql:           40	(max # of messages in system)
>	msgssz:            8	(size of a message segment)
>	msgseg:         2048	(# of message segments in system)
>
>shminfo:
>	shmmax:    536870912	(max shared memory segment size)
>	shmmin:            1	(min shared memory segment size)
>	shmmni:          192	(max number of shared memory identifiers)
>	shmseg:          128	(max shared memory segments per process)
>	shmall:       131072	(max amount of shared memory in pages)
>
>seminfo:
>	semmni:           50	(# of semaphore identifiers)
>	semmns:          340	(# of semaphores in system)
>	semmnu:          150	(# of undo structures in system)
>	semmsl:          340	(max # of semaphores per id)
>	semopm:          100	(max # of operations per semop call)
>	semume:           50	(max # of undo entries per process)
>	semusz:          632	(size in bytes of undo structure)
>	semvmx:        32767	(semaphore maximum value)
>	semaem:        16384	(adjust on exit max value)
>
>
>------------------------------------------------------------------------
>nfsstat
>
>Rpc Counts:
>      Getattr      Setattr       Lookup     Readlink         Read        Write       Create       Remove
>            0            0            0            0            0            0            0            0
>       Rename         Link      Symlink        Mkdir        Rmdir      Readdir     RdirPlus       Access
>            0            0            0            0            0            0            0            0
>        Mknod       Fsstat       Fsinfo     PathConf       Commit
>            0            0            0            0            0
>Rpc Info:
>     TimedOut      Invalid    X Replies      Retries     Requests
>            0            0            0            0            0
>Cache Info:
>    Attr Hits  Attr Misses    Lkup Hits  Lkup Misses    BioR Hits  BioR Misses    BioW Hits  BioW Misses
>            0            0            0            0            0            0            0            0
>   BioRL Hits BioRL Misses    BioD Hits  BioD Misses    DirE Hits  DirE Misses    Accs Hits  Accs Misses
>            0            0            0            0            0            0            0            0
>Server Info:
>      Getattr      Setattr       Lookup     Readlink         Read        Write       Create       Remove
>            0            0            0            0            0            0            0            0
>       Rename         Link      Symlink        Mkdir        Rmdir      Readdir     RdirPlus       Access
>            0            0            0            0            0            0            0            0
>        Mknod       Fsstat       Fsinfo     PathConf       Commit
>            0            0            0            0            0
>Server Re-Failed:
>  140737488346800
>Server Faults:
>140737488346800
>Server Write 
>     WriteOps     WriteRPC      Opsaved
>            0            0            0
>Server Cache 
>       Inprog         Idem     Non-Idem       Misses
>            0            0            0            0
>
>------------------------------------------------------------------------
>netstat -s
>
>tcp:
>	0 packets sent
>		0 data packets (0 bytes)
>		0 data packets (0 bytes) retransmitted
>		0 data packets unnecessarily retransmitted
>		0 resends initiated by MTU discovery
>		0 ack-only packets (0 delayed)
>		0 URG only packets
>		0 window probe packets
>		0 window update packets
>		0 control packets
>	0 packets received
>		0 acks (for 0 bytes)
>		0 duplicate acks
>		0 acks for unsent data
>		0 packets (0 bytes) received in-sequence
>		0 completely duplicate packets (0 bytes)
>		0 old duplicate packets
>		0 packets with some dup. data (0 bytes duped)
>		0 out-of-order packets (0 bytes)
>		0 packets (0 bytes) of data after window
>		0 window probes
>		0 window update packets
>		0 packets received after close
>		0 discarded for bad checksums
>		0 discarded for bad header offset fields
>		0 discarded because packet too short
>		0 discarded due to memory problems
>	0 connection requests
>	0 connection accepts
>	0 bad connection attempts
>	0 listen queue overflows
>	0 ignored RSTs in the windows
>	0 connections established (including accepts)
>		0 times used RTT from hostcache
>		0 times used RTT variance from hostcache
>		0 times used slow-start threshold from hostcache
>	2 connections closed (including 0 drops)
>		0 connections updated cached RTT on close
>		0 connections updated cached RTT variance on close
>		0 connections updated cached ssthresh on close
>	0 embryonic connections dropped
>	0 segments updated rtt (of 0 attempts)
>	0 retransmit timeouts
>		0 connections dropped by rexmit timeout
>	0 persist timeouts
>		0 connections dropped by persist timeout
>	0 Connections (fin_wait_2) dropped because of timeout
>	0 keepalive timeouts
>		0 keepalive probes sent
>		0 connections dropped by keepalive
>	0 correct ACK header predictions
>	0 correct data packet header predictions
>	0 syncache entries added
>		0 retransmitted
>		0 dupsyn
>		0 dropped
>		0 completed
>		0 bucket overflow
>		0 cache overflow
>		0 reset
>		0 stale
>		0 aborted
>		0 badack
>		0 unreach
>		0 zone failures
>	0 cookies sent
>	0 cookies received
>	0 hostcache entries added
>		0 bucket overflow
>	0 SACK recovery episodes
>	0 segment rexmits in SACK recovery episodes
>	0 byte rexmits in SACK recovery episodes
>	0 SACK options (SACK blocks) received
>	0 SACK options (SACK blocks) sent
>	0 SACK scoreboard overflow
>	0 packets with ECN CE bit set
>	0 packets with ECN ECT(0) bit set
>	0 packets with ECN ECT(1) bit set
>	0 successful ECN handshakes
>	0 times ECN reduced the congestion window
>	0 packets with matching signature received
>	0 packets with bad signature received
>	0 times failed to make signature due to no SA
>	0 times unexpected signature received
>	0 times no signature provided by segment
>	0 Path MTU discovery black hole detection activations
>	0 Path MTU discovery black hole detection min MSS activations
>	0 Path MTU discovery black hole detection failures
>TCP connection count by state:
>	0 connections in CLOSED state
>	3 connections in LISTEN state
>	0 connections in SYN_SENT state
>	0 connections in SYN_RCVD state
>	0 connections in ESTABLISHED state
>	0 connections in CLOSE_WAIT state
>	0 connections in FIN_WAIT_1 state
>	0 connections in CLOSING state
>	0 connections in LAST_ACK state
>	0 connections in FIN_WAIT_2 state
>	0 connections in TIME_WAIT state
>udp:
>	7 datagrams received
>	0 with incomplete header
>	0 with bad data length field
>	0 with bad checksum
>	0 with no checksum
>	0 dropped due to no socket
>	0 broadcast/multicast datagrams undelivered
>	0 dropped due to full socket buffers
>	0 not for hashed pcb
>	7 delivered
>	7 datagrams output
>	0 times multicast source filter matched
>ip:
>	8 total packets received
>	0 bad header checksums
>	0 with size smaller than minimum
>	0 with data size < data length
>	0 with ip length > max ip packet size
>	0 with header length < data size
>	0 with data length < header length
>	0 with bad options
>	0 with incorrect version number
>	0 fragments received
>	0 fragments dropped (dup or out of space)
>	0 fragments dropped after timeout
>	0 packets reassembled ok
>	7 packets for this host
>	0 packets for unknown/unsupported protocol
>	0 packets forwarded (0 packets fast forwarded)
>	1 packet not forwardable
>	0 packets received for unknown multicast group
>	0 redirects sent
>	7 packets sent from this host
>	0 packets sent with fabricated ip header
>	0 output packets dropped due to no bufs, etc.
>	0 output packets discarded due to no route
>	0 output datagrams fragmented
>	0 fragments created
>	0 datagrams that can't be fragmented
>	0 tunneling packets that can't find gif
>	0 datagrams with bad address in header
>icmp:
>	0 calls to icmp_error
>	0 errors not generated in response to an icmp message
>	0 messages with bad code fields
>	0 messages less than the minimum length
>	0 messages with bad checksum
>	0 messages with bad length
>	0 multicast echo requests ignored
>	0 multicast timestamp requests ignored
>	0 message responses generated
>	0 invalid return addresses
>	0 no return routes
>ipsec:
>	0 inbound packets violated process security policy
>	0 inbound packets failed due to insufficient memory
>	0 invalid inbound packets
>	0 outbound packets violated process security policy
>	0 outbound packets with no SA available
>	0 outbound packets failed due to insufficient memory
>	0 outbound packets with no route available
>	0 invalid outbound packets
>	0 outbound packets with bundled SAs
>	0 spd cache hits
>	0 spd cache misses
>	0 clusters copied during clone
>	0 mbufs inserted during makespace
>ah:
>	0 packets shorter than header shows
>	0 packets dropped; protocol family not supported
>	0 packets dropped; no TDB
>	0 packets dropped; bad KCR
>	0 packets dropped; queue full
>	0 packets dropped; no transform
>	0 replay counter wraps
>	0 packets dropped; bad authentication detected
>	0 packets dropped; bad authentication length
>	0 possible replay packets detected
>	0 packets in
>	0 packets out
>	0 packets dropped; invalid TDB
>	0 bytes in
>	0 bytes out
>	0 packets dropped; larger than IP_MAXPACKET
>	0 packets blocked due to policy
>	0 crypto processing failures
>	0 tunnel sanity check failures
>esp:
>	0 packets shorter than header shows
>	0 packets dropped; protocol family not supported
>	0 packets dropped; no TDB
>	0 packets dropped; bad KCR
>	0 packets dropped; queue full
>	0 packets dropped; no transform
>	0 packets dropped; bad ilen
>	0 replay counter wraps
>	0 packets dropped; bad encryption detected
>	0 packets dropped; bad authentication detected
>	0 possible replay packets detected
>	0 packets in
>	0 packets out
>	0 packets dropped; invalid TDB
>	0 bytes in
>	0 bytes out
>	0 packets dropped; larger than IP_MAXPACKET
>	0 packets blocked due to policy
>	0 crypto processing failures
>	0 tunnel sanity check failures
>ipcomp:
>	0 packets shorter than header shows
>	0 packets dropped; protocol family not supported
>	0 packets dropped; no TDB
>	0 packets dropped; bad KCR
>	0 packets dropped; queue full
>	0 packets dropped; no transform
>	0 replay counter wraps
>	0 packets in
>	0 packets out
>	0 packets dropped; invalid TDB
>	0 bytes in
>	0 bytes out
>	0 packets dropped; larger than IP_MAXPACKET
>	0 packets blocked due to policy
>	0 crypto processing failures
>	0 packets sent uncompressed; size < compr. algo. threshold
>	0 packets sent uncompressed; compression was useless
>arp:
>	2 ARP requests sent
>	1 ARP reply sent
>	1 ARP request received
>	1 ARP reply received
>	2 ARP packets received
>	0 total packets dropped due to no ARP entry
>	0 ARP entrys timed out
>	0 Duplicate IPs seen
>ip6:
>	1 total packet received
>	0 with size smaller than minimum
>	0 with data size < data length
>	0 with bad options
>	0 with incorrect version number
>	0 fragments received
>	0 fragments dropped (dup or out of space)
>	0 fragments dropped after timeout
>	0 fragments that exceeded limit
>	0 packets reassembled ok
>	0 packets for this host
>	0 packets forwarded
>	0 packets not forwardable
>	0 redirects sent
>	5 packets sent from this host
>	0 packets sent with fabricated ip header
>	0 output packets dropped due to no bufs, etc.
>	0 output packets discarded due to no route
>	0 output datagrams fragmented
>	0 fragments created
>	0 datagrams that can't be fragmented
>	0 packets that violated scope rules
>	0 multicast packets which we don't join
>	Input histogram:
>		hop by hop: 1
>	Mbuf statistics:
>		0 one mbuf
>		1 one ext mbuf
>		0 two or more ext mbuf
>	0 packets whose headers are not contiguous
>	0 tunneling packets that can't find gif
>	0 packets discarded because of too many headers
>	0 failures of source address selection
>icmp6:
>	0 calls to icmp6_error
>	0 errors not generated in response to an icmp6 message
>	0 errors not generated because of rate limitation
>	Output histogram:
>		neighbor solicitation: 1
>		MLDv2 listener report: 4
>	0 messages with bad code fields
>	0 messages < minimum length
>	0 bad checksums
>	0 messages with bad length
>	Input histogram:
>		multicast listener query: 1
>	Histogram of error messages to be generated:
>		0 no route
>		0 administratively prohibited
>		0 beyond scope
>		0 address unreachable
>		0 port unreachable
>		0 packet too big
>		0 time exceed transit
>		0 time exceed reassembly
>		0 erroneous header field
>		0 unrecognized next header
>		0 unrecognized option
>		0 redirect
>		0 unknown
>	0 message responses generated
>	0 messages with too many ND options
>	0 messages with bad ND options
>	0 bad neighbor solicitation messages
>	0 bad neighbor advertisement messages
>	0 bad router solicitation messages
>	0 bad router advertisement messages
>	0 bad redirect messages
>	0 path MTU changes
>ipsec6:
>	0 inbound packets violated process security policy
>	0 inbound packets failed due to insufficient memory
>	0 invalid inbound packets
>	0 outbound packets violated process security policy
>	0 outbound packets with no SA available
>	0 outbound packets failed due to insufficient memory
>	0 outbound packets with no route available
>	0 invalid outbound packets
>	0 outbound packets with bundled SAs
>	0 spd cache hits
>	0 spd cache misses
>	0 clusters copied during clone
>	0 mbufs inserted during makespace
>rip6:
>	0 messages received
>	0 checksum calculations on inbound
>	0 messages with bad checksum
>	0 messages dropped due to no socket
>	0 multicast messages dropped due to no socket
>	0 messages dropped due to full socket buffers
>	0 delivered
>	0 datagrams output
>pfkey:
>	0 requests sent from userland
>	0 bytes sent from userland
>	0 messages with invalid length field
>	0 messages with invalid version field
>	0 messages with invalid message type field
>	0 messages too short
>	0 messages with memory allocation failure
>	0 messages with duplicate extension
>	0 messages with invalid extension type
>	0 messages with invalid sa type
>	0 messages with invalid address extension
>	0 requests sent to userland
>	0 bytes sent to userland
>	0 messages toward single socket
>	0 messages toward all sockets
>	0 messages toward registered sockets
>	0 messages with memory allocation failure
>
>------------------------------------------------------------------------
>netstat -m
>
>netstat: memstat_kvm_all: invalid address (0xfffff8063e5e3e00)
>
>------------------------------------------------------------------------
>netstat -anA
>
>Active Internet connections (including servers)
>Tcpcb            Proto Recv-Q Send-Q Local Address      Foreign Address    (state)    
>fffff80012f407a0 udp4       0      0 *.514              *.*                
>fffff80012f405b8 udp6       0      0 *.514              *.*                
>
>------------------------------------------------------------------------
>netstat -aL
>
>Current listen queue sizes (qlen/incqlen/maxqlen)
>Proto Listen                           Local Address         
>
>------------------------------------------------------------------------
>fstat
>
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20000000008800d
>fstat: can't read file 2 at 0x4000000000000a0
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x600000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x400000000
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x400000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read file 8 at 0x4000000001fffff
>fstat: can't read file 10 at 0x780000ffff
>fstat: can't read file 11 at 0x400000000
>fstat: can't read file 13 at 0x20007ffffffffff
>fstat: can't read file 14 at 0x4000000001fffff
>fstat: can't read file 16 at 0x780000ffff
>fstat: can't read file 17 at 0x400000000
>fstat: can't read file 19 at 0x20007ffffffffff
>fstat: can't read file 20 at 0x4000000001fffff
>fstat: can't read file 22 at 0x780000ffff
>fstat: can't read file 23 at 0x2600000001
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x800000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x200000000000000
>fstat: can't read file 2 at 0x400000000000000
>fstat: can't read file 5 at 0x800000000
>fstat: can't read file 7 at 0x200000000000002
>fstat: can't read file 8 at 0x400000000000000
>fstat: can't read file 11 at 0x400000000
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x800000000
>fstat: can't read file 7 at 0x20007ffffffffff
>fstat: can't read file 8 at 0x4000000001fffff
>fstat: can't read file 10 at 0x780000ffff
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read file 1 at 0x20007ffffffffff
>fstat: can't read file 2 at 0x4000000001fffff
>fstat: can't read file 4 at 0x780000ffff
>fstat: can't read file 5 at 0x800000000
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>fstat: can't read znode_phys at 0x1
>USER     CMD          PID   FD MOUNT      INUM MODE         SZ|DV R/W
>root                 1094 root -         -       error    -
>root                 1094   wd -         -       error    -
>root                 1094 text -         -       error    -
>root                 1094    0 /dev        112 crw-------   ttyv7 rw
>root                 1093 root -         -       error    -
>root                 1093   wd -         -       error    -
>root                 1093 text -         -       error    -
>root                 1093    0 /dev        111 crw-------   ttyv6 rw
>root                 1092 root -         -       error    -
>root                 1092   wd -         -       error    -
>root                 1092 text -         -       error    -
>root                 1092    0 /dev        110 crw-------   ttyv5 rw
>root                 1091 root -         -       error    -
>root                 1091   wd -         -       error    -
>root                 1091 text -         -       error    -
>root                 1091    0 /dev        109 crw-------   ttyv4 rw
>root                 1090 root -         -       error    -
>root                 1090   wd -         -       error    -
>root                 1090 text -         -       error    -
>root                 1090    0 /dev        108 crw-------   ttyv3 rw
>root                 1089 root -         -       error    -
>root                 1089   wd -         -       error    -
>root                 1089 text -         -       error    -
>root                 1089    0 /dev        107 crw-------   ttyv2 rw
>root                 1088 root -         -       error    -
>root                 1088   wd -         -       error    -
>root                 1088 text -         -       error    -
>root                 1088    0 /dev        106 crw-------   ttyv1 rw
>root                 1087 root -         -       error    -
>root                 1087   wd -         -       error    -
>root                 1087 text -         -       error    -
>root                 1087    0 /dev        105 crw-------   ttyv0 rw
>root                 1085 root -         -       error    -
>root                 1085   wd -         -       error    -
>root                 1085 text -         -       error    -
>root                 1085    0 /dev         36 crw-rw-rw-    null  r
>root                 1084 root -         -       error    -
>root                 1084   wd -         -       error    -
>root                 1084 text -         -       error    -
>root                 1084    0* pipe fffff800107998e8 <-> fffff80010799a50      0 rw
>root                 1083 root -         -       error    -
>root                 1083   wd -         -       error    -
>root                 1083 text -         -       error    -
>root                 1083    0 /dev         36 crw-rw-rw-    null  r
>root                 1027 root -         -       error    -
>root                 1027   wd -         -       error    -
>root                 1027 text -         -       error    -
>root                 1027    0 /dev         36 crw-rw-rw-    null rw
>smmsp                1023 root -         -       error    -
>smmsp                1023   wd -         -       error    -
>smmsp                1023 text -         -       error    -
>smmsp                1023    0 /dev         36 crw-rw-rw-    null  r
>root                 1020 root -         -       error    -
>root                 1020   wd -         -       error    -
>root                 1020 text -         -       error    -
>root                 1020    0 /dev         36 crw-rw-rw-    null  r
>root                 1020    6 /dev         36 crw-rw-rw-    null  w
>root                 1017 root -         -       error    -
>root                 1017   wd -         -       error    -
>root                 1017 text -         -       error    -
>root                 1017    0 /dev         36 crw-rw-rw-    null rw
>root                 1017    6 /dev         36 crw-rw-rw-    null rw
>root                  973 root -         -       error    -
>root                  973   wd -         -       error    -
>root                  973 text -         -       error    -
>root                  973    0 /dev         36 crw-rw-rw-    null rw
>root                  811 root -         -       error    -
>root                  811   wd -         -       error    -
>root                  811 text -         -       error    -
>root                  811    0 /dev         36 crw-rw-rw-    null rw
>root                  811    6 /dev         36 crw-rw-rw-    null rw
>root                  811   12 /dev         36 crw-rw-rw-    null rw
>root                  811   18* pipe fffff8001a06b8e8 <-> fffff8001a06ba50      0 rw
>root                  736 root -         -       error    -
>root                  736   wd -         -       error    -
>root                  736 text -         -       error    -
>root                  736    0 /dev         36 crw-rw-rw-    null rw
>root                  736    6 /dev         36 crw-rw-rw-    null rw
>_dhcp                 735 root -         -       error    -
>_dhcp                 735   wd -         -       error    -
>_dhcp                 735 text -         -       error    -
>_dhcp                 735    0 /dev         36 crw-rw-rw-    null rw
>_dhcp                 735    6 /dev         36 crw-rw-rw-    null rw
>root                  689 root -         -       error    -
>root                  689   wd -         -       error    -
>root                  689 text -         -       error    -
>root                  689    0 /dev         36 crw-rw-rw-    null rw
>root                  689    6 /dev         36 crw-rw-rw-    null rw
>root                  686 root -         -       error    -
>root                  686   wd -         -       error    -
>root                  686 text -         -       error    -
>root                  686    0 /dev         36 crw-rw-rw-    null rw
>root                  686    6 /dev         36 crw-rw-rw-    null rw
>root                   18 root -         -       error    -
>root                   18   wd -         -       error    -
>root                    1 root -         -       error    -
>root                    1   wd -         -       error    -
>root                    1 text -         -       error    -
>root                    0 root -         -       error    -
>root                    0   wd -         -       error    -
>
>------------------------------------------------------------------------
>dmesg
>
>---<<BOOT>>---
>Copyright (c) 1992-2018 The FreeBSD Project.
>Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>	The Regents of the University of California. All rights reserved.
>FreeBSD is a registered trademark of The FreeBSD Foundation.
>FreeBSD 13.0-CURRENT #38 r342190M: Mon Jan  7 21:10:11 MSK 2019
>    butcher@btr-test.yandex.net:/usr/obj/home/devel/freebsd/base/head/amd64.amd64/sys/GENERIC amd64
>FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1)
>WARNING: WITNESS option enabled, expect reduced performance.
>VT(vga): resolution 640x480
>CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (3093.05-MHz K8-class CPU)
>  Origin="GenuineIntel"  Id=0x206a7  Family=0x6  Model=0x2a  Stepping=7
>  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>  Features2=0x1fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX>
>  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
>  AMD Features2=0x1<LAHF>
>  XSAVE Features=0x1<XSAVEOPT>
>  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
>  TSC: P-state invariant, performance statistics
>real memory  = 25769803776 (24576 MB)
>avail memory = 24871919616 (23719 MB)
>Event timer "LAPIC" quality 600
>ACPI APIC Table: <INTEL  DQ67SW  >
>FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
>FreeBSD/SMP: 1 package(s) x 4 core(s)
>random: unblocking device.
>ioapic0 <Version 2.0> irqs 0-23 on motherboard
>Launching APs: 3 2 1
>Timecounter "TSC-low" frequency 1546523272 Hz quality 1000
>random: entropy device external interface
>[ath_hal] loaded
>kbd1 at kbdmux0
>module_register_init: MOD_LOAD (vesa, 0xffffffff810fdf40, 0) error 19
>000.000047 [4164] netmap_init               netmap: loaded module
>nexus0
>vtvga0: <VT VGA driver> on motherboard
>cryptosoft0: <software crypto> on motherboard
>acpi0: <RStyle Proxima> on motherboard
>acpi0: Power Button (fixed)
>cpu0: <ACPI CPU> on acpi0
>attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
>Timecounter "i8254" frequency 1193182 Hz quality 0
>Event timer "i8254" frequency 1193182 Hz quality 100
>atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
>atrtc0: registered as a time-of-day clock, resolution 1.000000s
>Event timer "RTC" frequency 32768 Hz quality 0
>hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
>Timecounter "HPET" frequency 14318180 Hz quality 950
>Event timer "HPET" frequency 14318180 Hz quality 550
>Event timer "HPET1" frequency 14318180 Hz quality 440
>Event timer "HPET2" frequency 14318180 Hz quality 440
>Event timer "HPET3" frequency 14318180 Hz quality 440
>Event timer "HPET4" frequency 14318180 Hz quality 440
>Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
>acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
>pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
>pci0: <ACPI PCI bus> on pcib0
>pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
>pci1: <ACPI PCI bus> on pcib1
>vgapci0: <VGA-compatible display> port 0xf000-0xf03f mem 0xfe000000-0xfe3fffff,0xd0000000-0xdfffffff irq 16 at device 2.0 on pci0
>vgapci0: Boot video device
>pci0: <simple comms> at device 22.0 (no driver attached)
>atapci0: <Intel ATA controller> port 0xf130-0xf137,0xf120-0xf123,0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0ff irq 18 at device 22.2 on pci0
>ata2: <ATA channel> at channel 0 on atapci0
>ata3: <ATA channel> at channel 1 on atapci0
>uart2: <Intel AMT - KT Controller> port 0xf0e0-0xf0e7 mem 0xfe629000-0xfe629fff irq 17 at device 22.3 on pci0
>uart2: Using 1 MSI message
>em0: <Intel(R) PRO/1000 Network Connection> port 0xf080-0xf09f mem 0xfe600000-0xfe61ffff,0xfe628000-0xfe628fff irq 20 at device 25.0 on pci0
>em0: attach_pre capping queues at 1
>em0: using 1024 tx descriptors and 1024 rx descriptors
>em0: msix_init qsets capped at 1
>em0: Unable to map MSIX table 
>em0: Using an MSI interrupt
>em0: allocated for 1 tx_queues
>em0: allocated for 1 rx_queues
>em0: Ethernet address: 00:22:4d:6a:5e:b9
>em0: netmap queues/slots: TX 1/1024, RX 1/1024
>ehci0: <Intel Cougar Point USB 2.0 controller> mem 0xfe627000-0xfe6273ff irq 16 at device 26.0 on pci0
>usbus0: EHCI version 1.0
>usbus0 on ehci0
>usbus0: 480Mbps High Speed USB v2.0
>hdac0: <Intel Cougar Point HDA Controller> mem 0xfe620000-0xfe623fff irq 22 at device 27.0 on pci0
>pcib2: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
>pci2: <ACPI PCI bus> on pcib2
>pcib3: <ACPI PCI-PCI bridge> irq 18 at device 28.6 on pci0
>pci3: <ACPI PCI bus> on pcib3
>xhci0: <NEC uPD720200 USB 3.0 controller> mem 0xfe500000-0xfe501fff irq 18 at device 0.0 on pci3
>xhci0: 32 bytes context size, 32-bit DMA
>xhci0: Unable to map MSI-X table 
>usbus1 on xhci0
>usbus1: 5.0Gbps Super Speed USB v3.0
>ehci1: <Intel Cougar Point USB 2.0 controller> mem 0xfe626000-0xfe6263ff irq 23 at device 29.0 on pci0
>usbus2: EHCI version 1.0
>usbus2 on ehci1
>usbus2: 480Mbps High Speed USB v2.0
>pcib4: <ACPI PCI-PCI bridge> at device 30.0 on pci0
>pci4: <ACPI PCI bus> on pcib4
>re0: <D-Link DGE-528(T) Gigabit Ethernet Adapter> port 0xe000-0xe0ff mem 0xfe421000-0xfe4210ff irq 16 at device 0.0 on pci4
>re0: Chip rev. 0x10000000
>re0: MAC rev. 0x00000000
>miibus0: <MII bus> on re0
>rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0
>rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
>re0: Using defaults for TSO: 65518/35/2048
>re0: Ethernet address: 1c:bd:b9:de:0d:7d
>re0: netmap queues/slots: TX 1/256, RX 1/256
>pci4: <serial bus, FireWire> at device 3.0 (no driver attached)
>isab0: <PCI-ISA bridge> at device 31.0 on pci0
>isa0: <ISA bus> on isab0
>ahci0: <Intel Cougar Point AHCI SATA controller> port 0xf0d0-0xf0d7,0xf0c0-0xf0c3,0xf0b0-0xf0b7,0xf0a0-0xf0a3,0xf060-0xf07f mem 0xfe625000-0xfe6257ff irq 19 at device 31.2 on pci0
>ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
>ahcich0: <AHCI channel> at channel 0 on ahci0
>ahcich3: <AHCI channel> at channel 3 on ahci0
>ahcich4: <AHCI channel> at channel 4 on ahci0
>ahcich5: <AHCI channel> at channel 5 on ahci0
>ahciem0: <AHCI enclosure management bridge> on ahci0
>acpi_button0: <Power Button> on acpi0
>uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
>orm0: <ISA Option ROMs> at iomem 0xc0000-0xcdfff,0xce000-0xcefff pnpid ORM0000 on isa0
>atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
>atkbd0: <AT Keyboard> irq 1 on atkbdc0
>kbd0 at atkbd0
>atkbd0: [GIANT-LOCKED]
>atkbdc0: non-PNP ISA device will be removed from GENERIC in FreeBSD 12.
>est0: <Enhanced SpeedStep Frequency Control> on cpu0
>ZFS filesystem version: 5
>ZFS storage pool version: features support (5000)
>Timecounters tick every 1.000 msec
>hdacc0: <Realtek ALC888 HDA CODEC> at cad 2 on hdac0
>hdaa0: <Realtek ALC888 Audio Function Group> at nid 1 on hdacc0
>pcm0: <Realtek ALC888 (Rear Analog)> at nid 20 and 24,26 on hdaa0
>pcm1: <Realtek ALC888 (Front Analog)> at nid 27 and 25 on hdaa0
>pcm2: <Realtek ALC888 (Onboard Digital)> at nid 30 on hdaa0
>pcm3: <Realtek ALC888 (Onboard Analog Speaker)> at nid 23 on hdaa0
>hdacc1: <Intel Cougar Point HDA CODEC> at cad 3 on hdac0
>hdaa1: <Intel Cougar Point Audio Function Group> at nid 1 on hdacc1
>pcm4: <Intel Cougar Point (HDMI/DP 8ch)> at nid 6 on hdaa1
>ugen1.1: <0x1033 XHCI root HUB> at usbus1
>ugen0.1: <Intel EHCI root HUB> at usbus0
>ugen2.1: <Intel EHCI root HUB> at usbus2
>uhub0: <0x1033 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
>uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
>uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
>uhub0: 4 ports with 4 removable, self powered
>uhub1: 3 ports with 3 removable, self powered
>uhub2: 3 ports with 3 removable, self powered
>ugen2.2: <vendor 0x8087 product 0x0024> at usbus2
>uhub3 on uhub1
>uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus2
>ugen0.2: <vendor 0x8087 product 0x0024> at usbus0
>uhub4 on uhub2
>uhub4: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
>ses0 at ahciem0 bus 0 scbus6 target 0 lun 0
>ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
>ses0: SEMB SES Device
>cd0 at ahcich3 bus 0 scbus3 target 0 lun 0
>cd0: <Optiarc DVD RW AD-7280S 1.01> Removable CD-ROM SCSI device
>cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
>cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
>ada0 at ahcich0 bus 0 scbus2 target 0 lun 0
>ada0: <HDS725050KLA360 K2AOAB5A> ATA-7 SATA 2.x device
>ada0: Serial Number KRVN67ZBH70EMF
>ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
>ada0: Command Queueing enabled
>ada0: 476940MB (976773168 512 byte sectors)
>WARNING: WITNESS option enabled, expect reduced performance.
>Trying to mount root from zfs:z/ROOT/head []...
>Root mount waiting for: usbus2 usbus0
>uhub4: 6 ports with 6 removable, self powered
>uhub3: 8 ports with 8 removable, self powered
>ugen0.3: <vendor 0x04f3 product 0x0103> at usbus0
>ukbd0 on uhub4
>ukbd0: <vendor 0x04f3 product 0x0103, class 0/0, rev 2.00/1.07, addr 3> on usbus0
>kbd2 at ukbd0
>Setting hostuuid: d0848cdb-a7f4-e011-bb5d-000ea68f73ad.
>Setting hostid: 0xfe8654eb.
>Starting file system checks:
>Mounting local filesystems:.
>ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/perl5/5.26/mach/CORE /usr/local/lib/pth
>32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat
>Setting hostname: btr-test.yandex.net.
>Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
>Feeding entropy: .
>lo0: link state changed to UP
>re0: link state changed to DOWN
>Starting Network: lo0 em0 re0 enc0.
>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
>	options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
>	inet6 ::1 prefixlen 128 
>	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 
>	inet 127.0.0.1 netmask 0xff000000 
>	groups: lo 
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>em0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
>	options=81249b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,WOL_MAGIC,VLAN_HWFILTER>
>	ether 00:22:4d:6a:5e:b9
>	media: Ethernet autoselect
>	status: no carrier
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>	options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
>	ether 1c:bd:b9:de:0d:7d
>	inet6 fe80::1ebd:b9ff:fede:d7d%re0 prefixlen 64 scopeid 0x2 
>re0: link state changed to UP
>	media: Ethernet autoselect (1000baseT <full-duplex>)
>	status: active
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>enc0: flags=0<> metric 0 mtu 1536
>	groups: enc 
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>Starting devd.
>Starting Network: em0.
>em0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
>	options=81249b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,WOL_MAGIC,VLAN_HWFILTER>
>	ether 00:22:4d:6a:5e:b9
>	media: Ethernet autoselect
>	status: no carrier
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>Starting Network: enc0.
>enc0: flags=0<> metric 0 mtu 1536
>	groups: enc 
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>Autoloading module: uhid.ko
>Autoloading module: wmt.ko
>uhid0 on uhub4
>uhid0: <vendor 0x04f3 product 0x0103, class 0/0, rev 2.00/1.07, addr 3> on usbus0
>Starting dhclient.
>DHCPREQUEST on re0 to 255.255.255.255 port 67
>DHCPACK from 10.9.8.1
>bound to 10.9.8.12 -- renewal in 180000 seconds.
>add host 127.0.0.1: gateway lo0 fib 0: route already in table
>add host ::1: gateway lo0 fib 0: route already in table
>add net fe80::: gateway ::1
>add net ff02::: gateway ::1
>add net ::ffff:0.0.0.0: gateway ::1
>add net ::0.0.0.0: gateway ::1
>Creating and/or trimming log files.
>Starting syslogd.
>No core dumps found.
>Clearing /tmp (X related).
>Updating motd:.
>Mounting late filesystems:.
>Starting powerd.
>Configuring vt: blanktime.
>Performing sanity check on sshd configuration.
>Starting sshd.
>Starting sendmail_submit.
>Starting sendmail_msp_queue.
>Starting cron.
>Starting background file system checks in 60 seconds.
>
>Mon Jan  7 23:16:39 MSK 2019
>Jan  7 23:21:43 btr-test su[1104]: butcher to root on /dev/pts/0
>Jan  7 23:22:23 btr-test su[1136]: butcher to root on /dev/pts/0
>Jan  7 23:38:08 btr-test shutdown[85967]: reboot by butcher: 
>Stopping cron.
>Waiting for PIDS: 1023.
>Stopping sshd.
>Waiting for PIDS: 1013.
>Stopping powerd.
>Waiting for PIDS: 969.
>Stopping devd.
>Waiting for PIDS: 734.
>Writing entropy file:.
>Writing early boot entropy file:.
>.
>Terminated
>Jan  7 23:38:08 btr-test syslogd: exiting on signal 15
>Waiting (max 60 seconds) for system process `vnlru' to stop... done
>Waiting (max 60 seconds) for system process `syncer' to stop... 
>Syncing disks, vnodes remaining... 0 0 0 0 0 done
>Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
>Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
>Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
>Waiting (max 60 seconds) for system thread `bufspacedaemon-2' to stop... done
>Waiting (max 60 seconds) for system thread `bufspacedaemon-3' to stop... done
>Waiting (max 60 seconds) for system thread `bufspacedaemon-4' to stop... done
>Waiting (max 60 seconds) for system thread `bufspacedaemon-5' to stop... done
>Waiting (max 60 seconds) for system thread `bufspacedaemon-6' to stop... done
>All buffers synced.
>lock order reversal:
> 1st 0xfffff8000ef429c8 zfs (zfs) @ /home/devel/freebsd/base/head/sys/kern/vfs_mount.c:1353
> 2nd 0xfffff8000e192248 devfs (devfs) @ /home/devel/freebsd/base/head/sys/kern/vfs_subr.c:2590
>stack backtrace:
>#0 0xffffffff80c109c3 at witness_debugger+0x73
>#1 0xffffffff80c10713 at witness_checkorder+0xab3
>#2 0xffffffff80b7d13a at lockmgr_lock_fast_path+0x17a
>#3 0xffffffff812015e3 at VOP_LOCK1_APV+0x73
>#4 0xffffffff80c8c160 at _vn_lock+0x60
>#5 0xffffffff80c7a94f at vget+0x5f
>#6 0xffffffff80a62add at devfs_allocv+0xdd
>#7 0xffffffff80a625e3 at devfs_root+0x43
>#8 0xffffffff80c7b3e8 at vflush+0x48
>#9 0xffffffff80a624e3 at devfs_unmount+0x43
>#10 0xffffffff80c73271 at dounmount+0x4b1
>#11 0xffffffff80c7c794 at vfs_unmountall+0xc4
>#12 0xffffffff80c58835 at bufshutdown+0x2c5
>#13 0xffffffff80ba87b8 at kern_reboot+0x218
>#14 0xffffffff80ba8549 at sys_reboot+0x3a9
>#15 0xffffffff81077eb4 at amd64_syscall+0x274
>#16 0xffffffff8105137d at fast_syscall_common+0x101
>Uptime: 21m59s
>---<<BOOT>>---
>Copyright (c) 1992-2018 The FreeBSD Project.
>Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>	The Regents of the University of California. All rights reserved.
>FreeBSD is a registered trademark of The FreeBSD Foundation.
>FreeBSD 13.0-CURRENT #39 r342190M: Mon Jan  7 23:28:59 MSK 2019
>    butcher@btr-test.yandex.net:/usr/obj/home/devel/freebsd/base/head/amd64.amd64/sys/GENERIC amd64
>FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1)
>WARNING: WITNESS option enabled, expect reduced performance.
>VT(vga): resolution 640x480
>CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (3093.04-MHz K8-class CPU)
>  Origin="GenuineIntel"  Id=0x206a7  Family=0x6  Model=0x2a  Stepping=7
>  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>  Features2=0x1fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX>
>  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
>  AMD Features2=0x1<LAHF>
>  XSAVE Features=0x1<XSAVEOPT>
>  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
>  TSC: P-state invariant, performance statistics
>real memory  = 25769803776 (24576 MB)
>avail memory = 24871919616 (23719 MB)
>Event timer "LAPIC" quality 600
>ACPI APIC Table: <INTEL  DQ67SW  >
>FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
>FreeBSD/SMP: 1 package(s) x 4 core(s)
>random: unblocking device.
>ioapic0 <Version 2.0> irqs 0-23 on motherboard
>Launching APs: 2 1 3
>Timecounter "TSC-low" frequency 1546521087 Hz quality 1000
>random: entropy device external interface
>[ath_hal] loaded
>kbd1 at kbdmux0
>module_register_init: MOD_LOAD (vesa, 0xffffffff810fdf40, 0) error 19
>000.000047 [4164] netmap_init               netmap: loaded module
>nexus0
>vtvga0: <VT VGA driver> on motherboard
>cryptosoft0: <software crypto> on motherboard
>acpi0: <RStyle Proxima> on motherboard
>acpi0: Power Button (fixed)
>cpu0: <ACPI CPU> on acpi0
>attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
>Timecounter "i8254" frequency 1193182 Hz quality 0
>Event timer "i8254" frequency 1193182 Hz quality 100
>atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
>atrtc0: registered as a time-of-day clock, resolution 1.000000s
>Event timer "RTC" frequency 32768 Hz quality 0
>hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
>Timecounter "HPET" frequency 14318180 Hz quality 950
>Event timer "HPET" frequency 14318180 Hz quality 550
>Event timer "HPET1" frequency 14318180 Hz quality 440
>Event timer "HPET2" frequency 14318180 Hz quality 440
>Event timer "HPET3" frequency 14318180 Hz quality 440
>Event timer "HPET4" frequency 14318180 Hz quality 440
>Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
>acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
>pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
>pci0: <ACPI PCI bus> on pcib0
>pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
>pci1: <ACPI PCI bus> on pcib1
>vgapci0: <VGA-compatible display> port 0xf000-0xf03f mem 0xfe000000-0xfe3fffff,0xd0000000-0xdfffffff irq 16 at device 2.0 on pci0
>vgapci0: Boot video device
>pci0: <simple comms> at device 22.0 (no driver attached)
>atapci0: <Intel ATA controller> port 0xf130-0xf137,0xf120-0xf123,0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0ff irq 18 at device 22.2 on pci0
>ata2: <ATA channel> at channel 0 on atapci0
>ata3: <ATA channel> at channel 1 on atapci0
>uart2: <Intel AMT - KT Controller> port 0xf0e0-0xf0e7 mem 0xfe629000-0xfe629fff irq 17 at device 22.3 on pci0
>uart2: Using 1 MSI message
>em0: <Intel(R) PRO/1000 Network Connection> port 0xf080-0xf09f mem 0xfe600000-0xfe61ffff,0xfe628000-0xfe628fff irq 20 at device 25.0 on pci0
>em0: attach_pre capping queues at 1
>em0: using 1024 tx descriptors and 1024 rx descriptors
>em0: msix_init qsets capped at 1
>em0: Unable to map MSIX table 
>em0: Using an MSI interrupt
>em0: allocated for 1 tx_queues
>em0: allocated for 1 rx_queues
>em0: Ethernet address: 00:22:4d:6a:5e:b9
>em0: netmap queues/slots: TX 1/1024, RX 1/1024
>ehci0: <Intel Cougar Point USB 2.0 controller> mem 0xfe627000-0xfe6273ff irq 16 at device 26.0 on pci0
>usbus0: EHCI version 1.0
>usbus0 on ehci0
>usbus0: 480Mbps High Speed USB v2.0
>hdac0: <Intel Cougar Point HDA Controller> mem 0xfe620000-0xfe623fff irq 22 at device 27.0 on pci0
>pcib2: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
>pci2: <ACPI PCI bus> on pcib2
>pcib3: <ACPI PCI-PCI bridge> irq 18 at device 28.6 on pci0
>pci3: <ACPI PCI bus> on pcib3
>xhci0: <NEC uPD720200 USB 3.0 controller> mem 0xfe500000-0xfe501fff irq 18 at device 0.0 on pci3
>xhci0: 32 bytes context size, 32-bit DMA
>xhci0: Unable to map MSI-X table 
>usbus1 on xhci0
>usbus1: 5.0Gbps Super Speed USB v3.0
>ehci1: <Intel Cougar Point USB 2.0 controller> mem 0xfe626000-0xfe6263ff irq 23 at device 29.0 on pci0
>usbus2: EHCI version 1.0
>usbus2 on ehci1
>usbus2: 480Mbps High Speed USB v2.0
>pcib4: <ACPI PCI-PCI bridge> at device 30.0 on pci0
>pci4: <ACPI PCI bus> on pcib4
>re0: <D-Link DGE-528(T) Gigabit Ethernet Adapter> port 0xe000-0xe0ff mem 0xfe421000-0xfe4210ff irq 16 at device 0.0 on pci4
>re0: Chip rev. 0x10000000
>re0: MAC rev. 0x00000000
>miibus0: <MII bus> on re0
>rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0
>rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
>re0: Using defaults for TSO: 65518/35/2048
>re0: Ethernet address: 1c:bd:b9:de:0d:7d
>re0: netmap queues/slots: TX 1/256, RX 1/256
>pci4: <serial bus, FireWire> at device 3.0 (no driver attached)
>isab0: <PCI-ISA bridge> at device 31.0 on pci0
>isa0: <ISA bus> on isab0
>ahci0: <Intel Cougar Point AHCI SATA controller> port 0xf0d0-0xf0d7,0xf0c0-0xf0c3,0xf0b0-0xf0b7,0xf0a0-0xf0a3,0xf060-0xf07f mem 0xfe625000-0xfe6257ff irq 19 at device 31.2 on pci0
>ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
>ahcich0: <AHCI channel> at channel 0 on ahci0
>ahcich3: <AHCI channel> at channel 3 on ahci0
>ahcich4: <AHCI channel> at channel 4 on ahci0
>ahcich5: <AHCI channel> at channel 5 on ahci0
>ahciem0: <AHCI enclosure management bridge> on ahci0
>acpi_button0: <Power Button> on acpi0
>uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
>orm0: <ISA Option ROMs> at iomem 0xc0000-0xcdfff,0xce000-0xcefff pnpid ORM0000 on isa0
>atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
>atkbd0: <AT Keyboard> irq 1 on atkbdc0
>kbd0 at atkbd0
>atkbd0: [GIANT-LOCKED]
>atkbdc0: non-PNP ISA device will be removed from GENERIC in FreeBSD 12.
>est0: <Enhanced SpeedStep Frequency Control> on cpu0
>ZFS filesystem version: 5
>ZFS storage pool version: features support (5000)
>Timecounters tick every 1.000 msec
>hdacc0: <Realtek ALC888 HDA CODEC> at cad 2 on hdac0
>hdaa0: <Realtek ALC888 Audio Function Group> at nid 1 on hdacc0
>pcm0: <Realtek ALC888 (Rear Analog)> at nid 20 and 24,26 on hdaa0
>pcm1: <Realtek ALC888 (Front Analog)> at nid 27 and 25 on hdaa0
>pcm2: <Realtek ALC888 (Onboard Digital)> at nid 30 on hdaa0
>pcm3: <Realtek ALC888 (Onboard Analog Speaker)> at nid 23 on hdaa0
>hdacc1: <Intel Cougar Point HDA CODEC> at cad 3 on hdac0
>hdaa1: <Intel Cougar Point Audio Function Group> at nid 1 on hdacc1
>pcm4: <Intel Cougar Point (HDMI/DP 8ch)> at nid 6 on hdaa1
>ugen1.1: <0x1033 XHCI root HUB> at usbus1
>ugen0.1: <Intel EHCI root HUB> at usbus0
>ugen2.1: <Intel EHCI root HUB> at usbus2
>uhub0: <0x1033 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
>uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
>uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
>uhub0: 4 ports with 4 removable, self powered
>uhub1: 3 ports with 3 removable, self powered
>uhub2: 3 ports with 3 removable, self powered
>ugen0.2: <vendor 0x8087 product 0x0024> at usbus0
>uhub3 on uhub1
>uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
>ugen2.2: <vendor 0x8087 product 0x0024> at usbus2
>ses0 at ahciem0 bus 0 scbus6 target 0 lun 0
>ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
>ses0: SEMB SES Device
>cd0 at ahcich3 bus 0 scbus3 target 0 lun 0
>cd0: <Optiarc DVD RW AD-7280S 1.01> Removable CD-ROM SCSI device
>cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
>cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
>uhub4 on uhub2
>ada0 at ahcich0 bus 0 scbus2 target 0 lun 0
>ada0: <HDS725050KLA360 K2AOAB5A> ATA-7 SATA 2.x device
>ada0: Serial Number KRVN67ZBH70EMF
>ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
>ada0: Command Queueing enabled
>ada0: 476940MB (976773168 512 byte sectors)
>uhub4: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus2
>WARNING: WITNESS option enabled, expect reduced performance.
>Trying to mount root from zfs:z/ROOT/head []...
>Root mount waiting for: usbus2 usbus0
>uhub3: 6 ports with 6 removable, self powered
>Root mount waiting for: usbus2 usbus0
>uhub4: 8 ports with 8 removable, self powered
>ugen0.3: <vendor 0x04f3 product 0x0103> at usbus0
>ukbd0 on uhub3
>ukbd0: <vendor 0x04f3 product 0x0103, class 0/0, rev 2.00/1.07, addr 3> on usbus0
>kbd2 at ukbd0
>Setting hostuuid: d0848cdb-a7f4-e011-bb5d-000ea68f73ad.
>Setting hostid: 0xfe8654eb.
>Starting file system checks:
>Mounting local filesystems:.
>ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/perl5/5.26/mach/CORE /usr/local/lib/pth
>32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat
>Setting hostname: btr-test.yandex.net.
>Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
>Feeding entropy: .
>lo0: link state changed to UP
>set - inm=0xfffff80010c79200 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x153e/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x16a/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>set - inm=0xfffff800038f7400 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x1667/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x16a/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>set - inm=0xfffff800038f7300 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x1754/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x16a/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>set - inm=0xfffff800038f7200 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x187c/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x16a/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>set - inm=0xfffff800038f7100 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x1981/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x16a/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>check - inm=0xfffff80010c79200 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x164/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x153e/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>acquire_locked - post inc - inm=0xfffff80010c79200 - in6m_refcount = 2
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x1b4/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x153e/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>check - inm=0xfffff800038f7400 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x164/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x1667/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>acquire_locked - post inc - inm=0xfffff800038f7400 - in6m_refcount = 2
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x1b4/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x1667/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>check - inm=0xfffff800038f7300 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x164/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x1754/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>acquire_locked - post inc - inm=0xfffff800038f7300 - in6m_refcount = 2
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x1b4/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x1754/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>check - inm=0xfffff800038f7200 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x164/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x187c/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>acquire_locked - post inc - inm=0xfffff800038f7200 - in6m_refcount = 2
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x1b4/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x187c/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>check - inm=0xfffff800038f7100 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x164/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x1981/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>acquire_locked - post inc - inm=0xfffff800038f7100 - in6m_refcount = 2
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b23290
>in6_joingroup_locked() at in6_joingroup_locked+0x1b4/frame 0xfffffe0099b23320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b23350
>in6_update_ifa() at in6_update_ifa+0x1981/frame 0xfffffe0099b23500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b23670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b236b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b236e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b23760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b23830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b238a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b23970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b23ab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b23ab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>re0: link state changed to DOWN
>set - inm=0xfffff80010c79100 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b4f290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b4f320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b4f350
>in6_update_ifa() at in6_update_ifa+0x153e/frame 0xfffffe0099b4f500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b4f670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b4f6b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b4f6e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b4f760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b4f830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b4f8a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b4f970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b4fab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b4fab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>set - inm=0xfffff800035fc900 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b4f290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b4f320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b4f350
>in6_update_ifa() at in6_update_ifa+0x1667/frame 0xfffffe0099b4f500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b4f670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b4f6b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b4f6e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b4f760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b4f830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b4f8a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b4f970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b4fab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b4fab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>set - inm=0xfffff800038f7000 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b4f290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b4f320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b4f350
>in6_update_ifa() at in6_update_ifa+0x1754/frame 0xfffffe0099b4f500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b4f670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b4f6b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b4f6e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b4f760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b4f830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b4f8a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b4f970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b4fab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b4fab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>set - inm=0xfffff800038f6e00 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b4f290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b4f320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b4f350
>in6_update_ifa() at in6_update_ifa+0x187c/frame 0xfffffe0099b4f500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b4f670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b4f6b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b4f6e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b4f760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b4f830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b4f8a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b4f970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b4fab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b4fab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>set - inm=0xfffff800038f6d00 - in6m_refcount = 1
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0099b4f290
>in6_joingroup_locked() at in6_joingroup_locked+0x419/frame 0xfffffe0099b4f320
>in6_joingroup() at in6_joingroup+0x44/frame 0xfffffe0099b4f350
>in6_update_ifa() at in6_update_ifa+0x1981/frame 0xfffffe0099b4f500
>in6_ifattach() at in6_ifattach+0x5a2/frame 0xfffffe0099b4f670
>in6_if_up() at in6_if_up+0x80/frame 0xfffffe0099b4f6b0
>if_up() at if_up+0x6a/frame 0xfffffe0099b4f6e0
>ifhwioctl() at ifhwioctl+0xf09/frame 0xfffffe0099b4f760
>ifioctl() at ifioctl+0x50f/frame 0xfffffe0099b4f830
>kern_ioctl() at kern_ioctl+0x29b/frame 0xfffffe0099b4f8a0
>sys_ioctl() at sys_ioctl+0x15e/frame 0xfffffe0099b4f970
>amd64_syscall() at amd64_syscall+0x274/frame 0xfffffe0099b4fab0
>fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0099b4fab0
>--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80047cb8a, rsp = 0x7fffffffe418, rbp = 0x7fffffffe470 ---
>re0: link state changed to UP
>Starting Network: lo0 em0 re0 enc0.
>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
>	options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
>	inet6 ::1 prefixlen 128 
>	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 
>	inet 127.0.0.1 netmask 0xff000000 
>	groups: lo 
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>em0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
>	options=81249b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,WOL_MAGIC,VLAN_HWFILTER>
>	ether 00:22:4d:6a:5e:b9
>	media: Ethernet autoselect
>	status: no carrier
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>	options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
>	ether 1c:bd:b9:de:0d:7d
>	inet6 fe80::1ebd:b9ff:fede:d7d%re0 prefixlen 64 scopeid 0x2 
>	media: Ethernet autoselect (1000baseT <full-duplex>)
>	status: active
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>enc0: flags=0<> metric 0 mtu 1536
>	groups: enc 
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>Starting devd.
>Starting Network: em0.
>em0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
>	options=81249b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,WOL_MAGIC,VLAN_HWFILTER>
>	ether 00:22:4d:6a:5e:b9
>	media: Ethernet autoselect
>	status: no carrier
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>Starting Network: enc0.
>enc0: flags=0<> metric 0 mtu 1536
>	groups: enc 
>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>Autoloading module: uhid.ko
>Autoloading module: wmt.ko
>uhid0 on uhub3
>uhid0: <vendor 0x04f3 product 0x0103, class 0/0, rev 2.00/1.07, addr 3> on usbus0
>Starting dhclient.
>DHCPREQUEST on re0 to 255.255.255.255 port 67
>DHCPACK from 10.9.8.1
>bound to 10.9.8.12 -- renewal in 180000 seconds.
>add host 127.0.0.1: gateway lo0 fib 0: route already in table
>add host ::1: gateway lo0 fib 0: route already in table
>add net fe80::: gateway ::1
>add net ff02::: gateway ::1
>add net ::ffff:0.0.0.0: gateway ::1
>add net ::0.0.0.0: gateway ::1
>Creating and/or trimming log files.
>Starting syslogd.
>No core dumps found.
>Clearing /tmp (X related).
>Updating motd:.
>Mounting late filesystems:.
>Starting powerd.
>Configuring vt: blanktime.
>Performing sanity check on sshd configuration.
>Starting sshd.
>Starting sendmail_submit.
>Starting sendmail_msp_queue.
>Starting cron.
>Starting background file system checks in 60 seconds.
>
>Mon Jan  7 23:39:05 MSK 2019
>list remove - post dec - inm=0xfffff800038f6e00 - in6m_refcount = 0
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00779ce800
>in6m_disconnect() at in6m_disconnect+0x1cc/frame 0xfffffe00779ce830
>mld_fasttimo() at mld_fasttimo+0x515/frame 0xfffffe00779ce900
>pffasttimo() at pffasttimo+0x54/frame 0xfffffe00779ce930
>softclock_call_cc() at softclock_call_cc+0x141/frame 0xfffffe00779ce9e0
>softclock() at softclock+0x7c/frame 0xfffffe00779cea10
>ithread_loop() at ithread_loop+0x187/frame 0xfffffe00779cea70
>fork_exit() at fork_exit+0x84/frame 0xfffffe00779ceab0
>fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00779ceab0
>--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
>panic: Assertion inm->in6m_refcount > 0 failed at /home/devel/freebsd/base/head/sys/netinet6/in6_mcast.c:641
>cpuid = 0
>time = 1546893553
>KDB: stack backtrace:
>db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00779ce740
>vpanic() at vpanic+0x1a3/frame 0xfffffe00779ce7a0
>panic() at panic+0x43/frame 0xfffffe00779ce800
>in6m_disconnect() at in6m_disconnect+0x25e/frame 0xfffffe00779ce830
>mld_fasttimo() at mld_fasttimo+0x515/frame 0xfffffe00779ce900
>pffasttimo() at pffasttimo+0x54/frame 0xfffffe00779ce930
>softclock_call_cc() at softclock_call_cc+0x141/frame 0xfffffe00779ce9e0
>softclock() at softclock+0x7c/frame 0xfffffe00779cea10
>ithread_loop() at ithread_loop+0x187/frame 0xfffffe00779cea70
>fork_exit() at fork_exit+0x84/frame 0xfffffe00779ceab0
>fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00779ceab0
>--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
>KDB: enter: panic
>
>------------------------------------------------------------------------
>kernel config
>
>options	CONFIG_AUTOGENERATED
>ident	GENERIC
>machine	amd64
>cpu	HAMMER
>makeoptions	WITH_CTF=1
>makeoptions	DEBUG=-g
>options	EVDEV_SUPPORT
>options	XENHVM
>options	USB_DEBUG
>options	ATH_ENABLE_11N
>options	AH_AR5416_INTERRUPT_MITIGATION
>options	AH_SUPPORT_AR5416
>options	IEEE80211_SUPPORT_MESH
>options	IEEE80211_AMPDU_AGE
>options	IEEE80211_DEBUG
>options	SC_PIXEL_MODE
>options	VESA
>options	PCI_IOV
>options	PCI_HP
>options	ACPI_DMAR
>options	EARLY_AP_STARTUP
>options	SMP
>options	NETDUMP
>options	ZSTDIO
>options	GZIO
>options	EKCD
>options	VERBOSE_SYSINIT=0
>options	MALLOC_DEBUG_MAXZONES=8
>options	WITNESS_SKIPSPIN
>options	WITNESS
>options	INVARIANT_SUPPORT
>options	INVARIANTS
>options	DEADLKRES
>options	GDB
>options	FULL_BUF_TRACKING
>options	DDB
>options	BUF_TRACKING
>options	KDB_TRACE
>options	KDB
>options	RCTL
>options	RACCT_DEFAULT_TO_DISABLED
>options	RACCT
>options	INCLUDE_CONFIG_FILE
>options	DDB_CTF
>options	KDTRACE_HOOKS
>options	KDTRACE_FRAME
>options	MAC
>options	CAPABILITIES
>options	CAPABILITY_MODE
>options	AUDIT
>options	HWPMC_HOOKS
>options	KBD_INSTALL_CDEV
>options	PRINTF_BUFR_SIZE=128
>options	_KPOSIX_PRIORITY_SCHEDULING
>options	SYSVSEM
>options	SYSVMSG
>options	SYSVSHM
>options	STACK
>options	KTRACE
>options	SCSI_DELAY=5000
>options	COMPAT_FREEBSD11
>options	COMPAT_FREEBSD10
>options	COMPAT_FREEBSD9
>options	COMPAT_FREEBSD7
>options	COMPAT_FREEBSD6
>options	COMPAT_FREEBSD5
>options	COMPAT_FREEBSD4
>options	COMPAT_FREEBSD32
>options	EFIRT
>options	GEOM_LABEL
>options	GEOM_RAID
>options	PSEUDOFS
>options	PROCFS
>options	CD9660
>options	MSDOSFS
>options	NFS_ROOT
>options	NFSLOCKD
>options	NFSD
>options	NFSCL
>options	MD_ROOT
>options	QUOTA
>options	UFS_GJOURNAL
>options	UFS_DIRHASH
>options	UFS_ACL
>options	SOFTUPDATES
>options	FFS
>options	SCTP
>options	TCP_RFC7413
>options	TCP_HHOOK
>options	TCP_BLACKBOX
>options	TCP_OFFLOAD
>options	IPSEC_SUPPORT
>options	IPSEC
>options	INET6
>options	INET
>options	VIMAGE
>options	PREEMPTION
>options	NUMA
>options	SCHED_ULE
>options	NEW_PCIB
>options	GEOM_PART_GPT
>options	GEOM_PART_MBR
>options	GEOM_PART_EBR_COMPAT
>options	GEOM_PART_EBR
>options	GEOM_PART_BSD
>device	isa
>device	mem
>device	io
>device	uart_ns8250
>device	cpufreq
>device	acpi
>device	pci
>device	fdc
>device	ahci
>device	ata
>device	mvs
>device	siis
>device	ahc
>device	ahd
>device	esp
>device	hptiop
>device	isp
>device	mpt
>device	mps
>device	mpr
>device	sym
>device	trm
>device	isci
>device	ocs_fc
>device	scbus
>device	ch
>device	da
>device	sa
>device	cd
>device	pass
>device	ses
>device	amr
>device	arcmsr
>device	ciss
>device	hptmv
>device	hptnr
>device	hptrr
>device	hpt27xx
>device	iir
>device	ips
>device	mly
>device	twa
>device	smartpqi
>device	tws
>device	aac
>device	aacp
>device	aacraid
>device	ida
>device	mfi
>device	mlx
>device	mrsas
>device	pmspcv
>device	twe
>device	nvme
>device	nvd
>device	atkbdc
>device	atkbd
>device	psm
>device	kbdmux
>device	vga
>device	splash
>device	sc
>device	vt
>device	vt_vga
>device	vt_efifb
>device	agp
>device	cbb
>device	pccard
>device	cardbus
>device	uart
>device	ppc
>device	ppbus
>device	lpt
>device	ppi
>device	puc
>device	bxe
>device	de
>device	em
>device	ix
>device	ixv
>device	ixl
>device	iavf
>device	le
>device	ti
>device	txp
>device	vx
>device	miibus
>device	ae
>device	age
>device	alc
>device	ale
>device	bce
>device	bfe
>device	bge
>device	cas
>device	dc
>device	et
>device	fxp
>device	gem
>device	hme
>device	jme
>device	lge
>device	msk
>device	nfe
>device	nge
>device	pcn
>device	re
>device	rl
>device	sf
>device	sge
>device	sis
>device	sk
>device	ste
>device	stge
>device	tl
>device	tx
>device	vge
>device	vr
>device	wb
>device	xl
>device	wlan
>device	wlan_wep
>device	wlan_ccmp
>device	wlan_tkip
>device	wlan_amrr
>device	an
>device	ath
>device	ath_pci
>device	ath_hal
>device	ath_rate_sample
>device	ipw
>device	iwi
>device	iwn
>device	malo
>device	mwl
>device	ral
>device	wi
>device	wpi
>device	crypto
>device	loop
>device	random
>device	padlock_rng
>device	rdrand_rng
>device	ether
>device	vlan
>device	tun
>device	md
>device	gif
>device	firmware
>device	bpf
>device	uhci
>device	ohci
>device	ehci
>device	xhci
>device	usb
>device	ukbd
>device	umass
>device	sound
>device	snd_cmi
>device	snd_csa
>device	snd_emu10kx
>device	snd_es137x
>device	snd_hda
>device	snd_ich
>device	snd_via8233
>device	mmc
>device	mmcsd
>device	sdhci
>device	virtio
>device	virtio_pci
>device	vtnet
>device	virtio_blk
>device	virtio_scsi
>device	virtio_balloon
>device	hyperv
>device	xenpci
>device	vmx
>device	netmap
>device	evdev
>device	uinput
>
>------------------------------------------------------------------------
>ddb capture buffer
>
>

Actions: View

Attachments on bug 233535: 200199 | 200658 | 200699 | 200753 | 200887 | 200956 | 201125 | 201210 | 201211 | 201212 | 201220 | 201221 | 201228