Bug 262676 - vimage: on starting jail instant kernel panic
Summary: vimage: on starting jail instant kernel panic
Status: Open
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: 13.1-RELEASE
Hardware: amd64 Any
: --- Affects Some People
Assignee: freebsd-bugs (Nobody)
URL:
Keywords: crash, ipv6, regression, vimage
Depends on:
Blocks:
 
Reported: 2022-03-19 23:46 UTC by Dirk Meyer
Modified: 2024-03-13 15:29 UTC (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Dirk Meyer freebsd_committer freebsd_triage 2022-03-19 23:46:43 UTC
starting an [VIMAGE] with /etc/jail.conf

Setup was working with FreeBSD 12.2-RELEASE, Regression.

System upgraded to FreeBSD 13.0-RELEASES,
rebooting -> instant panic before all services are started.
disabling jails let the system boot.

System upgraded to FreeBSD 13.1-BETA2
rebooting -> instant panic before all services are started.
disabling jails let the system boot.

FreeBSD t5.xxxxxx.xxx 13.1-BETA2 FreeBSD 13.1-BETA2 #0 releng/13.1-n249999-e404b2562b1: Sat Mar 19 12:32:14 UTC 2022     root@amd13.xxxxx.xxxx:/usr/obj/usr/src/amd64.amd64/sys/GENERIC  amd64

panic: page fault

GNU gdb (GDB) 11.1 [GDB v11.1 for FreeBSD]
Copyright (C) 2021 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-portbld-freebsd13.0".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<https://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /boot/kernel/kernel...
Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug...

Unread portion of the kernel message buffer:
<6>lo0: link state changed to UP

Fatal trap 12: page fault while in kernel mode
cpuid = 2; apic id = 02
fault virtual address   = 0xfffff800bb8b0240
fault code              = supervisor read instruction, protection violation
instruction pointer     = 0x20:0xfffff800bb8b0240
stack pointer           = 0x28:0xfffffe00c32c5698
frame pointer           = 0x28:0xfffffe00c32c56d0
code segment            = base rx0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 1865 (ifconfig)
trap number             = 12
panic: page fault
cpuid = 2
time = 1647731377
KDB: stack backtrace:
#0 0xffffffff80c69265 at kdb_backtrace+0x65
#1 0xffffffff80c1b8df at vpanic+0x17f
#2 0xffffffff80c1b753 at panic+0x43
#3 0xffffffff810addf5 at trap_fatal+0x385
#4 0xffffffff810ade4f at trap_pfault+0x4f
#5 0xffffffff810850e8 at calltrap+0x8
#6 0xffffffff80d5be64 at nhop_create_from_info+0x1c4
#7 0xffffffff80d5d393 at rib_add_route+0x133
#8 0xffffffff80d5f9a5 at ifa_maintain_loopback_route+0x185
#9 0xffffffff80e03932 at in6_update_ifa+0xd42
#10 0xffffffff80e098b8 at in6_ifattach+0x598
#11 0xffffffff80e059fe at in6_if_up+0x7e
#12 0xffffffff80d31a63 at ifioctl+0x433
#13 0xffffffff80c895ab at kern_ioctl+0x25b
#14 0xffffffff80c892b1 at sys_ioctl+0xf1
#15 0xffffffff810ae6ec at amd64_syscall+0x10c
#16 0xffffffff810859fb at fast_syscall_common+0xf8
Uptime: 4m38s
Dumping 518 out of 8155 MB:..4%..13%..22%..31%..41%..53%..62%..72%..81%..93%

__curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55

55              __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu,
(kgdb) #0  __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
#1  doadump (textdump=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:399
#2  0xffffffff80c1b4dc in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:487
#3  0xffffffff80c1b94e in vpanic (fmt=0xffffffff811b2ef6 "%s", 
    ap=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:920
#4  0xffffffff80c1b753 in panic (fmt=<unavailable>)
    at /usr/src/sys/kern/kern_shutdown.c:844
#5  0xffffffff810addf5 in trap_fatal (frame=0xfffffe00c32c55d0, 
    eva=18446735280762978880) at /usr/src/sys/amd64/amd64/trap.c:944
#6  0xffffffff810ade4f in trap_pfault (frame=0xfffffe00c32c55d0, 
    usermode=false, signo=<optimized out>, ucode=<optimized out>)
    at /usr/src/sys/amd64/amd64/trap.c:763
#7  <signal handler called>
#8  0xfffff800bb8b0240 in ?? ()
#9  0xffffffff80d5bed0 in get_nhop (rnh=rnh@entry=0xfffff80111b6c528, 
    info=info@entry=0xfffffe00c32c57f0, 
    pnh_priv=pnh_priv@entry=0xfffffe00c32c56e0)
    at /usr/src/sys/net/route/nhop_ctl.c:360
#10 0xffffffff80d5be64 in nhop_create_from_info (
    rnh=rnh@entry=0xfffff80111b6c528, info=info@entry=0xfffffe00c32c57f0, 
    nh_ret=nh_ret@entry=0xfffffe00c32c5740)
    at /usr/src/sys/net/route/nhop_ctl.c:329
#11 0xffffffff80d5d393 in create_rtentry (rnh=0xfffff80111b6c528, 
    info=0xfffffe00c32c57f0, prt=<optimized out>)
    at /usr/src/sys/net/route/route_ctl.c:652
#12 add_route (rnh=0xfffff80111b6c528, info=0xfffffe00c32c57f0, 
    rc=0xfffffe00c32c57b0) at /usr/src/sys/net/route/route_ctl.c:704
#13 rib_add_route (fibnum=<optimized out>, info=0xfffffe00c32c57f0, 
    rc=0xfffffe00c32c57b0) at /usr/src/sys/net/route/route_ctl.c:587
#14 0xffffffff80d5e0bf in rib_action (fibnum=0, action=action@entry=1, 
    info=info@entry=0xfffffe00c32c57f0, rc=0xfffff80036141300, 
    rc@entry=0xfffffe00c32c57b0) at /usr/src/sys/net/route/route_ctl.c:1258
#15 0xffffffff80d5f9a5 in ifa_maintain_loopback_route (cmd=cmd@entry=1, 
    otype=0xffffffff81257398 "insertion", ifa=ifa@entry=0xfffff8014372ea80, 
    ia=ia@entry=0xfffff8014372eae8)
    at /usr/src/sys/net/route/route_ifaddrs.c:163
#16 0xffffffff80d5f819 in ifa_add_loopback_route (ifa=0x0, 
    ifa@entry=0xfffff8014372ea80, ia=0xfffff80036141300, 
    ia@entry=0xfffff8014372eae8) at /usr/src/sys/net/route/route_ifaddrs.c:181
#17 0xffffffff80e03932 in in6_notify_ifa (ifp=<optimized out>, 
    ia=<optimized out>, ifra=<optimized out>, hostIsNew=<optimized out>)
    at /usr/src/sys/netinet6/in6.c:1512
#18 in6_update_ifa_internal (ifp=0xfffff80015925000, ifra=0xfffffe00c32c5ab8, 
    ia=<optimized out>, hostIsNew=<optimized out>, flags=<optimized out>)
    at /usr/src/sys/netinet6/in6.c:1180
#19 in6_update_ifa (ifp=ifp@entry=0xfffff80015925000, 
    ifra=ifra@entry=0xfffffe00c32c5ab8, ia=<optimized out>, ia@entry=0x0, 
    flags=flags@entry=1) at /usr/src/sys/netinet6/in6.c:883
#20 0xffffffff80e098b8 in in6_ifattach_linklocal (ifp=0xfffff80015925000, 
    altifp=<optimized out>) at /usr/src/sys/netinet6/in6_ifattach.c:463
#21 in6_ifattach (ifp=ifp@entry=0xfffff80015925000, altifp=<optimized out>, 
    altifp@entry=0x0) at /usr/src/sys/netinet6/in6_ifattach.c:732
#22 0xffffffff80e059fe in in6_if_up (ifp=0xfffff80015925000)
    at /usr/src/sys/netinet6/in6.c:1990
#23 0xffffffff80d31a63 in ifioctl (so=0xfffff80015d693b0, cmd=<optimized out>, 
    data=0xfffffe00c32c5d50 "vlan14", td=<optimized out>)
    at /usr/src/sys/net/if.c:3104
#24 0xffffffff80c895ab in fo_ioctl (fp=0xfffff800037f00a0, 
    com=<optimized out>, data=0x0, active_cred=0xfffff80036141300, 
    td=0xfffffe00c4b38900) at /usr/src/sys/sys/file.h:360
#25 kern_ioctl (td=0x0, fd=3, com=com@entry=2151967019, data=0x0, 
    data@entry=0xfffffe00c32c5d50 "vlan14")
    at /usr/src/sys/kern/sys_generic.c:803
#26 0xffffffff80c892b1 in sys_ioctl (td=<optimized out>, 
    uap=0xfffffe00c4b38ce8) at /usr/src/sys/kern/sys_generic.c:711
#27 0xffffffff810ae6ec in syscallenter (td=0xfffffe00c4b38900)
    at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189
#28 amd64_sysca    at /usr/src/sys/amd64/amd64/trap.c:1185
#29 <signal handler called>
#30 0x00000008012558ca in ?? ()
Backtrace stopped: Cannot access memory at address 0x7fffffffe368
(kgdb) 

------------------------------------------------------------------------
ps -axlww
ll (td=0xfffffe00c4b38900, traced=0)

UID  PID PPID C PRI NI    VSZ    RSS MWCHAN   STAT TT      TIME COMMAND
  0    0    0 3 -16  0      0      0 swapin   DLs   -   0:00.06 [kernel]
  0    1    0 0  42  0  11800    260 wait     DLs   -   0:00.00 [init]
  0    2    0 3 -16  0      0      0 -        DL    -   0:00.00 [KTLS]
  0    3    0 3 -16  0      0      0 crypto_w DL    -   0:00.00 [crypto]
  0    4    0 1 -16  0      0      0 -        RL    -   0:03.13 [cam]
  0    5    0 0 -16  0      0      0 -        DL    -   0:00.04 [rand_harvestq]
  0    6    0 1 -16  0      0      0 psleep   DL    -   0:00.02 [pagedaemon]
  0    7    0 1 -16  0      0      0 psleep   DL    -   0:00.00 [vmdaemon]
  0    8    0 0  20  0      0      0 -        RL    -   0:00.04 [bufdaemon]
  0    9    0 2  16  0      0      0 syncer   DL    -   0:00.00 [syncer]
  0   10    0 3 -16  0      0      0 audit_wo DL    -   0:00.00 [audit]
  0   11    0 0 155  0      0      0 -        RL    -  17:54.23 [idle]
  0   12    0 0 -52  0      0      0 -        WL    -   0:04.02 [intr]
  0   13    0 3 -16  0      0      0 sleep    DL    -   0:00.00 [ng_queue]
  0   14    0 0  -8  0      0      0 -        DL    -   0:04.45 [geom]
  0   15    0 3 -16  0      0      0 seqstate DL    -   0:00.00 [sequencer 00]
  0   16    0 3 -68  0      0      0 -        DL    -   0:00.00 [usb]
  0   17    0 1 -16  0      0      0 vlruwt   DL    -   0:00.00 [vnlru]
  0   18    0 3  -8  0      0      0 m:w1     DL    -   0:01.24 [g_mirror gm1]
  0   19    0 3  -8  0      0      0 m:w1     DL    -   0:00.00 [g_mirror gm0]
  0   20    1 2  52  0  13596   1380 wait     Ds+   -   0:00.04 [sh]
  0 1090    1 1  20  0  11468   1304 select   Ds    -   0:00.01 [devd]
  0 1098    1 0  20  0  13036   2216 kqread   DCs   -   0:00.01 [rtsold]
  0 1102    1 1  52  0  13032   2192 select   Ds    -   0:00.00 [rtsold]
  0 1104    1 0  52  0  13032   2188 select   Ds    -   0:00.00 [rtsold]
  0 1105    1 3  42  0  13032   2184 select   Ds    -   0:00.00 [rtsold]
  0 1106    1 2  20  0  13032   2344 select   Ds    -   0:00.00 [rtsold]
  0 1114    1 3  20  0  13036   2216 kqread   DCs   -   0:00.00 [rtsold]
  0 1118    1 0  52  0  13032   2192 select   Ds    -   0:00.00 [rtsold]
  0 1120    1 0  52  0  13032   2188 select   Ds    -   0:00.00 [rtsold]
  0 1121    1 1  52  0  13032   2184 select   Ds    -   0:00.00 [rtsold]
  0 1122    1 2  20  0  13032   2344 select   Ds    -   0:00.00 [rtsold]
  0 1130    1 0  20  0  13036   2216 kqread   DCs   -   0:00.00 [rtsold]
  0 1134    1 3  52  0  13032   2192 select   Ds    -   0:00.00 [rtsold]
  0 1136    1 0  52  0  13032   2188 select   Ds    -   0:00.00 [rtsold]
  0 1137    1 3  52  0  13032   2184 select   Ds    -   0:00.00 [rtsold]
  0 1138    1 2  20  0  13032   2344 select   Ds    -   0:00.00 [rtsold]
  0 1268    0 0 -16  0      0      0 pftm     DL    -   0:00.01 [pf purge]
  0 1434    1 3  20  0  12896   2460 select   Ds    -   0:00.02 [syslogd]
  0 1520    1 0  20  0  91500  59248 select   Ds    -   0:00.27 [bsnmpd]
  0 1528    0 1 -16  0      0      0 ftcl     DL    -   0:00.00 [ftcleanup]
  0 1548    1 3  23  0  12828   2400 select   Ds    -   0:00.00 [rpcbind]
  0 1573    1 3  22  0  12884   2584 select   Ds    -   0:00.00 [mountd]
  0 1580    1 0  52  0  12756   2160 select   Ds    -   0:00.03 [nfsd]
  0 1587 1580 0  52  0  12756   2076 rpcsvc   D     -   0:00.00 [nfsd]
136 1604    1 0  33  0  22560   6652 select   Ds    -   0:00.01 [dhcpd]
  0 1610    1 0  22  0  12804   2204 select   D     -   0:00.02 [minirsyslogd]
123 1632    1 1  21  0  17572   4512 select   Ds    -   0:00.00 [ntpd]
  0 1668    1 0  22  0  40280  13228 select   Ds    -   0:00.01 [nmbd]
  0 1672    1 0  32  0 177000 146100 select   Ds    -   0:00.43 [smbd]
  0 1689 1672 1  30  0 174516 142560 select   D     -   0:00.00 [smbd]
  0 1690 1672 0  30  0 174508 142500 select   D     -   0:00.00 [smbd]
  0 1692    1 2  52  0  21092   7308 select   Ds    -   0:00.00 [sshd]
  0 1700    1 3  25  0  27648   7896 select   Ds    -   0:00.00 [bird]
 25 1703    1 0  52  0  18124   5872 pause    Ds    -   0:00.00 [sendmail]
  0 1708 1672 2  39  0 177000 145976 select   D     -   0:00.00 [smbd]
  0 1720    1 2  52  0  12940   2532 nanslp   Ds    -   0:00.00 [cron]
  0 1723   20 3  52  0  13596   1780 wait     D+    -   0:00.00 [sh]
  0 1725 1723 3  52  0  13124   2448 kqread   D+    -   0:00.00 [jail]
  0 1728    1 0  52  0  21092   7324 select   Ds    -   0:00.00 [sshd]
  0 1731    1 2  52  0  21092   7324 select   Ds    -   0:00.00 [sshd]
  0 1735 1725 2  52  0  13596   2160 wait     D+    -   0:00.00 [sh]
  0 1799 1735 3  52  0  13596   2332 wait     D+    -   0:00.00 [sh]
  0 1865 1799 2  72  0  13708   2340 -        R+    -   0:00.00 [ifconfig]

------------------------------------------------------------------------
vmstat -s

  3121087 cpu context switches
   224593 device interrupts
     4817 software interrupts
   285151 traps
   764198 system calls
       21 kernel threads created
     1389  fork() calls
      420 vfork() calls
       35 rfork() calls
        0 swap pager pageins
        0 swap pager pages paged in
        0 swap pager pageouts
        0 swap pager pages paged out
     3491 vnode pager pageins
    13442 vnode pager pages paged in
        0 vnode pager pageouts
        0 vnode pager pages paged out
        0 page daemon wakeups
        0 pages examined by the page daemon
        0 clean page reclamation shortfalls
        0 pages reactivated by the page daemon
    78880 copy-on-write faults
       62 copy-on-write optimized faults
   192779 zero fill pages zeroed
        0 zero fill pages prezeroed
      850 intransit blocking page faults
   302058 total VM faults taken
     3311 page faults requiring I/O
        0 pages affected by kernel thread creation
    77530 pages affected by  fork()
    14690 pages affected by vfork()
     1186 pages affected by rfork()
   334922 pages freed
        0 pages freed by daemon
        0 pages freed by exiting processes
        0 pages active
        0 pages inactive
        0 pages in the laundry queue
        0 pages wired down
        0 virtual user pages wired down
        0 pages free
        0 bytes per page
        0 total name lookups
          cache hits (0% pos + 0% neg) system 0% per-directory
          deletions 0%, falsehits 0%, toolong 0%

------------------------------------------------------------------------
vmstat -m

vmstat: memstat_kvm_malloc: 
         Type InUse MemUse Requests  Size(s)

------------------------------------------------------------------------
vmstat -z

ITEM                   SIZE  LIMIT     USED     FREE      REQ     FAILSLEEP XDOMAIN
UMA Kegs:               384,      0,     145,       0,     146,   0,   0,   0
UMA Zones:             1024,      0,     159,       0,     160,   0,   0,   0
UMA Slabs 0:             80,      0,    3610,       0,    3610,   0,   0,   0
UMA Slabs 1:            112,      0,      16,       0,      16,   0,   0,   0
UMA Hash:               256,      0,       0,       0,       0,   0,   0,   0
2 Bucket:                32,      0,      26,     990,     482,   0,   0,   0
4 Bucket:                48,      0,      13,    1003,     130,   0,   0,   0
8 Bucket:                80,      0,      53,     580,    7380,   0,   0,   0
16 Bucket:              144,      0,      42,     211,     110,   0,   0,   0
32 Bucket:              256,      0,      76,     358,   17946,   0,   0,   0
64 Bucket:              512,      0,      79,     132,    2803,   8,   0,   0
128 Bucket:            1024,      0,      82,      77,    4428,  24,   0,   0
256 Bucket:            2048,      0,     138,      15,    1500,   0,   0,   0
SMR SHARED:              24,      0,       2,     506,       2,   0,   0,   0
SMR CPU:                 32,      0,       2,     506,       2,   0,   0,   0
vmem:                  1856,      0,       1,       7,       1,   0,   0,   0
vmem btag:               56,      0,   12867,     148,   12925,  90,   0,   0
VM OBJECT:              264,      0,   34076,      94,   59272,   0,   0,   0
RADIX NODE:             144,      0,   15141,     421,   80283,   0,   0,   0
KMAP ENTRY:              96,      0,     107,       0,     121,   0,   0,   0
MAP ENTRY:               96,      0,  128921,     607,  221973,   0,   0,   0
VMSPACE:               2552,      0,      43,      21,    1846,   0,   0,   0
fakepg:                 104,      0,       0,       0,       0,   0,   0,   0
pcpu-4:                   4,      0,       0,       0,       0,   0,   0,   0
pcpu-8:                   8,      0,    8004,     632,   11206,   0,   0,   0
pcpu-16:                 16,      0,      21,     487,      21,   0,   0,   0
pcpu-32:                 32,      0,       0,       0,       0,   0,   0,   0
pcpu-64:                 64,      0,     482,     534,     485,   0,   0,   0
malloc-16:               16,      0,  188141,     835,  441940,   0,   0,   0
malloc-32:               32,      0,   84719,     371,   98259,   0,   0,   0
malloc-64:               64,      0,   17759,     529,  119848,   0,   0,   0
malloc-128:             128,      0,  161316,     216,  259389,   0,   0,   0
malloc-256:             256,      0,   58297,     107,   74575,   0,   0,   0
malloc-384:             384,      0,    1052,      88,    2355,   0,   0,   0
malloc-512:             512,      0,      84,      36,     893,   0,   0,   0
malloc-1024:           1024,      0,     296,      40,    3512,   0,   0,   0
malloc-2048:           2048,      0,     303,      33,  220982,   0,   0,   0
malloc-4096:           4096,      0,     504,      10,   26844,   0,   0,   0
malloc-8192:           8192,      0,      70,       3,     684,   0,   0,   0
malloc-16384:         16384,      0,      20,       7,    1047,   0,   0,   0
malloc-32768:         32768,      0,      21,       1,     490,   0,   0,   0
malloc-65536:         65536,      0,      28,       5,     731,   0,   0,   0
SLEEPQUEUE:              80,      0,     265,     239,     265,   0,   0,   0
kenv:                   258,      0,      21,      99,    1610,   0,   0,   0
Files:                   80,      0,     355,     149,   52628,   0,   0,   0
filedesc0:             1072,      0,      64,      40,    1866,   0,   0,   0
PWD:                     32,      0,      20,     996,     176,   0,   0,   0
TURNSTILE:              136,      0,     265,     169,     265,   0,   0,   0
rangeset pctrie nodes:    144,      0,       0,       0,       0,   0,   0,   0
rl_entry:                40,      0,      67,     949,      67,   0,   0,   0
lkpicurr:               160,      0,       2,      19,       2,   0,   0,   0
lkpimm:                 160,      0,       1,      20,       1,   0,   0,   0
umtx pi:                 96,      0,       0,       0,       0,   0,   0,   0
umtx_shm:                88,      0,   31091,     283,   31093,   0,   0,   0
swrbuf:                2368,    128,       0,       0,       0,   0,   0,   0
swwbuf:                2368,     64,       0,       0,       0,   0,   0,   0
nfspbuf:               2368,    128,       0,       0,       0,   0,   0,   0
mdpbuf:                2368,     25,       0,       0,       0,   0,   0,   0
vnpbuf:                2368,    512,       0,       0,       0,   0,   0,   0
clpbuf:                2368,    128,       0,      64,     613,   0,   0,   0
pbuf:                  2368,     16,       0,       0,       0,   0,   0,   0
FPU_save_area:          576,      0,     230,      58,     302,   0,   0,   0
MAC labels:              40,      0,       0,       0,       0,   0,   0,   0
PROC:                  1352,      0,      63,      33,    1865,   0,   0,   0
PGRP:                    88,      0,      34,     344,      47,   0,   0,   0
THREAD:                1808,      0,     228,      36,     244,   0,   0,   0
cpuset:                 104,      0,      17,     487,      34,   0,   0,   0
domainset:               40,      0,       0,     508,      20,   0,   0,   0
audit_record:          1280,      0,       0,       0,       0,   0,   0,   0
mbuf_packet:            256,      0,       0,     762,     859,   0,   0,   0
mbuf:                   256, 3246830,    7491,    1145,   17509,   0,   0,   0
mbuf_cluster:          2048, 507317,    3834,     738,    4744,   0,   0,   0
mbuf_jumbo_page:       4096, 253658,       0,       0,       0,   0,   0,   0
mbuf_jumbo_9k:         9216,  75158,       0,       0,       0,   0,   0,   0
mbuf_jumbo_16k:       16384,  42276,       0,       0,       0,   0,   0,   0
epoch_record pcpu:      256,      0,       4,      58,       4,   0,   0,   0
ktls_session:           192,      0,       0,       0,       0,   0,   0,   0
NetGraph items:          72,   4096,       0,     254,       1,   0,   0,   0
NetGraph data items:     72,   4096,       0,       0,       0,   0,   0,   0
ttyinq:                 160,      0,      15,      47,      15,   0,   0,   0
ttyoutq:                256,      0,       8,      54,       8,   0,   0,   0
IOMMU_MAP_ENTRY:        120,      0,       0,       0,       0,   0,   0,   0
DEVCTL:                1024,   1000,       0,       0,     537,   0,   0,   0
g_bio:                  376,      0,       0,     480, 1086825,   0,   0,   0
linux_dma_pctrie:       144,      0,       0,       0,       0,   0,   0,   0
linux_dma_object:        32,      0,       0,       0,       0,   0,   0,   0
cryptop:                280,      0,       0,       0,       0,   0,   0,   0
vtnet_tx_hdr:            24,      0,       0,       0,       0,   0,   0,   0
VNODE:                  488,      0,    1523,     157,    1584,   0,   0,   0
BUF TRIE:               144,      0,    1661,     323,   11340,   0,   0,   0
S VFS Cache:            104,      0,    2175,     219,    2266,   0,   0,   0
STS VFS Cache:          144,      0,       0,       0,       0,   0,   0,   0
L VFS Cache:            320,      0,       0,      30,       1,   0,   0,   0
LTS VFS Cache:          360,      0,       0,       0,       0,   0,   0,   0
NAMEI:                 1024,      0,       0,      80,   36663,   0,   0,   0
NCLNODE:                616,      0,       0,       0,       0,   0,   0,   0
DIRHASH:               1024,      0,     147,      13,     147,   0,   0,   0
Mountpoints:           2752,      0,      13,       7,      13,   0,   0,   0
AIO:                    208,      0,       0,       0,       0,   0,   0,   0
AIOP:                    32,      0,       0,       0,       0,   0,   0,   0
AIOCB:                  552,      0,       0,       0,       0,   0,   0,   0
AIOLIO:                 272,      0,       0,       0,       0,   0,   0,   0
pipe:                   744,      0,       9,      39,     839,   0,   0,   0
ksiginfo:               112,      0,      80,     424,     191,   0,   0,   0
itimer:                 352,      0,       0,       0,       0,   0,   0,   0
KNOTE:                  160,      0,      11,     237,     102,   0,   0,   0
socket:                 944,  25000,     198,     818,    4927,   0,   0,   0
unpcb:                  256,  25000,      51,     965,    4366,   0,   0,   0
ipq:                     56,  15853,       0,       0,       0,   0,   0,   0
udp_inpcb:              496,  25000,      74,     942,     428,   0,   0,   0
udpcb:                   32,  25000,      74,     942,     428,   0,   0,   0
tcp_inpcb:              496,  25000,      56,     960,      78,   0,   0,   0
tcpcb:                 1080,  25000,      56,     960,      78,   0,   0,   0
tcptw:                   88,   5000,       0,       0,       0,   0,   0,   0
syncache:               168,  15360,       0,       0,       0,   0,   0,   0
hostcache:               96,  15360,       0,       0,       0,   0,   0,   0
sackhole:                32,      0,       0,       0,       0,   0,   0,   0
tfo:                      4,      0,       0,       0,       0,   0,   0,   0
tfo_ccache_entries:      80,      0,       0,       0,       0,   0,   0,   0
tcpreass:                48,  31707,       0,       0,       0,   0,   0,   0
tcp_log:                408, 5000000,       0,       0,       0,   0,   0,   0
tcp_log_bucket:         176,      0,       0,       0,       0,   0,   0,   0
tcp_log_node:           120,      0,       0,       0,       0,   0,   0,   0
udplite_inpcb:          496,  25000,       0,       0,       0,   0,   0,   0
ripcb:                  496,  25000,      10,    1006,      22,   0,   0,   0
IPsec SA lft_c:          16,      0,       0,     254,       4,   0,   0,   0
routing nhops:          256,      0,      63,     185,     100,   0,   0,   0
rtentry:                176,      0,      90,     158,      95,   0,   0,   0
swpctrie:               144, 1014664,       0,       0,       0,   0,   0,   0
swblk:                  136, 1014652,       0,       0,       0,   0,   0,   0
FFS inode:              160,      0,    1459,     153,    1502,   0,   0,   0
FFS1 dinode:            128,      0,       0,       0,       0,   0,   0,   0
FFS2 dinode:            256,      0,    1459,     215,    1502,   0,   0,   0
IPFW counters:           16,      0,      12,     750,      12,   0,   0,   0
IPFW dynamic states data:     88,  16384,       0,       0,       0,   0,   0,   0
IPFW parent dynamic states:     32,   4096,       0,       0,       0,   0,   0,   0
IPFW IPv4 dynamic states:     40,      0,       0,       0,       0,   0,   0,   0
IPFW IPv6 dynamic states:     72,      0,       0,       0,       0,   0,   0,   0
pf mtags:                48,      0,       0,       0,       0,   0,   0,   0
pf tags:                104,      0,       0,       0,       0,   0,   0,   0
pf states:              312, 100000,      12,     750,      12,   0,   0,   0
pf state keys:           88,      0,      12,     366,      12,   0,   0,   0
pf source nodes:        136,  10000,       0,       0,       0,   0,   0,   0
pf table entry counters:     64,      0,       0,       0,       0,   0,   0,   0
pf table entries:       160, 200000,      23,      39,      23,   0,   0,   0
pf frags:               248,      0,       0,       0,       0,   0,   0,   0
pf frag entries:         40,   5000,       0,       0,       0,   0,   0,   0
pf state scrubs:         40,      0,       0,       0,       0,   0,   0,   0
TMPFS node:             224,      0,       1,      61,       1,   0,   0,   0
dtrace_state_cache:   16384,      0,       0,       0,       0,   0,   0,   0
taskq_zone:             192,      0,       0,       0,       0,   0,   0,   0
ipq:                     56,  15853,       0,       0,       0,   0,   0,   0
udp_inpcb:              496,  25000,       2,     506,      12,   0,   0,   0
udpcb:                   32,  25000,       1,     507,      12,   0,   0,   0
tcp_inpcb:              496,  25000,       0,       0,       0,   0,   0,   0
tcpcb:                 1080,  25000,       0,       0,       0,   0,   0,   0
tcptw:                   88,   5000,       0,       0,       0,   0,   0,   0
syncache:               168,  15360,       0,       0,       0,   0,   0,   0
hostcache:               96,  15360,       0,       0,       0,   0,   0,   0
sackhole:                32,      0,       0,       0,       0,   0,   0,   0
tfo:                      4,      0,       0,       0,       0,   0,   0,   0
tfo_ccache_entries:      80,      0,       0,       0,       0,   0,   0,   0
udplite_inpcb:          496,  25000,       0,       0,       0,   0,   0,   0
ripcb:                  496,  25000,       0,       0,       0,   0,   0,   0
IPsec SA lft_c:          16,      0,       0,       0,       0,   0,   0,   0
rtentry:                176,      0,       4,     120,       4,   0,   0,   0
pf tags:                104,      0,       0,       0,       0,   0,   0,   0
pf states:              312, 100000,       0,       0,       0,   0,   0,   0
pf state keys:           88,      0,       0,       0,       0,   0,   0,   0
pf source nodes:        136,  10000,       0,       0,       0,   0,   0,   0
pf table entry counters:     64,      0,       0,       0,       0,   0,   0,   0
pf table entries:       160,      0,       0,       0,       0,   0,   0,   0
pf frags:               248,      0,       0,       0,       0,   0,   0,   0
pf frag entries:         40,   5000,       0,       0,       0,   0,   0,   0
pf state scrubs:         40,      0,       0,       0,       0,   0,   0,   0
IPFW counters:           16,      0,       1,     253,       1,   0,   0,   0
IPFW dynamic states data:     88,  16384,       0,       0,       0,   0,   0,   0
IPFW parent dynamic states:     32,   4096,       0,       0,       0,   0,   0,   0
IPFW IPv4 dynamic states:     40,      0,       0,       0,       0,   0,   0,   0
IPFW IPv6 dynamic states:     72,      0,       0,       0,       0,   0,   0,   0

------------------------------------------------------------------------
vmstat -i

interrupt                          total       rate
irq1: atkbd0                           1          0
irq14: ata0                          230          0
irq16: twa0                          672          1
irq19: uhci1++                    218116        259
cpu0:timer                         34013         40
cpu1:timer                         30116         36
cpu2:timer                         40384         48
cpu3:timer                         50283         60
irq48: em0:irq0                     3391          4
irq49: em1:irq0                     2183          3
Total                             379389        450

------------------------------------------------------------------------
pstat -T

355/25000 files
0M/0M swap space

------------------------------------------------------------------------
pstat -s

Device          1K-blocks     Used    Avail Capacity

------------------------------------------------------------------------
iostat

       tty            ada0             ada1              da0             cpu
 tin  tout KB/t  tps  MB/s  KB/t  tps  MB/s  KB/t  tps  MB/s  us ni sy in id
   0    52 10.3  784   7.9   2.2    0   0.0  13.4    2   0.0   0  0  1  0 98

------------------------------------------------------------------------
ipcs -a

Message Queues:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP                 CBYTES                 QNUM               QBYTES        LSPID        LRPID STIME    RTIME    CTIME   

Shared Memory:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP         NATTCH        SEGSZ         CPID         LPID ATIME    DTIME    CTIME   

Semaphores:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP          NSEMS OTIME    CTIME   


------------------------------------------------------------------------
ipcs -T

msginfo:
        msgmax:        16384    (max characters in a message)
        msgmni:           40    (# of message queues)
        msgmnb:         2048    (max characters in a message queue)
        msgtql:           40    (max # of messages in system)
        msgssz:            8    (size of a message segment)
        msgseg:         2048    (# of message segments in system)

shminfo:
        shmmax:    536870912    (max shared memory segment size)
        shmmin:            1    (min shared memory segment size)
        shmmni:          192    (max number of shared memory identifiers)
        shmseg:          128    (max shared memory segments per process)
        shmall:       131072    (max amount of shared memory in pages)

seminfo:
        semmni:           50    (# of semaphore identifiers)
        semmns:          340    (# of semaphores in system)
        semmnu:          150    (# of undo structures in system)
        semmsl:          340    (max # of semaphores per id)
        semopm:          100    (max # of operations per semop call)
        semume:           50    (max # of undo entries per process)
        semusz:          632    (size in bytes of undo structure)
        semvmx:        32767    (semaphore maximum value)
        semaem:        16384    (adjust on exit max value)


------------------------------------------------------------------------
netstat -s

tcp:
        0 packets sent
                0 data packets (0 bytes)
                0 data packets (0 bytes) retransmitted
                0 data packets unnecessarily retransmitted
                0 resends initiated by MTU discovery
                0 ack-only packets (0 delayed)
                0 URG only packets
                0 window probe packets
                0 window update packets
                0 control packets
        18 packets received
                0 acks (for 0 bytes)
                0 duplicate acks
                0 UDP tunneled pkts
                0 UDP tunneled pkt cnt with errors
                0 acks for unsent data
                0 packets (0 bytes) received in-sequence
                0 completely duplicate packets (0 bytes)
                0 old duplicate packets
                0 packets with some dup. data (0 bytes duped)
                0 out-of-order packets (0 bytes)
                0 packets (0 bytes) of data after window
                0 window probes
                0 window update packets
                0 packets received after close
                0 discarded for bad checksums
                0 discarded for bad header offset fields
                0 discarded because packet too short
                0 discarded due to full reassembly queue
        0 connection requests
        0 connection accepts
        0 bad connection attempts
        0 listen queue overflows
        0 ignored RSTs in the windows
        0 connections established (including accepts)
                0 times used RTT from hostcache
                0 times used RTT variance from hostcache
                0 times used slow-start threshold from hostcache
        22 connections closed (including 0 drops)
                0 connections updated cached RTT on close
                0 connections updated cached RTT variance on close
                0 connections updated cached ssthresh on close
        0 embryonic connections dropped
        0 segments updated rtt (of 0 attempts)
        0 retransmit timeouts
                0 connections dropped by rexmit timeout
        0 persist timeouts
                0 connections dropped by persist timeout
        0 Connections (fin_wait_2) dropped because of timeout
        0 keepalive timeouts
                0 keepalive probes sent
                0 connections dropped by keepalive
        0 correct ACK header predictions
        0 correct data packet header predictions
        0 syncache entries added
                0 retransmitted
                0 dupsyn
                0 dropped
                0 completed
                0 bucket overflow
                0 cache overflow
                0 reset
                0 stale
                0 aborted
                0 badack
                0 unreach
                0 zone failures
        0 cookies sent
        0 cookies received
        0 hostcache entries added
                0 bucket overflow
        0 SACK recovery episodes
        0 segment rexmits in SACK recovery episodes
        0 byte rexmits in SACK recovery episodes
        0 SACK options (SACK blocks) received
        0 SACK options (SACK blocks) sent
        0 SACK scoreboard overflow
        0 packets with ECN CE bit set
        0 packets with ECN ECT(0) bit set
        0 packets with ECN ECT(1) bit set
        0 successful ECN handshakes
        0 times ECN reduced the congestion window
        0 packets with matching signature received
        0 packets with bad signature received
        0 times failed to make signature due to no SA
        0 times unexpected signature received
        0 times no signature provided by segment
        0 Path MTU discovery black hole detection activations
        0 Path MTU discovery black hole detection min MSS activations
        0 Path MTU discovery black hole detection failures
        0 times connection in TIME-WAIT responded with ACK
        0 times connection in TIME-WAIT was actively recycled
        0 times connection in TIME-WAIT responded with RST
TCP connection count by state:
        0 connections in CLOSED state
        56 connections in LISTEN state
        0 connections in SYN_SENT state
        0 connections in SYN_RCVD state
        0 connections in ESTABLISHED state
        0 connections in CLOSE_WAIT state
        0 connections in FIN_WAIT_1 state
        0 connections in CLOSING state
        0 connections in LAST_ACK state
        0 connections in FIN_WAIT_2 state
        0 connections in TIME_WAIT state
udp:
        909 datagrams received
        0 with incomplete header
        0 with bad data length field
        0 with bad checksum
        0 with no checksum
        193 dropped due to no socket
        2 broadcast/multicast datagrams undelivered
        0 dropped due to full socket buffers
        0 not for hashed pcb
        714 delivered
        798 datagrams output
        0 times multicast source filter matched
ip:
        1060 total packets received
        0 bad header checksums
        0 with size smaller than minimum
        0 with data size < data length
        0 with ip length > max ip packet size
        0 with header length < data size
        0 with data length < header length
        0 with bad options
        0 with incorrect version number
        0 fragments received
        0 fragments dropped (dup or out of space)
        0 fragments dropped after timeout
        0 packets reassembled ok
        982 packets for this host
        0 packets for unknown/unsupported protocol
        0 packets forwarded (0 packets fast forwarded)
        75 packets not forwardable
        0 packets received for unknown multicast group
        0 redirects sent
        1054 packets sent from this host
        0 packets sent with fabricated ip header
        0 output packets dropped due to no bufs, etc.
        3 output packets discarded due to no route
        0 output datagrams fragmented
        0 fragments created
        0 datagrams that can't be fragmented
        0 tunneling packets that can't find gif
        0 datagrams with bad address in header
icmp:
        189 calls to icmp_error
        0 errors not generated in response to an icmp message
        Output histogram:
                echo reply: 51
                destination unreachable: 189
        0 messages with bad code fields
        0 messages less than the minimum length
        0 messages with bad checksum
        0 messages with bad length
        0 multicast echo requests ignored
        0 multicast timestamp requests ignored
        Input histogram:
                destination unreachable: 6
                echo: 51
        51 message responses generated
        0 invalid return addresses
        0 no return routes
arp:
        18 ARP requests sent
        6 ARP requests failed to sent
        0 ARP replies sent
        2251 ARP requests received
        10 ARP replies received
        4475 ARP packets received
        0 total packets dropped due to no ARP entry
        0 ARP entrys timed out
        0 Duplicate IPs seen
ip6:
        31 total packets received
        0 with size smaller than minimum
        0 with data size < data length
        0 with bad options
        0 with incorrect version number
        0 fragments received
        0 fragments dropped (dup or out of space)
        0 fragments dropped after timeout
        0 fragments that exceeded limit
        0 atomic fragments
        0 packets reassembled ok
        30 packets for this host
        0 packets forwarded
        0 packets not forwardable
        0 redirects sent
        58 packets sent from this host
        0 packets sent with fabricated ip header
        0 output packets dropped due to no bufs, etc.
        0 output packets discarded due to no route
        0 output datagrams fragmented
        0 fragments created
        0 datagrams that can't be fragmented
        0 packets that violated scope rules
        3 multicast packets which we don't join
        Input histogram:
                TCP: 1
                UDP: 2
                ICMP6: 28
        Mbuf statistics:
                28 one mbuf
                3 one ext mbuf
                0 two or more ext mbuf
        0 packets whose headers are not contiguous
        0 tunneling packets that can't find gif
        0 packets discarded because of too many headers
        1 failure of source address selection
        source addresses on an outgoing I/F
                3 link-locals
                3 globals
        source addresses on a non-outgoing I/F
                1 addresses scope=0xf
        source addresses of same scope
                1 link-local
                3 globals
        source addresses of a different scope
                2 link-locals
        Source addresses selection rule applied:
                6 first candidate
                1 same address
                3 appropriate scope
icmp6:
        0 calls to icmp6_error
        0 errors not generated in response to an icmp6 message
        0 errors not generated because of rate limitation
        Output histogram:
                echo reply: 18
                router solicitation: 3
                neighbor solicitation: 11
                neighbor advertisement: 2
                MLDv2 listener report: 10
        0 messages with bad code fields
        0 messages < minimum length
        0 bad checksums
        0 messages with bad length
        Input histogram:
                echo: 18
                router advertisement: 3
                neighbor solicitation: 2
                neighbor advertisement: 2
        Histogram of error messages to be generated:
                0 no route
                0 administratively prohibited
                0 beyond scope
                0 address unreachable
                0 port unreachable
                0 packet too big
                0 time exceed transit
                0 time exceed reassembly
                0 erroneous header field
                0 unrecognized next header
                0 unrecognized option
                0 redirect
                0 unknown
        18 message responses generated
        0 messages with too many ND options
        0 messages with bad ND options
        0 bad neighbor solicitation messages
        0 bad neighbor advertisement messages
        0 bad router solicitation messages
        0 bad router advertisement messages
        0 bad redirect messages
        0 default routers overflows
        0 prefix overflows
        0 neighbour entries overflows
        0 redirect overflows
        0 messages with invalid hop limit
        0 path MTU changes
rip6:
        0 messages received
        0 checksum calculations on inbound
        0 messages with bad checksum
        0 messages dropped due to no socket
        0 multicast messages dropped due to no socket
        0 messages dropped due to full socket buffers
        0 delivered
        0 datagrams output
pfkey:
        5 requests sent from userland
        464 bytes sent from userland
        histogram by message type:
                add: 4
                register: 1
        0 messages with invalid length field
        0 messages with invalid version field
        0 messages with invalid message type field
        0 messages too short
        0 messages with memory allocation failure
        0 messages with duplicate extension
        0 messages with invalid extension type
------------------------------------------------------------------------
netstat -m

netstat: memstat_kvm_all: 

------------------------------------------------------------------------

[...]
em0: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
em1: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500

ifconfig in rc.conf with "-tso4 -tso6 -lro -vlanhwtso"


[...]
Starting cron.
Starting jails:ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat
/pkg /usr/local/lib/compat/pkg
32-bit compatibility ldconfig path: /usr/lib32
Setting hostname: office.xxxxxxx.xxx
lo0: link state changed to UP


Fatal trap 12: page fault while in kernel mode
cpuid = 2; apic id = 02
fault virtual address   = 0xfffff800bb8b0240
fault code              = supervisor read instruction, protection violation
instruction pointer     = 0x20:0xfffff800bb8b0240
stack pointer           = 0x28:0xfffffe00c32c5698
frame pointer           = 0x28:0xfffffe00c32c56d0
code segment            = base rx0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 1865 (ifconfig)
trap number             = 12
panic: page fault
cpuid = 2
time = 1647731377
KDB: stack backtrace:
#0 0xffffffff80c69265 at kdb_backtrace+0x65
#1 0xffffffff80c1b8df at vpanic+0x17f
#2 0xffffffff80c1b753 at panic+0x43
#3 0xffffffff810addf5 at trap_fatal+0x385
#4 0xffffffff810ade4f at trap_pfault+0x4f
#5 0xffffffff810850e8 at calltrap+0x8
#6 0xffffffff80d5be64 at nhop_create_from_info+0x1c4
#7 0xffffffff80d5d393 at rib_add_route+0x133
#8 0xffffffff80d5f9a5 at ifa_maintain_loopback_route+0x185
#9 0xffffffff80e03932 at in6_update_ifa+0xd42
#10 0xffffffff80e098b8 at in6_ifattach+0x598
#11 0xffffffff80e059fe at in6_if_up+0x7e
#12 0xffffffff80d31a63 at ifioctl+0x433
#13 0xffffffff80c895ab at kern_ioctl+0x25b
#14 0xffffffff80c892b1 at sys_ioctl+0xf1
#15 0xffffffff810ae6ec at amd64_syscall+0x10c
#16 0xffffffff810859fb at fast_syscall_common+0xf8
Uptime: 4m38s
Dumping 518 out of 8155 MB:..4%..13%..22%..31%..41%..53%..62%..72%..81%..93%

------------------------------------------------------------------------
kernel config

options CONFIG_AUTOGENERATED
ident   GENERIC
machine amd64
cpu     HAMMER
makeoptions     WITH_CTF=1
makeoptions     DEBUG=-g
options IICHID_SAMPLING
options HID_DEBUG
options EVDEV_SUPPORT
options XENHVM
options USB_DEBUG
options ATH_ENABLE_11N
options AH_AR5416_INTERRUPT_MITIGATION
options IEEE80211_SUPPORT_MESH
options IEEE80211_DEBUG
options SC_PIXEL_MODE
options VESA
options PPS_SYNC
options COMPAT_LINUXKPI
options PCI_IOV
options PCI_HP
options IOMMU
options EARLY_AP_STARTUP
options SMP
options NETGDB
options NETDUMP
options DEBUGNET
options ZSTDIO
options GZIO
options EKCD
options KDB_TRACE
options KDB
options RCTL
options RACCT_DEFAULT_TO_DISABLED
options RACCT
options INCLUDE_CONFIG_FILE
options DDB_CTF
options KDTRACE_HOOKS
options KDTRACE_FRAME
options MAC
options CAPABILITIES
options CAPABILITY_MODE
options AUDIT
options HWPMC_HOOKS
options KBD_INSTALL_CDEV
options PRINTF_BUFR_SIZE=128
options _KPOSIX_PRIORITY_SCHEDULING
options SYSVSEM
options SYSVMSG
options SYSVSHM
options STACK
options KTRACE
options SCSI_DELAY=5000
options COMPAT_FREEBSD12
options COMPAT_FREEBSD11
options COMPAT_FREEBSD10
options COMPAT_FREEBSD9
options COMPAT_FREEBSD7
options COMPAT_FREEBSD6
options COMPAT_FREEBSD5
options COMPAT_FREEBSD4
options COMPAT_FREEBSD32
options EFIRT
options GEOM_LABEL
options GEOM_RAID
options TMPFS
options PSEUDOFS
options PROCFS
options CD9660
options MSDOSFS
options NFS_ROOT
options NFSLOCKD
options NFSD
options NFSCL
options MD_ROOT
options QUOTA
options UFS_GJOURNAL
options UFS_DIRHASH
options UFS_ACL
options SOFTUPDATES
options FFS
options KERN_TLS
options SCTP_SUPPORT
options TCP_RFC7413
options TCP_HHOOK
options TCP_BLACKBOX
options TCP_OFFLOAD
options ROUTE_MPATH
options IPSEC_SUPPORT
options INET6
options INET
options VIMAGE
options PREEMPTION
options NUMA
options SCHED_ULE
options NEW_PCIB
options GEOM_PART_GPT
options GEOM_PART_MBR
options GEOM_PART_EBR
options GEOM_PART_BSD
device  isa
device  mem
device  io
device  uart_ns8250
device  cpufreq
device  acpi
device  smbios
device  pci
device  fdc
device  ahci
device  ata
device  mvs
device  siis
device  ahc
device  ahd
device  esp
device  hptiop
device  isp
device  mpt
device  mps
device  mpr
device  sym
device  isci
device  ocs_fc
device  pvscsi
device  scbus
device  ch
device  da
device  sa
device  cd
device  pass
device  ses
device  amr
device  arcmsr
device  ciss
device  iir
device  ips
device  mly
device  twa
device  smartpqi
device  tws
device  aac
device  aacp
device  aacraid
device  ida
device  mfi
device  mlx
device  mrsas
device  pmspcv
device  twe
device  nvme
device  nvd
device  vmd
device  atkbdc
device  atkbd
device  psm
device  kbdmux
device  vga
device  splash
device  sc
device  vt
device  vt_vga
device  vt_efifb
device  vt_vbefb
device  agp
device  cbb
device  pccard
device  cardbus
device  uart
device  ppc
device  ppbus
device  lpt
device  ppi
device  puc
device  iflib
device  em
device  igc
device  ix
device  ixv
device  ixl
device  iavf
device  ice
device  vmx
device  axp
device  bxe
device  le
device  ti
device  mlx5
device  mlxfw
device  mlx5en
device  miibus
device  ae
device  age
device  alc
device  ale
device  bce
device  bfe
device  bge
device  cas
device  dc
device  et
device  fxp
device  gem
device  jme
device  lge
device  msk
device  nfe
device  nge
device  re
device  rl
device  sge
device  sis
device  sk
device  ste
device  stge
device  vge
device  vr
device  xl
device  wlan
device  wlan_wep
device  wlan_ccmp
device  wlan_tkip
device  wlan_amrr
device  an
device  ath
device  ath_pci
device  ath_hal
device  ath_rate_sample
device  ipw
device  iwi
device  iwn
device  malo
device  mwl
device  ral
device  wpi
device  crypto
device  aesni
device  loop
device  padlock_rng
device  rdrand_rng
device  ether
device  vlan
device  tuntap
device  md
device  gif
device  firmware
device  xz
device  bpf
device  uhci
device  ohci
device  ehci
device  xhci
device  usb
device  ukbd
device  umass
device  sound
device  snd_cmi
device  snd_csa
device  snd_emu10kx
device  snd_es137x
device  snd_hda
device  snd_ich
device  snd_via8233
device  mmc
device  mmcsd
device  sdhci
device  rtsx
device  virtio
device  virtio_pci
device  vtnet
device  virtio_blk
device  virtio_scsi
device  virtio_balloon
device  kvm_clock
device  hyperv
device  xenpci
device  netmap
device  evdev
device  uinput
device  hid

------------------------------------------------------------------------
ddb capture buffer

ddb: ddb_capture: kvm_nlist
Comment 1 Daniel O'Connor 2022-03-20 03:55:03 UTC
Can you post your jail.conf and rc.conf? (redacted or otherwise as you prefer)

Thanks
Comment 2 Dirk Meyer freebsd_committer freebsd_triage 2022-03-20 16:48:33 UTC
/etc/rc.conf

sshd_enable="YES"
rpcbind_enable="YES"
nfs_server_enable="YES"
nfs_client_enable="YES"
inetd_enable="NO"
sendmail_submit_enable="NO"
sendmail_outbound_enable="NO"
samba_enable="YES"
mountd_enable="YES"
fusefs_enable="YES"
pf_enable="YES"
firewall_enable="YES"
firewall_type="open"
firewall_quiet="YES"
firewall_logging="NO"
firewall_flags=""
background_fsck="NO"
bsnmpd_enable="YES"
fsck_y_enable="YES"
linux_enable="YES"
vboxnet_enable="YES"
dhcpd_enable="YES"
ntpd_enable="YES"
ipv6_activate_all_interfaces="YES"
dumpdev="/dev/mirror/gm1p2"
samba_server_enable="YES"
ntpdate_enable="YES"
microcode_update_enable="YES"
cloned_interfaces="epair0 epair1 epair2 bridge0"
route_fritz0="192.168.178.0/24 194.XXX.XXX.1 -fib 0"
route_fritz1="192.168.178.0/24 192.168.179.1 -fib 1"
route_fritz2="192.168.178.0/24 194.XXX.XXX.1 -fib 2"
route_vdsl="default 192.168.179.1 -fib 1"
route_vdsl6="-6 default fe80::XXXX:XXXX:XXXX:XXXX%em0 -fib 1"
jail_enable="YES"
jail_reverse_stop="YES"
bird_enable="YES"
ipsec_file="/etc/ipsec.conf"
nfsv4_server_enable="YES"
tpmd_enable="NO"
tcsd_enable="NO"
dhcpd6_enable="NO"
smartd_enable="NO"
rsyncd_enable="NO"
lighttpd_enable="NO"
nfs_server_managegids="NO"
keymap="de"
ipsec_enable="YES"
ifconfig_epair0a="up"
ifconfig_epair0b="up"
ifconfig_epair1a="up"
ifconfig_epair1b="up"
ifconfig_epair2a="up"
ifconfig_epair2b="up"
ipv6_defaultrouter="2a0b:f840::1"
cloned_interfaces="gif0 epair0 epair1 epair2 bridge0"
ipv6_gateway_enable="YES"
vlans_em0="vlan2 vlan3 vlan4 vlan5 vlan7"
create_args_vlan2="vlan 2 -rxcsum -txcsum"
create_args_vlan3="vlan 3 -rxcsum -txcsum"
create_args_vlan4="vlan 4 -rxcsum -txcsum"
create_args_vlan5="vlan 5 -rxcsum -txcsum"
create_args_vlan6="vlan 6 -rxcsum -txcsum"
create_args_vlan7="vlan 7 -rxcsum -txcsum"
create_args_vlan8="vlan 8 -rxcsum -txcsum"
kld_list="netgraph tcpmd5 ng_ether ng_pppoe ng_socket ng_mppc ng_ppp ng_tee ng_tcpmss"
ifconfig_vlan3="inet 192.168.138.15/24 fib 3"
ifconfig_gif0="tunnel 192.168.138.15 216.66.80.30 fib 3"
route_adsl="default 192.168.138.1 -fib 3"
ifconfig_vlan4="inet 192.168.178.15/24 fib 4"
route_vdsl="default 192.168.178.1 -fib 4"
route_vdsl6="-6 default fe80::5e49:79ff:fe81:3e36%vlan4 -fib 4"
ifconfig_vlan5="inet 192.168.188.15/24 fib 5"
route_ftth="default 192.168.188.1 -fib 5"
route_sdsl="-net 192.168.1.0/24 194.XXX.XXX.1"
defaultrouter="185.XXX.XXX.X"
ifconfig_em0="inet 185.XXX.XXX.XXX/24 -tso4 -tso6 -lro -vlanhwtso"
ifconfig_em0_ipv6="inet6 XXX:XXX::15/64"
ifconfig_em0_aliases="
inet6 2a03:7500:cc13:1::15/64
inet 194.XXX.XXX.15/24
inet 192.168.2.15/24
"
ntpdate_hosts="192.168.178.1 194.XXX.XXX.2"
dhcpd_ifaces="em0 vlan3 vlan4"
ifconfig_em1="up -tso4 -tso6 -lro -vlanhwtso -rxcsum -txcsum -vlanmtu -vlanhwtag -vlanhwcsum -vlanhwfilter"
vlans_em1="vlan14"
rpc_hosts4="-h 185.XXX.XXX.15 -h 194.XXX.XXX.15 -h 192.168.2.15 -h 192.168.138.15 -h 192.168.178.15 -h 192.168.188.15"
rpc_hosts6="-h XXXX:XXXX::15"
hostname="t5.XXX.XXX"
ifconfig_vlan5_ipv6="inet6 accept_rtadv"
rtsold_enable="YES"
rtsold_flags="vlan5"
rtsold_fib="5"
static_routes="sdsl adsl vdsl vdsl6 ftth ftth6"
dbus_enable="NO"
avahi_daemon_enable="NO"
avahi_dnsconfd_enable="NO"
minirsyslogd_enable="YES"
syslogd_flags="-ss"
ntpd_sync_on_start="YES"
cloned_interfaces=""
create_args_vlan14="vlan 4 -rxcsum -txcsum fib 4"
route_ftth6="-6 default fe80::XXXX:XXXX:XXXX:XXXX%vlan5 -fib 5"
uuidd_enable="NO"
ifconfig_vlan4_ipv6="inet6 accept_rtadv"
rtsold4_enable="YES"
rtsold4_flags="-p /var/run/rtsold4.pid vlan4"
rtsold4_fib="4"
rtsold5_enable="YES"
rtsold5_flags="-p /var/run/rtsold5.pid vlan5"
rtsold5_fib="5"
jail_enable="NO"
rpcbind_flags="${rpc_hosts4} ${rpc_hosts6}"
rpc_statd_flags="${rpc_hosts4} ${rpc_hosts6}"
mountd_flags="-r -S -n ${rpc_hosts4} ${rpc_hosts6}"
nfs_server_flags="-u -t ${rpc_hosts4} ${rpc_hosts6}"
Comment 3 Dirk Meyer freebsd_committer freebsd_triage 2022-03-20 16:51:00 UTC
/etc/jail.conf

office {
        host.hostname = "office.XXXX.XXX.XXX";
        vnet;
        vnet.interface = "vlan14";
        devfs_ruleset = 200;
        allow.sysvipc;
        allow.raw_sockets;
        persist;
}

inside the jail:
/etc/rc.conf  

hostname="office.XXXX.XXXX.XXX"
keymap="de"
defaultrouter="192.168.178.1"
ipv6_activate_all_interfaces="YES"
sendmail_submit_enable="NO"
sendmail_outbound_enable="NO"
devd_enable="NO"
sshd_enable="YES"
firewall_enable="YES"
firewall_script="/etc/rc.firewall"
firewall_type="open"
firewall_quiet="YES"
firewall_logging="NO"
firewall_flags=""
pf_enable="YES"
gateway_enable="YES"
ipv6_gateway_enable="YES"
ifconfig_vlan14="inet 192.168.178.8/24"
Comment 4 Mark Linimon freebsd_committer freebsd_triage 2022-10-15 21:00:21 UTC
Given that we now use the "crash" keyword, the Summary no longer needs "panic".
Comment 5 Dirk Meyer freebsd_committer freebsd_triage 2022-12-12 13:56:20 UTC
System upgraded to FreeBSD 13.1-RELEASE-p5

After disabling pf inside the Jail
the jails start successful.

The jail had no connectivity,
so I changed vlan14 back to fib 0.

With connectivity I was able to start pf successful.

Verified that now all jails start successful after reboot.

The panic seems to be related to "vmnet", "fibs" and "pf"
Comment 6 Graham Perrin freebsd_committer freebsd_triage 2022-12-18 20:30:29 UTC
(Sorry, not fixed, user error here with a scroll wheel.)
Comment 7 Dirk Meyer freebsd_committer freebsd_triage 2022-12-18 20:55:48 UTC
Inside the jail:

# /etc/pf.conf
nat on tun0 from any to any -> (tun0)
nat on tun1 from any to any -> (tun1)
pass quick on lo0
pass quick on epair1b
pass quick on vlan14
pass quick on tun0
# eof


It might be related that vimage/vnet jails in 13.x have their own fibs.
Previously the number of fibs have been inherited.
Now each jail can have its own set, defaults to 0.

# sysctl net.fibs
net.fibs: 8

# jexec 3 sysctl net.fibs
net.fibs: 1

# jexec 3 setfib 4 netstat -nr4
setfib: 4: invalid FIB (max 0)

So moving an Interface with fib set in the jail may cause the crash.

Should there be an out of bounds check?
Or Should the fib reset on attach?