starting an [VIMAGE] with /etc/jail.conf Setup was working with FreeBSD 12.2-RELEASE, Regression. System upgraded to FreeBSD 13.0-RELEASES, rebooting -> instant panic before all services are started. disabling jails let the system boot. System upgraded to FreeBSD 13.1-BETA2 rebooting -> instant panic before all services are started. disabling jails let the system boot. FreeBSD t5.xxxxxx.xxx 13.1-BETA2 FreeBSD 13.1-BETA2 #0 releng/13.1-n249999-e404b2562b1: Sat Mar 19 12:32:14 UTC 2022 root@amd13.xxxxx.xxxx:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 panic: page fault GNU gdb (GDB) 11.1 [GDB v11.1 for FreeBSD] Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd13.0". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: <6>lo0: link state changed to UP Fatal trap 12: page fault while in kernel mode cpuid = 2; apic id = 02 fault virtual address = 0xfffff800bb8b0240 fault code = supervisor read instruction, protection violation instruction pointer = 0x20:0xfffff800bb8b0240 stack pointer = 0x28:0xfffffe00c32c5698 frame pointer = 0x28:0xfffffe00c32c56d0 code segment = base rx0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 1865 (ifconfig) trap number = 12 panic: page fault cpuid = 2 time = 1647731377 KDB: stack backtrace: #0 0xffffffff80c69265 at kdb_backtrace+0x65 #1 0xffffffff80c1b8df at vpanic+0x17f #2 0xffffffff80c1b753 at panic+0x43 #3 0xffffffff810addf5 at trap_fatal+0x385 #4 0xffffffff810ade4f at trap_pfault+0x4f #5 0xffffffff810850e8 at calltrap+0x8 #6 0xffffffff80d5be64 at nhop_create_from_info+0x1c4 #7 0xffffffff80d5d393 at rib_add_route+0x133 #8 0xffffffff80d5f9a5 at ifa_maintain_loopback_route+0x185 #9 0xffffffff80e03932 at in6_update_ifa+0xd42 #10 0xffffffff80e098b8 at in6_ifattach+0x598 #11 0xffffffff80e059fe at in6_if_up+0x7e #12 0xffffffff80d31a63 at ifioctl+0x433 #13 0xffffffff80c895ab at kern_ioctl+0x25b #14 0xffffffff80c892b1 at sys_ioctl+0xf1 #15 0xffffffff810ae6ec at amd64_syscall+0x10c #16 0xffffffff810859fb at fast_syscall_common+0xf8 Uptime: 4m38s Dumping 518 out of 8155 MB:..4%..13%..22%..31%..41%..53%..62%..72%..81%..93% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c1b4dc in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:487 #3 0xffffffff80c1b94e in vpanic (fmt=0xffffffff811b2ef6 "%s", ap=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:920 #4 0xffffffff80c1b753 in panic (fmt=<unavailable>) at /usr/src/sys/kern/kern_shutdown.c:844 #5 0xffffffff810addf5 in trap_fatal (frame=0xfffffe00c32c55d0, eva=18446735280762978880) at /usr/src/sys/amd64/amd64/trap.c:944 #6 0xffffffff810ade4f in trap_pfault (frame=0xfffffe00c32c55d0, usermode=false, signo=<optimized out>, ucode=<optimized out>) at /usr/src/sys/amd64/amd64/trap.c:763 #7 <signal handler called> #8 0xfffff800bb8b0240 in ?? () #9 0xffffffff80d5bed0 in get_nhop (rnh=rnh@entry=0xfffff80111b6c528, info=info@entry=0xfffffe00c32c57f0, pnh_priv=pnh_priv@entry=0xfffffe00c32c56e0) at /usr/src/sys/net/route/nhop_ctl.c:360 #10 0xffffffff80d5be64 in nhop_create_from_info ( rnh=rnh@entry=0xfffff80111b6c528, info=info@entry=0xfffffe00c32c57f0, nh_ret=nh_ret@entry=0xfffffe00c32c5740) at /usr/src/sys/net/route/nhop_ctl.c:329 #11 0xffffffff80d5d393 in create_rtentry (rnh=0xfffff80111b6c528, info=0xfffffe00c32c57f0, prt=<optimized out>) at /usr/src/sys/net/route/route_ctl.c:652 #12 add_route (rnh=0xfffff80111b6c528, info=0xfffffe00c32c57f0, rc=0xfffffe00c32c57b0) at /usr/src/sys/net/route/route_ctl.c:704 #13 rib_add_route (fibnum=<optimized out>, info=0xfffffe00c32c57f0, rc=0xfffffe00c32c57b0) at /usr/src/sys/net/route/route_ctl.c:587 #14 0xffffffff80d5e0bf in rib_action (fibnum=0, action=action@entry=1, info=info@entry=0xfffffe00c32c57f0, rc=0xfffff80036141300, rc@entry=0xfffffe00c32c57b0) at /usr/src/sys/net/route/route_ctl.c:1258 #15 0xffffffff80d5f9a5 in ifa_maintain_loopback_route (cmd=cmd@entry=1, otype=0xffffffff81257398 "insertion", ifa=ifa@entry=0xfffff8014372ea80, ia=ia@entry=0xfffff8014372eae8) at /usr/src/sys/net/route/route_ifaddrs.c:163 #16 0xffffffff80d5f819 in ifa_add_loopback_route (ifa=0x0, ifa@entry=0xfffff8014372ea80, ia=0xfffff80036141300, ia@entry=0xfffff8014372eae8) at /usr/src/sys/net/route/route_ifaddrs.c:181 #17 0xffffffff80e03932 in in6_notify_ifa (ifp=<optimized out>, ia=<optimized out>, ifra=<optimized out>, hostIsNew=<optimized out>) at /usr/src/sys/netinet6/in6.c:1512 #18 in6_update_ifa_internal (ifp=0xfffff80015925000, ifra=0xfffffe00c32c5ab8, ia=<optimized out>, hostIsNew=<optimized out>, flags=<optimized out>) at /usr/src/sys/netinet6/in6.c:1180 #19 in6_update_ifa (ifp=ifp@entry=0xfffff80015925000, ifra=ifra@entry=0xfffffe00c32c5ab8, ia=<optimized out>, ia@entry=0x0, flags=flags@entry=1) at /usr/src/sys/netinet6/in6.c:883 #20 0xffffffff80e098b8 in in6_ifattach_linklocal (ifp=0xfffff80015925000, altifp=<optimized out>) at /usr/src/sys/netinet6/in6_ifattach.c:463 #21 in6_ifattach (ifp=ifp@entry=0xfffff80015925000, altifp=<optimized out>, altifp@entry=0x0) at /usr/src/sys/netinet6/in6_ifattach.c:732 #22 0xffffffff80e059fe in in6_if_up (ifp=0xfffff80015925000) at /usr/src/sys/netinet6/in6.c:1990 #23 0xffffffff80d31a63 in ifioctl (so=0xfffff80015d693b0, cmd=<optimized out>, data=0xfffffe00c32c5d50 "vlan14", td=<optimized out>) at /usr/src/sys/net/if.c:3104 #24 0xffffffff80c895ab in fo_ioctl (fp=0xfffff800037f00a0, com=<optimized out>, data=0x0, active_cred=0xfffff80036141300, td=0xfffffe00c4b38900) at /usr/src/sys/sys/file.h:360 #25 kern_ioctl (td=0x0, fd=3, com=com@entry=2151967019, data=0x0, data@entry=0xfffffe00c32c5d50 "vlan14") at /usr/src/sys/kern/sys_generic.c:803 #26 0xffffffff80c892b1 in sys_ioctl (td=<optimized out>, uap=0xfffffe00c4b38ce8) at /usr/src/sys/kern/sys_generic.c:711 #27 0xffffffff810ae6ec in syscallenter (td=0xfffffe00c4b38900) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189 #28 amd64_sysca at /usr/src/sys/amd64/amd64/trap.c:1185 #29 <signal handler called> #30 0x00000008012558ca in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffe368 (kgdb) ------------------------------------------------------------------------ ps -axlww ll (td=0xfffffe00c4b38900, traced=0) UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 3 -16 0 0 0 swapin DLs - 0:00.06 [kernel] 0 1 0 0 42 0 11800 260 wait DLs - 0:00.00 [init] 0 2 0 3 -16 0 0 0 - DL - 0:00.00 [KTLS] 0 3 0 3 -16 0 0 0 crypto_w DL - 0:00.00 [crypto] 0 4 0 1 -16 0 0 0 - RL - 0:03.13 [cam] 0 5 0 0 -16 0 0 0 - DL - 0:00.04 [rand_harvestq] 0 6 0 1 -16 0 0 0 psleep DL - 0:00.02 [pagedaemon] 0 7 0 1 -16 0 0 0 psleep DL - 0:00.00 [vmdaemon] 0 8 0 0 20 0 0 0 - RL - 0:00.04 [bufdaemon] 0 9 0 2 16 0 0 0 syncer DL - 0:00.00 [syncer] 0 10 0 3 -16 0 0 0 audit_wo DL - 0:00.00 [audit] 0 11 0 0 155 0 0 0 - RL - 17:54.23 [idle] 0 12 0 0 -52 0 0 0 - WL - 0:04.02 [intr] 0 13 0 3 -16 0 0 0 sleep DL - 0:00.00 [ng_queue] 0 14 0 0 -8 0 0 0 - DL - 0:04.45 [geom] 0 15 0 3 -16 0 0 0 seqstate DL - 0:00.00 [sequencer 00] 0 16 0 3 -68 0 0 0 - DL - 0:00.00 [usb] 0 17 0 1 -16 0 0 0 vlruwt DL - 0:00.00 [vnlru] 0 18 0 3 -8 0 0 0 m:w1 DL - 0:01.24 [g_mirror gm1] 0 19 0 3 -8 0 0 0 m:w1 DL - 0:00.00 [g_mirror gm0] 0 20 1 2 52 0 13596 1380 wait Ds+ - 0:00.04 [sh] 0 1090 1 1 20 0 11468 1304 select Ds - 0:00.01 [devd] 0 1098 1 0 20 0 13036 2216 kqread DCs - 0:00.01 [rtsold] 0 1102 1 1 52 0 13032 2192 select Ds - 0:00.00 [rtsold] 0 1104 1 0 52 0 13032 2188 select Ds - 0:00.00 [rtsold] 0 1105 1 3 42 0 13032 2184 select Ds - 0:00.00 [rtsold] 0 1106 1 2 20 0 13032 2344 select Ds - 0:00.00 [rtsold] 0 1114 1 3 20 0 13036 2216 kqread DCs - 0:00.00 [rtsold] 0 1118 1 0 52 0 13032 2192 select Ds - 0:00.00 [rtsold] 0 1120 1 0 52 0 13032 2188 select Ds - 0:00.00 [rtsold] 0 1121 1 1 52 0 13032 2184 select Ds - 0:00.00 [rtsold] 0 1122 1 2 20 0 13032 2344 select Ds - 0:00.00 [rtsold] 0 1130 1 0 20 0 13036 2216 kqread DCs - 0:00.00 [rtsold] 0 1134 1 3 52 0 13032 2192 select Ds - 0:00.00 [rtsold] 0 1136 1 0 52 0 13032 2188 select Ds - 0:00.00 [rtsold] 0 1137 1 3 52 0 13032 2184 select Ds - 0:00.00 [rtsold] 0 1138 1 2 20 0 13032 2344 select Ds - 0:00.00 [rtsold] 0 1268 0 0 -16 0 0 0 pftm DL - 0:00.01 [pf purge] 0 1434 1 3 20 0 12896 2460 select Ds - 0:00.02 [syslogd] 0 1520 1 0 20 0 91500 59248 select Ds - 0:00.27 [bsnmpd] 0 1528 0 1 -16 0 0 0 ftcl DL - 0:00.00 [ftcleanup] 0 1548 1 3 23 0 12828 2400 select Ds - 0:00.00 [rpcbind] 0 1573 1 3 22 0 12884 2584 select Ds - 0:00.00 [mountd] 0 1580 1 0 52 0 12756 2160 select Ds - 0:00.03 [nfsd] 0 1587 1580 0 52 0 12756 2076 rpcsvc D - 0:00.00 [nfsd] 136 1604 1 0 33 0 22560 6652 select Ds - 0:00.01 [dhcpd] 0 1610 1 0 22 0 12804 2204 select D - 0:00.02 [minirsyslogd] 123 1632 1 1 21 0 17572 4512 select Ds - 0:00.00 [ntpd] 0 1668 1 0 22 0 40280 13228 select Ds - 0:00.01 [nmbd] 0 1672 1 0 32 0 177000 146100 select Ds - 0:00.43 [smbd] 0 1689 1672 1 30 0 174516 142560 select D - 0:00.00 [smbd] 0 1690 1672 0 30 0 174508 142500 select D - 0:00.00 [smbd] 0 1692 1 2 52 0 21092 7308 select Ds - 0:00.00 [sshd] 0 1700 1 3 25 0 27648 7896 select Ds - 0:00.00 [bird] 25 1703 1 0 52 0 18124 5872 pause Ds - 0:00.00 [sendmail] 0 1708 1672 2 39 0 177000 145976 select D - 0:00.00 [smbd] 0 1720 1 2 52 0 12940 2532 nanslp Ds - 0:00.00 [cron] 0 1723 20 3 52 0 13596 1780 wait D+ - 0:00.00 [sh] 0 1725 1723 3 52 0 13124 2448 kqread D+ - 0:00.00 [jail] 0 1728 1 0 52 0 21092 7324 select Ds - 0:00.00 [sshd] 0 1731 1 2 52 0 21092 7324 select Ds - 0:00.00 [sshd] 0 1735 1725 2 52 0 13596 2160 wait D+ - 0:00.00 [sh] 0 1799 1735 3 52 0 13596 2332 wait D+ - 0:00.00 [sh] 0 1865 1799 2 72 0 13708 2340 - R+ - 0:00.00 [ifconfig] ------------------------------------------------------------------------ vmstat -s 3121087 cpu context switches 224593 device interrupts 4817 software interrupts 285151 traps 764198 system calls 21 kernel threads created 1389 fork() calls 420 vfork() calls 35 rfork() calls 0 swap pager pageins 0 swap pager pages paged in 0 swap pager pageouts 0 swap pager pages paged out 3491 vnode pager pageins 13442 vnode pager pages paged in 0 vnode pager pageouts 0 vnode pager pages paged out 0 page daemon wakeups 0 pages examined by the page daemon 0 clean page reclamation shortfalls 0 pages reactivated by the page daemon 78880 copy-on-write faults 62 copy-on-write optimized faults 192779 zero fill pages zeroed 0 zero fill pages prezeroed 850 intransit blocking page faults 302058 total VM faults taken 3311 page faults requiring I/O 0 pages affected by kernel thread creation 77530 pages affected by fork() 14690 pages affected by vfork() 1186 pages affected by rfork() 334922 pages freed 0 pages freed by daemon 0 pages freed by exiting processes 0 pages active 0 pages inactive 0 pages in the laundry queue 0 pages wired down 0 virtual user pages wired down 0 pages free 0 bytes per page 0 total name lookups cache hits (0% pos + 0% neg) system 0% per-directory deletions 0%, falsehits 0%, toolong 0% ------------------------------------------------------------------------ vmstat -m vmstat: memstat_kvm_malloc: Type InUse MemUse Requests Size(s) ------------------------------------------------------------------------ vmstat -z ITEM SIZE LIMIT USED FREE REQ FAILSLEEP XDOMAIN UMA Kegs: 384, 0, 145, 0, 146, 0, 0, 0 UMA Zones: 1024, 0, 159, 0, 160, 0, 0, 0 UMA Slabs 0: 80, 0, 3610, 0, 3610, 0, 0, 0 UMA Slabs 1: 112, 0, 16, 0, 16, 0, 0, 0 UMA Hash: 256, 0, 0, 0, 0, 0, 0, 0 2 Bucket: 32, 0, 26, 990, 482, 0, 0, 0 4 Bucket: 48, 0, 13, 1003, 130, 0, 0, 0 8 Bucket: 80, 0, 53, 580, 7380, 0, 0, 0 16 Bucket: 144, 0, 42, 211, 110, 0, 0, 0 32 Bucket: 256, 0, 76, 358, 17946, 0, 0, 0 64 Bucket: 512, 0, 79, 132, 2803, 8, 0, 0 128 Bucket: 1024, 0, 82, 77, 4428, 24, 0, 0 256 Bucket: 2048, 0, 138, 15, 1500, 0, 0, 0 SMR SHARED: 24, 0, 2, 506, 2, 0, 0, 0 SMR CPU: 32, 0, 2, 506, 2, 0, 0, 0 vmem: 1856, 0, 1, 7, 1, 0, 0, 0 vmem btag: 56, 0, 12867, 148, 12925, 90, 0, 0 VM OBJECT: 264, 0, 34076, 94, 59272, 0, 0, 0 RADIX NODE: 144, 0, 15141, 421, 80283, 0, 0, 0 KMAP ENTRY: 96, 0, 107, 0, 121, 0, 0, 0 MAP ENTRY: 96, 0, 128921, 607, 221973, 0, 0, 0 VMSPACE: 2552, 0, 43, 21, 1846, 0, 0, 0 fakepg: 104, 0, 0, 0, 0, 0, 0, 0 pcpu-4: 4, 0, 0, 0, 0, 0, 0, 0 pcpu-8: 8, 0, 8004, 632, 11206, 0, 0, 0 pcpu-16: 16, 0, 21, 487, 21, 0, 0, 0 pcpu-32: 32, 0, 0, 0, 0, 0, 0, 0 pcpu-64: 64, 0, 482, 534, 485, 0, 0, 0 malloc-16: 16, 0, 188141, 835, 441940, 0, 0, 0 malloc-32: 32, 0, 84719, 371, 98259, 0, 0, 0 malloc-64: 64, 0, 17759, 529, 119848, 0, 0, 0 malloc-128: 128, 0, 161316, 216, 259389, 0, 0, 0 malloc-256: 256, 0, 58297, 107, 74575, 0, 0, 0 malloc-384: 384, 0, 1052, 88, 2355, 0, 0, 0 malloc-512: 512, 0, 84, 36, 893, 0, 0, 0 malloc-1024: 1024, 0, 296, 40, 3512, 0, 0, 0 malloc-2048: 2048, 0, 303, 33, 220982, 0, 0, 0 malloc-4096: 4096, 0, 504, 10, 26844, 0, 0, 0 malloc-8192: 8192, 0, 70, 3, 684, 0, 0, 0 malloc-16384: 16384, 0, 20, 7, 1047, 0, 0, 0 malloc-32768: 32768, 0, 21, 1, 490, 0, 0, 0 malloc-65536: 65536, 0, 28, 5, 731, 0, 0, 0 SLEEPQUEUE: 80, 0, 265, 239, 265, 0, 0, 0 kenv: 258, 0, 21, 99, 1610, 0, 0, 0 Files: 80, 0, 355, 149, 52628, 0, 0, 0 filedesc0: 1072, 0, 64, 40, 1866, 0, 0, 0 PWD: 32, 0, 20, 996, 176, 0, 0, 0 TURNSTILE: 136, 0, 265, 169, 265, 0, 0, 0 rangeset pctrie nodes: 144, 0, 0, 0, 0, 0, 0, 0 rl_entry: 40, 0, 67, 949, 67, 0, 0, 0 lkpicurr: 160, 0, 2, 19, 2, 0, 0, 0 lkpimm: 160, 0, 1, 20, 1, 0, 0, 0 umtx pi: 96, 0, 0, 0, 0, 0, 0, 0 umtx_shm: 88, 0, 31091, 283, 31093, 0, 0, 0 swrbuf: 2368, 128, 0, 0, 0, 0, 0, 0 swwbuf: 2368, 64, 0, 0, 0, 0, 0, 0 nfspbuf: 2368, 128, 0, 0, 0, 0, 0, 0 mdpbuf: 2368, 25, 0, 0, 0, 0, 0, 0 vnpbuf: 2368, 512, 0, 0, 0, 0, 0, 0 clpbuf: 2368, 128, 0, 64, 613, 0, 0, 0 pbuf: 2368, 16, 0, 0, 0, 0, 0, 0 FPU_save_area: 576, 0, 230, 58, 302, 0, 0, 0 MAC labels: 40, 0, 0, 0, 0, 0, 0, 0 PROC: 1352, 0, 63, 33, 1865, 0, 0, 0 PGRP: 88, 0, 34, 344, 47, 0, 0, 0 THREAD: 1808, 0, 228, 36, 244, 0, 0, 0 cpuset: 104, 0, 17, 487, 34, 0, 0, 0 domainset: 40, 0, 0, 508, 20, 0, 0, 0 audit_record: 1280, 0, 0, 0, 0, 0, 0, 0 mbuf_packet: 256, 0, 0, 762, 859, 0, 0, 0 mbuf: 256, 3246830, 7491, 1145, 17509, 0, 0, 0 mbuf_cluster: 2048, 507317, 3834, 738, 4744, 0, 0, 0 mbuf_jumbo_page: 4096, 253658, 0, 0, 0, 0, 0, 0 mbuf_jumbo_9k: 9216, 75158, 0, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 42276, 0, 0, 0, 0, 0, 0 epoch_record pcpu: 256, 0, 4, 58, 4, 0, 0, 0 ktls_session: 192, 0, 0, 0, 0, 0, 0, 0 NetGraph items: 72, 4096, 0, 254, 1, 0, 0, 0 NetGraph data items: 72, 4096, 0, 0, 0, 0, 0, 0 ttyinq: 160, 0, 15, 47, 15, 0, 0, 0 ttyoutq: 256, 0, 8, 54, 8, 0, 0, 0 IOMMU_MAP_ENTRY: 120, 0, 0, 0, 0, 0, 0, 0 DEVCTL: 1024, 1000, 0, 0, 537, 0, 0, 0 g_bio: 376, 0, 0, 480, 1086825, 0, 0, 0 linux_dma_pctrie: 144, 0, 0, 0, 0, 0, 0, 0 linux_dma_object: 32, 0, 0, 0, 0, 0, 0, 0 cryptop: 280, 0, 0, 0, 0, 0, 0, 0 vtnet_tx_hdr: 24, 0, 0, 0, 0, 0, 0, 0 VNODE: 488, 0, 1523, 157, 1584, 0, 0, 0 BUF TRIE: 144, 0, 1661, 323, 11340, 0, 0, 0 S VFS Cache: 104, 0, 2175, 219, 2266, 0, 0, 0 STS VFS Cache: 144, 0, 0, 0, 0, 0, 0, 0 L VFS Cache: 320, 0, 0, 30, 1, 0, 0, 0 LTS VFS Cache: 360, 0, 0, 0, 0, 0, 0, 0 NAMEI: 1024, 0, 0, 80, 36663, 0, 0, 0 NCLNODE: 616, 0, 0, 0, 0, 0, 0, 0 DIRHASH: 1024, 0, 147, 13, 147, 0, 0, 0 Mountpoints: 2752, 0, 13, 7, 13, 0, 0, 0 AIO: 208, 0, 0, 0, 0, 0, 0, 0 AIOP: 32, 0, 0, 0, 0, 0, 0, 0 AIOCB: 552, 0, 0, 0, 0, 0, 0, 0 AIOLIO: 272, 0, 0, 0, 0, 0, 0, 0 pipe: 744, 0, 9, 39, 839, 0, 0, 0 ksiginfo: 112, 0, 80, 424, 191, 0, 0, 0 itimer: 352, 0, 0, 0, 0, 0, 0, 0 KNOTE: 160, 0, 11, 237, 102, 0, 0, 0 socket: 944, 25000, 198, 818, 4927, 0, 0, 0 unpcb: 256, 25000, 51, 965, 4366, 0, 0, 0 ipq: 56, 15853, 0, 0, 0, 0, 0, 0 udp_inpcb: 496, 25000, 74, 942, 428, 0, 0, 0 udpcb: 32, 25000, 74, 942, 428, 0, 0, 0 tcp_inpcb: 496, 25000, 56, 960, 78, 0, 0, 0 tcpcb: 1080, 25000, 56, 960, 78, 0, 0, 0 tcptw: 88, 5000, 0, 0, 0, 0, 0, 0 syncache: 168, 15360, 0, 0, 0, 0, 0, 0 hostcache: 96, 15360, 0, 0, 0, 0, 0, 0 sackhole: 32, 0, 0, 0, 0, 0, 0, 0 tfo: 4, 0, 0, 0, 0, 0, 0, 0 tfo_ccache_entries: 80, 0, 0, 0, 0, 0, 0, 0 tcpreass: 48, 31707, 0, 0, 0, 0, 0, 0 tcp_log: 408, 5000000, 0, 0, 0, 0, 0, 0 tcp_log_bucket: 176, 0, 0, 0, 0, 0, 0, 0 tcp_log_node: 120, 0, 0, 0, 0, 0, 0, 0 udplite_inpcb: 496, 25000, 0, 0, 0, 0, 0, 0 ripcb: 496, 25000, 10, 1006, 22, 0, 0, 0 IPsec SA lft_c: 16, 0, 0, 254, 4, 0, 0, 0 routing nhops: 256, 0, 63, 185, 100, 0, 0, 0 rtentry: 176, 0, 90, 158, 95, 0, 0, 0 swpctrie: 144, 1014664, 0, 0, 0, 0, 0, 0 swblk: 136, 1014652, 0, 0, 0, 0, 0, 0 FFS inode: 160, 0, 1459, 153, 1502, 0, 0, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 1459, 215, 1502, 0, 0, 0 IPFW counters: 16, 0, 12, 750, 12, 0, 0, 0 IPFW dynamic states data: 88, 16384, 0, 0, 0, 0, 0, 0 IPFW parent dynamic states: 32, 4096, 0, 0, 0, 0, 0, 0 IPFW IPv4 dynamic states: 40, 0, 0, 0, 0, 0, 0, 0 IPFW IPv6 dynamic states: 72, 0, 0, 0, 0, 0, 0, 0 pf mtags: 48, 0, 0, 0, 0, 0, 0, 0 pf tags: 104, 0, 0, 0, 0, 0, 0, 0 pf states: 312, 100000, 12, 750, 12, 0, 0, 0 pf state keys: 88, 0, 12, 366, 12, 0, 0, 0 pf source nodes: 136, 10000, 0, 0, 0, 0, 0, 0 pf table entry counters: 64, 0, 0, 0, 0, 0, 0, 0 pf table entries: 160, 200000, 23, 39, 23, 0, 0, 0 pf frags: 248, 0, 0, 0, 0, 0, 0, 0 pf frag entries: 40, 5000, 0, 0, 0, 0, 0, 0 pf state scrubs: 40, 0, 0, 0, 0, 0, 0, 0 TMPFS node: 224, 0, 1, 61, 1, 0, 0, 0 dtrace_state_cache: 16384, 0, 0, 0, 0, 0, 0, 0 taskq_zone: 192, 0, 0, 0, 0, 0, 0, 0 ipq: 56, 15853, 0, 0, 0, 0, 0, 0 udp_inpcb: 496, 25000, 2, 506, 12, 0, 0, 0 udpcb: 32, 25000, 1, 507, 12, 0, 0, 0 tcp_inpcb: 496, 25000, 0, 0, 0, 0, 0, 0 tcpcb: 1080, 25000, 0, 0, 0, 0, 0, 0 tcptw: 88, 5000, 0, 0, 0, 0, 0, 0 syncache: 168, 15360, 0, 0, 0, 0, 0, 0 hostcache: 96, 15360, 0, 0, 0, 0, 0, 0 sackhole: 32, 0, 0, 0, 0, 0, 0, 0 tfo: 4, 0, 0, 0, 0, 0, 0, 0 tfo_ccache_entries: 80, 0, 0, 0, 0, 0, 0, 0 udplite_inpcb: 496, 25000, 0, 0, 0, 0, 0, 0 ripcb: 496, 25000, 0, 0, 0, 0, 0, 0 IPsec SA lft_c: 16, 0, 0, 0, 0, 0, 0, 0 rtentry: 176, 0, 4, 120, 4, 0, 0, 0 pf tags: 104, 0, 0, 0, 0, 0, 0, 0 pf states: 312, 100000, 0, 0, 0, 0, 0, 0 pf state keys: 88, 0, 0, 0, 0, 0, 0, 0 pf source nodes: 136, 10000, 0, 0, 0, 0, 0, 0 pf table entry counters: 64, 0, 0, 0, 0, 0, 0, 0 pf table entries: 160, 0, 0, 0, 0, 0, 0, 0 pf frags: 248, 0, 0, 0, 0, 0, 0, 0 pf frag entries: 40, 5000, 0, 0, 0, 0, 0, 0 pf state scrubs: 40, 0, 0, 0, 0, 0, 0, 0 IPFW counters: 16, 0, 1, 253, 1, 0, 0, 0 IPFW dynamic states data: 88, 16384, 0, 0, 0, 0, 0, 0 IPFW parent dynamic states: 32, 4096, 0, 0, 0, 0, 0, 0 IPFW IPv4 dynamic states: 40, 0, 0, 0, 0, 0, 0, 0 IPFW IPv6 dynamic states: 72, 0, 0, 0, 0, 0, 0, 0 ------------------------------------------------------------------------ vmstat -i interrupt total rate irq1: atkbd0 1 0 irq14: ata0 230 0 irq16: twa0 672 1 irq19: uhci1++ 218116 259 cpu0:timer 34013 40 cpu1:timer 30116 36 cpu2:timer 40384 48 cpu3:timer 50283 60 irq48: em0:irq0 3391 4 irq49: em1:irq0 2183 3 Total 379389 450 ------------------------------------------------------------------------ pstat -T 355/25000 files 0M/0M swap space ------------------------------------------------------------------------ pstat -s Device 1K-blocks Used Avail Capacity ------------------------------------------------------------------------ iostat tty ada0 ada1 da0 cpu tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 52 10.3 784 7.9 2.2 0 0.0 13.4 2 0.0 0 0 1 0 98 ------------------------------------------------------------------------ ipcs -a Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME ------------------------------------------------------------------------ ipcs -T msginfo: msgmax: 16384 (max characters in a message) msgmni: 40 (# of message queues) msgmnb: 2048 (max characters in a message queue) msgtql: 40 (max # of messages in system) msgssz: 8 (size of a message segment) msgseg: 2048 (# of message segments in system) shminfo: shmmax: 536870912 (max shared memory segment size) shmmin: 1 (min shared memory segment size) shmmni: 192 (max number of shared memory identifiers) shmseg: 128 (max shared memory segments per process) shmall: 131072 (max amount of shared memory in pages) seminfo: semmni: 50 (# of semaphore identifiers) semmns: 340 (# of semaphores in system) semmnu: 150 (# of undo structures in system) semmsl: 340 (max # of semaphores per id) semopm: 100 (max # of operations per semop call) semume: 50 (max # of undo entries per process) semusz: 632 (size in bytes of undo structure) semvmx: 32767 (semaphore maximum value) semaem: 16384 (adjust on exit max value) ------------------------------------------------------------------------ netstat -s tcp: 0 packets sent 0 data packets (0 bytes) 0 data packets (0 bytes) retransmitted 0 data packets unnecessarily retransmitted 0 resends initiated by MTU discovery 0 ack-only packets (0 delayed) 0 URG only packets 0 window probe packets 0 window update packets 0 control packets 18 packets received 0 acks (for 0 bytes) 0 duplicate acks 0 UDP tunneled pkts 0 UDP tunneled pkt cnt with errors 0 acks for unsent data 0 packets (0 bytes) received in-sequence 0 completely duplicate packets (0 bytes) 0 old duplicate packets 0 packets with some dup. data (0 bytes duped) 0 out-of-order packets (0 bytes) 0 packets (0 bytes) of data after window 0 window probes 0 window update packets 0 packets received after close 0 discarded for bad checksums 0 discarded for bad header offset fields 0 discarded because packet too short 0 discarded due to full reassembly queue 0 connection requests 0 connection accepts 0 bad connection attempts 0 listen queue overflows 0 ignored RSTs in the windows 0 connections established (including accepts) 0 times used RTT from hostcache 0 times used RTT variance from hostcache 0 times used slow-start threshold from hostcache 22 connections closed (including 0 drops) 0 connections updated cached RTT on close 0 connections updated cached RTT variance on close 0 connections updated cached ssthresh on close 0 embryonic connections dropped 0 segments updated rtt (of 0 attempts) 0 retransmit timeouts 0 connections dropped by rexmit timeout 0 persist timeouts 0 connections dropped by persist timeout 0 Connections (fin_wait_2) dropped because of timeout 0 keepalive timeouts 0 keepalive probes sent 0 connections dropped by keepalive 0 correct ACK header predictions 0 correct data packet header predictions 0 syncache entries added 0 retransmitted 0 dupsyn 0 dropped 0 completed 0 bucket overflow 0 cache overflow 0 reset 0 stale 0 aborted 0 badack 0 unreach 0 zone failures 0 cookies sent 0 cookies received 0 hostcache entries added 0 bucket overflow 0 SACK recovery episodes 0 segment rexmits in SACK recovery episodes 0 byte rexmits in SACK recovery episodes 0 SACK options (SACK blocks) received 0 SACK options (SACK blocks) sent 0 SACK scoreboard overflow 0 packets with ECN CE bit set 0 packets with ECN ECT(0) bit set 0 packets with ECN ECT(1) bit set 0 successful ECN handshakes 0 times ECN reduced the congestion window 0 packets with matching signature received 0 packets with bad signature received 0 times failed to make signature due to no SA 0 times unexpected signature received 0 times no signature provided by segment 0 Path MTU discovery black hole detection activations 0 Path MTU discovery black hole detection min MSS activations 0 Path MTU discovery black hole detection failures 0 times connection in TIME-WAIT responded with ACK 0 times connection in TIME-WAIT was actively recycled 0 times connection in TIME-WAIT responded with RST TCP connection count by state: 0 connections in CLOSED state 56 connections in LISTEN state 0 connections in SYN_SENT state 0 connections in SYN_RCVD state 0 connections in ESTABLISHED state 0 connections in CLOSE_WAIT state 0 connections in FIN_WAIT_1 state 0 connections in CLOSING state 0 connections in LAST_ACK state 0 connections in FIN_WAIT_2 state 0 connections in TIME_WAIT state udp: 909 datagrams received 0 with incomplete header 0 with bad data length field 0 with bad checksum 0 with no checksum 193 dropped due to no socket 2 broadcast/multicast datagrams undelivered 0 dropped due to full socket buffers 0 not for hashed pcb 714 delivered 798 datagrams output 0 times multicast source filter matched ip: 1060 total packets received 0 bad header checksums 0 with size smaller than minimum 0 with data size < data length 0 with ip length > max ip packet size 0 with header length < data size 0 with data length < header length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 packets reassembled ok 982 packets for this host 0 packets for unknown/unsupported protocol 0 packets forwarded (0 packets fast forwarded) 75 packets not forwardable 0 packets received for unknown multicast group 0 redirects sent 1054 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 3 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 tunneling packets that can't find gif 0 datagrams with bad address in header icmp: 189 calls to icmp_error 0 errors not generated in response to an icmp message Output histogram: echo reply: 51 destination unreachable: 189 0 messages with bad code fields 0 messages less than the minimum length 0 messages with bad checksum 0 messages with bad length 0 multicast echo requests ignored 0 multicast timestamp requests ignored Input histogram: destination unreachable: 6 echo: 51 51 message responses generated 0 invalid return addresses 0 no return routes arp: 18 ARP requests sent 6 ARP requests failed to sent 0 ARP replies sent 2251 ARP requests received 10 ARP replies received 4475 ARP packets received 0 total packets dropped due to no ARP entry 0 ARP entrys timed out 0 Duplicate IPs seen ip6: 31 total packets received 0 with size smaller than minimum 0 with data size < data length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 fragments that exceeded limit 0 atomic fragments 0 packets reassembled ok 30 packets for this host 0 packets forwarded 0 packets not forwardable 0 redirects sent 58 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 0 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 packets that violated scope rules 3 multicast packets which we don't join Input histogram: TCP: 1 UDP: 2 ICMP6: 28 Mbuf statistics: 28 one mbuf 3 one ext mbuf 0 two or more ext mbuf 0 packets whose headers are not contiguous 0 tunneling packets that can't find gif 0 packets discarded because of too many headers 1 failure of source address selection source addresses on an outgoing I/F 3 link-locals 3 globals source addresses on a non-outgoing I/F 1 addresses scope=0xf source addresses of same scope 1 link-local 3 globals source addresses of a different scope 2 link-locals Source addresses selection rule applied: 6 first candidate 1 same address 3 appropriate scope icmp6: 0 calls to icmp6_error 0 errors not generated in response to an icmp6 message 0 errors not generated because of rate limitation Output histogram: echo reply: 18 router solicitation: 3 neighbor solicitation: 11 neighbor advertisement: 2 MLDv2 listener report: 10 0 messages with bad code fields 0 messages < minimum length 0 bad checksums 0 messages with bad length Input histogram: echo: 18 router advertisement: 3 neighbor solicitation: 2 neighbor advertisement: 2 Histogram of error messages to be generated: 0 no route 0 administratively prohibited 0 beyond scope 0 address unreachable 0 port unreachable 0 packet too big 0 time exceed transit 0 time exceed reassembly 0 erroneous header field 0 unrecognized next header 0 unrecognized option 0 redirect 0 unknown 18 message responses generated 0 messages with too many ND options 0 messages with bad ND options 0 bad neighbor solicitation messages 0 bad neighbor advertisement messages 0 bad router solicitation messages 0 bad router advertisement messages 0 bad redirect messages 0 default routers overflows 0 prefix overflows 0 neighbour entries overflows 0 redirect overflows 0 messages with invalid hop limit 0 path MTU changes rip6: 0 messages received 0 checksum calculations on inbound 0 messages with bad checksum 0 messages dropped due to no socket 0 multicast messages dropped due to no socket 0 messages dropped due to full socket buffers 0 delivered 0 datagrams output pfkey: 5 requests sent from userland 464 bytes sent from userland histogram by message type: add: 4 register: 1 0 messages with invalid length field 0 messages with invalid version field 0 messages with invalid message type field 0 messages too short 0 messages with memory allocation failure 0 messages with duplicate extension 0 messages with invalid extension type ------------------------------------------------------------------------ netstat -m netstat: memstat_kvm_all: ------------------------------------------------------------------------ [...] em0: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 em1: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 ifconfig in rc.conf with "-tso4 -tso6 -lro -vlanhwtso" [...] Starting cron. Starting jails:ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /pkg /usr/local/lib/compat/pkg 32-bit compatibility ldconfig path: /usr/lib32 Setting hostname: office.xxxxxxx.xxx lo0: link state changed to UP Fatal trap 12: page fault while in kernel mode cpuid = 2; apic id = 02 fault virtual address = 0xfffff800bb8b0240 fault code = supervisor read instruction, protection violation instruction pointer = 0x20:0xfffff800bb8b0240 stack pointer = 0x28:0xfffffe00c32c5698 frame pointer = 0x28:0xfffffe00c32c56d0 code segment = base rx0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 1865 (ifconfig) trap number = 12 panic: page fault cpuid = 2 time = 1647731377 KDB: stack backtrace: #0 0xffffffff80c69265 at kdb_backtrace+0x65 #1 0xffffffff80c1b8df at vpanic+0x17f #2 0xffffffff80c1b753 at panic+0x43 #3 0xffffffff810addf5 at trap_fatal+0x385 #4 0xffffffff810ade4f at trap_pfault+0x4f #5 0xffffffff810850e8 at calltrap+0x8 #6 0xffffffff80d5be64 at nhop_create_from_info+0x1c4 #7 0xffffffff80d5d393 at rib_add_route+0x133 #8 0xffffffff80d5f9a5 at ifa_maintain_loopback_route+0x185 #9 0xffffffff80e03932 at in6_update_ifa+0xd42 #10 0xffffffff80e098b8 at in6_ifattach+0x598 #11 0xffffffff80e059fe at in6_if_up+0x7e #12 0xffffffff80d31a63 at ifioctl+0x433 #13 0xffffffff80c895ab at kern_ioctl+0x25b #14 0xffffffff80c892b1 at sys_ioctl+0xf1 #15 0xffffffff810ae6ec at amd64_syscall+0x10c #16 0xffffffff810859fb at fast_syscall_common+0xf8 Uptime: 4m38s Dumping 518 out of 8155 MB:..4%..13%..22%..31%..41%..53%..62%..72%..81%..93% ------------------------------------------------------------------------ kernel config options CONFIG_AUTOGENERATED ident GENERIC machine amd64 cpu HAMMER makeoptions WITH_CTF=1 makeoptions DEBUG=-g options IICHID_SAMPLING options HID_DEBUG options EVDEV_SUPPORT options XENHVM options USB_DEBUG options ATH_ENABLE_11N options AH_AR5416_INTERRUPT_MITIGATION options IEEE80211_SUPPORT_MESH options IEEE80211_DEBUG options SC_PIXEL_MODE options VESA options PPS_SYNC options COMPAT_LINUXKPI options PCI_IOV options PCI_HP options IOMMU options EARLY_AP_STARTUP options SMP options NETGDB options NETDUMP options DEBUGNET options ZSTDIO options GZIO options EKCD options KDB_TRACE options KDB options RCTL options RACCT_DEFAULT_TO_DISABLED options RACCT options INCLUDE_CONFIG_FILE options DDB_CTF options KDTRACE_HOOKS options KDTRACE_FRAME options MAC options CAPABILITIES options CAPABILITY_MODE options AUDIT options HWPMC_HOOKS options KBD_INSTALL_CDEV options PRINTF_BUFR_SIZE=128 options _KPOSIX_PRIORITY_SCHEDULING options SYSVSEM options SYSVMSG options SYSVSHM options STACK options KTRACE options SCSI_DELAY=5000 options COMPAT_FREEBSD12 options COMPAT_FREEBSD11 options COMPAT_FREEBSD10 options COMPAT_FREEBSD9 options COMPAT_FREEBSD7 options COMPAT_FREEBSD6 options COMPAT_FREEBSD5 options COMPAT_FREEBSD4 options COMPAT_FREEBSD32 options EFIRT options GEOM_LABEL options GEOM_RAID options TMPFS options PSEUDOFS options PROCFS options CD9660 options MSDOSFS options NFS_ROOT options NFSLOCKD options NFSD options NFSCL options MD_ROOT options QUOTA options UFS_GJOURNAL options UFS_DIRHASH options UFS_ACL options SOFTUPDATES options FFS options KERN_TLS options SCTP_SUPPORT options TCP_RFC7413 options TCP_HHOOK options TCP_BLACKBOX options TCP_OFFLOAD options ROUTE_MPATH options IPSEC_SUPPORT options INET6 options INET options VIMAGE options PREEMPTION options NUMA options SCHED_ULE options NEW_PCIB options GEOM_PART_GPT options GEOM_PART_MBR options GEOM_PART_EBR options GEOM_PART_BSD device isa device mem device io device uart_ns8250 device cpufreq device acpi device smbios device pci device fdc device ahci device ata device mvs device siis device ahc device ahd device esp device hptiop device isp device mpt device mps device mpr device sym device isci device ocs_fc device pvscsi device scbus device ch device da device sa device cd device pass device ses device amr device arcmsr device ciss device iir device ips device mly device twa device smartpqi device tws device aac device aacp device aacraid device ida device mfi device mlx device mrsas device pmspcv device twe device nvme device nvd device vmd device atkbdc device atkbd device psm device kbdmux device vga device splash device sc device vt device vt_vga device vt_efifb device vt_vbefb device agp device cbb device pccard device cardbus device uart device ppc device ppbus device lpt device ppi device puc device iflib device em device igc device ix device ixv device ixl device iavf device ice device vmx device axp device bxe device le device ti device mlx5 device mlxfw device mlx5en device miibus device ae device age device alc device ale device bce device bfe device bge device cas device dc device et device fxp device gem device jme device lge device msk device nfe device nge device re device rl device sge device sis device sk device ste device stge device vge device vr device xl device wlan device wlan_wep device wlan_ccmp device wlan_tkip device wlan_amrr device an device ath device ath_pci device ath_hal device ath_rate_sample device ipw device iwi device iwn device malo device mwl device ral device wpi device crypto device aesni device loop device padlock_rng device rdrand_rng device ether device vlan device tuntap device md device gif device firmware device xz device bpf device uhci device ohci device ehci device xhci device usb device ukbd device umass device sound device snd_cmi device snd_csa device snd_emu10kx device snd_es137x device snd_hda device snd_ich device snd_via8233 device mmc device mmcsd device sdhci device rtsx device virtio device virtio_pci device vtnet device virtio_blk device virtio_scsi device virtio_balloon device kvm_clock device hyperv device xenpci device netmap device evdev device uinput device hid ------------------------------------------------------------------------ ddb capture buffer ddb: ddb_capture: kvm_nlist
Can you post your jail.conf and rc.conf? (redacted or otherwise as you prefer) Thanks
/etc/rc.conf sshd_enable="YES" rpcbind_enable="YES" nfs_server_enable="YES" nfs_client_enable="YES" inetd_enable="NO" sendmail_submit_enable="NO" sendmail_outbound_enable="NO" samba_enable="YES" mountd_enable="YES" fusefs_enable="YES" pf_enable="YES" firewall_enable="YES" firewall_type="open" firewall_quiet="YES" firewall_logging="NO" firewall_flags="" background_fsck="NO" bsnmpd_enable="YES" fsck_y_enable="YES" linux_enable="YES" vboxnet_enable="YES" dhcpd_enable="YES" ntpd_enable="YES" ipv6_activate_all_interfaces="YES" dumpdev="/dev/mirror/gm1p2" samba_server_enable="YES" ntpdate_enable="YES" microcode_update_enable="YES" cloned_interfaces="epair0 epair1 epair2 bridge0" route_fritz0="192.168.178.0/24 194.XXX.XXX.1 -fib 0" route_fritz1="192.168.178.0/24 192.168.179.1 -fib 1" route_fritz2="192.168.178.0/24 194.XXX.XXX.1 -fib 2" route_vdsl="default 192.168.179.1 -fib 1" route_vdsl6="-6 default fe80::XXXX:XXXX:XXXX:XXXX%em0 -fib 1" jail_enable="YES" jail_reverse_stop="YES" bird_enable="YES" ipsec_file="/etc/ipsec.conf" nfsv4_server_enable="YES" tpmd_enable="NO" tcsd_enable="NO" dhcpd6_enable="NO" smartd_enable="NO" rsyncd_enable="NO" lighttpd_enable="NO" nfs_server_managegids="NO" keymap="de" ipsec_enable="YES" ifconfig_epair0a="up" ifconfig_epair0b="up" ifconfig_epair1a="up" ifconfig_epair1b="up" ifconfig_epair2a="up" ifconfig_epair2b="up" ipv6_defaultrouter="2a0b:f840::1" cloned_interfaces="gif0 epair0 epair1 epair2 bridge0" ipv6_gateway_enable="YES" vlans_em0="vlan2 vlan3 vlan4 vlan5 vlan7" create_args_vlan2="vlan 2 -rxcsum -txcsum" create_args_vlan3="vlan 3 -rxcsum -txcsum" create_args_vlan4="vlan 4 -rxcsum -txcsum" create_args_vlan5="vlan 5 -rxcsum -txcsum" create_args_vlan6="vlan 6 -rxcsum -txcsum" create_args_vlan7="vlan 7 -rxcsum -txcsum" create_args_vlan8="vlan 8 -rxcsum -txcsum" kld_list="netgraph tcpmd5 ng_ether ng_pppoe ng_socket ng_mppc ng_ppp ng_tee ng_tcpmss" ifconfig_vlan3="inet 192.168.138.15/24 fib 3" ifconfig_gif0="tunnel 192.168.138.15 216.66.80.30 fib 3" route_adsl="default 192.168.138.1 -fib 3" ifconfig_vlan4="inet 192.168.178.15/24 fib 4" route_vdsl="default 192.168.178.1 -fib 4" route_vdsl6="-6 default fe80::5e49:79ff:fe81:3e36%vlan4 -fib 4" ifconfig_vlan5="inet 192.168.188.15/24 fib 5" route_ftth="default 192.168.188.1 -fib 5" route_sdsl="-net 192.168.1.0/24 194.XXX.XXX.1" defaultrouter="185.XXX.XXX.X" ifconfig_em0="inet 185.XXX.XXX.XXX/24 -tso4 -tso6 -lro -vlanhwtso" ifconfig_em0_ipv6="inet6 XXX:XXX::15/64" ifconfig_em0_aliases=" inet6 2a03:7500:cc13:1::15/64 inet 194.XXX.XXX.15/24 inet 192.168.2.15/24 " ntpdate_hosts="192.168.178.1 194.XXX.XXX.2" dhcpd_ifaces="em0 vlan3 vlan4" ifconfig_em1="up -tso4 -tso6 -lro -vlanhwtso -rxcsum -txcsum -vlanmtu -vlanhwtag -vlanhwcsum -vlanhwfilter" vlans_em1="vlan14" rpc_hosts4="-h 185.XXX.XXX.15 -h 194.XXX.XXX.15 -h 192.168.2.15 -h 192.168.138.15 -h 192.168.178.15 -h 192.168.188.15" rpc_hosts6="-h XXXX:XXXX::15" hostname="t5.XXX.XXX" ifconfig_vlan5_ipv6="inet6 accept_rtadv" rtsold_enable="YES" rtsold_flags="vlan5" rtsold_fib="5" static_routes="sdsl adsl vdsl vdsl6 ftth ftth6" dbus_enable="NO" avahi_daemon_enable="NO" avahi_dnsconfd_enable="NO" minirsyslogd_enable="YES" syslogd_flags="-ss" ntpd_sync_on_start="YES" cloned_interfaces="" create_args_vlan14="vlan 4 -rxcsum -txcsum fib 4" route_ftth6="-6 default fe80::XXXX:XXXX:XXXX:XXXX%vlan5 -fib 5" uuidd_enable="NO" ifconfig_vlan4_ipv6="inet6 accept_rtadv" rtsold4_enable="YES" rtsold4_flags="-p /var/run/rtsold4.pid vlan4" rtsold4_fib="4" rtsold5_enable="YES" rtsold5_flags="-p /var/run/rtsold5.pid vlan5" rtsold5_fib="5" jail_enable="NO" rpcbind_flags="${rpc_hosts4} ${rpc_hosts6}" rpc_statd_flags="${rpc_hosts4} ${rpc_hosts6}" mountd_flags="-r -S -n ${rpc_hosts4} ${rpc_hosts6}" nfs_server_flags="-u -t ${rpc_hosts4} ${rpc_hosts6}"
/etc/jail.conf office { host.hostname = "office.XXXX.XXX.XXX"; vnet; vnet.interface = "vlan14"; devfs_ruleset = 200; allow.sysvipc; allow.raw_sockets; persist; } inside the jail: /etc/rc.conf hostname="office.XXXX.XXXX.XXX" keymap="de" defaultrouter="192.168.178.1" ipv6_activate_all_interfaces="YES" sendmail_submit_enable="NO" sendmail_outbound_enable="NO" devd_enable="NO" sshd_enable="YES" firewall_enable="YES" firewall_script="/etc/rc.firewall" firewall_type="open" firewall_quiet="YES" firewall_logging="NO" firewall_flags="" pf_enable="YES" gateway_enable="YES" ipv6_gateway_enable="YES" ifconfig_vlan14="inet 192.168.178.8/24"
Given that we now use the "crash" keyword, the Summary no longer needs "panic".
System upgraded to FreeBSD 13.1-RELEASE-p5 After disabling pf inside the Jail the jails start successful. The jail had no connectivity, so I changed vlan14 back to fib 0. With connectivity I was able to start pf successful. Verified that now all jails start successful after reboot. The panic seems to be related to "vmnet", "fibs" and "pf"
(Sorry, not fixed, user error here with a scroll wheel.)
Inside the jail: # /etc/pf.conf nat on tun0 from any to any -> (tun0) nat on tun1 from any to any -> (tun1) pass quick on lo0 pass quick on epair1b pass quick on vlan14 pass quick on tun0 # eof It might be related that vimage/vnet jails in 13.x have their own fibs. Previously the number of fibs have been inherited. Now each jail can have its own set, defaults to 0. # sysctl net.fibs net.fibs: 8 # jexec 3 sysctl net.fibs net.fibs: 1 # jexec 3 setfib 4 netstat -nr4 setfib: 4: invalid FIB (max 0) So moving an Interface with fib set in the jail may cause the crash. Should there be an out of bounds check? Or Should the fib reset on attach?