Bug 246560

Summary:	sys.netinet.so_reuseport_lb_test.basic_ipv6 panics kernel after r361228
Product:	Base System	Reporter:	Li-Wen Hsu <lwhsu>
Component:	tests	Assignee:	freebsd-testing (Nobody) <testing>
Status:	Closed FIXED
Severity:	Affects Only Me	CC:	karels
Priority:	---
Version:	CURRENT
Hardware:	Any
OS:	Any

Description Li-Wen Hsu freebsd_committer

2020-05-19 02:01:15 UTC

sys.netinet.so_reuseport_lb_test.basic_ipv6 panics kernel after r361228

https://ci.freebsd.org/job/FreeBSD-head-amd64-test/15244/console
https://ci.freebsd.org/job/FreeBSD-head-i386-test/9341/console

libexec/tftpd/functional:abspath_v6  ->  Kernel page fault with the following non-sleepable locks held:
exclusive sleep mutex pcbinfohash (pcbinfohash) r = 0 (0xb6f1028) locked @ /usr/src/sys/netinet6/udp6_usrreq.c:859
exclusive rw udpinp (udpinp) r = 0 (0x26da88b4) locked @ /usr/src/sys/netinet6/udp6_usrreq.c:755
stack backtrace:
#0 0x102cbf1 at witness_debugger+0x61
#1 0x102d938 at witness_warn+0x348
#2 0x14014ba at trap_pfault+0x5a
#3 0x1400b60 at trap+0x3a0
#4 0xffc0319f at carp_list+0xda2839a7
#5 0x28 at ??+0


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x1
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0x1139f6f
stack pointer           = 0x28:0x2699b7b4
frame pointer           = 0x28:0x2699b7e4
code segment            = base rx0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, def32 1, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 3444 (functional)
trap number             = 12
panic: page fault
cpuid = 0
time = 1589848359
KDB: stack backtrace:
db_trace_self_wrapper(69,1c76a800,144b52b,1c76a800,2699b5cc,...) at db_trace_self_wrapper+0x2a/frame 0x2699b598
kdb_backtrace(2,2699b774,2699b774,c,0,...) at kdb_backtrace+0x2e/frame 0x2699b5f8
vpanic(144b52b,2699b634,2699b634,2699b668,1401457,...) at vpanic+0x11f/frame 0x2699b614
panic(144b52b,14da142,200246,c,1,...) at panic+0x14/frame 0x2699b628
trap_fatal(1cb04688,1c769274,26dd8000,2699b6c0,1da381c,...) at trap_fatal+0x357/frame 0x2699b668
trap_pfault(1,0,0) at trap_pfault+0x72/frame 0x2699b69c
trap(2699b774,8,28,28,2710,...) at trap+0x3a0/frame 0x2699b768
calltrap() at 0xffc0319f/frame 0x2699b768
--- trap 0xc, eip = 0x1139f6f, esp = 0x2699b7b4, ebp = 0x2699b7e4 ---
in_pcb_lport_dest(26da88a4,0,2699b84e,0,0,1c6ad500,1) at in_pcb_lport_dest+0x14f/frame 0x2699b7e4
in_pcb_lport(26da88a4,0,2699b84e,1c6ad500,1) at in_pcb_lport+0x68/frame 0x2699b82c
in6_pcbsetport(2699b8d0,26da88a4,1c6ad500) at in6_pcbsetport+0x89/frame 0x2699b85c
udp6_send(254c1220,0,1ca60900,bbd7e60,0,272b1e00) at udp6_send+0x8e9/frame 0x2699b984
sosend_dgram(254c1220,bbd7e60,2699ba18,0,0,0,272b1e00) at sosend_dgram+0x2b6/frame 0x2699b9bc
sosend(254c1220,bbd7e60,2699ba18,0,0,0,272b1e00) at sosend+0x50/frame 0x2699b9ec
kern_sendit(272b1e00,3,2699baa0,0,0,0) at kern_sendit+0x1cb/frame 0x2699ba50
sendit(2699baa0,0) at sendit+0x19b/frame 0x2699ba88
sys_sendto(272b1e00,272b2090,2699bb9c,272b1e00,272b2088,...) at sys_sendto+0x50/frame 0x2699bac8
syscall(2699bba8,3b,3b,3b,ffbfd338,...) at syscall+0x60c/frame 0x2699bb9c
Xint0x80_syscall() at 0xffc033f9/frame 0x2699bb9c
--- syscall (93, FreeBSD ELF32, sys_select), eip = 0xffc01268, esp = 0xffc07fe8, ebp = 0xffbfe91c ---
KDB: enter: panic
[ thread pid 3444 tid 100153 ]
Stopped at      kdb_enter+0x35: movl    $0,kdb_why
db:0:kdb.enter.panic> show pcpu
cpuid        = 0
dynamic pcpu = 0x8078c0
curthread    = 0x272b1e00: pid 3444 tid 100153 critnest 1 "functional"
curpcb       = 0x2699bc00
fpcurthread  = 0x272b1e00: pid 3444 "functional"
idlethread   = 0xb7dce00: tid 100003 "idle: cpu0"
APIC ID      = 0
currentldt   = 0x50
trampstk     = 0xffc07ff0
kesp0        = 0x2699bbf0
common_tssp  = 0xffc01130
tlb gen      = 16337
curvnet      = 0xb674b40
spin locks held:
db:0:kdb.enter.panic>

Comment 1 Li-Wen Hsu freebsd_committer

2020-05-19 02:02:02 UTC

karels: can you help check this? Thanks!

Comment 2 commit-hook freebsd_committer

2020-05-19 02:07:13 UTC

A commit references this bug:

Author: lwhsu
Date: Tue May 19 02:07:09 UTC 2020
New revision: 361237
URL: https://svnweb.freebsd.org/changeset/base/361237

Log:
  Temporarily disable test case causes kernel panic in CI:

  - sys.netinet.so_reuseport_lb_test.basic_ipv6

  PR:		246560
  Sponsored by:	The FreeBSD Foundation

Changes:
  head/tests/sys/netinet/so_reuseport_lb_test.c

Comment 3 Li-Wen Hsu freebsd_committer

2020-05-19 02:12:20 UTC

Sorry, didn't see r361231, I'll check if it fixes the issue.

Comment 4 Li-Wen Hsu freebsd_committer

2020-05-19 07:16:13 UTC

Fixed in r361231.

Comment 5 commit-hook freebsd_committer

2020-05-19 07:17:06 UTC

A commit references this bug:

Author: lwhsu
Date: Tue May 19 07:16:10 UTC 2020
New revision: 361241
URL: https://svnweb.freebsd.org/changeset/base/361241

Log:
  Revert r361237, it's fixed by r361231

  PR:		246560
  Sponsored by:	The FreeBSD Foundation

Changes:
  head/tests/sys/netinet/so_reuseport_lb_test.c