Bug 253932

Summary: Freebsd 11.4 crashes on reboots on ESXi with passthrough of NIC
Product: Base System Reporter: arif <mohdarif.khan>
Component: kernAssignee: freebsd-bugs (Nobody) <bugs>
Status: New ---    
Severity: Affects Many People CC: mohdarif.khan
Priority: ---    
Version: 11.4-RELEASE   
Hardware: amd64   
OS: Any   

Description arif 2021-03-01 09:51:47 UTC
Hi All,

The FreeBSD 11.4 vanilla VM downloaded from freebsd.org is crashing when doing passthrough of Intel NIC
"Ethernet Controller X710 for 10GbE SFP+" after a couple of reboots.

In the ESXi kernel logs seeing this message
Code:
cpu10:2235436)IntrCookie: 1565: Unable to allocate 128 cookies: Out of resources
2021-02-24T13:32:47.831Z cpu10:2235436)PCIPassthru: 2461: Failed to allocate 128 MSIX interrupts"
2021-02-24T13:32:47.968Z cpu10:2235436)UserDump: 2630: vmx-vcpu-1:arif-debug-11: Dumping cartel 2235424 (from world 2235436) to file /vmfs/volumes/5e329ba9-50e9cd52-8a4b-0cc47aacfdbc/arif-new-11/vmx-zdump.000 ...
2021-02-24T13:32:48.771Z cpu1:2235436)UserDump: 2818: vmx-vcpu-1:arif-debug-11: Userworld(vmx-vcpu-1:arif-debug-11) coredump complete.
PCIPassthru: 2461: Failed to allocate 128 MSIX interrupts


The issue is not seen 10.* freebsd VM. Looks like there is some issue with pci_alloc and free functions. First of all why ESX allocating 128 interrupts for one MSIX interrupt. And again after some reboots all the available interrupts are exhausted.

regards,
mak