Created attachment 216411 [details]
missing interrupt

I'm using Intel Optane NVMe drives on a Dell R720 server running vSphere ESXi 6.7 using PCIe passthrough to FreeBSD guests. In my particular case, I'm just trying to boot the amd64.iso installer images.


12.1-RELEASE:
crashes due to a bug in the NVMe driver that has since been fixed.


12.1-STABLE 2020-07-09 snapshot:
produces the screen shot listed below. console flooded with "nvme0: Missing interrupt" messages and a few other error messages. Having let it run for a length of time, the messages just cycle over and over again in that exact pattern. Never fully boots into the FreeBSD installer.


12.1-STABLE 2020-07-09 snapshot (workaround):
pciPassthru0.msiEnabled = "FALSE"

setting that value in the .vmx file for the passthrough device allows it to work. so there appears to be some other bug effecting MSI-X interrupts between ESXi and FreeBSD 12.1-STABLE. I've been trying to play around with the info in bug #203874 with no luck either way so far.


11.4-RELEASE and 11.4-STABLE 2020-07-09 snapshot:
same as 12.1-STABLE


13.0-CURRENT:
no issue at all. works exactly as expected.


Intel ARK:
https://ark.intel.com/content/www/us/en/ark/products/135581/intel-optane-memory-m10-series-16gb-m-2-80mm-pcie-3-0-20nm-3d-xpoint.html

Boot messages:
https://vincerants.com/public/freebsd/nvme-missing-interrupt.png

Workaround found at:
https://redmine.ixsystems.com/issues/26508#note-68

Possibly related:
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203874