Bug 236827 - bhyve pci passthru generates panic: vtd_init: invalid caching mode
Summary: bhyve pci passthru generates panic: vtd_init: invalid caching mode
Status: New
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: 12.0-STABLE
Hardware: amd64 Any
: --- Affects Only Me
Assignee: freebsd-virtualization (Nobody)
URL:
Keywords: bhyve, crash
Depends on:
Blocks:
 
Reported: 2019-03-27 12:22 UTC by Niklas
Modified: 2021-05-13 13:10 UTC (History)
1 user (show)

See Also:


Attachments
generated core.txt.3 dump (131.51 KB, application/x-troff-man)
2019-03-27 12:22 UTC, Niklas
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Niklas 2019-03-27 12:22:35 UTC
Created attachment 203187 [details]
generated core.txt.3 dump

Trying to passthru em0 interfaces to vm but kernel panics and system reboots

bhyve command : 

bhyve -c 2 -m 4G -w -H -S \
        -s 0:0,hostbridge \
        -s 4:0,virtio-blk,./opnsense_disk.img \
        -s 7:0,passthru,4/0/0 \
        -s 8:0,passthru,4/0/1 \
        -s 29,fbuf,tcp=192.168.1.5:5901,w=800,h=600 \
        -s 30,xhci,tablet \
        -s 31,lpc \
        -l com1,stdio \
        -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
        opnsense &

pciconf -lvc output:

ppt0@pci0:4:0:0:        class=0x020000 card=0x115e8086 chip=0x105e8086 rev=0x06 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82571EB/82571GB Gigabit Ethernet Controller D0/D1 (copper applications)'
    class      = network
    subclass   = ethernet
    cap 01[c8] = powerspec 2  supports D0 D3  current D0
    cap 05[d0] = MSI supports 1 message, 64 bit 
    cap 10[e0] = PCI-Express 1 endpoint max data 128(256) RO NS
                 link x4(x4) speed 2.5(2.5) ASPM disabled(L0s)
    ecap 0001[100] = AER 1 0 fatal 1 non-fatal 0 corrected
    ecap 0003[140] = Serial 1 6805caffff3251ee
ppt1@pci0:4:0:1:        class=0x020000 card=0x115e8086 chip=0x105e8086 rev=0x06 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82571EB/82571GB Gigabit Ethernet Controller D0/D1 (copper applications)'
    class      = network
    subclass   = ethernet
    cap 01[c8] = powerspec 2  supports D0 D3  current D0
    cap 05[d0] = MSI supports 1 message, 64 bit 
    cap 10[e0] = PCI-Express 1 endpoint max data 128(256) RO NS
                 link x4(x4) speed 2.5(2.5) ASPM disabled(L0s)
    ecap 0001[100] = AER 1 0 fatal 1 non-fatal 0 corrected
    ecap 0003[140] = Serial 1 6805caffff3251ee

kernel panic:

panic: vtd_init: invalid caching mode
cpuid = 10
time = 1553651419
KDB: stack backtrace:
#0 0xffffffff80be7977 at kdb_backtrace+0x67
#1 0xffffffff80b9b563 at vpanic+0x1a3
#2 0xffffffff80b9b3b3 at panic+0x43
#3 0xffffffff8265b039 at vtd_init+0x5f9
#4 0xffffffff8264a1db at iommu_create_domain+0x7b
#5 0xffffffff826410d2 at vm_assign_pptdev+0xe2
#6 0xffffffff82645653 at vmmdev_ioctl+0xed3
#7 0xffffffff80a51acd at devfs_ioctl+0xad
#8 0xffffffff811f945e at VOP_IOCTL_APV+0x7e
#9 0xffffffff80c7a144 at vn_ioctl+0x1a4
#10 0xffffffff80a520af at devfs_ioctl_f+0x1f
#11 0xffffffff80c04f3d at kern_ioctl+0x26d
#12 0xffffffff80c04c5e at sys_ioctl+0x15e
#13 0xffffffff81075449 at amd64_syscall+0x369
#14 0xffffffff8104fd1d at fast_syscall_common+0x101


I have a vmcore.3 dump on 1.9gb if needed
Comment 1 Mark Linimon freebsd_committer freebsd_triage 2021-05-13 13:10:37 UTC
^Triage: assign to mailing list.