Bug 236374 - bhyve: vmm/amd: ivhd0: Error: completion failed
Summary: bhyve: vmm/amd: ivhd0: Error: completion failed
Status: New
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: 12.0-RELEASE
Hardware: amd64 Any
: --- Affects Only Me
Assignee: freebsd-virtualization mailing list
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-03-07 19:38 UTC by Bert JW Regeer
Modified: 2019-06-16 17:01 UTC (History)
1 user (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Bert JW Regeer 2019-03-07 19:38:49 UTC
I am running a VM with bhyve using IOMMU support to pass-through a wireless card to a FreeBSD guest and I keep getting ivhd0 completion failed errors in the console of the host. I was hoping to do testing/kernel dev inside a VM to avoid disrupting all the other work-loads on the system, but I seem to have gotten the PCI device into some broken state, so a reboot is needed anyway, but I noticed the errors in the console.

CPU: AMD Ryzen Threadripper 2950X 16-Core Processor  (3493.51-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x800f82  Family=0x17  Model=0x8  Stepping=2
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
  Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr>
  SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
  TSC: P-state invariant, performance statistics

AMD-Vi: IVRS Info VAsize = 64 PAsize = 48 GVAsize = 2 flags:0
ivhd0: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd0: Flag:b0<IotlbSup,Coherent>
ivhd0: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0
ivhd0: Extended features[31:0]:22294ada<PPRSup,NXSup,GTSup,IASup> HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd0: Extended features[62:32]:f77ef<USSup> Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1
ivhd0: supported paging level:7, will use only: 4
ivhd0: device range: 0x0 - 0xffff
ivhd0: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>
ivhd1: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd1: Flag:b0<IotlbSup,Coherent>
ivhd1: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0
ivhd1: Extended features[31:0]:22294ada<PPRSup,NXSup,GTSup,IASup> HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd1: Extended features[62:32]:f77ef<USSup> Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1
ivhd1: supported paging level:7, will use only: 4
ivhd1: device range: 0x0 - 0xffff
ivhd1: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>

ivhd0: Error: completion failed tail:0x3a0, head:0x0.
ivhd0: Dump all the commands:
  [CMD0, off:0xff0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD1, off:0x0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD2, off:0x10] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD3, off:0x20] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD4, off:0x30] opcode= 0x2 0x500 0x0 0xa5a5
  [CMD5, off:0x40] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD6, off:0x50] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD7, off:0x60] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD8, off:0x70] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD9, off:0x80] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD10, off:0x90] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD11, off:0xa0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD12, off:0xb0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD13, off:0xc0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD14, off:0xd0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD15, off:0xe0] opcode= 0x2 0x500 0x0 0xa5a5
  [CMD16, off:0xf0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD17, off:0x100] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD18, off:0x110] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD19, off:0x120] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD20, off:0x130] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD21, off:0x140] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD22, off:0x150] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD23, off:0x160] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD24, off:0x170] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD25, off:0x180] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD26, off:0x190] opcode= 0x3 0x5e9b029 0x7 0x7ffffffffffff003
  [CMD27, off:0x1a0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD28, off:0x1b0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD29, off:0x1c0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD30, off:0x1d0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD31, off:0x1e0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD32, off:0x1f0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD33, off:0x200] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD34, off:0x210] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD35, off:0x220] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD36, off:0x230] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD37, off:0x240] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD38, off:0x250] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD39, off:0x260] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD40, off:0x270] opcode= 0x2 0x500 0x0 0xa5a5
  [CMD41, off:0x280] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD42, off:0x290] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD43, off:0x2a0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD44, off:0x2b0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD45, off:0x2c0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD46, off:0x2d0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD47, off:0x2e0] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD48, off:0x2f0] opcode= 0x3 0x5e9b029 0x7 0x7ffffffffffff003
  [CMD49, off:0x300] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD50, off:0x310] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD51, off:0x320] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD52, off:0x330] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD53, off:0x340] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD54, off:0x350] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD55, off:0x360] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD56, off:0x370] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD57, off:0x380] opcode= 0x1 0x5e9b029 0x0 0xa5a5
  [CMD58, off:0x390] opcode= 0x1 0x5e9b029 0x0 0xa5a5