Bug 241549

Summary: bhyve: Cannot install Centos 8, Centos Stream, Oracle Linux 8 with Secure UEFI
Product: Base System Reporter: doctor
Component: bhyveAssignee: freebsd-virtualization (Nobody) <virtualization>
Status: Open ---    
Severity: Affects Some People CC: grahamperrin, pi, rob2g2-freebsd, virtualization
Priority: --- Keywords: needs-qa
Version: CURRENT   
Hardware: Any   
OS: Any   

Description doctor 2019-10-28 17:22:54 UTC
Centos 8, Centos Stream, Oracle Linux 8 and suspect RHEL 8 will not work in bhyve.  Please fix.
Comment 1 Kurt Jaeger freebsd_committer freebsd_triage 2019-10-28 19:28:50 UTC
Can you explain this ? Does it mean, that because bhyve does not support
UEFI secure boot, all those linux variants won't work under bhyve ?

If they do not work, what is the error message ?

How is bhyve started ?
Comment 2 Kubilay Kocak freebsd_committer freebsd_triage 2019-10-29 05:41:31 UTC
Could you please provide additional information, including:

- Exact FreeBSD version
- Hardware details (/var/run/dmesg.boot) as an attachment
- Exact error messages if/when present
Comment 3 doctor 2019-10-29 17:41:35 UTC
FreeBSD-12.0

using  #!/bin/sh
/usr/sbin/bhyve -ASHP -s 0:0,hostbridge -s 31:0,lpc -s 2:0,virtio-net,tap5 -s 3:0,virtio-blk,/usr/vm/images/oracle -s 4:0,ahci-cd,/usr/vm/.iso/V983280-01.iso -s 29,fbuf,tcp=0.0.0.0:5961,w=1024,h=768,wait -c 4 -m 512M -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd oracleguest &

dracut-pre-trigger [795] : Failed to connect to lldpad - clif_open : Connection refused
dracut-pre-trigger [795] : Waiting for lldpad to be ready
dracut-pre-trigger [795] : connect: Connection refused
Comment 4 doctor 2019-10-29 17:43:59 UTC
/var/run/dmesg.boot

---<<BOOT>>---
Copyright (c) 1992-2018 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.0-RELEASE-p10 GENERIC amd64
FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1)
VT(efifb): resolution 800x600
CPU: Intel(R) Xeon(R) CPU E5-2603 v4 @ 1.70GHz (1700.03-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x406f1  Family=0x6  Model=0x4f  Stepping=1
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0x21cbfbb<FSGSBASE,TSCADJ,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,NFPUSG,PQE,RDSEED,ADX,SMAP,PROCTRACE>
  XSAVE Features=0x1<XSAVEOPT>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 16477827072 (15714 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <SUPERM SMCI--MB>
FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs
FreeBSD/SMP: 2 package(s) x 6 core(s)
random: unblocking device.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
Launching APs: 2 3 11 4 6 10 1 8 5 9 7
Timecounter "TSC" frequency 1700033504 Hz quality 1000
random: entropy device external interface
kbd1 at kbdmux0
netmap: loaded module
[ath_hal] loaded
module_register_init: MOD_LOAD (vesa, 0xffffffff810f9a00, 0) error 19
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
nexus0
efirtc0: <EFI Realtime Clock> on motherboard
efirtc0: registered as a time-of-day clock, resolution 1.000000s
cryptosoft0: <software crypto> on motherboard
acpi0: <> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> numa-domain 0 on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71,0x74-0x77 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
Event timer "HPET3" frequency 14318180 Hz quality 340
Event timer "HPET4" frequency 14318180 Hz quality 340
Event timer "HPET5" frequency 14318180 Hz quality 340
Event timer "HPET6" frequency 14318180 Hz quality 340
Event timer "HPET7" frequency 14318180 Hz quality 340
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <dasp, performance counters> at device 8.2 (no driver attached)
pci0: <dasp, performance counters> at device 9.2 (no driver attached)
pci0: <dasp, performance counters> at device 11.1 (no driver attached)
pci0: <dasp, performance counters> at device 11.2 (no driver attached)
pci0: <dasp, performance counters> at device 16.1 (no driver attached)
pci0: <dasp, performance counters> at device 16.6 (no driver attached)
pci0: <dasp, performance counters> at device 18.1 (no driver attached)
pcib1: <ACPI Host-PCI bridge> on acpi0
pci1: <ACPI PCI bus> on pcib1
pci1: <dasp, performance counters> at device 8.2 (no driver attached)
pci1: <dasp, performance counters> at device 9.2 (no driver attached)
pci1: <dasp, performance counters> at device 11.1 (no driver attached)
pci1: <dasp, performance counters> at device 11.2 (no driver attached)
pci1: <dasp, performance counters> at device 16.1 (no driver attached)
pci1: <dasp, performance counters> at device 16.6 (no driver attached)
pci1: <dasp, performance counters> at device 18.1 (no driver attached)
acpi_syscontainer0: <System Container> on acpi0
acpi_syscontainer1: <System Container> on acpi0
pcib2: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 26 at device 1.0 numa-domain 0 on pci2
pci3: <ACPI PCI bus> numa-domain 0 on pcib3
igb0: <Intel(R) PRO/1000 PCI-Express Network Driver> port 0x6020-0x603f mem 0xc7120000-0xc713ffff,0xc7144000-0xc7147fff irq 26 at device 0.0 numa-domain 0 on pci3
igb0: attach_pre capping queues at 8
igb0: using 1024 tx descriptors and 1024 rx descriptors
igb0: msix_init qsets capped at 8
igb0: pxm cpus: 6 queue msgs: 9 admincnt: 1
igb0: using 6 rx queues 6 tx queues 
igb0: Using MSIX interrupts with 7 vectors
igb0: allocated for 6 tx_queues
igb0: allocated for 6 rx_queues
igb0: Ethernet address: 0c:c4:7a:ac:51:1e
igb0: netmap queues/slots: TX 6/1024, RX 6/1024
igb1: <Intel(R) PRO/1000 PCI-Express Network Driver> port 0x6000-0x601f mem 0xc7100000-0xc711ffff,0xc7140000-0xc7143fff irq 28 at device 0.1 numa-domain 0 on pci3
igb1: attach_pre capping queues at 8
igb1: using 1024 tx descriptors and 1024 rx descriptors
igb1: msix_init qsets capped at 8
igb1: pxm cpus: 6 queue msgs: 9 admincnt: 1
igb1: using 6 rx queues 6 tx queues 
igb1: Using MSIX interrupts with 7 vectors
igb1: allocated for 6 tx_queues
igb1: allocated for 6 rx_queues
igb1: Ethernet address: 0c:c4:7a:ac:51:1f
igb1: netmap queues/slots: TX 6/1024, RX 6/1024
pcib4: <ACPI PCI-PCI bridge> irq 40 at device 3.0 numa-domain 0 on pci2
pci4: <ACPI PCI bus> numa-domain 0 on pcib4
pci2: <unknown> at device 17.0 (no driver attached)
ahci0: <Intel Wellsburg AHCI SATA controller> port 0x7110-0x7117,0x7100-0x7103,0x70f0-0x70f7,0x70e0-0x70e3,0x7020-0x703f mem 0xc7238000-0xc72387ff irq 16 at device 17.4 numa-domain 0 on pci2
ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
xhci0: <Intel Wellsburg USB 3.0 controller> mem 0xc7200000-0xc720ffff irq 19 at device 20.0 numa-domain 0 on pci2
xhci0: 32 bytes context size, 64-bit DMA
usbus0 numa-domain 0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci2: <simple comms> at device 22.0 (no driver attached)
pci2: <simple comms> at device 22.1 (no driver attached)
ehci0: <Intel Wellsburg USB 2.0 controller> mem 0xc7234000-0xc72343ff irq 18 at device 26.0 numa-domain 0 on pci2
usbus1: EHCI version 1.0
usbus1 numa-domain 0 on ehci0
usbus1: 480Mbps High Speed USB v2.0
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 28.0 numa-domain 0 on pci2
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 16 at device 28.4 numa-domain 0 on pci2
pci6: <ACPI PCI bus> numa-domain 0 on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 0.0 numa-domain 0 on pci6
pci7: <ACPI PCI bus> numa-domain 0 on pcib7
vgapci0: <VGA-compatible display> port 0x5000-0x507f mem 0xc6000000-0xc6ffffff,0xc7000000-0xc701ffff irq 16 at device 0.0 numa-domain 0 on pci7
vgapci0: Boot video device
ehci1: <Intel Wellsburg USB 2.0 controller> mem 0xc7233000-0xc72333ff irq 18 at device 29.0 numa-domain 0 on pci2
usbus2: EHCI version 1.0
usbus2 numa-domain 0 on ehci1
usbus2: 480Mbps High Speed USB v2.0
isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci2
isa0: <ISA bus> numa-domain 0 on isab0
ahci1: <Intel Wellsburg AHCI SATA controller> port 0x7070-0x7077,0x7060-0x7063,0x7050-0x7057,0x7040-0x7043,0x7000-0x701f mem 0xc7232000-0xc72327ff irq 16 at device 31.2 numa-domain 0 on pci2
ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
ahcich6: <AHCI channel> at channel 2 on ahci1
ahcich7: <AHCI channel> at channel 3 on ahci1
ahcich8: <AHCI channel> at channel 4 on ahci1
ahcich9: <AHCI channel> at channel 5 on ahci1
ahciem1: <AHCI enclosure management bridge> on ahci1
pcib8: <ACPI Host-PCI bridge> numa-domain 1 on acpi0
pci8: <ACPI PCI bus> numa-domain 1 on pcib8
pcib9: <ACPI PCI-PCI bridge> irq 64 at device 3.0 numa-domain 1 on pci8
pci9: <ACPI PCI bus> numa-domain 1 on pcib9
AVAGO MegaRAID SAS FreeBSD mrsas driver version: 06.712.04.00-fbsd
mfi0: <ThunderBolt> port 0xf000-0xf0ff mem 0xfbe60000-0xfbe63fff,0xfbe00000-0xfbe3ffff irq 64 at device 0.0 numa-domain 1 on pci9
mfi0: Using MSI
mfi0: Megaraid SAS driver Ver 4.23 
mfi0: FW MaxCmds = 1008, limiting to 128
mfi0: MaxCmd = 1008, Drv MaxCmd = 128, MaxSgl = 70, state = 0xb73c03f0
mfi0: 23889 (625329343s/0x0020/info) - Shutdown command received from host
mfi0: 23890 (boot + 9s/0x0020/info) - Firmware initialization started (PCI ID 005b/1000/9276/1000)
mfi0: 23891 (boot + 9s/0x0020/info) - Firmware version 3.460.05-4565
mfi0: 23892 (boot + 12s/0x0008/info) - Battery Present
mfi0: 23893 (boot + 12s/0x0020/info) - Package version 23.34.0-0005
mfi0: 23894 (boot + 12s/0x0020/info) - Board Revision 001
mfi0: 23895 (boot + 17s/0x0008/info) - Battery started charging
mfi0: 23896 (boot + 17s/0x0008/info) - Battery charge complete
mfi0: 23897 (boot + 17s/0x0008/info) - Battery temperature is normal
mfi0: 23898 (boot + 30s/0x0002/info) - Inserted: PD 09(e0xfc/s0)
mfi0: 23899 (boot + 30s/0x0002/info) - Inserted: PD 09(e0xfc/s0) Info: enclPd=fc, scsiType=0, portMap=01, sasAddr=5000c50096e12239,0000000000000000
mfi0: 23900 (boot + 30s/0x0002/info) - Inserted: PD 0a(e0xfc/s1)
mfi0: 23901 (boot + 30s/0x0002/info) - Inserted: PD 0a(e0xfc/s1) Info: enclPd=fc, scsiType=0, portMap=00, sasAddr=5000c50084ca7425,0000000000000000
mfi0: 23902 (625329425s/0x0020/info) - Time established as 10/25/19 14:37:05; (35 seconds since power on)
mfi0: 23903 (625329427s/0x0008/info) - Battery relearn will start in 4 days
mfi0: 23904 (625329480s/0x0020/WARN) - Host driver needs to be upgraded to enable extended LD support
mfi0: 23905 (625329480s/0x0020/info) - Host driver is loaded and operational
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (115200,n,8,1)
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xd0000-0xd0fff pnpid ORM0000 on isa0
est0: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu0
fuse-freebsd: version 0.4.4, FUSE ABI 7.8
Timecounters tick every 1.000 msec
mfid0 numa-domain 1 on mfi0
mfid0: 3814912MB (7812939776 sectors) RAID volume (no label) is optimal
ugen1.1: <Intel EHCI root HUB> at usbus1
ugen2.1: <Intel EHCI root HUB> at usbus2
ugen0.1: <0x8086 XHCI root HUB> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
uhub2: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ses0 at ahciem0 bus 0 scbus4 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ses1 at ahciem1 bus 0 scbus11 target 0 lun 0
ses1: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses1: SEMB SES Device
cd0 at ahcich6 bus 0 scbus7 target 0 lun 0
cd0: <TSSTcorp CDDVDW SN-208FB SB00> Removable CD-ROM SCSI device
cd0: Serial Number S1236YAH4003P4
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
Trying to mount root from ufs:/dev/mfid0p2 []...
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 21 ports with 21 removable, self powered
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
warning: total configured swap (58982400 pages) exceeds maximum recommended amount (16155552 pages).
warning: increase kern.maxswzone or reduce amount of swap.
ugen0.2: <Logitech USB Optical Mouse> at usbus0
ugen1.2: <vendor 0x8087 product 0x800a> at usbus1
uhub3 numa-domain 0 on uhub0
uhub3: <vendor 0x8087 product 0x800a, class 9/0, rev 2.00/0.05, addr 2> on usbus1
ugen2.2: <vendor 0x8087 product 0x8002> at usbus2
uhub4 numa-domain 0 on uhub1
uhub4: <vendor 0x8087 product 0x8002, class 9/0, rev 2.00/0.05, addr 2> on usbus2
uhub3: 6 ports with 6 removable, self powered
uhub4: 8 ports with 8 removable, self powered
ugen0.3: <Logitech USB Keyboard> at usbus0
ukbd0 numa-domain 0 on uhub2
ukbd0: <USB Keyboard> on usbus0
kbd2 at ukbd0
ugen0.4: <vendor 0x0557 product 0x7000> at usbus0
uhub5 numa-domain 0 on uhub2
uhub5: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 3> on usbus0
uhub5: 4 ports with 3 removable, self powered
ugen0.5: <vendor 0x0557 product 0x2419> at usbus0
ukbd1 numa-domain 0 on uhub5
ukbd1: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> on usbus0
kbd3 at ukbd1
bridge0: Ethernet address: 02:ea:75:2d:9d:00
tap0: Ethernet address: 00:bd:b4:ef:f6:00
tap1: Ethernet address: 00:bd:c0:ef:f6:01
tap2: Ethernet address: 00:bd:cb:ef:f6:02
tap3: Ethernet address: 00:bd:dd:ef:f6:03
tap4: Ethernet address: 00:bd:e9:ef:f6:04
tap5: Ethernet address: 00:bd:f5:ef:f6:05
tap6: Ethernet address: 00:bd:00:f0:f6:06
tap7: Ethernet address: 00:bd:10:f0:f6:07
tap8: Ethernet address: 00:bd:1b:f0:f6:08
tap9: Ethernet address: 00:bd:27:f0:f6:09
tap10: Ethernet address: 00:bd:32:f0:f6:0a
tap11: Ethernet address: 00:bd:41:f0:f6:0b
tap12: Ethernet address: 00:bd:4d:f0:f6:0c
tap13: Ethernet address: 00:bd:58:f0:f6:0d
tap14: Ethernet address: 00:bd:64:f0:f6:0e
tap15: Ethernet address: 00:bd:73:f0:f6:0f
lo0: link state changed to UP
igb0: promiscuous mode enabled
bridge0: link state changed to UP
tap0: promiscuous mode enabled
bridge0: link state changed to DOWN
tap1: promiscuous mode enabled
tap2: promiscuous mode enabled
tap3: promiscuous mode enabled
tap4: promiscuous mode enabled
tap5: promiscuous mode enabled
tap6: promiscuous mode enabled
tap7: promiscuous mode enabled
tap8: promiscuous mode enabled
tap9: promiscuous mode enabled
tap10: promiscuous mode enabled
tap11: promiscuous mode enabled
tap12: promiscuous mode enabled
tap13: promiscuous mode enabled
tap14: promiscuous mode enabled
tap15: promiscuous mode enabled
igb0: link state changed to UP
bridge0: link state changed to UP
ioat0: <BDX IOAT Ch0> mem 0xc722c000-0xc722ffff irq 31 at device 4.0 numa-domain 0 on pci2
ioat0: Capabilities: 2f7<PQ,Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat1: <BDX IOAT Ch1> mem 0xc7228000-0xc722bfff irq 39 at device 4.1 numa-domain 0 on pci2
ioat1: Capabilities: 2f7<PQ,Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat2: <BDX IOAT Ch2> mem 0xc7224000-0xc7227fff irq 31 at device 4.2 numa-domain 0 on pci2
ioat2: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat3: <BDX IOAT Ch3> mem 0xc7220000-0xc7223fff irq 39 at device 4.3 numa-domain 0 on pci2
ioat3: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat4: <BDX IOAT Ch4> mem 0xc721c000-0xc721ffff irq 31 at device 4.4 numa-domain 0 on pci2
ioat4: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat5: <BDX IOAT Ch5> mem 0xc7218000-0xc721bfff irq 39 at device 4.5 numa-domain 0 on pci2
ioat5: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat6: <BDX IOAT Ch6> mem 0xc7214000-0xc7217fff irq 31 at device 4.6 numa-domain 0 on pci2
ioat6: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat7: <BDX IOAT Ch7> mem 0xc7210000-0xc7213fff irq 39 at device 4.7 numa-domain 0 on pci2
ioat7: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat8: <BDX IOAT Ch0> mem 0xfbf1c000-0xfbf1ffff irq 55 at device 4.0 numa-domain 1 on pci8
ioat8: Capabilities: 2f7<PQ,Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat9: <BDX IOAT Ch1> mem 0xfbf18000-0xfbf1bfff irq 63 at device 4.1 numa-domain 1 on pci8
ioat9: Capabilities: 2f7<PQ,Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat10: <BDX IOAT Ch2> mem 0xfbf14000-0xfbf17fff irq 55 at device 4.2 numa-domain 1 on pci8
ioat10: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat11: <BDX IOAT Ch3> mem 0xfbf10000-0xfbf13fff irq 63 at device 4.3 numa-domain 1 on pci8
ioat11: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat12: <BDX IOAT Ch4> mem 0xfbf0c000-0xfbf0ffff irq 55 at device 4.4 numa-domain 1 on pci8
ioat12: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat13: <BDX IOAT Ch5> mem 0xfbf08000-0xfbf0bfff irq 63 at device 4.5 numa-domain 1 on pci8
ioat13: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat14: <BDX IOAT Ch6> mem 0xfbf04000-0xfbf07fff irq 55 at device 4.6 numa-domain 1 on pci8
ioat14: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat15: <BDX IOAT Ch7> mem 0xfbf00000-0xfbf03fff irq 63 at device 4.7 numa-domain 1 on pci8
ioat15: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ums0 numa-domain 0 on uhub2
ums0: <Logitech USB Optical Mouse, class 0/0, rev 2.00/72.00, addr 1> on usbus0
ums0: 3 buttons and [XYZ] coordinates ID=0
uhid0 numa-domain 0 on uhub2
uhid0: <USB Keyboard> on usbus0
ums1 numa-domain 0 on uhub5
ums1: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> on usbus0
ums1: 3 buttons and [Z] coordinates ID=0
pflog0: promiscuous mode enabled
pid 4964 (VBoxSVC), uid 0: exited on signal 5 (core dumped)
CPU: Intel(R) Xeon(R) CPU E5-2603 v4 @ 1.70GHz (1700.03-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x406f1  Family=0x6  Model=0x4f  Stepping=1
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0x21cbfbb<FSGSBASE,TSCADJ,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,NFPUSG,PQE,RDSEED,ADX,SMAP,PROCTRACE>
  XSAVE Features=0x1<XSAVEOPT>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
  TSC: P-state invariant, performance statistics
Comment 5 rob2g2 2020-08-26 19:06:02 UTC
works fine here with "bhyve -c 1 -m 2048 -Hwl bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -U 60b8c81d-972c-49da-b582-5696ea090736 -u -s 0:0,hostbridge -s 31:0,lpc -s 4:0,virtio-blk,/data/vms/centos8t1/disk0.img -s 5:0,virtio-net,tap8,mac=58:9c:44:33:22:08 -s 6:0,fbuf,tcp=10.0.0.4:5908,vga=io -l com1,/dev/nmdm-centos8t1.1A -s 3:0,ahci-cd,/data/iso/centos/CentOS-8.2.2004-x86_64-dvd1.iso centos8t1"