Bug 241774 - FreeBSD 11.3 & 12.0 has broken SCSI & Networking on KVM/QEMU Q35 with OVMF
Summary: FreeBSD 11.3 & 12.0 has broken SCSI & Networking on KVM/QEMU Q35 with OVMF
Status: New
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: 11.3-RELEASE
Hardware: amd64 Any
: --- Affects Some People
Assignee: freebsd-virtualization mailing list
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-11-07 06:00 UTC by John Hartley
Modified: 2019-11-08 09:17 UTC (History)
0 users

See Also:


Attachments
dmesg with 3 disks SATA, SCSI/lsisas1068, VirtIO + 2 NICs e1000, VirtIO (7.61 KB, text/plain)
2019-11-08 08:49 UTC, John Hartley
no flags Details
/var/log/syslog with 3 Disks SATA, SCSI/lsisas1068, VirtIO + 2 NICs e1000, VirtIO (12.22 KB, text/plain)
2019-11-08 08:54 UTC, John Hartley
no flags Details
pciconf with 3 Disks SATA, SCSI/lsisas1608, VirtIO + 2 NICs e1000, VirtIO (6.78 KB, text/plain)
2019-11-08 09:04 UTC, John Hartley
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description John Hartley 2019-11-07 06:00:27 UTC
BUG:

FreeBSD VM's on Ubuntu KVM / QEMU / OVMF host have SCSI Disk and Network Issues.

Network Interface: em / qemu e1000 / Intel Pro 1G no longer works with 11.3 (it did work with 11.2) or 12.0

TESTING:

I have tested various FreeBSD VM configuration and have found issues with SCSI and Network Device support when using: Ubuntu 19.04 / 19.10 KVM / QEMU Host with: Q35 Machine and OVMF EFI Firmware.

Here is summary of testing:

FreeBSD 11.2 (on KVM / QEMU Q35 with OVMF)
SCSI disk - none work
SATA disk - works
Networking - only e1000 works

FreeBSD 11.2 (on KVM / QEMU Q35 with BIOS)
SCSI disk - works with lsisas1068 controller type
Network - only e1000 works

FreeBSD 11.3 (on KVM / QEMU Q35 with OVMF)
SCSI disk - none work
SATA disk - works
Networking - nothing works
NOTE: I also tested with custom kernel build (ie remove all bit minimal drivers but leaving MPT/MPS & VirtIO SCSI and intel em and VirtIO Networking, still does not work

FreeBSD 12.0 (on KVM / QEMU with OVMF)
SCSI disk - none works
SATA disk - works
Networking - nothing works

So in summary, in move from FreeBSD 11.2 -> 11.3 / 12.X
- networking is broken with KVM / QEMU / OVMF
- SCSI disk support is broken for all KVM / QEMU / OVMF

So while there is work around of SATA and BIOS, for new VMs, I have existing VMs which need to be upgraded and this cannot be done, as network or disk subsystem fails.

I can do additional testing / validation if required.
Comment 1 John Hartley 2019-11-08 08:49:42 UTC
Created attachment 208964 [details]
dmesg with 3 disks SATA, SCSI/lsisas1068, VirtIO + 2 NICs e1000, VirtIO

This attachment has the dmesg results after booting with:

QEMU / KVM - Q35 with OVMF
3 Disks Attached:
  SATA - Found and ok
  SCSI with lsisas1068 controller - now found
  VirtIO - not found

and 2 NICS
  e1000
  VirtIO

I may be trying to many things at once here but thought it might be simpler to try various disk at once.
Comment 2 John Hartley 2019-11-08 08:54:13 UTC
Created attachment 208965 [details]
/var/log/syslog with 3 Disks SATA, SCSI/lsisas1068, VirtIO + 2 NICs e1000, VirtIO


This syslog from: QEMU / KVM - Q35 with OVMF

FreeBSD 11.3 (regular Kernel)

3 Disks
  SATA - ok
  SCSI/lsisas1068 - not found
  VirtIO - not found

2 NICS
  e1000 - not found
  VirtIO - not found
Comment 3 John Hartley 2019-11-08 09:04:08 UTC
Created attachment 208966 [details]
pciconf with 3 Disks SATA, SCSI/lsisas1608, VirtIO + 2 NICs e1000, VirtIO


Here is result from:

pciconf -lcve

FreeBSD 11.3

3 Disks
  SATA - ok
  SCSI/lsisas1068 - not found
  VirtIO - not found

2 NICs
  e1000 - not found
  VirtIO - not found
Comment 4 John Hartley 2019-11-08 09:17:40 UTC
To single view of various variations of disk/nic, I created this VM with 3 disks and 2 NICS and collected the dmesg, syslog and pciconf results.

Here is QEMU VM Desriptor for:

Q35 with OVMF - FreeBSD 11.3 VM

<domain type='kvm'>
  <name>newt-dev-freebsd-11.3</name>
  <uuid>d66dcbb4-d28e-4362-b3c5-486c85b8c4f3</uuid>
  <metadata>
    <libosinfo:libosinfo xmlns:libosinfo="http://libosinfo.org/xmlns/libvirt/domain/1.0">
      <libosinfo:os id="http://freebsd.org/freebsd/11.2"/>
    </libosinfo:libosinfo>
  </metadata>
  <memory unit='KiB'>4194304</memory>
  <currentMemory unit='KiB'>4194304</currentMemory>
  <vcpu placement='static'>2</vcpu>
  <os>
    <type arch='x86_64' machine='pc-q35-4.0'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/OVMF/OVMF_CODE.fd</loader>
    <nvram>/home/XXX/OVMF_VARS.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
    <vmport state='off'/>
  </features>
  <cpu mode='host-model' check='partial'>
    <model fallback='allow'/>
  </cpu>
  <clock offset='utc'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <pm>
    <suspend-to-mem enabled='no'/>
    <suspend-to-disk enabled='no'/>
  </pm>
  <devices>
    <emulator>/usr/bin/qemu-system-x86_64</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2'/>
      <source file='/home/newt-hd1-01.qcow2'/>
      <target dev='sdb' bus='sata'/>
      <boot order='1'/>
      <address type='drive' controller='0' bus='0' target='0' unit='1'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/home/FreeBSD-11.3-RELEASE-amd64-dvd1.iso'/>
      <target dev='sdc' bus='sata'/>
      <readonly/>
      <boot order='2'/>
      <address type='drive' controller='0' bus='0' target='0' unit='2'/>
    </disk>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2'/>
      <source file='/home/newt-hd2-01.qcow2'/>
      <target dev='sda' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2'/>
      <source file='/home/newt-hd3-01.qcow2'/>
      <target dev='vda' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x06' slot='0x00' function='0x0'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1d' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1d' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1d' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1d' function='0x2'/>
    </controller>
    <controller type='scsi' index='0' model='lsisas1068'>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x02' function='0x0'/>
    </controller>
    <controller type='sata' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'/>
    <controller type='pci' index='1' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='1' port='0x10'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0' multifunction='on'/>
    </controller>
    <controller type='pci' index='2' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='2' port='0x11'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x1'/>
    </controller>
    <controller type='pci' index='3' model='pcie-to-pci-bridge'>
      <model name='pcie-pci-bridge'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
    </controller>
    <controller type='pci' index='4' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='4' port='0x12'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x2'/>
    </controller>
    <controller type='pci' index='5' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='5' port='0x13'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x3'/>
    </controller>
    <controller type='pci' index='6' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='6' port='0x14'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x4'/>
    </controller>
    <controller type='pci' index='7' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='7' port='0x15'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x5'/>
    </controller>
    <controller type='pci' index='8' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='8' port='0x16'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x6'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x05' slot='0x00' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:b6:23:1a'/>
      <source bridge='br01'/>
      <model type='virtio'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/>
    </interface>
    <interface type='bridge'>
      <mac address='52:54:00:98:20:03'/>
      <source bridge='br01'/>
      <model type='e1000'/>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x01' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='spicevmc'>
      <target type='virtio' name='com.redhat.spice.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='keyboard' bus='usb'>
      <address type='usb' bus='0' port='1'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <graphics type='spice' autoport='yes'>
      <listen type='address'/>
      <image compression='off'/>
    </graphics>
    <video>
      <model type='qxl' ram='65536' vram='65536' vgamem='16384' heads='1' primary='yes'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0'/>
    </video>
    <redirdev bus='usb' type='spicevmc'>
      <address type='usb' bus='0' port='2'/>
    </redirdev>
    <redirdev bus='usb' type='spicevmc'>
      <address type='usb' bus='0' port='3'/>
    </redirdev>
    <memballoon model='virtio'>
      <address type='pci' domain='0x0000' bus='0x07' slot='0x00' function='0x0'/>
    </memballoon>
  </devices>
</domain>