Bug 220872 - ixv driver 12.0 crash in AWS/EC2
Summary: ixv driver 12.0 crash in AWS/EC2
Status: New
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: CURRENT
Hardware: Any Any
: --- Affects Some People
Assignee: Eric Joyner
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-07-20 02:56 UTC by James
Modified: 2017-10-05 20:22 UTC (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description James 2017-07-20 02:56:45 UTC
I have created a few instances in AWS using the lastest AMI for the CURRENT branch:
FreeBSD 12.0-CURRENT-amd64-2017-07-11 (ami-847b7992)

A couple of these have started up just fine, but the rest of the instances are inaccessible due to the network driver crashing on startup and rendering the machines inaccessible by SSH. I have one working instance, but even creating more based off of that configuration are failing to start networking properly. Restarting the instances does not fix the problem. I have pulled the following logs from the AWS web console for two m4.10xlarge instances with the same configuration and AMI.

Working instance:
ixv0: <Intel(R) PRO/10GbE Virtual Function Network Driver, Version - 1.5.13-k> mem 0xf3000000-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on pci0
ixv0: Using MSI-X interrupts with 2 vectors
ixv0: Ethernet address: 0a:2f:e8:85:2f:38
ixv0: netmap queues/slots: TX 1/1024, RX 1/1024

Malfunctioning instance:
ixv0: <Intel(R) PRO/10GbE Virtual Function Network Driver, Version - 1.5.13-k> mem 0xf3000000-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on pci0
ixv0: MBX API 1.2 negotiation failed! Error -32

The error appears to be coming from sys/dev/ixgbe/if_ixv.c in the source. Let me know if I can provide any further information.

Thanks,
James
Comment 1 commit-hook freebsd_committer 2017-08-24 22:57:01 UTC
A commit references this bug:

Author: erj
Date: Thu Aug 24 22:56:22 UTC 2017
New revision: 322865
URL: https://svnweb.freebsd.org/changeset/base/322865

Log:
  ixv(4): Add more robust mailbox API negotiation

  The previous update to the driver to 3.2.12-k changed the VF's API version
  to 1.2, but did not let the VF fall back to 1.1 or 1.0 versions. So, this
  patch tries 1.2 first, then the older versions in succession if that fails.

  This should allow the VF driver to negotiate 1.1 and work with older PF
  drivers, such as the one used in Amazon's EC2 service.

  PR:		220872
  Submitted by:	Jeb Cramer <jeb.j.cramer@intel.com>
  MFC after:	1 week
  Sponsored by:	Intel Corporation

Changes:
  head/sys/dev/ixgbe/if_ixv.c