|Summary:||ixv driver 12.0 crash in AWS/EC2|
|Product:||Base System||Reporter:||James <jwjerni>|
|Component:||kern||Assignee:||Eric Joyner <erj>|
|Severity:||Affects Some People||CC:||cperciva, emaste, erj, op, pete|
Description James 2017-07-20 02:56:45 UTC
I have created a few instances in AWS using the lastest AMI for the CURRENT branch: FreeBSD 12.0-CURRENT-amd64-2017-07-11 (ami-847b7992) A couple of these have started up just fine, but the rest of the instances are inaccessible due to the network driver crashing on startup and rendering the machines inaccessible by SSH. I have one working instance, but even creating more based off of that configuration are failing to start networking properly. Restarting the instances does not fix the problem. I have pulled the following logs from the AWS web console for two m4.10xlarge instances with the same configuration and AMI. Working instance: ixv0: <Intel(R) PRO/10GbE Virtual Function Network Driver, Version - 1.5.13-k> mem 0xf3000000-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on pci0 ixv0: Using MSI-X interrupts with 2 vectors ixv0: Ethernet address: 0a:2f:e8:85:2f:38 ixv0: netmap queues/slots: TX 1/1024, RX 1/1024 Malfunctioning instance: ixv0: <Intel(R) PRO/10GbE Virtual Function Network Driver, Version - 1.5.13-k> mem 0xf3000000-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on pci0 ixv0: MBX API 1.2 negotiation failed! Error -32 The error appears to be coming from sys/dev/ixgbe/if_ixv.c in the source. Let me know if I can provide any further information. Thanks, James
Comment 1 commit-hook 2017-08-24 22:57:01 UTC
A commit references this bug: Author: erj Date: Thu Aug 24 22:56:22 UTC 2017 New revision: 322865 URL: https://svnweb.freebsd.org/changeset/base/322865 Log: ixv(4): Add more robust mailbox API negotiation The previous update to the driver to 3.2.12-k changed the VF's API version to 1.2, but did not let the VF fall back to 1.1 or 1.0 versions. So, this patch tries 1.2 first, then the older versions in succession if that fails. This should allow the VF driver to negotiate 1.1 and work with older PF drivers, such as the one used in Amazon's EC2 service. PR: 220872 Submitted by: Jeb Cramer <email@example.com> MFC after: 1 week Sponsored by: Intel Corporation Changes: head/sys/dev/ixgbe/if_ixv.c
Comment 2 pete 2018-07-10 17:48:09 UTC
Hi, was this commit ported to the 11.2-RELEASE branch? I've run into the exact same issue using 11.2-RELEASE on a m4 instance.
Comment 3 Eric Joyner 2018-07-10 18:42:54 UTC
It doesn't look like it was ever MFC'd. I'll look at doing it to stable/11.