Bug 231192 - cxl: nic does not work after reboot
Summary: cxl: nic does not work after reboot
Status: Open
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: 11.2-RELEASE
Hardware: Any Any
: --- Affects Only Me
Assignee: Navdeep Parhar
URL:
Keywords: regression
Depends on:
Blocks:
 
Reported: 2018-09-06 08:35 UTC by Marius Halden
Modified: 2019-11-05 16:09 UTC (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Marius Halden 2018-09-06 08:35:54 UTC
Hi,

We use some Chelsio T540-CR NICs and after upgrading to 11.2 from 11.1 we have run into an issue where the NICs don't forward any traffic after rebooting them. If we unplug the SFPs and then reinsert them everything will start working. Looking at ifconfig everything looks normal and ifconfig down/up does not help. The SFPs we are experiencing the issue with are 1Gbit CWDM optics, our 10Gbit DAC cables are working correctly. I'm unable to find anything specific in the log about what is happening, but interface frame counters say we are sending packets, but nothing is received at the other end and we are not receiving any thing at all according to the same counters.

Looking at the hw.t5nex.0.misc.devlog I noticed a line containing "hw_mac_init_port[0], …" is always logged when it works, but never when it doesn't work. Otherwise the there is not anything obvious to me in that log. (Full log can be found in the original email thread[1].)

After downgrading the firmware from 1.19.1.0 to 1.16.45.0 and disabling automatic upgrade in loader.conf everything works as expected, even on 11.2.

[1]: https://lists.freebsd.org/pipermail/freebsd-net/2018-August/051420.html
Comment 1 Marius Halden 2019-11-05 16:09:11 UTC
We still experience issues if we try to upgrade to the latest 1.23.0.0 firmware.