Hi, We use some Chelsio T540-CR NICs and after upgrading to 11.2 from 11.1 we have run into an issue where the NICs don't forward any traffic after rebooting them. If we unplug the SFPs and then reinsert them everything will start working. Looking at ifconfig everything looks normal and ifconfig down/up does not help. The SFPs we are experiencing the issue with are 1Gbit CWDM optics, our 10Gbit DAC cables are working correctly. I'm unable to find anything specific in the log about what is happening, but interface frame counters say we are sending packets, but nothing is received at the other end and we are not receiving any thing at all according to the same counters. Looking at the hw.t5nex.0.misc.devlog I noticed a line containing "hw_mac_init_port[0], …" is always logged when it works, but never when it doesn't work. Otherwise the there is not anything obvious to me in that log. (Full log can be found in the original email thread[1].) After downgrading the firmware from 1.19.1.0 to 1.16.45.0 and disabling automatic upgrade in loader.conf everything works as expected, even on 11.2. [1]: https://lists.freebsd.org/pipermail/freebsd-net/2018-August/051420.html
We still experience issues if we try to upgrade to the latest 1.23.0.0 firmware.
I tried a a couple of different 1G optics in a T540 in a system running head and they both worked just fine. I do not have any 1G CWDM optics so I could not try that. 11.2 is no longer supported and I'm closing this as unable to reproduce. Please reopen if you still have this problem with a recent release.