Bug 206016

Summary:	Changing MTU on the interface Infiniband network card (Mellanox MHQH29B-XTR) causes panic
Product:	Base System	Reporter:	Vladyslav V. Prodan <admin>
Component:	bin	Assignee:	freebsd-net (Nobody) <net>
Status:	Closed FIXED
Severity:	Affects Only Me	CC:	menyy
Priority:	---
Version:	10.1-RELEASE
Hardware:	Any
OS:	Any

Description Vladyslav V. Prodan 2016-01-08 00:03:51 UTC

I bought on ebay.com map Mellanox Infiniband CONNECTX-2 MHQH29B-XTR
( http://www.mellanox.com/page/products_dyn?product_family=4 )

After installing and loading drivers V2.1.6 site Mellanox, the card identifies:
mlx4_core0@pci0:6:0:0:  class=0x028000 card=0x002115b3 chip=0x673c15b3 rev=0xb0 hdr=0x00
    vendor     = 'Mellanox Technologies'
    device     = 'MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE]'
    class      = network
mlxen1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=d07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE>
        ether 00:00:00:00:00:01
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (autoselect <full-duplex,rxpause,txpause>)
        status: active

But after trying to change mtu - ifconfig mlxen1 mtu 1500 UP - server immediately is gone to reboot :(

P.S.

FreeBSD 10.1-PRERELEASE #0: Fri Sep  5 03:04:51 EEST 2014     root@core.domain.com:/usr/obj/usr/src/sys/core.domain.com.2  amd64


I load all modules:
# ll /boot/modules
total 1799
-rw-r--r--  1 root  101  652720  8 янв 00:57 ibcore.ko
-rw-r--r--  1 root  101   99104  8 янв 00:58 ipoib.ko
-rw-r--r--  1 root  101  429616  8 янв 00:58 mlx4.ko
-rw-r--r--  1 root  101  256752  8 янв 00:59 mlx4ib.ko
-rw-r--r--  1 root  101  136736  8 янв 00:59 mlxen.ko

Comment 1 Vladyslav V. Prodan 2016-01-08 00:08:07 UTC

 5    3 0xffffffff812f1000 a8020    ibcore.ko (/boot/modules/ibcore.ko)
        Contains modules:
                Id Name
                 8 ibcore
 6    2 0xffffffff8139a000 3670     toecore.ko (/boot/kernel/toecore.ko)
        Contains modules:
                Id Name
                 7 toecore
 7    1 0xffffffff8139e000 1a730    ipoib.ko (/boot/modules/ipoib.ko)
        Contains modules:
                Id Name
                 9 ipoib
 8    3 0xffffffff813b9000 6d638    mlx4.ko (/boot/modules/mlx4.ko)
        Contains modules:
                Id Name
                10 mlx4
 9    1 0xffffffff81427000 42770    mlx4ib.ko (/boot/modules/mlx4ib.ko)
        Contains modules:
                Id Name
                11 mlx4ib
10    1 0xffffffff8146a000 22d80    mlxen.ko (/boot/modules/mlxen.ko)
        Contains modules:
                Id Name
                12 mlxen

Comment 2 Vladyslav V. Prodan 2016-01-08 01:03:58 UTC

# sysctl sys.device.
sys.device.mlx4_core0.fw_ver: 2.9.1530
sys.device.mlx4_core0.hca: MT26428
sys.device.mlx4_core0.board_id: HP_0180000009
sys.device.mlx4_core0.mlx4_port1: eth
sys.device.mlx4_core0.mlx4_port2: eth

Comment 3 Vladyslav V. Prodan 2016-01-09 01:04:46 UTC

After reading the article https://wiki.freebsd.org/InfiniBand, I realized my error.

I unload the old modules in the memory .
Rebuild the world to FreeBSD 10.2-STABLE # 0: Fri Jan 8, 2016 18:45:13 EET
And added to the kernel options
options        OFED            # Infiniband protocol stack and support
options        SDP             # Sockets Direct Protocol for infiniband
options        IPOIB_CM        # Use connect mode ipoib
device         ipoib           # IP over IB devices
device         mlx4ib          # ConnectX Infiniband support
device         mlxen           # ConnectX Ethernet support
device         mthca           # Infinihost cards

After these manipulations network card recognized by the system, it is now possible to change the IP and MTU.