Hi Erez,
Thanks for the suggestion. I'm following HowTo Change Port Type in Mellanox ConnectX-3 Adapter now.
Actually, /sys/bus/pci/devices/0000\:21\:00.0/mlx4_port1 or port2 are already set as eth.
Once port_type_array is set, I can't change the port configuration as follows:
# cat /etc/modprobe.d/mlx4_core.conf
options mlx4_core port_type_array=2,2 num_vfs=16 probe_vf=0 enable_64b_cqe_eqe=0 log_num_mgm_entry_size=-1
# connectx_port_config
ConnectX PCI devices :
|----------------------------|
| 1 0000:21:00.0 |
|----------------------------|
Before port change:
eth
eth
Not allowed to change port configuration, quitting...
When trying it after commenting current setup in mlx4_core.conf, still Ethernet is DOWN as follows:
# cat /sys/bus/pci/devices/0000\:21\:00.0/mlx4_port1
eth
# cat /sys/bus/pci/devices/0000\:21\:00.0/mlx4_port2
eth
# connectx_port_config -s
--------------------------------
Port configuration for PCI device: 0000:21:00.0 is:
eth
eth
--------------------------------
# connectx_port_config
ConnectX PCI devices :
|----------------------------|
| 1 0000:21:00.0 |
|----------------------------|
Before port change:
eth
eth
|----------------------------|
| Possible port modes: |
| 1: Infiniband |
| 2: Ethernet |
| 3: AutoSense |
|----------------------------|
Select mode for port 1 (1,2,3): 1
Select mode for port 2 (1,2,3): 1
WARNING: Illegal port configuration attempted,
Please view dmesg for details.
// ... [ 4135.654328] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 ...
# connectx_port_config
ConnectX PCI devices :
|----------------------------|
| 1 0000:21:00.0 |
|----------------------------|
Before port change:
eth
eth
|----------------------------|
| Possible port modes: |
| 1: Infiniband |
| 2: Ethernet |
| 3: AutoSense |
|----------------------------|
Select mode for port 1 (1,2,3): 2
Select mode for port 2 (1,2,3): 2
After port change:
eth
eth
# hca_self_test.ofed
---- Performing Adapter Device Self Test ----
Number of CAs Detected ................. 1
PCI Device Check ....................... PASS
Kernel Arch ............................ x86_64
Host Driver Version .................... MLNX_OFED_LINUX-2.4-1.0.0 (OFED-2.4-1.0.0): modules
Host Driver RPM Check .................. PASS
Firmware on CA #0 VPI .................. v2.33.5000
Firmware Check on CA #0 (VPI) .......... PASS
Host Driver Initialization ............. PASS
Number of CA Ports Active .............. 0
Port State of Port #1 on CA #0 (VPI)..... DOWN (Ethernet)
Port State of Port #2 on CA #0 (VPI)..... DOWN (Ethernet)
Error Counter Check on CA #0 (VPI)...... NA (Eth ports)
Kernel Syslog Check .................... PASS
Node GUID on CA #0 (VPI) ............... 00:02:c9:03:00:fb:a4:50
------------------ DONE ---------------------
When upgrading ConnectX-3 firmware, it was not installed automatically using "mlnxofedinstall" on CentOS7.
So I upgraded the firmware from 2.11 to 2.33 using "firmware/mlxfwmanager_sriov_en_x86_64 --online -u -d 21:00.0" command.
Is there any other stuff to be checked? Any tips are welcome.