Hi,
Configuration:
Host: RHEL7.0
Mellanox Card: ConnectX-3 Pro FDR InfiniBand + 40 GigE (MX354A-FCCT)
Mellanox Driver: MLNX_OFED_LINUX-2.4-1.0.4-rhel7.0-x86_64
Mellanox Switch: SX1012
I have one server connected to the switch with above config. After installation of OFED driver, I have set port type as "eth" ports and configured the IP for the port. However, I am not able to see the LED's lighting up on the switch as well as adapter side. I have few observations. Can someone please take a look and give suggestion?
=================
1. Adapters ports status is DOWN:
[root@RHEL7-R54-U5 ~]# connectx_port_config -s
--------------------------------
Port configuration for PCI device: 0000:1a:00.0 is:
eth
eth
[root@RHEL7-R54-U5 ~]# cat /sys/class/infiniband/mlx4_0/ports/1/state
1: DOWN
[root@RHEL7-R54-U5 ~]# cat /sys/class/infiniband/mlx4_0/ports/2/state
1: DOWN
[root@RHEL7-R54-U5 ~]# ibv_devinfo
hca_id: mlx4_0
transport: InfiniBand (0)
fw_ver: 2.33.5000
node_guid: f452:1403:00f4:f8c0
sys_image_guid: f452:1403:00f4:f8c3
vendor_id: 0x02c9
vendor_part_id: 4103
hw_ver: 0x0
board_id: MT_1090111019
phys_port_cnt: 2
port: 1
state: PORT_DOWN (1)
max_mtu: 4096 (5)
active_mtu: 1024 (3)
sm_lid: 0
port_lid: 0
port_lmc: 0x00
link_layer: Ethernet
port: 2
state: PORT_DOWN (1)
max_mtu: 4096 (5)
active_mtu: 1024 (3)
sm_lid: 0
port_lid: 0
port_lmc: 0x00
link_layer: Ethernet
[root@RHEL7-R54-U5 ~]# ethtool enp26s0
Settings for enp26s0:
Supported ports: [ FIBRE ]
Supported link modes: 1000baseKX/Full
10000baseKX4/Full
40000baseCR4/Full
40000baseSR4/Full
Supported pause frame use: Symmetric Receive-only
Supports auto-negotiation: Yes
Advertised link modes: 40000baseCR4/Full
40000baseSR4/Full
Advertised pause frame use: Symmetric
Advertised auto-negotiation: Yes
Speed: Unknown!
Duplex: Unknown! (255)
Port: FIBRE
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000014 (20)
link ifdown
Link detected: no
2. Switch Port's admin state is enabled but operational state is down.
MLNX-R54-U15-40G [standalone: master] # show interfaces ethernet 1/1
Eth1/1
Admin state: Enabled
Operational state: Down
Description: N\A
Mac address: f4:52:14:65:55:06
MTU: 1500 bytes(Maximum packet size 1522 bytes)
Flow-control: receive on send on
Actual speed: 40 Gbps
Width reduction mode: disabled
Switchport mode: access
Last clearing of "show interface" counters : Never
60 seconds ingress rate: 0 bits/sec, 0 bytes/sec, 0 packets/sec
60 seconds egress rate: 0 bits/sec, 0 bytes/sec, 0 packets/sec
Rx
0 packets
0 unicast packets
0 multicast packets
0 broadcast packets
0 bytes
0 error packets
0 discard packets
Tx
0 packets
0 unicast packets
0 multicast packets
0 broadcast packets
0 bytes
0 discard packets
=================
Thanks!