Re: 40Gb/s IPoIB only gives 5Gb/s real throughput?!
Yes 40Gb/s data rate, but sending 8 bits data in a 10 bit packet giving 32Gb/s max data thruput; however the PCIe bus will limit you to about 25Gb/s.Keep in mind that the performance for hardware to...
View ArticleClik here to view.
Re: 40Gb/s IPoIB only gives 5Gb/s real throughput?!
Hi!Don't use IPoIB mode.Mellanox remove support RC mode (mtu=65535) on Windows.RC mode use RDMA, but DM mode wasn't. And ~Microsoft don't want to use RC mode, but SMB Direct file share that use RDMA....
View ArticleClik here to view.
Re: SN2100B and 56GbE
Hi Andrzej, SN2700B does only supports 40g, not the 56GbE and below are the specification for the same. MSN2700-BS2F Spectrum™ based 40GbE, 1U Open Ethernet Switch with MLNX-OS, 32 QSFP28 ports, 2...
View ArticleRe: How to configure cards to run at 25Gbs
Hi, your device is already with the requested speed 25000 after running "ethtool -s enp2s0f0 speed 25000 autoneg off",does the other side (switch or Back to Back device ) configured to 25000 speed ? I...
View ArticleRe: Patch needed to activate ROCEV2 for Connect 3X 10G card
Hi Rama,could you please tell me the device type, operation system and the kernel version that you are using.for your information, RoCE v2 is supported ONLY in ConnectX®-3 Pro and ConnectX®-4 adapter...
View ArticleRe: questions regarding SRQ performance
Hi Sam, For the above question please open a ticket with Mellanox support by sending the info to support@mellanox.com.this need to be investigated in order to provide you with the most accurate reply....
View ArticleRe: Patch needed to activate ROCEV2 for Connect 3X 10G card
we are using ConnectX3-pro with MLNX OFED stack, it is detecting ROCEV2 properly.But we are not getting ROCEV2 parameter with 4.8 kernel without MLNX OFED stack.I want to work with Connect X3 pro with...
View ArticleRe: Patch needed to activate ROCEV2 for Connect 3X 10G card
Yes, it's possible.The RoCE V2 support accepted at kernel v4.5. commit 3f723f42d9d625bb9ecfe923d19d1d42da775797 check the gid's that generated, should be there RoCE V2 gids. please make sure that your...
View ArticleRe: Patch needed to activate ROCEV2 for Connect 3X 10G card
Hi Talat, I have used kernel 4.8, after that if i give ls /sys/modules/mlx4_core/parameters I did not find any entry related to RoCE mode. Please tell how we can view gid's. what is the location. Also,...
View ArticleRe: Patch needed to activate ROCEV2 for Connect 3X 10G card
There is no roce_mode parameter in upstream, RoCE V2 is enabled by default.GID Table in sysfsGID table is exposed to user space via sysfs 1. GID values can be read from:...
View ArticleRe: Patch needed to activate ROCEV2 for Connect 3X 10G card
Hi Talat, The above entries are only visible with MLNX_OFED stack. we are not getting with kernel 4.8 with INBOX OFED. Even the below step giving error.cd /sys/kernel/config/rdma_cm# mkdir mlx4_0...
View ArticleRe: Patch needed to activate ROCEV2 for Connect 3X 10G card
i don't think so, is all the modules up ? please make sure that you have the updated user space and all the modules is up like.ib_cm,rdma_cm,ib_umad,ib_uverbs,ib_ucm,rdma_ucm,mlx4_ib could you please...
View ArticleClik here to view.
Re: infiniband SR-IOV with neutron error
Hi Bernie, Can you update the /etc/modprobe.d/mlx4_core.conf file with the following options: options mlx4_core num_vfs=8 port_type_array=1,1 probe_vf=8 enable_64b_cqe_eqe=0 log_num_mgm_entry_size=-1...
View ArticleRe: infiniband SR-IOV with neutron error
this option “probe_vf=8“ mean the vf can be used by this host not guest。
View ArticleRe: Setting SR-IOV num_vfs for ConnectX-2 card
Hi Talat, thanks for your reply and the steps! I'll try them out
View ArticleMinimum OpenSM level to support SRIOV on IS5030 switch
We are trying to attach a DDN GS7k to an existing IS5030 switch and we cannot get a ib link up. We suspect the switch either does not support SRIOV or the OpenSM they are running on the switch does...
View ArticleClik here to view.
hca_self_test.ofed found errors in the port_rcv_errors counters
I am trying to configure NFS for our infiniband network, and following the instructions at HowTo Configure NFS over RDMA (RoCE)I installed the MLNX_OFED drivers on CentOS 6.8. (I had originally...
View ArticleRe: Patch needed to activate ROCEV2 for Connect 3X 10G card
Thanks Talat, I can able to use connect 3X pro in ROCEV2 mode with inbox OFED.One correction in your documentecho RoCE V2 > default_roce_mode We need to use v2 (small v) ThanksRama
View Articleibdump not working for 100G Mellanox card, MLNX_OFED 3.4.1
Hi,ibdump is not working with 100G Mellanox card. I am using RHEL 7.0 kernel 4.7.[root@localhost ~]# ibdumpInitiating resources ...searching for IB devices in hostPort active_mtu=1024MR was registered...
View ArticleRe: hca_self_test.ofed found errors in the port_rcv_errors counters
it seems the port_rcv_errors error is based on the subnet manager not running, as the counter has not increased anymore since OpenSM was started. I ran several RDMA verification tests which were all...
View Article