Re: OFED/IBDUMP for ConnectX-4
Update: found this oneHowTo Dump RDMA traffic Using the Inbox tcpdump tool But: CentOS-7.2/OFED-3.2.2 [root@5810-client ~]# which ethtool/opt/mellanox/ethtool/sbin/ethtool[root@5810-client ~]# ethtool...
View ArticleRe: MHEA28-XTC on Windows Server 2012 R2 and Windows 7
It's been a while and I had given up on these cards but last week I received two new servers and saw the cards lying on the shelf and figured I'd give it another go.Figured I'd post my results here if...
View ArticleI have problem porting my RDMA application from InfiniBand(Mellanox...
So, I have a small application written in C testing RDMA write. It works perfectly on Mellanox ConnectX-3 40Gb IB NIC. We got new Mellanox ConnectX-4 100GbE hardware, which supports RoCE (Testing with...
View ArticleM2401G Switch Redundancy?
Hi everyone, glad to be on this community.I have two Mellanox M2401G Infiniband switches, which are the Dell blade switches for M1000e.They seem to work, but I have some issues here and maybe someone...
View ArticleRe: M2401G Switch Redundancy?
hi Paul, If you don't have a phyiscall link between the 2 switches - meaning they are part of the same IB network then no failover is possible. Also - the output of ibstat confirms that that each port...
View ArticleRe: Firmware Mellanox Voltaire 4036E ?
Hello,I would suggest that you open a support account with Mellanox.
View ArticleClik here to view.
Re: M2401G Switch Redundancy?
Hi Eddie thank you for your response.I can setup a link between those two switches easy but if I remember correctly when I've done that the switches behave strange as in a loop or something, high io...
View ArticleRe: ROCEv2 on ConnectX-3 (not ConnectX-3 Pro)
Hi ConnectX-3 doesn't support RoCEv2RoCEv2 supports starts only from ConnecX-3 Pro cards.
View ArticleRe: M2401G Switch Redundancy?
Ok, I now have an update. It seems like the switches are there alright it's just that I manually need to query.Although this is server 1 connected to the switch, port 16 shows up. Which means port 16...
View ArticleClik here to view.
Re: infiniband: ofed installation in diskless environment
Although it has been a while since i've done it, i'll try to help First, are you using staleless or statelite? i assume you are using stateless because the answer is shorter and if you are using...
View ArticleRe: Mellanox Infiniband + mmap() + MPI one-sided communication fails when...
Note sure if this is any help: Have you tried to file it as a bug to the Intel MPI team?Does the same thing happen if you use another MPI implementation?
View ArticleConnect-IB MTT
I have a fat node which has 2TB memory. With the new Connect-IB card, I want to increase the MTT, so I could register a large memory region. I found this post for HowTo Increase Memory Size used by...
View ArticleOpenMPI MXM problem
I am probably making a stupid error, but I don't really know where I should look. This is all on RHEL 6.5. I have previously used both HPC-X and compiled OpenMPI against libmxm (yalla driver).HPC-X...
View ArticleRe: OpenMPI MXM problem
Hi Nils,I think you can try the IMB test that is included in HPC-X that is in $HPCX_MPI_TESTS_DIRmpirun -mca pml yalla -np 2 ${HPCX_MPI_TESTS_DIR}/imb/IMB-MPI1Could it possibly be that there are other...
View ArticleClik here to view.
Re: OpenMPI MXM problem
Same behaviour using the version of IMB provided in the gcc version of HPC-X 1.5.370.Runs fine on a single node, but hangs if scheduled across two nodes. The LD_LIBRARY_PATH only contains pointers to...
View Articlewindows server infiniband ibping fail
Hello, I'm trying to configure an infiniband network between two servers running Windows Server 2008 R2 using a Mellanox switch and copper cables. The ports all identify as active and LinkUp, subnet is...
View ArticleIssues with updating kernel with OFED installed - AttributeError: 'module'...
Hello, My environment:- Ubuntu 14.04 with kernel linux-image-4.2.0-27-generic- OFED 3.2-2.0.0.0 During installation of linux kernel > 4.2.0-27 DKMS reports errors. Setting up...
View ArticleConnect-IB driver trace info
When I am using my connect-ib card for rdma communications, I had some seg fault with my application. I was able to get some trace information using fwtrace as follows: [503:12:30.862093402] I2...
View ArticleRe: Connect-IB driver trace info
Hi,I guess the trace is from mlxtrace tool. It is pretty hard to guess what went wrong since we don't have your piece of code and on call you are getting a segfault. My guess is that these error might...
View ArticleRe: windows server infiniband ibping fail
Hi,Can you share "vstat" from PS from both of your machines, and ibping syntax and error?
View Article