Clik here to view.
Re: Problem driving MCX353A-FCBT with OFED3.5 on Fedora16
Hello Justin-san, console output of lspci command related to Mellanox HCA are followings: 87:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3] Subsystem: Mellanox Technologies...
View ArticleRe: 40GbE optimization and bandwidth testing
So I now have two servers with Windows 2012 on them + The latest firmware on each HCA + the latest 4.2 drivers on each machine. I confirmed that RDMA is enabled on each machine and I still can't break...
View ArticleMellanox (old Voltaire) ISR9024D-M recover flash area
I have 9024D-M, 4036 switches.4036 works fine.But 9024 have a problem some day before. I connected console via serial cable.But I can't access safe mode.I'm also tried bootd, bootp via tftp protocol....
View ArticleRe: Suggestions for *quiet* Infiniband switch?
Well I setup CentOS on a small Atom server I had and connected it to my IB network (currently connected using a TopSpin 120 switch). I installed OpenSM and it is running. I won't get the 9024D switch...
View ArticleRe: Suggestions for *quiet* Infiniband switch?
Nope, not really. If you're inexperienced with CentOS and IB, here's the best walkthrough that I've used when I forget....
View ArticleClik here to view.
Re: Will there be ESXi 5.x driver support for ConnectX adapters?
If you haven't found it, the firmware are available on Mellanox's site in the archives. Mellanox - Support Download Assistant
View Articledual port FDR ConnectX-3 card
when we say dual port FDR VPI card, does it means both the ports parallely works @ 56Gbps and i can get aggregated BW 112 Gbps (ofcourse in theory). OR one port is redundant and both aggregates to...
View ArticleDual port FDR connectx-3 card
when we say dual port FDR VPI card, does it means both the ports parallely works @ 56Gbps and i can get aggregated BW 112 Gbps (ofcourse in theory). OR one port is redundant and both aggregates to...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Yes, thanks, I was able to flash a 2.7 version of the firmware for my hardware and now ESXi is connecting to the IB network. However, it's connecting at single data rate instead of quad for some...
View ArticleRe: 40GbE optimization and bandwidth testing
Someone pointed me the chelsio website which has white papers for 40GbE over SMB between Windows 2012 servers setup just like mine getting a whopping 36Gbps... Another poster confirmed that he's...
View ArticleRe: Suggestions for *quiet* Infiniband switch?
Well I got the 9024D today and connected it up. At first my storage server and one VM server could not connect via IPoIB. I had to downgrade the firmware on the MHGH28-XTC IB cards to 2.7.0 from...
View ArticleRe: Suggestions for *quiet* Infiniband switch?
First off, the MHGH28/29 only work with 2.7 and ESXi. They won't show up with anything newer. I think that the ConnectX is stuck at that firmware for VMware... Mellanox has to plans to fix it....
View ArticleClik here to view.
Re: Will there be ESXi 5.x driver support for ConnectX adapters?
Regarding the MTU, I think that is part of the Mellanox OFED driver. What size are you using? It looks like it can be set up to be as high as 4k. In the older releases, the cap was 1500 and everything...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
I'll keep poking around. I don't think it's the cabling since it is on a blade server and its sister node is running fine under Windows. Found the setting for jumbo frames on ESXi and that let me...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
I think I saw the 4k MTU in ESX when I was reading the docs for the MLNX OFED driver so I think it should still work on the 2.7 firmware. I'll try to do some MTU testing this weekend as well on my...
View ArticleRe: Suggestions for *quiet* Infiniband switch?
Well its definitely not the cables since if I direct connect the ports on a MHGH28 card, it will register at 4X DDR speeds. I tried pressing the reset button on the switch but that didn't seem to...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Thanks again. I'll probably keep poking at it, I think the 4k issue probably has to do with opensm and how it is starting as a service under Windows. Might need to run opensm under a Linux system,...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Hi wark286,Yes 4K mtu is supported in IPoIB for vSphere 5 as explained in the User Manual.You basically need to configure the SM to enable 4K mtu for IPoIB (check your SM user manual, the configuration...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
I've run through all of the command and configuration recommendations in the user manuals, best I can get is 2044 MTU. Could possibly be opensm not listening to my partitions.conf file as when I run...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Hi wark286,Indeed, looks like your opensm is not listening to the config file (the test you've done using saquery reflects this fact).If you're running opensm from a host, try to run it manually:>...
View Article