Counters per VF?
Hello, I just found that one can read the counters per port per interface at the following locations: /sys/class/infiniband/mlx4_X/ports/*/counters/*/sys/class/infiniband/mlx4_X/ports/*/counters_ext/*...
View ArticleRe: Some weird timestamp format?
Hi Andrey, Can you suggest what is the platform you're using ? OS, kernel what driver version / ConnectX-3 FW version ?
View ArticleRe: Error /hca_self_test.ofed: line 165: [: too many arguments
Hi All, Just wanted to drop by and mention again that this script simply queries basic configuration from the server. you can simply run basic IB commands like ibstat to query the physical / logical...
View ArticleRe: Issues with OFED 2.2.1 driver update
Hi John, a couple of questions, First, is PFC enabled on the interface but not on a switch ? if yes, can you disable it and try to load the driver again ?if that doesnt work I recommend uninstalling...
View ArticleRe: OpenSM service won't start
Hi, As you probably know, OpenSM on windows is still in beta stages,which means we the general recommendation is to use the SM on a switch in a windows environment. Regardless, what FW and driver is...
View ArticleRe: Mellanox Infiniband ConnectX-2 VPI interfaces not populating in ESXi 5.5u1
More info: ~ # cat /var/log/vmkernel.log | grep -i mlx2014-08-27T12:41:04.180Z cpu0:32768)VisorFSTar: 1960: net_mlx4.v00 for 0x5bd2b bytes2014-08-27T12:41:04.180Z cpu0:32768)VisorFSTar: 1960:...
View ArticleRe: Some weird timestamp format?
CentOS 6.5 2.6.32-431.el6.x86_64mlx4-en 2.2-1.0.0 and 2.2-1.0.1 both reproduce thisfirmware version 2.31.5050
View ArticleRe: Error /hca_self_test.ofed: line 165: [: too many arguments
In the end, we found out that this customer - without my knowledge - had actually bumped up their kernel with errata updates via the Red Hat Network. Once we reconfigured OFED and built a custom ISO,...
View ArticleClik here to view.
Re: Mellanox Infiniband ConnectX-2 VPI interfaces not populating in ESXi 5.5u1
Disable "above 4G decoding" in the system BIOS and the adapter will register correctly.
View ArticleClik here to view.
Re: Mellanox Infiniband ConnectX-2 VPI interfaces not populating in ESXi 5.5u1
Good news...:)I was in vacation in last week.I'm also install ethernet driver on my VPI system and did a simple test to connect to my 10Gb DCBX ethernet switch via Mellanox QSA converter. All of test...
View ArticleRe: Mellanox Infiniband ConnectX-2 VPI interfaces not populating in ESXi 5.5u1
It was such a simple thing, but it prevented the adapter from working in ESXi (other operating systems were fine). Apparently this a known issue with VMWare and has no resolution.That is why Supermicro...
View ArticleRe: Mellanox Infiniband ConnectX-2 VPI interfaces not populating in ESXi 5.5u1
I'm also SuperMicro system.All system based on X8DTN+-FLR.What's your Mobo's model?
View ArticleClik here to view.
Re: Mellanox Infiniband ConnectX-2 VPI interfaces not populating in ESXi 5.5u1
Primary we use X8DTT-H for our cluster systems, but the new system is a X9DRi-LN4F+. We wanted a dedicated email server that would be able vMotion with a twin for maintenance. The above 4G decoding...
View ArticleClik here to view.
Re: Mellanox Infiniband ConnectX-2 VPI interfaces not populating in ESXi 5.5u1
May I ask where you got> I have installed Mellanox OFED drivers (MLNX-OFED-ESX-1.9.10.0-10EM-550.0.0.1331820)from? I can only find 1.8.2.4 on the official website.
View ArticleClik here to view.
QoS for Virtual Functions(SR-IOV devices)
Configuration:Host: CentOS 6.4Mellanox Adapter: ConnectX-3 ENMellanox Driver: MLNX_OFED_LINUX-2.2-1.0.1-rhel6.4-x86_64 with SRIOV enabledVirtualization: KVM with SRIOV devices PCI passthroughed...
View ArticleRe: Some weird timestamp format?
Hi Andrey, As far as I know, MLNX_OFED 2.0.3 was the latest stable version that supported PTP. however its not available for RHEL/CentOS 6.5. My advice is to wait for the next OFED release (2.3) and...
View ArticleClik here to view.
ConnectX-HCA and 2.9.1000 brings serious trouble ?
I heard ConnectX-HCA and 2.9.1000 bring serious trouble. Could you please tell me what kind of troubles will occur ?We need it to migrate exiting system to correct combination in our...
View ArticleHow to stack two Voltaire 4036
Hi guys, I am trying to stack two Voltaire 4036 switches but I am not very familiar with this type of devices. Can I just link them together with a cable plugged in whatever port (let's say port 36),...
View ArticleRe: How to stack two Voltaire 4036
Yes, you can have just one cable between two switches or as many as you have unused ports available. I assume you have SM (subnet manager) enabled on at least one of the switches and/or on at least one...
View Article