I don't know if I should be asking this here on on the vmware forums, so forgive me if I am in the wrong place. I have two connectx-5 cards connected directly with a QSFP28 cable. One side is on a vsphere 6.7 host, the other on a CentOS 7.5 storage appliance. The basic functionality is working just fine. I am trying to set up an iSER initiator on the vsphere host, but it doesn't seem to be working. One of the vmware blog posts I found gave directions for creating a software iSCSI initiator, and enabling it for iSER, but that doesn't seem to work (yet I don't get any errors.) I ask this here only because there may be a possibility I am configuring something wrong. The cards are connected back to back (no switch), so I haven't bothered with PFC (dunno if that could be relevant.) I also have SR-IOV enabled, with 1 VF attached to a windows server 2012 guest configured as a VEEAM backup proxy (dunno if SR-IOV could be in play either?) Any thoughts, hints or tips appreciated
↧
How to set up a connectx-5 as an iSER initiator on vsphere?
↧
Re: Installing OFED on FC27 throwing compiler errors
Hello Peter,
Thank you for posting your question on the Mellanox Community.
Based on the information provided and an internal discussion, we noticed that you opened a Mellanox Support case.
We will continue to assist and update you through that case.
Thanks and regards,
~Mellanox Technical Support
↧
↧
Re: i2C writing interface to A0 and A2 tables using ConnectX3 ???
If this is a job offer, then you are not very good at finding new employees in your project. Usually people write requirements, tasks, give contacts, announce the amount of remuneration. Then potential employees will be able to assess the situation and respond to the announcement. I even ordered a resume from topresume reviews for my last job, because the conditions were so cool that I couldn't miss this opportunity. I think you should learn to do the same if you want the workers to compete for your offer.
↧
Re: VLANs port Virtualization
Hi Jorge,
Can you please provide more details?
Do you mean to do virtualization on the mellanox switch?
↧
Re: Support for "INBOX drivers?" for 18.04/connected mode?
Hi Bill,
Here is the link to the Release Notes for Ubuntu 18.04 Inbox Driver. Section 2 Changes and New Features lists the support for Enhanced IPoIB for ConnectX-4 cards. Also, I am attaching the link for the User Manual for your reference. Which card are you using? Also, you mentioned you are receiving the following error [ 57.573664] ib_ipoib: unknown parameter 'ipoib_enhanced' ignored. Is this after testing with MLNX_OFED? If yes, which OFED version did you test it with? Also, for any questions related Inbox Driver, it would be great to reach out to OS Vendor.
http://www.mellanox.com/pdf/prod_software/Ubuntu_18.04_Inbox_Driver_Release_Notes.pdf
http://www.mellanox.com/pdf/prod_software/Ubuntu_18_04_Inbox_Driver_User_Manual.pdf
↧
↧
Re: How to configure host chaining for ConnectX-5 VPI
Disappointment also on my side :-(
But thank you so much for your help.
↧
Re: MLAG, PFC in a stretch scenario
Hi Andreas,
The post How to Enable PFC on Mellanox Switches (Spectrum) is outdated.
Please refer to the Recommended Network Configuration Examples for RoCE Deployment article.
The configuration in the above article will enable the correct lossless priority pfc on all ports.
↧
DPDK under FreeBSD
Is there anyone working on or any road map for getting the mlx5 driver working under FreeBSD? FreeBSD 12 has added a lot of features needed to the default kernel build but it looks to be still missing quite a bit.
Thanks in advance!
Mit
↧
Re: How to enable Multi-Host on ConnectX-5?
Hi Fred,
We noticed that you had a Mellanox Support Case opened with us regarding the same question in which we provided you with the information requested. If needed, we can continue communicating through the Mellanox Support Case.
Thanks & Regards,
Namrata.
↧
↧
Re: Error counters and thresholds
Hi,
Please refer to the following community links:
Understanding mlx4 Linux Counters
Understanding mlx5 Linux Counters and Status Parameters
Thanks,
Samer
↧
Re: DPDK under FreeBSD
Samer-
I understand that it is not currently supported. That is why I asked if anyone was working on it... before I tackle the port myself.
We started using DPDK to get out of the driver business, which worked until now!
Thanks!
Mit
↧
Re: DPDK under FreeBSD
Hi Mit,
Currently there is no plan to support FreeBSD in any roadmap.
Thanks,
Samer
↧
Re: DPDK under FreeBSD
Thank you sir.
Mit
↧
↧
Re: DPDK under FreeBSD
Hi,
Currently Mellanox supports the following OS list in the latest DPDK 18.05 :
OS List:
- Red Hat Enterprise Linux Server release 7.5 (Maipo)
- Red Hat Enterprise Linux Server release 7.4 (Maipo)
- Red Hat Enterprise Linux Server release 7.3 (Maipo)
- Red Hat Enterprise Linux Server release 7.2 (Maipo)
- Ubuntu 18.04
- Ubuntu 17.10
- Ubuntu 16.10
- Ubuntu 16.04
- SUSE Linux Enterprise Server 15
Currently there is no plan to support FreeBSD in any roadmap.
Thanks,
Samer
↧
Re: Error counters and thresholds
Hi Samer.
Thanks for your reply. But I'm looking for theshold information. Like I told in previous message, you can have 50 symbol error in an hour or in a week. I want to know when these 50 errors are important. The same for all the port counters of an Infiniband link. I need to debug the situation and I don't know and I don't know where to look for information about what are dangerous numbers on Infiniband counters.
Thanks again.
BYe...
↧
Re: Concurrent INFINIBAND multicast writers
Hi Wayne,
Did you try running SM on the server to check if issue is not reproducible? Can you please let me know the following:
1. PSID of the card and FW version
#mst start
#mst status (get the mst device name)
#flint -d <mst device name> q
2. Driver version
#ofed_info -s
↧
Re: How to set up a connectx-5 as an iSER initiator on vsphere?
Hi Dan,
Many thanks for posting your question on the Mellanox Community.
As per ESXi 6.7, iSER support is built-in ESXi 6.7 and also supports the ConnectX-5 adapter
Please following the instruction provided in the following link on how-to configure iSER in ESXi 6.7 -> https://docs.vmware.com/en/VMware-vSphere/6.7/com.vmware.vsphere.storage.doc/GUID-679D1419-BF9D-4E10-8598-F23205E8AB0F.html
In case, you run in to a new issue, please contact VMware for additional support.
Many thanks.
~Mellanox Technical Support
↧
↧
Re: How to set up a connectx-5 as an iSER initiator on vsphere?
This is kinda frustrating. I have done this exercise multiple times. As the docs say, I did:
esxcli rdma iser add
and the log shows:
2018-11-07T02:10:53.287Z cpu4:2099839 opID=28b042a0)Device: 1466: Registered device: 0x43060f7cd070 logical#swdevroot#com.vmware.iser0 com.vmware.iser (parent=0x6daa43060f7cd35b)
yet no iSER storage adapter is visible in the web client. I'm puzzled why y'all just cut&pasted a reference to vmware docs when I explicitly stated this didn't work for me.
↧
Re: Error counters and thresholds
Hi Manuel,
To monitor such counters, i suggest using ibdiagnet tool
ibdiagnet performs quality and health checks, scans the fabric and extracts connectivity and devices available information.
An ibdiagnet run performs the following:
• Fabric discovery
• Duplicated GUIDs detection
• Duplicate Node Description detection
• Alias GUIDs check
• Lids check
• Links in INIT state and unresponsive links detection
• Counters fetch
• Error counters check
• Counter increments during run detection
• BER test
• Routing checks
• Link width and speed checks
• Topology matching.
• Partition checks
Example:
./ibdiagnet -P all=1 --pc --pm_pause_time 1200 --get_cable_info -r -o /tmp/$(date +%Y%m%d)
The output logs will be under “/var/tmp/ibdiagnet2/”
Thanks,
Samer
↧
Help with Mellanox MHGA28-XTC InfiniHost III Ex Installation on Windows
Hiya, I hope you can help me.
I have purchased the MHGA28-XTC card (Revision 5) I am wanting to install it on Windows 10 (Ideally)
I have followed the instructions on the Mellanox website but for my trying I cannot get the card installed. I have tried it on different machines, on different OS's from Windows 7 to Windows 10 and also on Windows server 2016.
The Device manager sees the card as an Infiniband Controller, and when i follow the instructions to download and install the Card but it doesnt want to know, I have tried forcing the driver onto the card and the best i have got is that it will take the driver, and the device will appear in Network Devices but its disabled, and I cannot enable it.
I have used the MST Status command and it always states that there are no MST Devices detected, even though Windows sees the PCI Card (ive used multiple PCI Slots also)
If someone could basically take me through this step by step I would be eternally grateful.
↧