OK, I finally received my switch box. I connected everything and nothing happened. I then did as justinclift suggested below. I rebooted and everything seems to be lit up now. Thank you very much justinclift. I am not sure how to configure to ensure that the servers are using or communicating or how to test. I did find this link but it didn't work for me
How to install support for Mellanox Infiniband hardware on RHEL6 - Red Hat Customer Portal
justinclift
"
Yeah, that line is a good sign. It's showing the hardware is being found.
When the switch arrives and you have things hooked up, the easy way to try things is probably this:
$ sudo yum groupinstall "Infiniband Support"
In theory that should install working drivers.
Though, as mentioned by the guys above, Mellanox support might not really like that.
It's pretty easy to remove those packages afterwards though if they want you to try a different approach:
$ sudo yum groupremove "Infiniband Support"
Just saying. "