I recently bought two Connectx-3 FDR Infiniband + 40GigE cards (model CX535A)
I am not seeing the expected through put from the cards. I am using NTTCP (ver 5.28) to test the performance of the cards. The best I have been able to get is about 190 MB/s or about 1520 Mb/s. This is far short of the expected results. I have attached the results from my tests.
Of the two servers I am using one is running Windows Server 2012 R2 and the other is running Windows Server 2008 R2. The appropriate drivers have been installed on both servers.
The two configurations I have tried to this point are back-to-back and through a 10Gb switch.
In the first scenario the cards show a 40Gb connection.
In the second scenario both cards show a 10Gb connection (these are connected to the switch).
I have tried to optimize the cards for a single connection as well as changing the frame size. Nothing makes a difference.
Could someone point me in a direction to figure this out?
Thank you.