Quantcast
Viewing all articles
Browse latest Browse all 6211

EDR HCA Card Problems

When we tested the MPI latency of the EDR card using OSU Benchmark,the latency was 1.13us which is obviously high,and the latency of ib_write_lat was 0.75us,both of the latency tests were even higher then the results of  the FDR card tests in the same enviroment.

Besides, the MPI bandwidth was only 9GB using the default  MPI_FABRICS dapl ,if set the MPI_FABRICS to ofa by manual,the MPI bandwidth was back to 11.7GB.

We also tried some performance tuning methods according to the tuning manual guide,but it seems had few effects.

 

 

Here is the test enviroment:

HCA card:MCX455A-ECAT

Firmware:12.1100.6630

System:CentOS7.1

MPI:Intel impi 5.02

Driver:MLNX_OFED_LINUX-3.0-1.0.1-rhel7.1-x86_64

Tools:OSU_benchmark 3.1.2


Viewing all articles
Browse latest Browse all 6211

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>