hi
yes we tried ipoib in CM and UD modes, using ip drbd replication set to 20Gb/s but it only managed 200~300Mb/s.
whereas using SRP with MDADM we can achieve 900Mb/s to 1400Mb/s easy!
It was OFED 2 on the target only, not on the initiator as that is ESXi5.1 with the esxi driver which i dont think is based on OFED 2, as i suspect target and initiator have to be the same level to see the best performance. Though we did see a jump in SRP banddwidth ? unless others have seen otherwise.?
lets hope Mellanox update the vmware driver 1.8.1 to OFED2? plz!