The most advantage about RDMA is end-to-end reliability. But there is some limit in storage field.
1, Mostly, in a computer node, IB is connected to PCIe Switch, and PCIe write is post write. So if node A write data to node B's memory by RDMA, data may store in PCIe Switch's buffer, not totally in node B's memory. Also, if PCIe switch doesn't function properly, RDMA can't detect the error. So there is risk about data reliability.
2, Now, Intel X86 processor support DDIO feature by default. So if node A write data to node B's memory by RDMA, data may store in CPU cache, not totally in node B's memory.
Is there any method to deal with it?
Thanks,