Hi Markus,
Thank you for taking the time and posting. I poked around with some smart engineers and was able to get some idea in addition to the data you provided.
The issue here was the SCSI mid-layer modifying the DMA device dma_boundary attribute under IPoIB (from 64bit to 32bit).
This phenomenon was due to SRP adding a new SCSI host while keeping the dma_boundary attribute of scsi_host template at default.
In this case SCSI mid-layer will override the DMA device dma_boundary to default (32bit boundary) – causing IPoIB allocation across the 32bit boundary to fail and possibly crash.
In order to avoid this problem, it is recommended to uninstall SRP (if no need for it) using:
$ esxcli software vib remove –n scsi-ib-srp
$ reboot
I hope that it will help..
Cheers!