My question now is why wasn't the sub ib0.1 interface enslaving setup for me as the user manual says the below:
"The IPoIB daemon (ipoibd) detects the new VIFs and creates a new IPoIB instances, as a result number of IPoIB interfaces (ibX.Y) are shown as being created/destroyed, and are being enslaved to the corresponding ethX interface to serve any active VIF in the system according to the set configuration, This process is done automatically by the ipoibd service."
or do you just have to manually do the PIF but the VIF's are auto setup ?