Do you have subnet manager running on the network? This is required for an IB fabric to work. Since the switch you are using is unmanaged, this has to be run on a host machine.
ibv_devinfo will confirm if these hosts have addresses assigned which in turn will indicate SM availability.