Well, here is some good news.
I took one of the Vm servers off the network, connected it to the IB switch using the CX4 cable and now i can ping 192.168.2.9 but when i try to ssh to it, i get nothing in return (destination host unreachable). But in order for me to ping it i have to specify an interface (ib1) to use for ping. Not sure how to do this with ssh, so im going to have to look at the routing table now.