I haven't tried the "options mlx4_core log_num_mgm_entry_size=-7" yet. However, I did upgrade my install OFED to 3.0-1.0.1 on all of my servers. No change.
In my initial post, I mentioned that this was happening on VMA and non-VMA servers but I think this is isolated to servers using VMA only. The tcp rx threads are fairly idle. Like poll% = 0. Not sure if that is causing the problem.
I'm going to add the "options mlx4_core log_num_mgm_entry_size=-7" tonight to see if that has an impact.
-- Bud