Long story short, I have migrated the network configuration of a couple of hosts we have to dvSwitches. That seemed to go fine. Now however we are looking to implement network I/O control. I have enabled network I/O control and defined user defined network resource pools. I then create new dvPort groups and associate each of the resource pools to the newly created dvPorts. Finally I move 1 of the VM's from the existing default dvPort group that we created that every VM resides in on this host to one of the new dvPort groups with I/O control enabled. Once moved the VM is able to communicate across the network fine however it no longer can communicate to the default gateway.
I'm left scratching my head. Anyone have any idea's? We are not using any type of VLANID's. The two hosts are connected to a single simple switch.
Its just a play environment and its really not that complicated of a design. I don't get how the VM's can communicate to other things with in the same subnet (even machines not on the ESX host) but when it comes to trying to get to the gateway and beyond it simply doesnt.
If you move the VM back to the original dvPort group all network communication picks back up.