Hello nightmare (but thanks for creative suggestion)...went down this path...won't re-live it...get a 'proper switch' and be done w/ it! Here ye here ye who agrees? Bet I get a few votes :-DHow many servers other servers?
if ONLY 3 servers then directly connect w/o switch (see below)
big team of 1gb ports 2 x 4 port carts = $100
switch with more 10gb ports under $800
or
this card on ebay could allow you to have point to point access 671798-001 666172-001 HP 10GB MELLANOX CONNECTX-2 PCIe 10GBe ETHERNET NIC
then you set up one with a VM + routing
$100