you have a 580 and a 585? Sick.
The problem I find is the intel only has 2 pci-e bus and for that I could just get a dl380p gen8 or ml370
Can you fit a few quadro 6000 in those big 5 series? like a video card (quadro 6000) and a pair of tesla cards? I want to try out VDI but the GRID K1[vgx] cards cost a lot more than say a hacked GTX480 or a quadro/tesla [api-intercept/pass-through].
Mellanox-3 is the only card that Tesla can do GPUDIRECT bus-master mode where the gpu poops the datastream direct to the nic I'm guessing for HPC applications but could also be used to rapidly do VDI. 10gbe full duplex might be near pci-e x2 which is fine for business 3D, 40-56gbe would be fast enough to handle more than 1 video card in theory.
I
had a DL580 G7, but while I loved having 64 DIMM slots and getting Xeon x7560 ES CPUs for the price of gumballs, the IO on the thing was just miserable. It had 11 PCIe slots, but only two IO chips. Just four of the PCIe slots were x8 and none were x16 plus it had only two IO chips. I sold it.
My DL585 G7, on the other hand, has the same eleven PCIe slots, but there are four IO chips and ALL slots are wide - seven are x8 and four are x16. Much better for my needs.
Both DLs have a cool feature - built in support for four 225watt GPUs or three 300W GPUs!
Now the Xeon E5 series of CPUs blows the doors off of the AMD 6xxx IO advantage and even matches the AMD memory bandwidth, while of course having far more CPU grunt. Once the prices get reasonable, a quad Xeon E5-46xx is my next database, either HP DL560 G8 or something like this
Supermicro.