I would like to set up a server for AI/inference. Already have some GPUs. An RX580 and a P40. I couldn't get the P40 running in any of my other systems due to incompatibility. I will eventually get more GPU as my budget allows. They will be high vram GPUs like more P40s or 3090, etc.
I was set on the Supermicro H11SSL-i or even the V2 of that board, but I'm afraid that it wont' support resizable BAR like my other desktop boards and the P40 will not work. So what about a complete used server? Any recommends for something that will enable me to install at least 3 or 4 GPU? My budget is $1000 and quiet or lower(ish) power consumption would be a plus. No worries though, it's going into my garage. I will add at least 128 or 256 of ram and shoot for 16+ cores.
Saw some options like Poweredge R720 and ML 350 G9 but I'm not super up on the server space anymore. The last ones I had were DL380 G3.
Of course if I can just build off some motherboard within the same budget I will do that. Asking for your expert recommends.
I was set on the Supermicro H11SSL-i or even the V2 of that board, but I'm afraid that it wont' support resizable BAR like my other desktop boards and the P40 will not work. So what about a complete used server? Any recommends for something that will enable me to install at least 3 or 4 GPU? My budget is $1000 and quiet or lower(ish) power consumption would be a plus. No worries though, it's going into my garage. I will add at least 128 or 256 of ram and shoot for 16+ cores.
Saw some options like Poweredge R720 and ML 350 G9 but I'm not super up on the server space anymore. The last ones I had were DL380 G3.
Of course if I can just build off some motherboard within the same budget I will do that. Asking for your expert recommends.