I've tried Proxmox 4.2 (Debian), and Ubuntu 14.04 and 16.04. Downloading Windows Server 2016 eval to try that.
Mine arrived today - given that my E5-2670 V1's haven't arrived yet, I won't be able to contribute to the conversation much.
Regarding the fanspeed issue - if it's anything like the Dell C1100's - it's equal parts BIOS and host OS. Off the shelf ESXi on the C1100 resulted in the fans spontaneously jumping to maximum RPMs for a short period and slowly throttling down. Made for a very jarring and disruptive environment.
What host OS are you running where you experience such high fan noise?