I'm starting to build V3 of my Dirt Cheap Data Warehouse - a server designed for maximum throughput in a database application at minimum cost. Version 2 of the DCDW is a 48 core HP DL585 G7 capable of >18,000MB/s of throughput in a single SQL query, some 270 million rows per second. The goal for V3 is to exceed 25,000MB/s.
The specs:
Chassis: Supermicro SuperServer 4047R-7JRFT. This is a 4U chassis with 48 2.5" bays and a quad Xeon E5 motherboard with 10GbE and dual LSI 2308 chips built in. The expander-based backplanes will be replaced with non-expander backplanes.
CPUs: Quad Intel Xeon E5-4640 C1 stepping. These are 8 core CPUs. I hate paying Intel prices, even ES prices, but I need PCIe3.
Disk IO: 2x LSI 2308 chips built in, plus 4x LSI 2308-based PCIe3 internal port cards and 4x LSI 2308-based PCIe3 external-port cards.
Disks: 2.5" 128GB SSD drives. I'll start with 56 drives and expand to 80 drives to explore the limits of performance.
Networking: Gigabit Ethernet plus QDR Infiniband running IPoIB.
Measuring raw CPU horsepower, the Xeon E5s aren't much better than the quad 12-core AMD 6172 CPUs in DCDW (Dirt Cheap Data Warehouse) V2, and in fact have fewer total cores. In their favor, however, is their support for PCIe3 with its improved throughput and very low latency. On balance, this should improve query throughput considerably for most cases, though this will need to be verified.
With 10 PCIe3 disk controllers, this setup should be good for ~40GB/s of raw disk IO and - I hope - around 28GB/s of SQL query throughput.
The specs:
Chassis: Supermicro SuperServer 4047R-7JRFT. This is a 4U chassis with 48 2.5" bays and a quad Xeon E5 motherboard with 10GbE and dual LSI 2308 chips built in. The expander-based backplanes will be replaced with non-expander backplanes.
CPUs: Quad Intel Xeon E5-4640 C1 stepping. These are 8 core CPUs. I hate paying Intel prices, even ES prices, but I need PCIe3.
Disk IO: 2x LSI 2308 chips built in, plus 4x LSI 2308-based PCIe3 internal port cards and 4x LSI 2308-based PCIe3 external-port cards.
Disks: 2.5" 128GB SSD drives. I'll start with 56 drives and expand to 80 drives to explore the limits of performance.
Networking: Gigabit Ethernet plus QDR Infiniband running IPoIB.
Measuring raw CPU horsepower, the Xeon E5s aren't much better than the quad 12-core AMD 6172 CPUs in DCDW (Dirt Cheap Data Warehouse) V2, and in fact have fewer total cores. In their favor, however, is their support for PCIe3 with its improved throughput and very low latency. On balance, this should improve query throughput considerably for most cases, though this will need to be verified.
With 10 PCIe3 disk controllers, this setup should be good for ~40GB/s of raw disk IO and - I hope - around 28GB/s of SQL query throughput.
Last edited: