You have to populate both CPUs to use all 12 DIMM slots in a node. With only one CPU you can only use 6 DIMMs.So how much ram do these take?
Are we talking about maximum configuration 12*16gb per node?
Did you try this? I'm wondering how it worked out for you.Been digging around in the past 2 days looking for ways to fit some extra SSDs inside each node in the Dell C6100, so far there seems to be 2 viable solutions.
Although these cards only allow you to add 1 mSATA SSD inside each node (I was looking for a way to add 3 SSDs), at least now your 3 mechanical disks under ZFS won't choke when your DB write heavily into it, and you can now sleep better at night knowing a 3-way ZFS mirror is better than a 2-way.
Koutech IO-PESA238 PCI-Express 2.0 x1 Low Profile Ready SATA III (6.0Gb/s) Dual Channel Controller Card with HybridDrive Support (1 x Int+1 x mSATA)
NeweggBusiness - Koutech IO-PESA238 PCI-Express 2.0 x1 Low Profile Ready SATA III (6.0Gb/s) Dual Channel Controller Card with HybridDrive Support (1 x Int+1 x mSATA)
Two 6.0Gbps SATA III channels
One (1) internal 7-pin SATA III connector
One (1) internal mSATA (mini PCIe) socket
Supports all mSATA (mini-SATA) SSD devices at 1.5/3.0/6.0 Gbps
Compliant with 5Gb/s PCI Express 2.0 specifications
Transfer Rate up to 5Gb/s
OWC Mercury AccelsiorM mSATA PCIe Controller
http://eshop.macsales.com/item/Other World Computing/PCIEACCELM
AHCI compliant (no drivers required)
Mac and PC-bootable
Sustained Reads (up to)380MB/s
Sustained Writes (up to) 380MB/s
3 Year OWC Warranty
I am going to try the Koutech IO-PESA238 as it appears to have a much higher throughput, supposedly it is designed to turn a normal HDD into a SSD hybrid, but someone on newegg said they booted into Windows on a mSATA using it so I am going to assume it'll work as a stand alone drive.
That looks very reasonable. I may get 1-2 to play around with.I think if I were going to do it again I would use something like this for mSATA: Amazon.com: MP3S (mSATA to SATA Adapter for PCIe Slot): Computers & Accessories. These just use the PCIe slot to power the mSATA card. Then you use a short SATA cable to wire it over to an on-board SATA port. You'll avoid any driver issues as every OS in the world understands Intel on-board SATA. You won't get SATA-III speeds but in fact the Koutech card is "SATA-III in name only" anyway.
Assume a 500W (about 50% of the power supply capacity) load, 24/7.Quick question.
If I were to run this C6100 24/7, how much might that cost in electricity per month?
Granted this answer is going to vary depending on your location and the local costs of whatever. However, if you were to give me a price and what city you live in, I should be able to get a pretty good idea of what it might run my bill up to should I leave it on all the time.
You have to populate both CPUs to use all 12 DIMM slots in a node. With only one CPU you can only use 6 DIMMs.
Max is 12x 8gb per node when using X55xx or L55xx CPUs.
Max is 12x 16gb per node when using X56xx or L56xx CPUs.
If you use more than 3 DIMMs/CPU and the DIMMs are quad-rank (most RDIMMs are) then memory speed will be reduced to DDR3-800. Some people have reported that using Dual-Rank RDIMMs avoids this speed downgrade, but dual-rank are hard to find at higher capacities. In most cases, for most workloads, there is little impact from this because the lower CAS latency of most DIMMS offsets the lower speed for random accesses. But for synthetic benchmarks and some memory-pump workloads (gaming, rendering, ray-tracing, etc.) the lower speed may be noticeable.
Generally I'm just using one SSD per node. Backup nodes get a 3TB WD Red just to archive off of. Also remember that the SATA ports are driven off of the ICH10R so you get 6 SATA II ports with a maximum of 650-660MB/s. You can use a PCIe controller for more disk performance though.Thanks for an excellent reply, looks like I have to pick up one or a dozen of those for a kvm/openstack cluster.
What kind of disks are you guys running on your setups? I can imagine the 7200rpm satas would be a big bottleneck.
Should the ICH10R chipset be able to detect and use SAS drives? I'm having a weird issue where I can slot a SATA drive in and it detects just fine, but when I swap it out to a 10k SAS drive I get nothing. I can move the SAS drives over to a LSI 9211i and it has no problems, just the on board ports don't detect the drives.