Dell C6100 XS23-TY3 2U 4-Node (8 CPU) Cloud Server

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

PimpSmurf

New Member
Aug 4, 2013
23
0
0
Did you flash the Fan Controller with 1.20? The server runs the fans much slower after the update.
It doesn't seem like it works on ubuntu 12.04 server. It keeps saying it can't find the command that I'm running (which is set +x) no idea what is going on. I think I might install centos 6 and try again! :)

EDIT: I was having trouble getting it to boot from a CentOS USBStick and it sat in the BIOS for ~5 minutes... The fans doubled in sound level. It was unbearable. I have no idea if I'm going to be able to box this up and still not hear it. I might have to build a new addition to the house.
 
Last edited:

BThunderW

Active Member
Jul 8, 2013
242
25
28
Canada, eh?
www.copyerror.com
Try from a bootable DOS USB stick.

It doesn't seem like it works on ubuntu 12.04 server. It keeps saying it can't find the command that I'm running (which is set +x) no idea what is going on. I think I might install centos 6 and try again! :)

EDIT: I was having trouble getting it to boot from a CentOS USBStick and it sat in the BIOS for ~5 minutes... The fans doubled in sound level. It was unbearable. I have no idea if I'm going to be able to box this up and still not hear it. I might have to build a new addition to the house.
 

PimpSmurf

New Member
Aug 4, 2013
23
0
0
Thanks for that.

My service tag doesn't work on Dell's site. My BMC version (on 1 node at least) says 1.04.

I guess I'm going to try to boot other nodes and see if they show a different BMC version (so maybe the fan upgrade will work there?)

The fan flash complains that I should use -f because a pin is shorted or something. -f didn't work, it just timed out.
 

Clownius

Member
Aug 5, 2013
85
0
6
It doesn't seem like it works on ubuntu 12.04 server. It keeps saying it can't find the command that I'm running (which is set +x) no idea what is going on. I think I might install centos 6 and try again! :)

EDIT: I was having trouble getting it to boot from a CentOS USBStick and it sat in the BIOS for ~5 minutes... The fans doubled in sound level. It was unbearable. I have no idea if I'm going to be able to box this up and still not hear it. I might have to build a new addition to the house.
One thing that will help a lot is check the cable management between the fans and the backplane for the drives. With good cable management i managed to get enough airflow that it rarely keeps spinning up to higher levels.
Also check the airflow generated b the fans i had one that spun just as fast as the other and made the same noise but was for some reason pushing very little air compared to the others. Since i replaced it my fans site a level lower than they used to at least.

P.S I had memtest running on this thing for over 11 hours (96GB on one node) the other day and its sitting within 10cm of my ear on top of a desktop tower while im working on it. So yes the thing is bloody loud but its much much better than when i got it. I used a genuine C6100 fan as a replacement.
 

pgh5278

Active Member
Oct 25, 2012
479
130
43
Australia
That's called hearing loss my friend! ;)
The old lady told her son that she wanted to see her Dr.
The son asked what were the symptoms, she replied, when I pass gas, they are silent and very deadly".
The son replied, perhaps we should visit the hearing specialist first!!
 

33_viper_33

Member
Aug 3, 2013
204
3
18
Has any one tried replacing one of these nodes with a more modern E5 setup? I understand they are completely differend platforms however, the origional motherboards are made by supermicro. I wonder if some of their "propritory" boards have the same dimensions to fit in the C6100 sleds. It would make for one really nice node for the main server with additional (origional) nodes for backup and testing. With the newer E5 technology, I would think a power savings would be possible as well.

-V
 

MiniKnight

Well-Known Member
Mar 30, 2012
3,073
974
113
NYC
Has any one tried replacing one of these nodes with a more modern E5 setup? I understand they are completely differend platforms however, the origional motherboards are made by supermicro. I wonder if some of their "propritory" boards have the same dimensions to fit in the C6100 sleds. It would make for one really nice node for the main server with additional (origional) nodes for backup and testing. With the newer E5 technology, I would think a power savings would be possible as well.

-V
The E5 one is the C6220. Any reason you wouldn't want the 6-core C6100 instead? Will save you thousands per 2U in up-front costs.
 

33_viper_33

Member
Aug 3, 2013
204
3
18
I mainly want to free up my only PCIe slot in my C6100. I'm currently using the raid daughter board for 6 HDDs and a 10GbE NIC in the PCIe slot. I would like to add an external SAS card to the server and expand my array into a Norco 3u 16 bay case (RPC3116 I think is the model). A simple sas expander made by chenbro I think would do the trick for to convert the case. Additionally, I would love to have IB or FC available for the other nodes in the C6100 and other servers in my rack (mainly the backup server) as a cheep network solution. I prefer 10GbE due to the simplicity of running CAT 6 to my various computers. Admittedly, I have not played with IB or FC to date and am slightly intimidated by it. I think I may give the advice a try from this thread. http://forums.servethehome.com/netw...et-10gbe-networking-nics-switches-etc-13.html

Power consumption heat and noise is a concern for me. I purchased the C6100 for home lab purposes to test theories in preparation to build a new server. If I can quiet and put my C6100 on a bit of a diet with a newer technology (its past time for me to upgrade my server anyway), it may be a viable solution. What I save on new PSU, Case, 10GbE NICs, etc. can be put into motherboard, processor, and ram.

Ultimate goal is to have a "relatively" low power server that is my router, small switch for main computers (1-2 x 4 port NICs), domain controller, primary storage with an additional 2 SSDs for SAN boot drives. This may be a bit too ambitious with the physical constraints of the C6100 and its lack of PCIe ports even with a new motherboard. But it is a possibility.

-V
 

Clownius

Member
Aug 5, 2013
85
0
6
The E5 one is the C6220. Any reason you wouldn't want the 6-core C6100 instead? Will save you thousands per 2U in up-front costs.
I was thinking the same thing for the future. Can i swap out a dead node with something newer. If anyone knows it would be nice to hear from them.

Looking at the motherboard if you can get a matching power connector it looks possible. Maybe.

Its not an immediate thing in any case this C6100 will be replacing a single server. It may be an E5 with 32GB RAM its replacing but i think the fact we have 4 to specialise in tasks will more than make up for the loss in processing power on a node.

But we only have the E5 because we killed the old 5500 series Xeon setup we had before that. The C6100 was still a basic package that needed a lot of work before it could go into use so we got the E5. I expect something to go on a second hand server if we work it hard enough. Be nice to know if we can buy something a bit more modern as a replacement or if we need to hunt down more second hand gear exactly the same specs.

That's called hearing loss my friend! ;)
Maybe its hard to tell. I work in a loud environment and have a very loud car stereo. The question is what ruins my hearing first not if i will ruin it......
 
Last edited:

dba

Moderator
Feb 20, 2012
1,477
184
63
San Francisco Bay Area, California, USA
I was thinking the same thing for the future. Can i swap out a dead node with something newer. If anyone knows it would be nice to hear from them...
I was thinking along the same lines. Unfortunately, the c6220 sleds are not at all compatible with the c6100 since they have different dimensions and use very different connectors. Even if the dimensions and connectors had matched, the pinout would have to be identical as well, and further the c6220 sled would have to be capable of properly talking to the c6100 fan control board, etc.
 
Last edited:

Patrick

Administrator
Staff member
Dec 21, 2010
12,519
5,826
113
I was thinking along the same lines. Unfortunately, the c6220 sleds are not at all compatible with the c6100 since they use very different connectors.
I still have not tried a C6220 sled, but I sense this is correct. One example is simply if you look at how the sleds connect into the chassis. In the C6100 there is a small piece of PCB that routes SATA and power into a slot type connector. In the C6220 this appears to be integrated on the motherboard and a different type of chassis connector is used.
 

Clownius

Member
Aug 5, 2013
85
0
6
Well that answers that question then. No C6220 nodes. So the only real upgrade would be Faster processors and more RAM.

Havent seen much on the C6220 before.

Edit: Downloading the manual now out of interest
 
Last edited:

33_viper_33

Member
Aug 3, 2013
204
3
18
That's called hearing loss my friend.

Maybe its hard to tell. I work in a loud environment and have a very loud car stereo. The question is what ruins my hearing first not if i will ruin it......
I understand hearing loss to well. Helicopter pilot... Whats that you say, I couldn't hear you.:rolleyes:

Still, its LOUD! I need to try some of the fan mods from the other thread.

-V
 

dba

Moderator
Feb 20, 2012
1,477
184
63
San Francisco Bay Area, California, USA
Well that answers that question then. No C6220 nodes. So the only real upgrade would be Faster processors and more RAM.

Havent seen much on the C6220 before.
The c6220 is a nice upgrade from the c6100 if you need lots more CPU power and/or PCIe3. One other nice feature of the c6220 is a "programmable" disk backplane. You can use a UI to assign drives in the backplane to nodes in the server. Want ten of the twelve drives assigned to node four? Done! The problem with the c6220 is that it has a very high ratio of CPU power to IO capability. This limits its usefulness greatly - not a huge problem for HPC but not so appealing as a database server or even a VM host.

If you want the power of the c6220 but at a lower price, check out the Intel H2312WPJR. The specifications are very similar to the c6220 but the Intel version is likely to be less expensive since they just stopped selling them (but still support them).
 
Last edited:

PimpSmurf

New Member
Aug 4, 2013
23
0
0
I'm a recovering automobile racer. I had a 3" side exit on a car with zero interior/insulation that I drove every day. I regret every mile traveled.

I have found musician's ear plugs can be very comfortable and allow for easily hearing people talk in noisy environments. A lot of them have valves that seal only on the heavy pulses which prevents a lot of the temporary deafness. I really like them for guitar playing (Oh yeah, I used to play metal guitar with no protection as well.)

I went to Lowes today and just price shopped some gear to build an enclosure. It seems pretty easy, however sourcing exhaust fans that are quiet as well as move enough air is going to be tricky. I also need to find some less expensive sound deadening foam to use in the box, especially in the inlet/outlet ducts.
 

33_viper_33

Member
Aug 3, 2013
204
3
18
How is the compatibility of the 10GbE daughter card with other devices for the C6100? Please forgive my ignorance with FC and IB. I haven't had a chance to play with them much and when I did, it was just from switch to like switch. Compatibility wasn't something I've paid attention to in the past. I posed these questions in the 10GB forum and haven’t received a reply yet. It was in reference mainly to the OneConnect FC Cards.

"How do these FC and IB cards interact with ESXi? Does ESXi see them as a NIC or a storage controller? Is there a way to attach them to the Vswitch?"

EDIT: Found the answer. RTFM! "When such adapter is installed, your host detects and can use both CNA components. In the vSphere Client, the networking component appears as a standard network adapter (vmnic) and the Fibre Channel component as a FCoE adapter (vmhba). You do not need to configure the hardware FCoE adapter to be able to use it."

An additional question is, are they compatible with the C6100's FC daughter card? A better question may be; are the protocols and hardware standardized across the industry? If ESXi will attach them to the Vswitch, then this would give me 10GbE W/O sucking up my only PCIe slot.

As cool as IB sounds just because of 40Gb/s, it also sounds like a PITA with driver support and compatibility between brands. Further, 40Gb/s is still a bit expensive. My concerns and ignorance remains the same with FC. Any thoughts?
These C6100s have so much potential. However, the limited on board expandability keeps kicking me in the rear.


Sorry for the tangent all. Pimp smirf,

I'm not sure what your end state is however; why not buy a used rack. They are plentiful if you watch craigslist. I picked up a full size for $125 that’s in good shape about a year ago. The smaller (half or quarter racks) are more expensive due to supply and demand, $200-400.

If you are looking for a piece of furniture, your only bet is to build. One of my next major projects is an entertainment center to rackmount my UPS, AMPs, processer, and media PC to sit nicely under my screen. If you are looking to silence servers like the C6100, building will likely be a better bet. Although my rack helps with noise, it’s not a large improvement. I've been putting off installing sound insulation in my rack which would likely help. Still, there are too many holes and vents that are not baffled to muffle the noise. Further, if I close my eyes, the 3 x 120mm AC fans on top makes me think I'm on a flight line next to a Blackhawk or Chinook. I don't run those fans at all since my rack isn't that dense with always on heat producing equipment.

Another idea, since I move every 2-4 years and generally build new houses; my next house will utilize earth tubes to pump air in and out of the ground around the foundation of the house. This will utilize a simple fan to move air in and out of my rack through PVC pipe to utilize the cool ground as a heat sink. Think of it as a poor man's AC.
 
Last edited: