Dell C6100 XS23-TY3 2U 4-Node (8 CPU) Cloud Server

Discussion in 'Processors and Motherboards' started by Patrick, Jan 19, 2013.

  1. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,666
    Likes Received:
    4,601
    Well elegant was going to be 2.5" adapters until I realized I purchased something with a similar layout to the above... when I got there.

    Velcro can be a bit tricky due to spacing.
     
    #101
  2. Dragon

    Dragon Banned

    Joined:
    Feb 12, 2013
    Messages:
    77
    Likes Received:
    0
    #102
  3. mulder

    mulder New Member

    Joined:
    Feb 9, 2013
    Messages:
    31
    Likes Received:
    0
    Hi Dragon,
    It looks like those HDD caddies are compatible with the Dell PowerEdge 700, 800, 1600, 1600SC, 1800, 1850, 2600, 2650, 2800, 2850, 3250, 6600, 6650, 6800, 6850, 7150 & PowerVault 220S, 221S, 220F, 650F, 660F searching by the part number. They won't fit into a C6100.

    Regards,
     
    #103
    Last edited: Feb 14, 2013
  4. cactus

    cactus Moderator

    Joined:
    Jan 25, 2011
    Messages:
    826
    Likes Received:
    76
    I have ICY DOCK MB882SP-1S-1B that I use for SSDs in 3.5 hot swap trays.
     
    #104
  5. Dragon

    Dragon Banned

    Joined:
    Feb 12, 2013
    Messages:
    77
    Likes Received:
    0
    Yeah someone from Dell decided it's a good idea to make the c6100 tray open to the left while almost every other Dell server in recent years open to the right. If the plastic doors on those cheap trays can be modified to fit upside down that'd be great.
     
    #105
  6. McKajVah

    McKajVah Member

    Joined:
    Nov 14, 2011
    Messages:
    46
    Likes Received:
    8
    This maybe a dumb question, but what kind of RAM does the C6100 take.

    I've found some crucial 4gb with the following specs.:

    Company Program: Crucial
    Configuration: 512Meg x 72
    DDR Timings: CL=9
    DIMM Type: Registered
    Density: 4GB
    Error Checking: ECC
    Megabytes: 4096
    Memory Type: DDR3 PC3-10600
    Module Rank: Dual Ranked
    Package: 240-pin DIMM
    Platform Category: DDR3
    Speed: DDR3-1333

    When I check the guide on Crucial's site, they are not compatible... WHY??
     
    #106
  7. dba

    dba Moderator

    Joined:
    Feb 20, 2012
    Messages:
    1,478
    Likes Received:
    181
    Notes that will be helpful for others working with Infiniband on the C6100, especially using Windows:

    I was unable to get the Infiniband cards to work properly on my C6100. Everything appeared to work, but the ports always showed as disconnected. Further, the card would suddenly cease to be a device for an hour or two. I did finally get it working, and here is how:

    1) Update the C6100 BIOS to 1.69 on each motherboard.
    2) Update the C6100 BMC Firware to 1.29 on each motherboard.
    3) Update the fan control board firmware to 118 once - fan board is shared across all motherboards.
    4) Install WinMFT 2.7.2 on each motherboard
    5) Download and extract new IB firmware to the WinMFT folder on each server. Resulting file is named fw-ConnectX2-rel-2_9_1000-059MP7.bin
    6) Re-flash the IB card by running the following from within the WinMFT folder: flint -d mt26428_pci_cr0 -i fw-ConnectX2-rel-2_9_1000-059MP7.bin burn
    7) Reboot
    8) Install Mellanox WinOF VPI IB driver software. I installed MLNX_VPI_WinOF-3_2_0_win7_x64.exe
    9) Reboot
     
    #107
  8. McKajVah

    McKajVah Member

    Joined:
    Nov 14, 2011
    Messages:
    46
    Likes Received:
    8
    Mulder: Did you manage to update the bios??

    I can see that "dba" managed to update his in the last post?

    Dba: Did you use the windows utility or Dos version when you upgraded the bios?
     
    #108
  9. dba

    dba Moderator

    Joined:
    Feb 20, 2012
    Messages:
    1,478
    Likes Received:
    181
    I used the Windows executable. It's automatic once you run it and takes about two minutes.

     
    #109
  10. dba

    dba Moderator

    Joined:
    Feb 20, 2012
    Messages:
    1,478
    Likes Received:
    181
    Infiniband update:

    Using IP over Infiniband on Win2008R2 with all default settings (no tuning) I get 1,960MB/Second throughput for reads and more IOPS than you can imagine. This is far short of what you'd get using a lightweight protocol, but i'ts fantastic considering how easy it is to utilize Infiniband when it's just emulating an Ethernet adapter.
     
    #110
  11. korban

    korban Member

    Joined:
    Feb 12, 2013
    Messages:
    33
    Likes Received:
    1
    Hi, have you an idea if the passthrough will work with esxi?
    With the price per node there is no more need to do a virtual San appliance... But always interesting to know :)
     
    #111
  12. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,666
    Likes Received:
    4,601
    It should. vt-d was in that generation Xeon devices.
     
    #112
  13. mulder

    mulder New Member

    Joined:
    Feb 9, 2013
    Messages:
    31
    Likes Received:
    0
    I sent my XS23-TY3 back Tuesday ordered one from another vendor who guaranteed the bios/ecm/bmc/fcb can be upgraded & will have it updated to the latest versions. Should have it by end of next week. Whoever Dell DCS built the server I just sent back wanted the bios locked down.

    Regards,
     
    #113
    Last edited: Feb 15, 2013
  14. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,666
    Likes Received:
    4,601
    Which vendors?
     
    #114
  15. mrkrad

    mrkrad Well-Known Member

    Joined:
    Oct 13, 2012
    Messages:
    1,244
    Likes Received:
    51
    Always use RDIMM - it protects the address and data lines, plus has far less load (more ranks usable). $65 for 8gb of RDIMM average going price. Remember that this gen of xeon will typcally drop to 800mhz ram at 3 dimms (if possible), and sometimes (HP does it) you can overclock the ram when 2DPC is used.

    There are two 5520 chipsets, the original one really buggy and you'd get random ecc errors if fully populated to 3DPC (aka 9 dimms per socket), so many folks just only allowed 6 dimms per socket. The early 5520 chipset also did not support the features of the 5600 series cpu's (AES/LV-dimm), so you'd boot up and see that your shiny 6-core has no AES support :( These were replaced for the most part since the early chip set had the buggy ram timing issues and most certainly wouldn't do 9 large dimms for 144gb (per socket!). This is important to remember! For example HP would under warranty, replace the motherboard for folks who complained and had the old chipset. Dell would spend hours diverting your attention because they didn't want to eat the cost and would ask you for proof of ownership,etc (pisses me off still).

    Check out MSA2312SA $499[ebay] - these can support 3gbps*4 links (4 of them) and 12 3.5" drives. ESXi supports scsi or ATS locking fine with them. Microsoft uses them for 4-way clusters in their stores. The newer model P2000 G3 ups the port count to 8 and 6gbps*4 (24gbps * 8).

    So yeah if you could rig up a MSA2312sa one SAS port to each node, the dual controller device would give you real san, fill her up with RE4 4TB SAS drives, no need for VSA. DAS baby DAS :) $499 - go check it out. expandable with more MSA70/60 boxes chained. Might not be super fast but 146gb SAS 15K drives are stupid cheap these days since nobody wants them. These are not JBOD, but true DUAL controller raid systems.
     
    #115
  16. mulder

    mulder New Member

    Joined:
    Feb 9, 2013
    Messages:
    31
    Likes Received:
    0
    Hi Patrick,
    Both servers are eBay items:
    Original server with the locked bios bought from MrRackables (a.k.a unixsurplus.com)
    New server bought from: pdneiman

    Regards,
     
    #116
  17. Toddh

    Toddh Member

    Joined:
    Jan 30, 2013
    Messages:
    119
    Likes Received:
    8
    I bought two of the C6100 from pdneiman and he was great. Really good communication and he made me a great deal on the infiniband ConnectX cards. HOWEVER looking for infiniband switch I had a long conversation with an eBay seller from Carlton Tx asking about all the stuff coming out of there. We got on the topic that I had just bought some C6100s and he said he had them too on ebay for only $899. Told him I never saw them??? Here is the link.

    http://www.ebay.com/itm/DELL-POWERE...123928?pt=COMP_EN_Servers&hash=item19d8e5d758

    So he has everything I need, barebones servers, ram, hd cages, the Infiniband switch and he made me a deal that was better than piecing everything together from separate vendors, one stop shopping.

    BTW - Dragon, VistaComputer has the hd trays for $15. You can also ask the above seller.


    .
     
    #117
  18. PigLover

    PigLover Moderator

    Joined:
    Jan 26, 2011
    Messages:
    2,804
    Likes Received:
    1,132
    Luckily (or not, if you really wanted a large memory config) the MB on the C6100 node only deploys 2 banks/CPU (6 RDIMM/CPU) so no matter which rev of the 5520 it is you don't tickle this bug.
     
    #118
  19. Jeggs101

    Jeggs101 Well-Known Member

    Joined:
    Dec 29, 2010
    Messages:
    1,474
    Likes Received:
    220
    Unixsurplus is way overpriced.

    That seller dropped prices $75. Used to be 975
     
    #119
  20. McKajVah

    McKajVah Member

    Joined:
    Nov 14, 2011
    Messages:
    46
    Likes Received:
    8
    Is it possible to check the version/rev. number of the 5520 chipset?
     
    #120
Similar Threads: Dell C6100
Forum Title Date
Processors and Motherboards Dell Xanadu C6100 XS23-SB Board Config Issues Jan 7, 2020
Processors and Motherboards Dell C6100 XS23-TY3 2U 4-Node (8 CPU) one node BMC works other 3 not so much. Oct 23, 2019
Processors and Motherboards Anyone still using Dell C6100? Sep 2, 2019
Processors and Motherboards Dell C6100 Remote Management Controller Certificate Jun 7, 2019
Processors and Motherboards Dell C6100 - Fans start out quiet, but over time grow louder May 19, 2019

Share This Page