Supermicro SC-846E1 Build Log

Discussion in 'DIY Server and Workstation Builds' started by Patrick, Nov 3, 2014.

  1. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    I am building this actually as an additional shared storage (backup) server for the colocation. The server was purchased as part of the deal thread.

    Starting a build log here.

    Build Purpose Backup target
    OS Ubuntu 14.04 LTS Server

    Hardware
    • 24 bay Supermicro 846E1 chassis (includes an E1 6.0gbps expander)
    • Supermicro AOC-USAS2-L8i (UIO controller)
    • Supermicro X9DRL-iF
    • Redundant 1200w PSUs
    • 16GB 4x 4GB DDR3 DIMMs
    • Intel Xeon E5-2603 x1

    Drives
    • 4x 4TB WD SAS
    • 4x 200GB SLC SAS SSD
    • Other

    Initial boot noise: 59.4dba
    No drive power consumption: TBD
     
    #1
  2. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    As I try things out, I wanted to keep a log of what did not work:
    • Swapping PSUs for 1.4kw Supermicro 80Plus Gold versions - These did not lock in place and therefore did not power on system. Very strange.
    • I tried using an Intel Xeon E5-2630L V2 ES - this did not work at first. Required a V1 processor to flash to latest BIOS. The chips are QF8D.
    • All 4 DIMMs CPU1 populaed = stuck at B7 post code. It did work with all 16 DIMMs I tried in pairs of 2.
     
    #2
    Last edited: Nov 4, 2014
  3. Hank C

    Hank C Active Member

    Joined:
    Jun 16, 2014
    Messages:
    642
    Likes Received:
    66
    how about the 1.28k Platinum PSU?
     
    #3
  4. PigLover

    PigLover Moderator

    Joined:
    Jan 26, 2011
    Messages:
    2,771
    Likes Received:
    1,115
    What BIOS rev did the board have on it? Mine had 1.0 when I powered it up. You need to have 3.0 or above for v2 CPUs (current is 3.0a).

    When you update it pay close attention to the instructions. You have to update the IPMI to 2.x first or you'll brick the board. When you flash the BIOS you have to pull the jumpers to disable the management engine (JPME1 and JPME2) or the BIOS update won't take.

    I'm surprised at the 59.4dba noise levels. I don't have a meter and its in rack with other noisy stuff but mine doesn't seen to be anywhere near that loud.
     
    #4
  5. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    OK it does appear as though the memory issue is related to the DIMM slot closest to the CPU and atop the heatsink. DIMMs in the 3 other slots work fine.
     
    #5
  6. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    Sitting at 54.5dba now trying to boot. Thanks for the info on the BIOS boot. I wonder if it is worth the effort.
     
    #6
  7. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    The wife is working on the Linux-Bench RESTful API next to me. She just looked at me and said: "Why would you flash the BIOS of the board that is not working? Why not just return it if there is a hardware issue?"

    Excellent point I must admit. I sent a note to the seller. The big question is: if it cannot be fixed, does it become an 8GB config? stay at 12GB? or do I try a motherboard swap?
     
    #7
  8. markpower28

    markpower28 Active Member

    Joined:
    Apr 9, 2013
    Messages:
    393
    Likes Received:
    98
    Patrick, you have a good woman!

    Mine, :"Let's go over last month's spending..."
     
    #8
  9. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    I do!

    ... and let me help you with that one: "Yes but look at how many ebay bucks I earned." and "of course I spent that much. I need for STH and much of it will get resold after I no longer need it."

    I actually end up a bit better than even money on the used stuff I buy for the site on the deals posted here minus what I actually end up using/ keeping. Luckily in Mountain View, CA not enough room to allow IT to accumulate.
     
    #9
  10. markpower28

    markpower28 Active Member

    Joined:
    Apr 9, 2013
    Messages:
    393
    Likes Received:
    98
    :) Can't wait for Black Friday's sweet SSD deals!
     
    #10
  11. PigLover

    PigLover Moderator

    Joined:
    Jan 26, 2011
    Messages:
    2,771
    Likes Received:
    1,115
    Before you give up on the board - pull the CPU and give the socket pins a close inspection with a good magnifier or jewelers lupe. I had exactly this same problem on used socket-2011 boards and its almost always a pin or two misaligned/shorted on on the CPU socket. You can almost always fix them by gently pushing them back in place with a toothpick or coffee stirrer. Its easier than R&Ring the board, especially when the reseller has sold out.
     
    #11
  12. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    @PigLover - I do actually have a whole head mounted kit, lights and small picks just for rehabilitating sockets. I had to do this once on a G34 4P platform.

    I just did the IPMI firmware. Next is to update: https://forums.servethehome.com/pjk/STH_SMC_LSI_LiveCD_2014.iso with the BIOS so I can flash it. If I am going to spend the time looking at pins, may as well try the V2's also.
     
    #12
    Last edited: Nov 3, 2014
  13. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    Updated IPMI firmware and BIOS. QF8D works. Also, I added in the 4th DIMM and that works now!?! I visually inspected the socket but did not see anything wrong. Very strange indeed. I may try some of the other V2's tomorrow. Then it is time for Mellanox FDR and to move the AOC to a PCIe 3.0 slot.
     
    #13
    TD_Trader likes this.
  14. MikeC

    MikeC Member

    Joined:
    Apr 27, 2013
    Messages:
    59
    Likes Received:
    11
    With regards to the 1.4kw psu's - check the width of the PCB connector - I suspect that the 1.4kw is wider than the 1200w ones. I've been caught in a similar situation!
     
    #14
    Chuntzu and Patrick like this.
  15. Jeggs101

    Jeggs101 Well-Known Member

    Joined:
    Dec 29, 2010
    Messages:
    1,466
    Likes Received:
    216
    Linux-Bench plz.

    Did ya get a chance to see if the E5-2603 works with the 4 dimms? I'm wondering if the CPU isn't bad now.
     
    #15
  16. PigLover

    PigLover Moderator

    Joined:
    Jan 26, 2011
    Messages:
    2,771
    Likes Received:
    1,115
    You should still give the socket pins a close inspection. If a couple of them are off a small bit then you probably cleared it by seating a new CPU. But it may come back when you change out to another.
     
    #16
  17. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    This will certainly get tested. I am actually more worried that it will happen during shipping to the DC.

    @MikeC thank you for the idea. I will investigate.
     
    #17
    PigLover likes this.
  18. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    I do not think that I will be running this configuration too long but I will post some benchmarks:
    1x Intel Xeon E5-2630L V2 - 58051415153038
     
    #18
  19. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,545
    Likes Received:
    4,467
    Spot on! These have the PCB that is more narrow. The 1.4kw and the 1280w-SQ are both the wider PCB.
     
    #19
  20. Hank C

    Hank C Active Member

    Joined:
    Jun 16, 2014
    Messages:
    642
    Likes Received:
    66
    so dang...can't buy the 1280w-SQ one ...
     
    #20
Similar Threads: Supermicro SC-846E1
Forum Title Date
DIY Server and Workstation Builds supermicro e300-9d-8cn8tp Cooling options (homelab) Nov 5, 2019
DIY Server and Workstation Builds Supermicro X9SCM-F weirdness Oct 12, 2019
DIY Server and Workstation Builds Two Different E5-2600 CPUs Possible on the Same Supermicro Motherboard? Sep 29, 2019
DIY Server and Workstation Builds Inexpensive Tower Case for Supermicro X9DRi-LN4F Motherboard Sep 26, 2019
DIY Server and Workstation Builds Supermicro: Old Chassis + New(er) Motherboard Feb 28, 2019

Share This Page