Supermicro SC-846E1 Build Log

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
I am building this actually as an additional shared storage (backup) server for the colocation. The server was purchased as part of the deal thread.

Starting a build log here.

Build Purpose Backup target
OS Ubuntu 14.04 LTS Server

Hardware
  • 24 bay Supermicro 846E1 chassis (includes an E1 6.0gbps expander)
  • Supermicro AOC-USAS2-L8i (UIO controller)
  • Supermicro X9DRL-iF
  • Redundant 1200w PSUs
  • 16GB 4x 4GB DDR3 DIMMs
  • Intel Xeon E5-2603 x1

Drives
  • 4x 4TB WD SAS
  • 4x 200GB SLC SAS SSD
  • Other

Initial boot noise: 59.4dba
No drive power consumption: TBD
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
As I try things out, I wanted to keep a log of what did not work:
  • Swapping PSUs for 1.4kw Supermicro 80Plus Gold versions - These did not lock in place and therefore did not power on system. Very strange.
  • I tried using an Intel Xeon E5-2630L V2 ES - this did not work at first. Required a V1 processor to flash to latest BIOS. The chips are QF8D.
  • All 4 DIMMs CPU1 populaed = stuck at B7 post code. It did work with all 16 DIMMs I tried in pairs of 2.
 
Last edited:

PigLover

Moderator
Jan 26, 2011
3,184
1,545
113
What BIOS rev did the board have on it? Mine had 1.0 when I powered it up. You need to have 3.0 or above for v2 CPUs (current is 3.0a).

When you update it pay close attention to the instructions. You have to update the IPMI to 2.x first or you'll brick the board. When you flash the BIOS you have to pull the jumpers to disable the management engine (JPME1 and JPME2) or the BIOS update won't take.

I'm surprised at the 59.4dba noise levels. I don't have a meter and its in rack with other noisy stuff but mine doesn't seen to be anywhere near that loud.
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
OK it does appear as though the memory issue is related to the DIMM slot closest to the CPU and atop the heatsink. DIMMs in the 3 other slots work fine.
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
I'm surprised at the 59.4dba noise levels. I don't have a meter and its in rack with other noisy stuff but mine doesn't seen to be anywhere near that loud.
Sitting at 54.5dba now trying to boot. Thanks for the info on the BIOS boot. I wonder if it is worth the effort.
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
The wife is working on the Linux-Bench RESTful API next to me. She just looked at me and said: "Why would you flash the BIOS of the board that is not working? Why not just return it if there is a hardware issue?"

Excellent point I must admit. I sent a note to the seller. The big question is: if it cannot be fixed, does it become an 8GB config? stay at 12GB? or do I try a motherboard swap?
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
Patrick, you have a good woman!

Mine, :"Let's go over last month's spending..."
I do!

... and let me help you with that one: "Yes but look at how many ebay bucks I earned." and "of course I spent that much. I need for STH and much of it will get resold after I no longer need it."

I actually end up a bit better than even money on the used stuff I buy for the site on the deals posted here minus what I actually end up using/ keeping. Luckily in Mountain View, CA not enough room to allow IT to accumulate.
 

PigLover

Moderator
Jan 26, 2011
3,184
1,545
113
OK it does appear as though the memory issue is related to the DIMM slot closest to the CPU and atop the heatsink. DIMMs in the 3 other slots work fine.
Before you give up on the board - pull the CPU and give the socket pins a close inspection with a good magnifier or jewelers lupe. I had exactly this same problem on used socket-2011 boards and its almost always a pin or two misaligned/shorted on on the CPU socket. You can almost always fix them by gently pushing them back in place with a toothpick or coffee stirrer. Its easier than R&Ring the board, especially when the reseller has sold out.
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
Updated IPMI firmware and BIOS. QF8D works. Also, I added in the 4th DIMM and that works now!?! I visually inspected the socket but did not see anything wrong. Very strange indeed. I may try some of the other V2's tomorrow. Then it is time for Mellanox FDR and to move the AOC to a PCIe 3.0 slot.
 
  • Like
Reactions: TD_Trader

MikeC

Member
Apr 27, 2013
59
11
8
UK
As I try things out, I wanted to keep a log of what did not work:
  • Swapping PSUs for 1.4kw Supermicro 80Plus Gold versions - These did not lock in place and therefore did not power on system. Very strange.
  • I tried using an Intel Xeon E5-2630L V2 ES - this did not work. QF8D - will try after new bios.
  • All 4 DIMMs CPU1 populaed = stuck at B7 post code. It did work with all 16 DIMMs I tried in pairs of 2.
With regards to the 1.4kw psu's - check the width of the PCB connector - I suspect that the 1.4kw is wider than the 1200w ones. I've been caught in a similar situation!
 
  • Like
Reactions: Chuntzu and Patrick

Jeggs101

Well-Known Member
Dec 29, 2010
1,529
241
63
Linux-Bench plz.

Did ya get a chance to see if the E5-2603 works with the 4 dimms? I'm wondering if the CPU isn't bad now.
 

PigLover

Moderator
Jan 26, 2011
3,184
1,545
113
Also, I added in the 4th DIMM and that works now!?!
You should still give the socket pins a close inspection. If a couple of them are off a small bit then you probably cleared it by seating a new CPU. But it may come back when you change out to another.
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
You should still give the socket pins a close inspection. If a couple of them are off a small bit then you probably cleared it by seating a new CPU. But it may come back when you change out to another.
This will certainly get tested. I am actually more worried that it will happen during shipping to the DC.

@MikeC thank you for the idea. I will investigate.
 
  • Like
Reactions: PigLover

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
I do not think that I will be running this configuration too long but I will post some benchmarks:
1x Intel Xeon E5-2630L V2 - 58051415153038
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,511
5,792
113
With regards to the 1.4kw psu's - check the width of the PCB connector - I suspect that the 1.4kw is wider than the 1200w ones. I've been caught in a similar situation!
Spot on! These have the PCB that is more narrow. The 1.4kw and the 1280w-SQ are both the wider PCB.