Gigabyte MJ11-EC1 EPYC 3151 Mystery

[kedzior]

Hey, bought 3 G431-MM0 servers (natural habitat of MJ11-EC1), doing some modifications, so they can feed my OCP v1 GPU server's 3x80A power.

4x SXM2 V100 16GB, baby!

That means, I will not need the 10x PCIe Backplane boards.

If someone needs a CPBG8A0 Backplane board for 10x PCIe using the MJ11-EC1, let me know, I have 3 of them for sale, shipping worldwide.
50 eur+shipping/each (SAS cable not included, I'll still need that, cheaper then ebay.

If you really need it, I could give you the empty 4U server case (without HDD bay, PSUs) too, but that's heavy, so shipping would be very expensive.

I'm building something and I'm wondering if anyone connect this PCIe Backplane to normal ATX power supply direct ?

 

[Debtor8100]

I've managed to get myself quite locked out of my machine. My server running password manager had some trouble yesterday and as a result I lost my IPMI password and access to the host OS (TrueNAS).

I can still SSH to BMC. Is there any way to reset the IPMI interface password from there? Or is there any way to reset BMC to defaults on this board?

My only other option available seems to be to get VGA cable and adapter so that I can get video output from the VGA port, reset the TrueNAS password that way and then reset IPMI password through ipmitool inside TrueNAS.

E1: ... And the VGA does not work on my board. This is not a good situation.
E2: Phew, had one SSH Public key sent to server. Got access again!

 

[chobpt]

I got the full box with the 10x pcie and have been losing my mind on why it won't even one GPU. Any ideas?

- tried in F09 and F02
- Tried enabling SL_SAS to pcie, and change the different pcie modes
- updated BMC (pcie inventory shows no pcie devices)
-Booted windows and the Device manager didn't show anything, although it shows many pcie bridges
- power is connected to the board
- 3 psus are plugged, 1 orange (also tried with just 1 or just 2 psu)
- tried with both SMT, AER enabled and disabled
- tried a P40, a 2080ti, a 1060 and a sata controller

Getting desperate as I spent 300 on this apparent 4U paperweight

Thanks

 

[chobpt]

Has anyone successfully booted from a disk attached to the integrated SATA controller (SATA0-4)? The boot drive I carried over from my old system gets detected but never shows up in the boot options.

A bit late for the party but for reference, a workaround would be to use easy2boot to manually boot from the drive. Not elegant but good for emergencies

 

[bpop]

Hey all, have been trying to update to the latest BMC firmware (12.61.17 -> 12.61.39) from the BMC itself and it keeps failing verification constantly. I reckon it needs an intermediate set of versions. Anyone done this successfully or am I looking at having to use a different method?

 

[muha7a]

Hey all, have been trying to update to the latest BMC firmware (12.61.17 -> 12.61.39) from the BMC itself and it keeps failing verification constantly. I reckon it needs an intermediate set of versions. Anyone done this successfully or am I looking at having to use a different method?

Might be late, and not answering your question, I apologise for which. But imho it's rarely a good idea to update bios or bmc firmware unless there's a new feature you want to take advantage of, or something is genuinely not working. In my expirience it's more of a headache to upgrade, also the chance of something breaking is too high.
Maybe there is something going wrong with the extraction, or the file itself is corrupt. Also could try to Restore Factory Defaults your bmc and try the update then. But make sure you have a backup as well, you never know.
Anyway you shouldn't need any intermediate versions. this fimware should work:

MC12-LE0 (rev. 1.x) | Workstation Motherboard - GIGABYTE Germany

Single AMD Ryzen™ 5000/4000/3000 Series ProcessorsDual Channel UDIMM DDR4, 4 DIMMs2 x 1Gb/s LAN ports via Intel® I210-AT6 x SATA 6Gb/s ports1 x M.2 slot with PCIe Gen3 x1 inter...

www.gigabyte.com

Unzip the file and navigate to the folder "fw", then upload the file "rom.ima_enc" in IPMI under the point "Maintenance" -> "Firmware update".
You could also try to do it under linux, or windows I guess, should return more usefull logs.

EDIT: spelling

 

[Yellow]

Ah okay, i have had missed that Info. In the German forum they found this workaround, install 2 of your RAMs in the blue Slots. Set These settings :

AMD CBS -> UMC Common Options -> DDR4 Common Options -> Data Bus Configuration:
RTTnom 7
RTTwr Dynamic ODT off
RTTpark 2

~ >DRAM Timing Configuration:
Memory Clock Speed 1067MHz
Trcdrd 10h
Trcdwr 10h
Trp 10h
ProcODT 48 Ohm

Save and Install the other 2 RAMs.

Reporting happily that this setting works for me. Running 4x32G SK Hynix HMA84GR7MFR4N-UH (dual rank) without ECC errors.

Besides, i had to set the pcie_aspm=off as a bootable flag.

Can anyone point me to the german forum? I can't find it and i'd like to know as much as possible about this board.

Cheers!

 

[MSameer]

Can anyone point me to the german forum?

Gigabyte MJ11-EC1 NAS Server

Bei Ram-König werden gerade ITX Mainboard's mit AMD EPYC 3151 für 69€ Verschleudert. Das Mainboard kommt Inkl. dem ATX Adapter versandkostenfrei. Leider hat das Mainboard keinen PCI-e Slot dafür. Jedoch einen M2 Slot und bis zu 16 SATA Laufwerke passen an das Mainboard. Als Speicher wird u.a...

www.hardwareluxx.de

 

[dreunion61]

Reporting happily that this setting works for me. Running 4x32G SK Hynix HMA84GR7MFR4N-UH (dual rank) without ECC errors.

Besides, i had to set the pcie_aspm=off as a bootable flag.

Can anyone point me to the german forum? I can't find it and i'd like to know as much as possible about this board.

Cheers!

Why are you setting pcie_aspm=off ? Did you already disabled both onboard Intel NICs?

 

[Yellow]

Gigabyte MJ11-EC1 NAS Server

Bei Ram-König werden gerade ITX Mainboard's mit AMD EPYC 3151 für 69€ Verschleudert. Das Mainboard kommt Inkl. dem ATX Adapter versandkostenfrei. Leider hat das Mainboard keinen PCI-e Slot dafür. Jedoch einen M2 Slot und bis zu 16 SATA Laufwerke passen an das Mainboard. Als Speicher wird u.a...

www.hardwareluxx.de

Why are you setting pcie_aspm=off ? Did you already disabled both onboard Intel NICs?

I got these BadDLLP warnings (Correctable PCIe Bus Error) flooding my logs.

Disabling the onboard Intel NICs is something i will try out soon. Thanks for the suggestion!

 

[dreunion61]

@Yellow Normally disabling aspm doesn't fix it. Without an extra network card that board is essentially toast. And don't disable AER with something like pci=noaer. It doesn't solve anything. It just stops reporting the errors.

 

[bizotto]

Hi all, thanks for all the great info about this board!

I’ve gotten 3 of those and of course they did not behave the same from the beginning! To begin with, two of the boards did not POST with neither 1 nor 2 Samsung M393A4K40BB1 - CRC4Q 32GB RDIMMS in the blue slots. The third one POST without issues with 4 of those without having to change anything in BIOS.

What solved the 2 other boards issue, was to clear CMOS. After clearing it, the board POST directly with 4 DIMMS installed. I then adjusted ONLY the clock speed to 1067MHz just to be on the safe side.

I ran MemTest86 on all boards and no errors have been detected.

I have also updated the BMC to the latest 12.61.39 FW and everything kept working. I have shut the boards down for a couple of days now, so I wonder if they will POST directly or if I’ll have to do some magic there again.

question I have, do any of you see any downside in not setting the other values as suggested in the posts before?


AMD CBS -> UMC Common Options -> DDR4 Common Options -> Data Bus Configuration:
RTTnom 7
RTTwr Dynamic ODT off
RTTpark 2

~ >DRAM Timing Configuration:
Memory Clock Speed 1067MHz
Trcdrd 10h
Trcdwr 10h
Trp 10h
ProcODT 48 Ohm

Like I mentioned, the only change I did was to the Clock Speed to 1067MHz.


Thanks again and let’s hope I manage to make this board stable with 128gb memory and a 10gbps NIC!