Gigabyte MJ11-EC1 EPYC 3151 Mystery

[s0lid]

This are dual rank modules I would like to see if there will be ECC errors using all 4 slots on this motherboard...

Seems to work fine for me.

 

[Andiii]

Install 2 rams in the blue Slots , Set these Settings i posted here and then Install the other 2 RAMs. This worked for me. I am using 4 dual rank RAMs now. (2x Kingston and 2x Micron)

 

[Yababakets]

NO !!
See here [Link] for the correct Ceacent adapter (and the reasons why).

I've tried the Ceacent CNS41CX16I with a RTX A400 works out of the box.

 

[Vanetta]

Took some time to test this, but the following results are observed:
Card DOESN'T work from SlimSAS-4i port with SlimSAS-4i to SAS-8087 cable (tested with F02 and F09 BIOS)
Card does work when inserted into M.2 slot as it was designed. It is genuine X520 with ASPM and no weird dmesg errors

Also tested cheap M.2 to PCIe x4 adapter ($5) which works with throughs lots of dmesg errors and no ASPM

Could this be related to the direction on the cable? This card would fit perfectly in my 1u servers, thinking right now if I can skip the m.2 slot for boot os

 

[insurgensy]

Could this be related to the direction on the cable? This card would fit perfectly in my 1u servers, thinking right now if I can skip the m.2 slot for boot os

Might be something with cable, unfortunately I sold all the boards recently and got none left for further testing.
Above linked card does however work nicely in M.2 and fits standard 1U without any fiddling

 

[Vanetta]

Might be something with cable, unfortunately I sold all the boards recently and got none left for further testing.
Above linked card does however work nicely in M.2 and fits standard 1U without any fiddling

Ahh, I have order one card now to test with some cable, will report back once it arrives and then link the products tested

 

[Bingo600]

I'm quite new to BMC/IPMI etc ...
And i have no idea what Redfish is ....

But this doesn't look good ... I think'
I'm running BMC FW : 12.61.21 , the latest i could find in this thread.

AMI BMC Vuln - Score = 10

CVE-2024-54085 : AMI’s SPx contains a vulnerability in the BMC where an Attacker may bypass aut

CVE-2024-54085 : AMI’s SPx contains a vulnerability in the BMC where an Attacker may bypass authentication remotely through the Redfish Host Interface. A successful

www.cvedetails.com

NVD - CVE-2024-54085

nvd.nist.gov

I have no idea where to get (DL) a new BMC package.
If you have access to that please point at DL URL here too.

TIA
Bingo

 

[ericloewe]

I'm quite new to BMC/IPMI etc ...
And i have no idea what Redfish is ....

But this doesn't look good ... I think'
I'm running BMC FW : 12.61.21 , the latest i could find in this thread.

AMI BMC Vuln - Score = 10

CVE-2024-54085 : AMI’s SPx contains a vulnerability in the BMC where an Attacker may bypass aut

CVE-2024-54085 : AMI’s SPx contains a vulnerability in the BMC where an Attacker may bypass authentication remotely through the Redfish Host Interface. A successful

www.cvedetails.com

NVD - CVE-2024-54085

nvd.nist.gov

I have no idea where to get (DL) a new BMC package.
If you have access to that please point at DL URL here too.

TIA
Bingo

Since you should never, ever, ever, in a million years, if your life depended on it, even consider exposing a BMC to the internet, this is not super concerning.

 

[_Dejan_]

For MC12-LE0 Gigabyte release BMC update 12.61.35 . Can same image be used also on MJ11 board?

Main problem for BMC vulnerability is that default setting for network is shared and not dedicated... So this is first option which user need to maketo seperate BMC from LAN port...

 

[_Dejan_]

I have one question... What is power limit on System FAN 1 & 2 ports? I would like connect 2 input fans by spliter to sys fan1 port and 2 output fans to sys fan 2 ports and control them by IPMI logic...

Fans spec say operating voltage 5 - 13.2V Input&Safety current 0.2A, Input Power 2,4W....

Can each fan output handle 5W if there will be need for 100% fan speed?

So cpu 2,4W, sys1 5w, sys2 5W?

Or I need power them over molex and send only pwm signals from board and rpm(from one fan) to board?

 

[Vanetta]

I have one question... What is power limit on System FAN 1 & 2 ports? I would like connect 2 input fans by spliter to sys fan1 port and 2 output fans to sys fan 2 ports and control them by IPMI logic...

Fans spec say operating voltage 5 - 13.2V Input&Safety current 0.2A, Input Power 2,4W....

Can each fan output handle 5W if there will be need for 100% fan speed?

So cpu 2,4W, sys1 5w, sys2 5W?

Or I need power them over molex and send only pwm signals from board and rpm(from one fan) to board?

I have used 3x of these, one on each connector and they work, but the longest I have boards powered on is around 1h

https://www.aliexpress.com/item/32274315691.html?spm=a2g0o.order_list.order_list_main.5.30c41802cfxiWe

I have a weird issue were the m.2 doesn't work, havent been able to debug it alot either, someone with the same issue?

 

[_Dejan_]

I have used 3x of these, one on each connector and they work, but the longest I have boards powered on is around 1h

https://www.aliexpress.com/item/32274315691.html?spm=a2g0o.order_list.order_list_main.5.30c41802cfxiWe

I have a weird issue were the m.2 doesn't work, havent been able to debug it alot either, someone with the same issue?

Ok, my both vents will draw max 0,4A usually PWM ports on motherboards allow around 1A but because there is no info in manual and this board is in many things different as usual boards I’m asking here if someone have info or run it long term with vents with higher power consumptions…

I’m test 2 boards and both work normally with Optane 16GB M.2 drive as boot drive(One board Proxmox and another TrueNAS) I didn’t try 3rd board but I assume it will work normally…

 

[Vanetta]

I tested a bit, nothing will be detected in the M.2 slot, both via BIOS and a linux distro. Tested on other pc and works flawless, weird is that i have the same issue on both off my boards right now, the third got RMA because it got damaged in shipping. Wonder if there is damage to these that I can't see

 

[binarycodes]

Run into the same problem.
Got it fixed after a rat hole of ipmiutil jtag and dip switches.
It got it fixed pretty simple: Flash a new BMC Version via Linux, Windows, or UEFI Shell.
I used this firmware: https://download.gigabyte.com/FileList/Firmware/server_firmware_ast2500_AMI_12.x.zip
Prepare a FAT32 USB Stick, copy the unpacked zip onto it, boot into uefi shell, follow the guide and do not preserve the settings.
After that got finally access to the megarack sp-x webui.
Hope it helps!

Thank you so much for this. I ran into the same thing today. Enabled the one touch firewall and boom no web ui.
Tried a bunch of stuff with ipmitool but at the end had to flash the firmware following your steps. And it works fine with the updated BMC version.

 

[Kozhuharov]

Do any of you managed to fix the dropping off NICs from the PCIe bus?

 

[_Dejan_]

Do any of you managed to fix the dropping off NICs from the PCIe bus?

Can you please explain what exactly is issue and how you can reproduce it?
I have issues with NIC's after running iperf3 test on modified BIOS from german forum and on MJ11-EC0 F02 BIOS but on stock MJ11-EC1 I don't have issues after running iperf3 for more than day... On modified BIOS and EC0 bios NIC stop working and board reboot after 1-2 running iperf3 ...

 

[etorix]

My MJ11-EC1 (native BIOS) was working for some time as a test NAS. It didn't came back after a reboot this afternoon.
The console is spammed with errors from Intel NICs, both of them, and the NAS web interface is not reachable.

End of life?

Hope again: The initial failure was with TrueNAS 25.04.0. It equally failed, but with a different error message, using an old OMV boot drive. But my MJ11-EC1 is now back online and happy running TrueNAS CORE 13.3-U1.1. So maybe the issue is with Linux/Debian.
FreeBSD rules!

 

[_Dejan_]

Did you in TrueNAS set kernel options to disable pcie_aspm ? If not then this is reason why it do not work for you...
If you use onboard NIC's during installation then you need before you start installation in GRUB set kernel parameters pcie_aspm=off then you install TrueNAS. Then you after installation on first boot you need again edit GRUB and set pcie_aspm=off then it will boot into TrueNAS and then you need to make this persistent by running something like this:

midclt call system.advanced.update '{ "kernel_extra_options": "pcie_aspm=off" }'

Then it will after reboot keep pcie_aspm disabled and NIC's will work without issues...

 

[karmark]

There is no need to flash the F02 BIOS to change the sata/pcie selection. of SL_SAS. The menu item is present also in the F09 BIOS but it is hidden. It can be unhidden and a modified BIOS flashed, I have done so.
......

I drew some inspiration of the last sentence there and had a look at the IFR, which says that these options are suppressed if question 0x1A8 has the value 0x0:

Form FormId: 0x27D4, Title: "PCI Subsystem Settings"
                Text Prompt: "PCI Bus Driver Version", Help: "PCI, PCI-X and PCI Express Settings.", Text: "00.00"
                SuppressIf
                        EqIdVal QuestionId: 0x1A8, Value: 0x0
                        Subtitle Prompt: "", Help: "", Flags: 0x0
                        End
                        OneOf Prompt: "SL_SAS Control", Help: "Change SL_SAS function. SATA/PCIe x4", QuestionFlags: 0x10, QuestionId: 0xDA, VarStoreId: 0x1, VarOffset: 0x1FF, Flags: 0x10, Size: 8, Min: 0x0, Max: 0x3, Step: 0x0
                                Default DefaultId: 0x0 Value: 3
                                OneOfOption Option: "Disabled" Value: 0
                                OneOfOption Option: "SATA" Value: 3
                                OneOfOption Option: "PCIe x4" Value: 1
                        End
                End

..........

So, searching for the question with id 0x1A8 gives us:

Numeric Prompt: "", Help: "", QuestionFlags: 0x0, QuestionId: 0x1A8, VarStoreId: 0x1, VarOffset: 0x1C8, Flags: 0x10, Size: 8, Min: 0x0, Max: 0xFF, Step: 0x0

We can see that the VarStoreId is the same as for the SL_SAS setting. I wrote a 0x1 to that address (VarOffset) with the setup_var.efi tool @PeterF linked to:


Rebooting the computer and entering setup now gives me these settings:


I set this to PCIe x4, saved the settings and rebooted into EFI Shell again. Reading the 0x1FF variable, I can see that it has changed:



Sadly, so has the value on 0x1C8 so the setup options are once more gone. I guess a modified BIOS is the way to go.




Anyway, I still can't get my hot swap drive bay working (the one that came in the server, I bought the motherboard + the cage/caddys).
Does anyone else use this configuration? Or perhaps owns the whole G431-MM0 server?
I'm not 100% sure that I did the power cable correctly as I have no life out of it whatsoever, but I've double checked against the SATA connector on the backplane (3.3V, 5V, 12V plus GNDs) and they're good.

I don't know if there's a setting I need to enable or if the BIOS assumes that this device is not connected on the motherboard itself? Does anyone know how it is on the complete unit?

I may flash the F02 bios and see if that makes any difference.

 

[erich.hai]

i buy a MJ11-EC1 with 12.83.50 firmware without vga output wo can download the firmware? the 12.61.21 was the latest was work with vga output. thanks or what is the latest best firmware?