Hyve "S-SKUD 2" - 1U, 8x LFF SATA6, 2x LGA 3647 Skylake-SP, 2x PCIe x16, 2x OCP PCIe x8 w/2x 25Gbps Connectx-4 installed - $179 + Shipping

plessley

New Member
Dec 1, 2019
28
18
3
well... crud. I already ordered the proc, and I have spare ram on hand for testing. I have a heatsink assembly that should allow it, but yeah.. that bracket doesn't exist on these boards.

Also, trying to dig through the openbmc hyve specific in the vain hopes of getting the kvm working once more, but that looks like a lost cause. It hasn't been updated in forever, and looks like it only support the very bare minimum functions. There's another openbmc project that seems much more current, but of course no support at all for the hyve boards.

Reconciling all of that is going to be a lot of work, even if it's remotely compatible work.
 

eduncan911

The New James Dean
Jul 27, 2015
605
435
63
eduncan911.com
well... crud. I already ordered the proc, and I have spare ram on hand for testing. I have a heatsink assembly that should allow it, but yeah.. that bracket doesn't exist on these boards.

Also, trying to dig through the openbmc hyve specific in the vain hopes of getting the kvm working once more, but that looks like a lost cause. It hasn't been updated in forever, and looks like it only support the very bare minimum functions. There's another openbmc project that seems much more current, but of course no support at all for the hyve boards.

Reconciling all of that is going to be a lot of work, even if it's remotely compatible work.
PiKVM until the BMC KVM is resolved.
 

eduncan911

The New James Dean
Jul 27, 2015
605
435
63
eduncan911.com
Noice. The pushing config part stuff in the first pic... Are you flashing firmware? Or, changing in bios? (As that would push changes)
 

plessley

New Member
Dec 1, 2019
28
18
3
Still trying to figure out where that gets configured. It's a PITA on first boot when it refuses to do anything until you pull the ipmi network.
 

plessley

New Member
Dec 1, 2019
28
18
3
Oh, and I forgot- this is not a sas3 motherboard. It's all sata. I had to add in an lsi 2008 to use sas. Those connectors just break out into sata ports.
 
  • Wow
Reactions: eduncan911

eduncan911

The New James Dean
Jul 27, 2015
605
435
63
eduncan911.com
Oh, and I forgot- this is not a sas3 motherboard. It's all sata. I had to add in an lsi 2008 to use sas. Those connectors just break out into sata ports.
Oh crap, the listing says "Internal SAS Ports!". That was on my To Do list to get to the bottom of those connectors.

As an alternative, there are LSI OCP 2.0 controllers. I have some 40 GbE QSFP OCP 2.0 cards coming as well. It will allow me to test multiple OCP cards, PCIe limitations, etc. There was one request this thread asking if an dual OCP slot connector card will work in a single OCP slot. Oddball things like that for a FAQs.

There is a 2nd OCP 2.0 port with a single Type A x8 PCIe port. At least, via the pictures I can see it on the left, unoccupied.

I have never seen an OCP 2.0 device or port inperson - until this arrives this weekend. But to me, it may interfere with the left-side pci expansion card (if you install one). That's another thing to test, OCP height limitations with PCIe cards because the OCP specification allows for 3 different heights.

Btw, I'm updating the OP with findings and links to posts as we go (it's a WIP)
 
  • Like
Reactions: plessley

plessley

New Member
Dec 1, 2019
28
18
3
Oh crap, the listing says "Internal SAS Ports!". That was on my To Do list to get to the bottom of those connectors.

As an alternative, there are LSI OCP 2.0 controllers. I have some 40 GbE QSFP OCP 2.0 cards coming as well. It will allow me to test multiple OCP cards, PCIe limitations, etc. There was one request this thread asking if an dual OCP slot connector card will work in a single OCP slot. Oddball things like that for a FAQs.

There is a 2nd OCP 2.0 port with a single Type A x8 PCIe port. At least, via the pictures I can see it on the left, unoccupied.

I have never seen an OCP 2.0 device or port inperson - until this arrives this weekend. But to me, it may interfere with the left-side pci expansion card (if you install one). That's another thing to test, OCP height limitations with PCIe cards because the OCP specification allows for 3 different heights.

Btw, I'm updating the OP with findings and links to posts as we go (it's a WIP)

Of course, which is why I mentioned it.

So the 6126F processors either run REALLY hot, or I damaged the heatsink.

root@ubuntu-server:~# sensors
coretemp-isa-0000
Adapter: ISA adapter
Package id 0: +93.0°C (high = +91.0°C, crit = +101.0°C)
Core 0: +26.0°C (high = +91.0°C, crit = +101.0°C)
Core 1: +25.0°C (high = +91.0°C, crit = +101.0°C)
Core 3: +25.0°C (high = +91.0°C, crit = +101.0°C)
Core 4: +25.0°C (high = +91.0°C, crit = +101.0°C)
Core 5: +26.0°C (high = +91.0°C, crit = +101.0°C)
Core 6: +26.0°C (high = +91.0°C, crit = +101.0°C)
Core 8: +24.0°C (high = +91.0°C, crit = +101.0°C)
Core 9: +25.0°C (high = +91.0°C, crit = +101.0°C)
Core 10: +24.0°C (high = +91.0°C, crit = +101.0°C)
Core 11: +25.0°C (high = +91.0°C, crit = +101.0°C)
Core 12: +25.0°C (high = +91.0°C, crit = +101.0°C)
Core 13: +24.0°C (high = +91.0°C, crit = +101.0°C)

power_meter-acpi-0
Adapter: ACPI interface
power1: 136.00 W (interval = 1.00 s)

pch_lewisburg-virtual-0
Adapter: Virtual device
temp1: +27.0°C


or for those of us who don't natively speak Metrique:
root@ubuntu-server:~# sensors -f
coretemp-isa-0000
Adapter: ISA adapter
Package id 0: +199.4°F (high = +195.8°F, crit = +213.8°F)
Core 0: +78.8°F (high = +195.8°F, crit = +213.8°F)
Core 1: +77.0°F (high = +195.8°F, crit = +213.8°F)
Core 3: +77.0°F (high = +195.8°F, crit = +213.8°F)
Core 4: +75.2°F (high = +195.8°F, crit = +213.8°F)
Core 5: +78.8°F (high = +195.8°F, crit = +213.8°F)
Core 6: +77.0°F (high = +195.8°F, crit = +213.8°F)
Core 8: +75.2°F (high = +195.8°F, crit = +213.8°F)
Core 9: +77.0°F (high = +195.8°F, crit = +213.8°F)
Core 10: +75.2°F (high = +195.8°F, crit = +213.8°F)
Core 11: +77.0°F (high = +195.8°F, crit = +213.8°F)
Core 12: +77.0°F (high = +195.8°F, crit = +213.8°F)
Core 13: +75.2°F (high = +195.8°F, crit = +213.8°F)

power_meter-acpi-0
Adapter: ACPI interface
power1: 136.00 W (interval = 1.00 s)

pch_lewisburg-virtual-0
Adapter: Virtual device
temp1: +78.8°F


I'm pretty sure that's mostly accurate due to the system fans running at full blast. As in, loud enough that I can't hear the AC unit over them, nor can I hold a conversation in the same room without yelling. LOUD.

for reference, this is my second box- the first is running DUAL 5120s, and runs quiet enough that I can easily lose track of the fact that it's even running. I'm going to try replacing the heatsink and see if that makes a difference. Also, as far as accuracy goes... this is a 12 core proc, but it looks like lmsensors picked up 14... <shrug?>
 

plessley

New Member
Dec 1, 2019
28
18
3
lspci xeon gold 5120s:
root@ubuntu-server:~# lspci
00:00.0 Host bridge: Intel Corporation Sky Lake-E DMI3 Registers (rev 04)
00:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 04)
00:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 04)
00:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 04)
00:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:11.0 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 0 (rev 09)
00:11.5 SATA controller: Intel Corporation C620 Series Chipset Family SSATA Controller [AHCI mode] (rev 09)
00:14.0 USB controller: Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev 09)
00:14.2 Signal processing controller: Intel Corporation C620 Series Chipset Family Thermal Subsystem (rev 09)
00:16.0 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #1 (rev 09)
00:16.1 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #2 (rev 09)
00:16.4 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #3 (rev 09)
00:17.0 SATA controller: Intel Corporation C620 Series Chipset Family SATA Controller [AHCI mode] (rev 09)
00:1c.0 PCI bridge: Intel Corporation C620 Series Chipset Family PCI Express Root Port #4 (rev f9)
00:1f.0 ISA bridge: Intel Corporation C621 Series Chipset LPC/eSPI Controller (rev 09)
00:1f.2 Memory controller: Intel Corporation C620 Series Chipset Family Power Management Controller (rev 09)
00:1f.4 SMBus: Intel Corporation C620 Series Chipset Family SMBus (rev 09)
00:1f.5 Serial bus controller: Intel Corporation C620 Series Chipset Family SPI Controller (rev 09)
01:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 04)
02:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41)
16:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
16:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
16:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
16:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
16:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
16:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
16:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
16:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
16:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
16:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
16:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
64:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
64:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
64:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
64:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 04)
64:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 04)
64:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 04)
64:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 04)
64:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 04)
64:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 04)
64:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 04)
64:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 04)
64:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 04)
64:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 04)
64:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 04)
64:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 04)
64:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 04)
64:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 04)
b2:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 04)
b2:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
b2:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
b2:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
b2:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
b2:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
b2:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
b2:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
b2:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
b2:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
b2:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
b2:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
b2:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
b2:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
b3:00.0 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
b3:00.1 Ethernet controller: Mellanox
 

plessley

New Member
Dec 1, 2019
28
18
3
lspci 6126f:
root@ubuntu-server:~# lspci
00:00.0 Host bridge: Intel Corporation Sky Lake-E DMI3 Registers (rev 04)
00:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
00:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 04)
00:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 04)
00:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 04)
00:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:11.0 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 0 (rev 09)
00:11.5 SATA controller: Intel Corporation C620 Series Chipset Family SSATA Controller [AHCI mode] (rev 09)
00:14.0 USB controller: Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev 09)
00:14.2 Signal processing controller: Intel Corporation C620 Series Chipset Family Thermal Subsystem (rev 09)
00:16.0 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #1 (rev 09)
00:16.1 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #2 (rev 09)
00:16.4 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #3 (rev 09)
00:17.0 SATA controller: Intel Corporation C620 Series Chipset Family SATA Controller [AHCI mode] (rev 09)
00:1c.0 PCI bridge: Intel Corporation C620 Series Chipset Family PCI Express Root Port #4 (rev f9)
00:1f.0 ISA bridge: Intel Corporation C621 Series Chipset LPC/eSPI Controller (rev 09)
00:1f.2 Memory controller: Intel Corporation C620 Series Chipset Family Power Management Controller (rev 09)
00:1f.4 SMBus: Intel Corporation C620 Series Chipset Family SMBus (rev 09)
00:1f.5 Serial bus controller: Intel Corporation C620 Series Chipset Family SPI Controller (rev 09)
01:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 04)
02:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41)
17:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
17:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
17:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
17:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0a.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0a.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0a.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0a.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0a.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0a.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0b.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0b.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0b.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0b.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:10.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:10.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:10.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:10.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:10.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:10.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:11.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:11.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:11.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:11.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
17:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
17:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
17:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
17:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
17:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
17:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
17:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
64:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
64:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
64:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
64:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 04)
64:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 04)
64:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 04)
64:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 04)
64:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 04)
64:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 04)
64:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 04)
64:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 04)
64:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 04)
64:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 04)
64:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 04)
64:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 04)
64:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 04)
64:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 04)
64:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 04)
b1:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 04)
b1:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
b1:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
b1:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
b1:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
b1:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
b1:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
b1:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
b1:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
b1:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
b1:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
b1:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
b1:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
b1:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
b1:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
b2:00.0 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
b2:00.1 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
fe:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
fe:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
fe:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
 

RolloZ170

Well-Known Member
Apr 24, 2016
1,808
458
83
55
So the 6126F processors either run REALLY hot, or I damaged the heatsink.
this is the typical behaviour for not supported F type CPU if the mboard starts (mostly systems does not POST)
core clocks under 800 Mhz and Temp. sensors (faulty) critical, they are not Hot.
 

RolloZ170

Well-Known Member
Apr 24, 2016
1,808
458
83
55
found this searching for this board and 8124m.. was wondering if you could modify the vrm code to support 255w.
the phase conf. is 6+1 and a good chance this board supports TDC=255A already.
if anyone can identify the chip in the red area. the 3 pin can be the PMBus I2C connector (with luck)
VRM_PMBus sth.jpg
 

eduncan911

The New James Dean
Jul 27, 2015
605
435
63
eduncan911.com
Ok, got my server and initial teardown and "oooo, ahhhhs" done with the kids. I'm going to post things in random order. However, I'll try to stick to 1 topic per post - to give a chance to reply about a specific topic.

First up we have the OCP ports, as this most interested me. Officially, this server supports:

- 1x OCP 2.0, single-connector x8 Type 1 Low-Profile (5mm height) "NIC".




So, this has the Dual SFP28 card already. I'm almost certain you won't be able to change this for any other OCP 2.0 card out there - unless it has a super-low 5mm heatsink profile. Checkout the included dual SFP28 card next to a QSFP card I just bought in hopes of using it - it won't fit.



Well, that taller heatsink hits the motherboard - so you'll never be able to use it.

In addition, the extra Type 2 x8 connector on the QSFP card hits the x16 expansion slot #2! So you wouldn't be able to use a dual Type 1 and 2 connector in this single Type 1 connector slot.



You an also make out that the heatsink is hitting the motherboard as well.

There's just not enough room for the heatsink, nor for the 2nd connector.


- 1x OCP 2.0, single-connector x8 Type 1 Low-Profile "SAS Mezzanine" card, with a proprietary connector.



I tried to follow some traces on the motherboard from that connector, and it seems to be a breakout connector that goes to 4x MiniSAS ports that flanks both sides of the otherboard..

I am giving up trying to search and find the SAS HBA OCP card for this. Nothing has that proprietary connector, and the ones that will kinda fit will hit that connector.

No, you are not able to put NIC OCP 2.0 into this slot s the NIC cages will hit the motherboard components.
 

eduncan911

The New James Dean
Jul 27, 2015
605
435
63
eduncan911.com
The Motherboard has to be the easiest motherboard I have ever removed. Two built-in screw retainers, and it slides out.

Take note of the proprietary holes and sliding mounting system. Quite possibly the best setup I've ever used. However, there are no ATX standoffs here and no hold provisions for them.



















(can't seem to attach super-high-res photos)









 
Last edited:

eduncan911

The New James Dean
Jul 27, 2015
605
435
63
eduncan911.com
M.2 22110 -> 2280

If you want to use an 2280 M.2 drive, you'll have to remove the motherboard to move the plastic clip hold down.

A pair of needle-nose pliers easily does the trick. Pulling up will break the tabs.





 

eduncan911

The New James Dean
Jul 27, 2015
605
435
63
eduncan911.com
For you Windows users, there's a sliver of hope for a TPM module.

I have yet to boot my machine so perhaps others could chime in on rather it's working. I would assume so, since it's kind of a requirement now for Windows.




PS: If someone needs a TPM module, let me know. I have no use for these.
 

plessley

New Member
Dec 1, 2019
28
18
3
M.2 22110 -> 2280

If you want to use an 2280 M.2 drive, you'll have to remove the motherboard to move the plastic clip hold down.

A pair of needle-nose pliers easily does the trick. Pulling up will break the tabs.





yeah, forgot to mention that. I'm still wondering what was there initially that used the 110mm length.
 
  • Like
Reactions: eduncan911