HPE ProLiant MicroServer Gen10 Plus Ultimate Customization Guide

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

DeltaQ

New Member
Sep 29, 2020
3
0
1
I GOT IT!!! :)
It is very simple: the NVME SSD from Samsung (Evo Plus) with 2 TByte is INCOMPATIBLE with the “QNAP QM2-2P10G1TA” and the HPE Microserver Gen10+!!!

I have a spare NVME: "Intel SSD 660p 2TB". I just build this into the “QNAP QM2-2P10G1TA” and voila: The Microsrerver Gen10+ boots without any problems and I see under VMware ESXi 7.0b the 10Gbit Aquantia Chip and also the Intel 2TB NVME SSD!

I want to use the Samsung Evo Plus 970 2 TB as it is a very good combination of speed and reliability but if it isnt't working from the ground up I will go with the Intel 660p and do some more backups. ;)

...so now I got 10Gbit in a tiny Microserver with the Intel 660p 2TB NVME SSD (a little bit slowlier than Samsung but this doesn't hurt) and something new learned... :D

So in sum:
- 1 TByte Samsung EVO Plus NVME works very good
- 2 TByte Samsung EVO Plus NVME do NOT WORK with the “QNAP QM2-2P10G1TA”-Adapter in the HPE Microserver 10+!!!!
 
Last edited:

Evan

Well-Known Member
Jan 6, 2016
3,346
598
113
Opps I just ordered one (good price for my part of the world)

I did it to replace at least 1 Synology NAS.
e-2224 will stay the CPU, either add another 16gb to make it 32gb as will run a few small VM’s
I think I will run Linux with ZFS or VDO with who know what FS on top, and KVM for VM’s
data disks 4 x 3.84tb sata ssd.

boot off what, Will NVMe boot ok native in the PCIe slot ? Or a innodisk SLC/MLC USB key ?

if I really like like it in testing then would also move my backup to same platform, then my question is has anybody tried a H240 for SAS JBOD use in a microserver gen10+ ? (If not I will try it and let you know how it goes) (yes normally just use sata but I have the card and 4 x 8TB SAS drives)

They use a lot more power than the Synology systems but price wise they are i think even cheaper, and are more flexible.
 

Think

Member
Jul 5, 2017
32
5
8
I don't think there is an M2 slot. So for NVMe, you will have to go PCIe - or one in a USB slot. I'm booting off PCIe NVMe here, works well. I also have the VMs on that SSD.

OS-wise, ZFS with KVM here as well. I'm using Proxmox, combines both quite nicely.
 

Evan

Well-Known Member
Jan 6, 2016
3,346
598
113
I don't think there is an M2 slot. So for NVMe, you will have to go PCIe - or one in a USB slot. I'm booting off PCIe NVMe here, works well. I also have the VMs on that SSD.

OS-wise, ZFS with KVM here as well. I'm using Proxmox, combines both quite nicely.
nope, no M.2 slot, can just use a PCIe m.2 or u.2 adapter. That was my plan. Don’t need the slot for anything else as no need for 10G network or much else. Reason I asked about USB as for the backup system if I make it then it will have SAS adapter in the slot. (Although if I use just zfs snaps then maybe 3 x 8tb will be enough leaving space for a SAS boot SSD as well)
 

Think

Member
Jul 5, 2017
32
5
8
I guess as a boot/system drive, USB will be fine. I was a bit concerned about write endurance and speed, given that I also wanted to put some VMs onto that drive. Hence I went for a PCIe SSD.
 

KinChungE

New Member
May 8, 2021
3
0
1
Hello! Thank you very much for the very good article!

I just buyed a “QNAP QM2-2P10G1TA” with a “Samsung EVO Plus 970 2TB” NVME SSD as it was advertised as an operational possibility to add 10Gbit + NVME to the Microserver 10+ in the article (even it will not use the full speed).

If I try to boot the HPE Microserver 10+ with the QNAP Adapter WITH the EVO 970 (it doesn’t matter if build on Slot1 or Slot2) I only see an error message in red letters: “RIP address out of range”.

I googled about this and come to some articles which says that I have to disable “UEFI Optimized Boot”. I tried this but it wont work.

If I try to boot only the “QNAP QM2-2P10G1TA” without a NVME SSD everything is okay and the Microserver Gen10+ boots normally and the AC107 NIC of the QNAP-Adapter is usable. So this is good. :)

Does anyone knows whats wrong in my setup? I hope only a BIOS/UEFI setting is wrong but I can’t find the wrong setting.

- I just updated the BIOS of the HPE Microserver 10+ to "2.18_06-24-2020(14 Aug 2020)"
- I updated iLO to 2.31
- I have done a reset of the BIOS settings to "Default"
- I tried to change UEFI to "Legacy BIOS-boot" but the error comes before the Boot-Screen

I have also a simple PCIe M.2 NVME SSD-Adapter from "Icy Box" (IB-PCI214M2-HSL):
- this works very well and without problems with the same "Samsung EVO Plus 970 2TB"
So I asume that there is no error within the SSD itself.

I tried to watch the UEFI boot process via iLO serial port and see that the SSD and also the 10GBit-NIC-AC107-Chip is recognized:
Code:
....
Starting handle 72355D98
Starting Slot 1 Port 2 : Aquantia AQtion 10Gbit Network Adapter (HTTP(S) IPv4)
Starting handle 72355318
Starting handle 72354318
Starting handle 72354698
Starting handle 72354598
Starting handle 72353E98
Starting handle 72353218
Starting handle 72352018
Starting handle 72352C18
Starting handle 72352A18
Starting handle 72352798
Starting Slot 1 Port 2 : Aquantia AQtion 10Gbit Network Adapter (PXE IPv4)
Starting handle 72351C18
Starting handle 72351818
Starting handle 72350998
Starting handle 7234FE18
Starting handle 7234EC18
Starting handle 7234EE18
Starting Slot 1 NVMe Drive 1 : NVM Express Controller - S***********-Samsung SSD 970 EVO Plus 2TB-58382500
Starting Slot 1 NVMe Drive 1 : NVM Express Controller - S***********-Samsung SSD 970 EVO Plus 2TB-58382500
Starting iLO Virtual USB 1 : iLO Virtual Keyboard
Starting iLO Virtual USB 1 : iLO Virtual Keyboard
Starting Internal USB 1 : USB SanDisk 3.2Gen1
...
I attach the error screen and the messages to give a better understanding of the problem:
Code:
X64 Exception Type 0x02 - NMI Detected. Please check the IML for more details.
Software NMI

RCX=00000000708C4118 DX=00000000454EC648 R8=00000000793C7060 R9=00000000453C5790
RSP=00000000454EC680 BP=00000000454EC719 AX=00000000453C42E0 BX=00000000708C4118
R10=0000000000000180 11=0000000000000002 12=0000000000000000 13=0000000000000004
R14=8000000000000012 15=000000007298E028 SI=000000007249C010 DI=8000000000000006
CR2=0000000000000000 CR3=00000000454ED000 CR0=80000013 CR4=00000668 CR8=00000000
CS=00000038 DS=00000030 SS=00000030 ES=00000030 RFLAGS=00000246
MSR: 0x1D9 = 00004801, 0x345=000033C5, 0x1C9=00000008

LBRs From              To                From              To
01h  00000000453B2398->0000000075993052  00000000453B2368->00000000453B2398
03h  00000000453B2332->00000000453B2364  00000000453B22F8->00000000453B2309
05h  0000000077F718A1->00000000453B22E8  0000000077F718A7->0000000077F71887
07h  00000000453B23A5->0000000077F718A4  00000000453B2368->00000000453B2398
09h  00000000453B23A5->0000000077F718A4  00000000453B2368->00000000453B2398
0Bh  00000000453B2332->00000000453B2364  00000000453B22F8->00000000453B2309
0Dh  0000000077F718A1->00000000453B22E8  0000000077F718A7->0000000077F71887
0Fh  00000000453B23A5->0000000077F718A4  000000007599305D->00000000789B8660

CALL ImageBase        ImageName+Offset
00h  00000000453AD000 DxeCore+005398h
01h  0000000077F6F000 NvmExpressDxe+0028A4h
02h  0000000064992000 HpSmbiosType242HddInventory+00355Bh
RIP address out of range
View attachment 16146

If this isn't the right place for this issue please advice me where to post it elsewhere in the forum. :)

Best regards!




EDIT:
- I just tried to downgrade the BIOS to the original one "2.00_12-06-2019(19 Mar 2020)" =>
The same error message at boot :(

The iLO-Log gives a good feedback in the early boot process but later the boot process end with the red error which I have posted earlier "RIP address out of range":

Code:
....
Starting PciRoot(0x0)/Pci(0x0,0x0)
Starting Embedded : PCIe Controller
Starting Slot 1 Port 1 : PCIe Controller
Starting Slot 1 Port 1 : PCIe Controller
Starting Slot 1 Port 1 : PCIe Controller
Starting Slot 1 Port 1 : Aquantia AQtion 10Gbit Network Adapter
Starting handle 73B6FE18
Starting Slot 1 Port 1 : PCIe Controller
Starting Slot 1 Port 1 : NVM Express Controller - S***********-Samsung SSD 970 EVO Plus 2TB-58382500
Starting Embedded : PCIe Controller
Starting Embedded : eXtensible Host Controller (USB 3.0)
Starting PciRoot(0x0)/Pci(0x14,0x2)
....
For me it is not clear where the error is and what to do to make the “QNAP QM2-2P10G1TA” usable in the HPE Microserver 10+. :(

I will now try to test the QNAP Adapter in my good old Microserver 8...
I just got similar issue here.

I bought these items:
- QNAP QM2-2P2G2T (2 x 2.5GbE + 2 x NVMe, PCI-e 3.0)
- Samsung PM981a 1TB
OS: Windows Server 2019

Even if I don't install any SSD, the system still get the same NMI issue
Sometimes if I am lucky I can boot into the OS, but it gives BSOD in 5-10 minutes

I have no way to verify if PM981a is compatible or not at this moment.
Now going to buy single PCI-e to NVMe adapter and test if it works
 

DrSpanky

New Member
May 13, 2021
1
0
1
Just adding to the collective knowledge

I have a Gen 10+ with a QM2-2P10G1TA
and a Kingston SA2000m8250g

This nvme gives NMI issue on shutdown and restart but the unit will restart and otherwise works correctly. I didn't notice the error as only RDP and remotely reboot it. A friend of mine also has a similar setup has had issues so i plugged my monitor in to check (and found i have the error as well). Hopefully he will pop in a post what ones do not work with the Gen 10+ and the QM2.

Dan
 

sheltem

New Member
Dec 6, 2019
2
0
1
I have a Gen 10+ with the stock Xeon E-2224 processor. The processor is overkill for my needs as I am using it as a Unraid NAS with a few docker containers. Would it be worth my time to change my CPU to something like a Core i5 8400t or 9500t for the power savings?
 

cesmith9999

Well-Known Member
Mar 26, 2013
1,417
468
83
not really, the cpu power savings is not worth the saving cost ROI of the T processor cost (unless you get it for dirt cheap) over the life of the server


the TDP of the E-2224 is 71W
the TDP of the i5 8400 is 65W
the TDP of the i5 8400T is 25W
the TDP if the i5 9500 is 65W
the TDP if the i5 9500 is 25W

Where I live it is $0.10 per KWH the 46W difference is ~$3.31 per month. And that is running at full out. with an ebay cost of $160 for a i5 9500t it would take me 4 years to recoup the cost on ROI basis if I was to do this

If you run at half that... 12W for the 9500T and 35W for the E-2224 at idle (which it will be most of the time) the cost difference is ~$1.44 and the recoup time would be around 9 years and change.

so unless you have a lot of power utilization for the machine and high power costs. it is not worth the swap.

this is only for the CPU swap. it does not count for any of the devices in the server, which add power consumption.

Here is a real good thread about this https://forums.servethehome.com/index.php?threads/the-truth-about-cpu-power-consumption.16/

Chris
 
  • Like
Reactions: Patrick

Evan

Well-Known Member
Jan 6, 2016
3,346
598
113
Essentially no cpu of same generation has much difference, a small amount based in cores so a 2 core will idle lower than 4 core. At this part of the product stack it’s essentially zero. Don’t waste effort changing cpu to reduce power.
 
  • Like
Reactions: cesmith9999

logicfrog

New Member
Dec 13, 2020
1
1
3
Came across this HPE advisory on drive compatibility:

Note that power consumption of the storage devices should not exceed either of the total power budget numbers provided below (max drive counts are four):

Total power budget for 2.5″ SATA SSD cannot exceed 2.23W. (Per each drive)
Total power budget for 3.5″ SATA HDD cannot exceed 12W. (Per each drive)

Document Display | HPE Support Center
 
  • Like
Reactions: Patrick

Mr HPE

New Member
Oct 2, 2021
3
0
1
Boston, MA
www.w1cjf.com
Anyone have part numbers for 32GB ECC memory (I'd like 2 for a total of 64GB)? From what I've searched online, this seems to be the part number for Crucial (1 x 32GB): CT32G4RFD4266. However, I looked for this part number in Crucial's web site but could not find it. I can see it in online stores. I also looked in Micron's web site and couldn't find it (it seems that Micron took over Crucial's memory line).

Can someone confirm if Crucial CT32G4RFD4266 is the correct memory or recommend what memory to get with part numbers?

EDIT: Also, it should be okay to just put 1 x 32 GB memory in one slot and leave the 2nd slot unused (for now, until I need an additional 32GB memory in the future)?


I am looking for the same info.. I just got mine a week ago and put esxi enterprise on it... 1 windows vm kills all the ram in the host so is it possible to go higher than 64gb?

chris
 

tumor_

New Member
Oct 13, 2021
3
0
1
Just adding to the collective knowledge

I have a Gen 10+ with a QM2-2P10G1TA
and a Kingston SA2000m8250g

This nvme gives NMI issue on shutdown and restart but the unit will restart and otherwise works correctly. I didn't notice the error as only RDP and remotely reboot it. A friend of mine also has a similar setup has had issues so i plugged my monitor in to check (and found i have the error as well). Hopefully he will pop in a post what ones do not work with the Gen 10+ and the QM2.

Dan
Also adding to the collective knowledge.

QNAP QM2-2P10G1TA in a GEN10+ gets the NMI error with below SSD.
Crucial P2 2TB 3D NAND NVMe PCIe M.2 SSD CT2000P2SSD8, 2 TB

It boot loops and keeps throwing the same error.

The QNAP card works ok with no m.2 drives mounted.

EDIT: Also tried an Intel SSD Pro 6000p Series 1.0TB M.2 stick and got the same result.

IMG_20211013_152733.jpg
 
Last edited:

WANg

Well-Known Member
Jun 10, 2018
1,302
967
113
46
New York, NY
I am looking for the same info.. I just got mine a week ago and put esxi enterprise on it... 1 windows vm kills all the ram in the host so is it possible to go higher than 64gb?

chris
No. AFAIK all Xeon-D 15xx models max out at 32GB per DIMM unit, so 64 is the max that you can have.
 

KinChungE

New Member
May 8, 2021
3
0
1
Also adding to the collective knowledge.

QNAP QM2-2P10G1TA in a GEN10+ gets the NMI error with below SSD.
Crucial P2 2TB 3D NAND NVMe PCIe M.2 SSD CT2000P2SSD8, 2 TB

It boot loops and keeps throwing the same error.

The QNAP card works ok with no m.2 drives mounted.

EDIT: Also tried an Intel SSD Pro 6000p Series 1.0TB M.2 stick and got the same result.

View attachment 20166
I was having the same issue before on Bios 2.20
The workaround is to set the PCI-e port speed to PCI-e 2.0 and it works flawlessly.

And just now I updated the Bios to 2.54, it seems I can finally run at PCI-e 3.0 speed without any issues!

My QNAP Card: QM2-2P2G2T
My SSD: Samsung PM981a 1TB
 

tumor_

New Member
Oct 13, 2021
3
0
1
I was having the same issue before on Bios 2.20
The workaround is to set the PCI-e port speed to PCI-e 2.0 and it works flawlessly.

And just now I updated the Bios to 2.54, it seems I can finally run at PCI-e 3.0 speed without any issues!

My QNAP Card: QM2-2P2G2T
My SSD: Samsung PM981a 1TB
Cheers! I'm on a BIOS version I downloaded on ‎14 ‎October ‎2021. I see that version you have was released in November.
Will give it a try later and follow up.

Awesome work finding that workaround too. I hadn't tried that.
 

hvddrift

New Member
Jan 12, 2022
3
0
1
Hi,

I am probably the newest member here. I am trying to add some ssd to an QNAP Systems Dual M.2 22110/2280 SATA SSD Expansion Card - PCI-E Gen 2x2 Low-Profile. I have updated the bios. Sure I have installed physically everything correctly. But the ssd’s are just not coming up as an option. I want to install proxmox onto one, and some other vm’s on the other.

Are there any other bios settings or ssd prep you all have done to get them to be recognised?

Should they show in the storage option in the summary tab of the boot menu?
Any help would be greatly appreciated.
 

Zaiban

New Member
Jan 17, 2022
1
0
1
There seems to be series of new QM2 cards. There are higher end models with PCIe gen 4, but the interesting one for me at least is the new

"QM2-2P10G1TB"

Featuring 1x 10gbe + 2x m.2 ssd slots with a total bandwidth of PCIe Gen3 x 8. The 10gb port is advertised as "high efficiency", using about half the power of previous models.

I have just ordered the new card, though it may take some time to arrive. Just hoping its compatible with gen10+ :)