NVDimm support on AMD Epyc
- Thread starter Rand__
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
two possible issues between powergems.
Pinout of the cable / connectors.
And the Controller used in the Powergem.
I suspect that they have i2c wired up so that the NVDIMM can get telemetry from the Gem.
Through that, it could check for a specific controller used.
Datasheets for a a LTC3350:
www.analog.com
Technically its the wrong manufacturer since the logo on the chip shown in the pictures refers to Linear Technology (LT) and not Analog Devices
@nasbdh9 you could do as a favor in grabbing a multimeter and measuring the pinout of the powergem connector going to the NVDIMM.
Pinout of the cable / connectors.
And the Controller used in the Powergem.
I suspect that they have i2c wired up so that the NVDIMM can get telemetry from the Gem.
Through that, it could check for a specific controller used.
Datasheets for a a LTC3350:
LTC3350 Datasheet and Product Info | Analog Devices
The LTC3350 is a backup power controller that can charge and monitor a series stack of one to four supercapacitors. The LTC3350’s synchronous step-down controller drives N‑channel MOSFETs for constant current/constant voltage charging with programmable input current limit. In addition, the...
@nasbdh9 you could do as a favor in grabbing a multimeter and measuring the pinout of the powergem connector going to the NVDIMM.
Sorry, I have sold all these boxestwo possible issues between powergems.
Pinout of the cable / connectors.
And the Controller used in the Powergem.
I suspect that they have i2c wired up so that the NVDIMM can get telemetry from the Gem.
Through that, it could check for a specific controller used.
Datasheets for a a LTC3350:
Technically its the wrong manufacturer since the logo on the chip shown in the pictures refers to Linear Technology (LT) and not Analog DevicesLTC3350 Datasheet and Product Info | Analog Devices
The LTC3350 is a backup power controller that can charge and monitor a series stack of one to four supercapacitors. The LTC3350’s synchronous step-down controller drives N‑channel MOSFETs for constant current/constant voltage charging with programmable input current limit. In addition, the...
@nasbdh9 you could do as a favor in grabbing a multimeter and measuring the pinout of the powergem connector going to the NVDIMM.
Analog Devices bought Linear Technology a few years ago.two possible issues between powergems.
Pinout of the cable / connectors.
And the Controller used in the Powergem.
I suspect that they have i2c wired up so that the NVDIMM can get telemetry from the Gem.
Through that, it could check for a specific controller used.
Datasheets for a a LTC3350:
Technically its the wrong manufacturer since the logo on the chip shown in the pictures refers to Linear Technology (LT) and not Analog DevicesLTC3350 Datasheet and Product Info | Analog Devices
The LTC3350 is a backup power controller that can charge and monitor a series stack of one to four supercapacitors. The LTC3350’s synchronous step-down controller drives N‑channel MOSFETs for constant current/constant voltage charging with programmable input current limit. In addition, the...
@nasbdh9 you could do as a favor in grabbing a multimeter and measuring the pinout of the powergem connector going to the NVDIMM.
I wonder, are any of these safe to use in production environments, while waiting for CXL products to hit the market? I'm not a fan of HPE's storage cost, but I would trust their NVIDMM implementation, and possibly Dell. If I buy a Tyan TS75-B8252 and some NVDIMMs and PowerGems, even if they are new-in-box, is there any vendor support? I wonder if there is a way I could test them to be confident they are reliable?
Of course you can test them, its ram + battery.
Mount as drive, write to it, power down box, remove any trace of power, power back up. Everything should still be there.
I doubt you get vendor support from HPE/Dell unless the system they were sold with is still under warranty, and basically no chance for any support on 3rd party.
I know Supermicro is not helping much (no market for them), but Micron was helpful, but not sure if that's the official stance or if i was lucky
Mount as drive, write to it, power down box, remove any trace of power, power back up. Everything should still be there.
I doubt you get vendor support from HPE/Dell unless the system they were sold with is still under warranty, and basically no chance for any support on 3rd party.
I know Supermicro is not helping much (no market for them), but Micron was helpful, but not sure if that's the official stance or if i was lucky
Are we still looking for validation? With the price of NVDIMMs dropping, I'm thinking of playing with the tech now.
I'm just learning about NVDIMMs (yeah, late to the party - was stuck in X9/X10/E5 V1-V4 land the last 9 years).
I have a few boards that may be compatible. So I'll need to pick a couple modules up.
I was focused on the Intel Optane PMem versions, as I'm mostly interested in the flash storage aspect for ZFS tunables (ZIL, persistent L2ARC, etc). Until this thread, I had no idea it was an AMD option!
Is there interest in these Intel NVDIMM support?
Does anyone want me to test a particular type in these boards (and can send me the sample stick).
I'm currently learning the ropes of bios hacking / unhiding options, and I have the following boards to tinker with:
AsRock Rack EPYCD8-2T (7001/7002 Epycs)
AsRock Rack X399D8U-2T (ThreadRipper 2, I have no idea if this supports it by my gawd the BIOS is full of more CPU options than my Asus overclocking boards it seems!)
Unknown (Wynnsynn?) Dual LGA3647 Skylake-SP with 4x NVDIMM slots flanking both CPU. It's the 1U Hyve 8x LFF chassis in the Deals section (or check my posts).
So if I run across NVDIMM options, I'll look into them as well.
I'm just learning about NVDIMMs (yeah, late to the party - was stuck in X9/X10/E5 V1-V4 land the last 9 years).
I have a few boards that may be compatible. So I'll need to pick a couple modules up.
I was focused on the Intel Optane PMem versions, as I'm mostly interested in the flash storage aspect for ZFS tunables (ZIL, persistent L2ARC, etc). Until this thread, I had no idea it was an AMD option!
Is there interest in these Intel NVDIMM support?
Does anyone want me to test a particular type in these boards (and can send me the sample stick).
I'm currently learning the ropes of bios hacking / unhiding options, and I have the following boards to tinker with:
AsRock Rack EPYCD8-2T (7001/7002 Epycs)
AsRock Rack X399D8U-2T (ThreadRipper 2, I have no idea if this supports it by my gawd the BIOS is full of more CPU options than my Asus overclocking boards it seems!)
Unknown (Wynnsynn?) Dual LGA3647 Skylake-SP with 4x NVDIMM slots flanking both CPU. It's the 1U Hyve 8x LFF chassis in the Deals section (or check my posts).
So if I run across NVDIMM options, I'll look into them as well.
Do I need to install an NVDIMM to get options in BIOS to show? Are the options hidden if you don't have any Optane memory?
Also, please excuse my addition rookie questions but...
I've only read up on the Intel Optane DC Pem tech and different modes of operations.
And a massive shout-out to @Patrick and his deep dive and "middle ground" videos on Intel Optane NVDIMMs! Seriously, lately, and I mean every single time, I go to STH to use the search, or prefix / prioritize STH in my searches, hands down and blindly.
however, I hear name drops and Pem200 stuff mentioned, but either no videos or my search-foo is really bad. Other types of NVDIMM or types?
Would someone be able to elaborate on these types and their differences? Maybe an STH video/article I've missed?
Also, please excuse my addition rookie questions but...
I've only read up on the Intel Optane DC Pem tech and different modes of operations.
And a massive shout-out to @Patrick and his deep dive and "middle ground" videos on Intel Optane NVDIMMs! Seriously, lately, and I mean every single time, I go to STH to use the search, or prefix / prioritize STH in my searches, hands down and blindly.
however, I hear name drops and Pem200 stuff mentioned, but either no videos or my search-foo is really bad. Other types of NVDIMM or types?
Would someone be able to elaborate on these types and their differences? Maybe an STH video/article I've missed?
most likely
yes, but the settings for Optane and NVDIMM are different.
NVDIMM - Wikipedia
en.wikipedia.org
don't expect these 4 extra slots to be for NVDIMM. this is mostly only A2 / D2.
memory population guide(manual): populate A2 / D2 only if you don't have enough memory.
Note 2ng gen scalable(non 'M' non 'L') support 1TB of memory, 8 x 128GB does the job with all 6 channels populated.
4x 256GB will also be 1TB but only quad.channel operation.
What gives me a little hope is that the BIOS had NVDIMM options. At least, from what someone else posted. I'll find out today.
you can put NVDIMM-N with backup batterie and or flash storage in every memory slot. this memory should not be erased on POST memtest, any idea why?
My Gigabyte MZ-AR0 v1 and v3 support NVDIMM-N. Settings are available once you populate NVDIMM-N on them. I just cant get it running together with LR-DIMM. Only RDIMM. Just being a 2666Mhz is no issue for EPYC, at least not for Naples and Rome. 7371, 7F32 and 7302P are running fine. No post issues. Even passing them through to vm's is working with Proxmox, not just as a 'slow' block device. Fun but quirky sometimes.
if you can find NVDIMM-N greater than 16GB.There might be an upgrade path for me after all
thanks, any not EOL and under $600 usd ? thought Intel Optane DC Persistent Memory is expensive...
You get 128Gb modules for 50-70EUR sometimes. There was a German seller on eBay Germany selling them. There's also a UK seller who throughs them out for cheap from time to time. On eBayKA someone sold 512Gb modules for 250Eur each just recently. Puff ... All gone.
Also @Rand__ Posted an eBay sale some days ago.