512 GB Intel Optane DDR4-2666 RDIMM PMEM NMA1XBD512GQS

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

jason879

Member
Feb 28, 2016
41
44
18
43
I'm a stock market investor and speculator at night and from that point of view and correct me if I am wrong but those 512GB PMEM 100 just had a RRP of 2000 USD per piece. Now 120 or 130. I think they won't come down more, these are imho EOL and firesale prices. Next stop might be Unobtainium City.
With Reddit imploding a little more every day these days and users jumping onto lemmy or here or level1, maybe it'd be a good time to rescue the r/homelab slogan. ;-) Don't forget you probably want an -L suffix CPU for that.
I was waiting for 8200 and mobo to come down. Recently I got a deal on the mobo @$250 so I could start to build my large memory rig.

I'm planning to get 8259CL for ~$275 or less and a WD SN640 7.68T ~$300. So the total will be round $1K usd. For PMEM I'll see how that works then decide if I will get more, no rush to get it fully loaded ATM. These parts are always going down in most cases.


@RolloZ170 thanks for the info. I was reading all your threads regarding mod TDC=255A on different platforms(Dell 7820/R740/X11-SPA). I end up getting EPC621D8A which is mentioned on one of you reply. It supports special SKU out of the box along with few SuperMicros.
 
Last edited:

Stephan

Well-Known Member
Apr 21, 2017
945
714
93
Germany
120 is too much if they die after 4 weeks of use.
They might and I know full well that it's a gamble. So I bought 7 with 6 in use and 1 as spare. I even calculated 50:50 they wouldn't even show up in the Asrock and Supermicro boards with the 82xx CPUs I have. Funny enough everything works. That seller appears to sell new in box modules even. Datasheet says 300 PBW. In the cluster I might write 1 TB per day per module. Would take 822 years to wear them out.
 
  • Like
Reactions: gb00s

jason879

Member
Feb 28, 2016
41
44
18
43
I got everything setup today. In memory mode the speed is not bad(quad channel). Doubled than my EPYC 7302P esxi setup (maybe it's not fine tuned). I've would bought 2 more to fill up the slots... Anyways it's good enough.

My setup as below for anyone whom is interested to build in the future. It works out of the box no mod needed.(Only 2 jumpers to endable NVDIMM support)


Intel 8259CL x 1
ASRock EPC621D8A x 1
Intel Optane 512GB x 2
Hynix 16GB 2666V x 4
WD SN640 7.68T x 1
CPU Cooler x 1


8259cl.png
8259cl-rig.jpg
 
Last edited:
  • Like
Reactions: chrgrose

nasbdh9

Active Member
Aug 4, 2019
168
96
28
The ratio of DDR memory to DCPMM depends on your use case
DCPMM in memory mode is more like a hardware SWAP
According to 32*6+512*6, the full-speed memory you have is 32*6, and the part exceeding 32*6 will be written into DCPMM
Assuming your active memory portion will never exceed 32*6, why configure more DDR memory? ;)
 
  • Like
Reactions: gb00s

jason879

Member
Feb 28, 2016
41
44
18
43
Got 2 more sticks and the order has to be set like the following. (Not interleaved DRAM | PMEM | DRAM | PMEM)

1:16 DRAM to PMEM ratio seems like a recommendation not a hard requirement. ESXI 8.0 is able to recognize 2TB (64GB dram cache) without issue.

epc621d8a dimm order.jpg


EPC621 2T.jpg
 
Last edited:

chrgrose

Active Member
Jul 18, 2018
113
58
28
Is there a test to show how worn out Optane dimms are? Or do you just use them until they die?
 

Stephan

Well-Known Member
Apr 21, 2017
945
714
93
Germany
Or use ipmctl on Arch. Here are some examples for reference:

# Configuration

ipmctl show -topology
ipmctl show -dimm
ipmctl show -a -dimm
ipmctl show -memoryresources
ipmctl show -goal
ipmctl show -region

# Firmware

ipmctl show -firmware
ipmctl show -dimm -firmware
ipmctl show -d ARSStatus -dimm

# Health

ipmctl show -d HealthState,HealthStateReason -dimm
ipmctl show -a -sensor
ipmctl show -a -sensor MediaTemperature
ipmctl show -a -sensor ControllerTemperature

# Set Goal

ipmctl create -goal PersistentMemoryType=AppDirectNotInterleaved
ipmctl create -dimm 0x0101 -goal PersistentMemoryType=AppDirectNotInterleaved

# Create Namespace

ndctl create-namespace --mode sector
ndctl list --regions --human
ndctl list --human

Also good luck trying to wear out these Optanes. They'll just last until you are fed up with Cascade Lake and get something better.