ES Xeon Discussion
- Thread starter britinpdx
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
Have had to get creative with DIMM and socket phase cooking with tiny ms73 blowthru sinks. Was not able to get MS72 mono board manufacturer for MS73 as I run water with bitspower blocks. Have tried blow fan clip ons, and swapped between Byski DIMM modules for watercooling... DIMMs always read 70c+ ... will try those Kingston next go around, thanks.
I got a T3DGQ mobo. qyfs don't work on it. Can i get some assisstance from u to modify the bios? I have downloaded the bios from their website.
replace the 06F8 (platform 10) microcode wth the 06F3 ( MMTool_5.2.0.25 )
i can check into the hpm file for BMC flashing later today.
Thanks a lot. Following ur instruction, the bios have been found that there is no 06F3, only 2 06F8(different microcode id) and 1 06F2.
If i want to support the ES as much as possible.(I have QYFS, Q0KG, Q30G) what should I do?
Thank a lot again. I am waiting my BIOS IC programmer to arrive. I will try immediately after.
no way. Q30H is Emerald Rapids and not a WS processor.
SPR-SP D0 only work because there are SPR-WS ES stepping D0(step 3) processors.
Last edited:
Anyone have IPEX benchmarks for 4th or 5th gen ES, QYFR or SRMJ? 111gb/s on full 16 DIMMs on int8 7b model but only getting 2 tokens/sec. AVX/AMX getting blocked? Tried node assigning too, no luck.
SRMJ on HBM saturated I am reaching about 5 token/sec and made sure have memory bound HBM, but am not even saturating bandwidth. Though do see prompt generated improvements compared to DDR5 for 9480.
Something BIOS am missing on both platforms? AVX throttling? ES woe?
Maybe not best place to ask this in particular.
SRMJ on HBM saturated I am reaching about 5 token/sec and made sure have memory bound HBM, but am not even saturating bandwidth. Though do see prompt generated improvements compared to DDR5 for 9480.
Something BIOS am missing on both platforms? AVX throttling? ES woe?
Maybe not best place to ask this in particular.
In any case, you need to disable NUMA virtualization. Under Windows OS, you should not wait for normal speeds. You can also use the ik_llama.cpp fork for model interference. If you have a two-socket system, then you will not be able to fully load it due to UPI speed limits.
I previously used a two-socket system in conjunction with several GPUs. Through KTransformers, one model can be loaded onto each socket, thereby significantly increasing the speed of access from GPU to RAM.
Yes, I run dual socket configs and assign by socket, 2,3,6 and 1,4,5 already with breakout boards broadening that up to 9+8 GPUs at x4. This was only a test I was looking at with CPUs on other results some people have on non ES examples. But I figured it out! I apparently was not running int8 and was on bf/fp16.
Non-ES info but I've noticed recently market had price adjustment (or new-obsolete stock release) for SPR 8473C (for Microsoft) and 8487C (not sure to whom those were intended for - AWS, GCP, AliBaba, IBM, etc.) at some ok-ish prices, I think both models are designed for multi-socket configurations (UPIs unlocked),
None of sellers on ebay are first-hand owning it - therefore they're only resellers (and just charge some margin on input price), so don't expect material discounts (I think around 5% max), which probably still makes those CPUs a bit overpriced (subject to how much value you can extract for your use-scenarios of course), at these prices I would get those 3-4 years ago (and was actually submitting offers in this range) but not now anymore.
None of sellers on ebay are first-hand owning it - therefore they're only resellers (and just charge some margin on input price), so don't expect material discounts (I think around 5% max), which probably still makes those CPUs a bit overpriced (subject to how much value you can extract for your use-scenarios of course), at these prices I would get those 3-4 years ago (and was actually submitting offers in this range) but not now anymore.
Last edited:
i guess these are 806F6 stepping E3 EV-QS (early validation QS)
8487C EV-QS
8473C EV-QS Q172
correction: non QS at same low prices(ebay)
Last edited:
this does makes sense, ebay images for 8473C show L240.. (L= Malaysia, 2=year 2022, week 40) - period they started extending SKU range offering,
(and for 8487C = L211.. , year 2022 week 11), although as you have explained previously - seller have no troubles re-print anything they need on lids.
they usualy show production units to explain what's coming and to hide the source of the QS.
QS: you will get a processor with "Intel Confidential" printed on it not what pictured.
example: recently sold 8470 E3 QS:
ebay listing 8470
i asked for QDF, seller replied: " this is Q16R "
sell ES/QS is just not allowed(for the original ES customer), reprint to sell as retail is illegal/crime act, even in china.
Last edited: