Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
).Just wondering does anyone know if this chip will work on the ace? Intel Xeon Max 9480 56-Core 1.9GHz SRMJA Sapphire Rapids HBM Processor, Grade A- | eBay
Intel Xeon Max 9480 56-Core 1.9GHz SRMJA Sapphire Rapids HBM
Intel Xeon Max 9480 56-Core 1.9GHz SRMJA Sapphire Rapids HBM
I encountered a problem with the assembly QYK8 + ASUS Pro WS W790E-SAGE SE + RDIMM 6800Mhz 16GB from kingston + Noctua cooler. I installed 2 memory sticks in the right slots according to the manual, the stock BIOS was 0215. Only the processor, memory and video card were installed. Once I saw POST code 31 (memory installed), from the very beginning there was no image on the monitor (I did not use a UEFI video card) but the USB keyboard responded to pressing, but then I reset the CMOS and the processor LED (1st LED in a group of four) on the upper right began to light up red. I updated the BIOS to 0805 , then to 1202, wiped the processor with alcohol, but unsuccess - CPU red LED is light . I do not have other processors, as well as a motherboard. What else can you advise to do?
you got POST codes, return to this config.
GPU may not compatible and if you see image very late after memory and PCIe initialisations.
use the onboard analog VGA 15pin (integrated in ASPEED BMC)
Today I add an extra 8-pin power cable near the 24-pin connector (from the left) and the total number of cables = 4. A pair of 8-pin + 24-pin and an extra 8-pin to the left of the 24-pin connector. I saw the post but the system hangs in BIOS (latest version 1502), it seems something with the C-states? Who uses what BIOS version with QYK8 and other D0 processors?
normaly freeze at OS load. try 0215.
ES and latest BIOS is not a good idea. can work but must not.
In total, I flashed 5 different BIOSes to this board and as a result, everything hangs at the stage of entering the BIOS or on the first BIOS screen. I tried to install 1, 2 and 4 memory sticks, their volume is determined correctly. The 1 kW power supply previously worked without problems. The motherboard itself is new, the processor - QYK8 from Ebay, Noctua cooling with 2 coolers, plus 2 additional coolers are installed to blow the VRM and socket. I have run out of ideas, something is not working properly, installing and reinstalling the processor with wiping it with alcohol did not help, using integrated or discrete graphics as well. I think either the processor QYK8 or the board.
anyone here have all 8 memory channels filled would you be able to run llama-bench, my qquad channel results are below i only got like 12-13 t/s with dual channel so i think memory channels effect the performance a lot
32 threads with half cores disabled
'/Documents/llama.cpp/build/bin/llama-bench' --numa distribute -t 32 -m '/Downloads/llama-2-7b.Q4_0.gguf' -p 0 -n 128,256,512
| model | size | params | backend | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 32 | tg128 | 21.92 ± 0.83 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 32 | tg256 | 22.97 ± 0.13 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 32 | tg512 | 22.47 ± 0.02 |
104 threads with all cores enabled
'/Documents/llama.cpp/build/bin/llama-bench' --numa distribute -t 104 -m '/Downloads/llama-2-7b.Q4_0.gguf' -p 0 -n 128,256,512
| model | size | params | backend | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 104 | tg128 | 24.22 ± 0.05 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 104 | tg256 | 23.95 ± 0.03 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 104 | tg512 | 23.33 ± 0.01 |
32 threads with half cores disabled
'/Documents/llama.cpp/build/bin/llama-bench' --numa distribute -t 32 -m '/Downloads/llama-2-7b.Q4_0.gguf' -p 0 -n 128,256,512
| model | size | params | backend | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 32 | tg128 | 21.92 ± 0.83 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 32 | tg256 | 22.97 ± 0.13 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 32 | tg512 | 22.47 ± 0.02 |
104 threads with all cores enabled
'/Documents/llama.cpp/build/bin/llama-bench' --numa distribute -t 104 -m '/Downloads/llama-2-7b.Q4_0.gguf' -p 0 -n 128,256,512
| model | size | params | backend | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 104 | tg128 | 24.22 ± 0.05 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 104 | tg256 | 23.95 ± 0.03 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CPU | 104 | tg512 | 23.33 ± 0.01 |
we have had defective new motherboards, rare but happen.
how do chinese (often) test CPU ?
they put them in socket, turn on the motherboard and try if they get in to BIOS = pass.
try to get other CPU e.g. QYFP/QYFQ (and not QYK8) to sort things out.
90% CPU issues, Engineering Samples are are expected to be full of bugs which isn't even officially supported by MB/BIOS. ES in general is quite a pain and masochism. I prefer to avoid such gamble whenever is possible.
I have spare QYFQ which doesn't work on my SM MB and ebay seller never requested it to be sent back - just refunded order more than a year ago (I think it was for around $400 back then).
Can send it via ebay as "for parts" item to whoever is in UK for £10 to cover postage.
very unhelpfull comments. SPR D0 are working fine for many people here. some bad CPU can happen with all types of them.
e.g.
i have had a platinum 8176 (prod.unit Retail, no ES) went fine into BIOS but BSOD in OS load.
defective core(s) - enableing only 10 cores got me in OS.
(edit: no core disable bitmap because supermicro motherboard )
Last edited:
Gigabyte MS33-AR0 + EMR Q2SR + 8 x DDR5 64Gb, 4800 MHz (Kingston Server Premier KSM48R40BD4TMM-64HMR).
BIOS R07 (tweak RolloZ170): Standart Perfomance, Virtual Numa = Enable (4 nodes).
https_://github.com/ggerganov/llama.cpp/releases/download/b4663/llama-b4663-bin-win-cuda-cu12.4-x64.zip
build: c026ba3c (4663)
https_://huggingface.co/TheBloke/Llama-2-7B-GGUF
D:\llama_cpp>llama-bench.exe --numa distribute -t 32 -m llama-2-7b.Q4_0.gguf -p 0 -n 128,256,512
| model | size | params | backend | ngl | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CUDA,RPC | 99 | 32 | tg128 | 29.15 ± 0.04 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CUDA,RPC | 99 | 32 | tg256 | 28.61 ± 0.08 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CUDA,RPC | 99 | 32 | tg512 | 27.66 ± 0.21 |
D:\llama_cpp>llama-bench.exe --numa distribute -t 104 -m llama-2-7b.Q4_0.gguf -p 0 -n 128,256,512
| model | size | params | backend | ngl | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CUDA,RPC | 99 | 104 | tg128 | 19.91 ± 0.38 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CUDA,RPC | 99 | 104 | tg256 | 20.28 ± 0.07 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CUDA,RPC | 99 | 104 | tg512 | 19.79 ± 0.04 |
D:\llama_cpp>llama-bench.exe --numa distribute -t 128 -m llama-2-7b.Q4_0.gguf -p 0 -n 128,256,512
| model | size | params | backend | ngl | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CUDA,RPC | 99 | 128 | tg128 | 18.42 ± 0.28 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CUDA,RPC | 99 | 128 | tg256 | 18.47 ± 0.17 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | CUDA,RPC | 99 | 128 | tg512 | 17.82 ± 0.06 |
Clear Linux OS :
./llama-bench --numa distribute -t 32 -m llama-2-7b.Q4_0.gguf -p 0 -n 128,256,512
| model | size | params | backend | ngl | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | RPC | 99 | 32 | tg128 | 33.71 ± 2.58 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | RPC | 99 | 32 | tg256 | 37.20 ± 0.85 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | RPC | 99 | 32 | tg512 | 37.35 ± 0.52 |
./llama-bench --numa distribute -t 104 -m llama-2-7b.Q4_0.gguf -p 0 -n 128,256,512
| model | size | params | backend | ngl | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | RPC | 99 | 104 | tg128 | 29.59 ± 2.32 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | RPC | 99 | 104 | tg256 | 32.03 ± 0.57 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | RPC | 99 | 104 | tg512 | 31.69 ± 0.08 |
./llama-bench --numa distribute -t 128 -m llama-2-7b.Q4_0.gguf -p 0 -n 128,256,512
| model | size | params | backend | ngl | threads | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | ------------: | -------------------: |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | RPC | 99 | 128 | tg128 | 28.14 ± 2.36 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | RPC | 99 | 128 | tg256 | 28.82 ± 1.15 |
| llama 7B Q4_0 | 3.56 GiB | 6.74 B | RPC | 99 | 128 | tg512 | 27.26 ± 0.47 |
Last edited:
so some improvement but not as big as going from 2 to 4 thanks its also kinda itneresting that after like 32 threads speed doesnt increase even though all threads are used i saw all of mine going to 100%
oh just saw the clear linux result also crazy that it almost doubles the performance with linux, maybe thats more aligned with my 2 to 4 channel increase so maybe memory channel effect linux performance more than it does on windows my benchmarks are from arch linux
Last edited:
Okay quick question. It never dawned on me to ask what Windows Version is everyone running? I am on Windows 10 22H2 without debloat (could prob do this but haven't gotten around to it). I think I found a reason to goto Windows 11 24H2 and that was for the Android subsystem, but I see that is being removed March 5. I found Google Play for PC and that's works on 10.
Here's an update for those using Xeon Platium 8480+ QYFS paired with Ryzen 6900XT and 128GB DDR5:
Here's an update for those using Xeon Platium 8480+ QYFS paired with Ryzen 6900XT and 128GB DDR5:
- Have to restart once a week, sometimes once every two weeks. But other than that, computer stays on 24/7.
- Firefox has issue with delayed playback with Youtube videos. Chrome plays youtube videos just fine. Could just be a Google hates Firefox thing.
- Some games are not smooth with high motion movement. Example: Genshin Impact, moving mouse left to right creates artifacts. On Ryzen 5950x movement is butter smooth.
JosefHrib, even though your response hasn't posted yet (got an email), Thanks for continuing us down the rabbit hole. May have to do some extra gig work to move on up. I found you newest thread. Nice!!!
For example EMR Q2SR 64core 320MB L3 350W cost plus minus same as SPR QYFS 56core 105MB L3 350W. Only minus is that user must exchange board from W790 to C741. Or wait on GNR. Now I live with Q2SR and it is good cpu.
Last edited: