I'm not sure about training, but when it comes to running LLMs on 9654, I found it hit bandwidth bottlenecks well before max core count. So honestly 32-48 cores per socket was enough. I also did it quite a while ago, like couple years, and ran into issues with NUMA. I would love to hear how...