Where We Expect AMD EPYC 9006 CPUs in the era of Agentic AI

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

Jeffrey1910

Member
Nov 10, 2024
32
21
8
I don't know if we'll enter the agentic AI era with just better CPU's, even if they are engineered from the ground up for this.
Software side still is going to need a lot of work to make the best of the hardware.

But to just ignore the AI part for a moment, these CPU's are just a ludicrous leap forward in compute in general. (the largest we had in years)
The power and cooling required are also ludicrous, but when smaller non hyper-scale sku's come available when demand stabilizes eventually.
It will enable lot's of new possibilities in general IT as most improvement made for AI happen to also benefit other industries and use cases.
And of course lots of local hosted models and inferencing generally.