3 ms·
> It is as related to "Agentic $whatever" as your toaster is related to it These things have hardware FP8 support, and a 1.8TB/s full mesh interconnect betwee
by pdpi 7mo ago
> It is as related to "Agentic $whatever" as your toaster is related to it
These things have hardware FP8 support, and a 1.8TB/s full mesh interconnect between CPUs and GPUs. We can argue about the "agentic" bit, but those are features that don't really matter for any workload other than AI.
- kibibu 7mo agoWould cloud gaming platforms benefit from the interconnect?
- pdpi 7mo agoDon't think they would. Games aren't nearly as hungry for memory bandwidth as LLMs are. Also, I expect that the VRAM/GPU/CPU balance would be completely out of whack. Something would be twiddling its thumbs waiting for the rest of the hardware.
- dmitrygr 7mo agomem bw between cores matters for .... literally all workloads that are not single-core (read: all). And FP8 matters not at all cause inference on cpu is too slow to be of any use whatsoever in the days of proper accelerators
- pezezin 7mo agoThe huge interconnect would also useful be for HPC tasks. The FP8 not so much, HPC still loves FP64.