That’s a lot to parse, so I’m kinda hand waving, but the memory bandwidth emphasis seems like a great fit for most LLMs at least if not also some ViTs and other

That’s a lot to parse, so I’m kinda hand waving, but the memory bandwidth emphasis seems like a great fit for most LLMs at least if not also some ViTs and other attention-style architectures on both training and inference? Certainly sounds like the price is right. Am I missing something key either conceptually or by failing to read all the stats closely?