> Has the whole thing been all about memory bandwidth all along Yeah, sort of. LLMs like llama at a batch size of 1 are hilariously bandwidth bound. Stable D

> Has the whole thing been all about memory bandwidth all along Yeah, sort of. LLMs like llama at a batch size of 1 are hilariously bandwidth bound. Stable Diffusion less so. Its still bandwidth heavy on GPUs, but compute is much more of a bottleneck.