There wasn't a "killer app" for on-die AI accelerators until roughly this March. Until about nine months ago, the only widely-discussed ideas were re-aiming pup

There wasn't a "killer app" for on-die AI accelerators until roughly this March. Until about nine months ago, the only widely-discussed ideas were re-aiming pupils to make your video call feel more natural, and applying background filters. So today's on-die AI accelerators were, as far as I can tell, a cautious bet. It turns out caution was warranted, because LLM's need large amounts of memory bandwidth and capacity far more than they need a specialized neural compute engine.