2 ms·
> A similar threat is posed from ASIC chips that are dedicated to LLM tasks, but at least in that case Nvidia can still compete for a specific hardware design r
by godelski 3y ago
> A similar threat is posed from ASIC chips that are dedicated to LLM tasks, but at least in that case Nvidia can still compete for a specific hardware design rather than overcoming an entire category of commodity hardware.
But also consider the reason Nvidia is doing so well in the first place. The reason is because they were already developing hardware that specialized at performing tensor operations. Maybe not at the size or always the same types we see in ML, but not very far either. There's reasons why they aren't filling cards with tensor cores. But they are clearly developing specialized hardware for ML tasks. I'm not sure betting on LLMs sticking around is the best bet though. I'll be very impressed if scale is all you need.