3 ms·
The interesting thing is that at some point, its very possible that LLM (or rather just transformer based large models) are going to be used to create ASIC or a
by ActorNightly 2y ago
The interesting thing is that at some point, its very possible that LLM (or rather just transformer based large models) are going to be used to create ASIC or at least used to program much cheaper FPGAs for the specific applications, so in fact, GPU use will still decline.
- CharlieDigital 2y agoI feel like this is unlikely because it's not like a crypto algorithm where there's really only one way to compute the output. There are various optimizations, algorithms, and approaches and having more general purpose hardware yields flexibility.
- ActorNightly 2y ago>crypto algorithm where there's really only one way to compute the output. With ML, its basically just matrix math. You can easily build ASIC if you know your Tensor sizes for inference, because the memory locations become static, which means your circuitry gets way simpler.
- yencabulator 2y agoSome time after an LLM programs its own successor, without bugs. I won't be holding my breath.