4 ms·
Or they invested in GPU’s to mine bitcoin and the ASIC’s are just starting to arrive. At least for inference, GPU’s are not the end game. And who knows if train
by richardw 2y ago
Or they invested in GPU’s to mine bitcoin and the ASIC’s are just starting to arrive. At least for inference, GPU’s are not the end game. And who knows if training will continue to need them.
If so there could be another round of investment at a better performance per watt, and specialised hardware will be the key. They’ll all be building custom chips.
- JonChesterfield 2y agoThe specialised ASIC approach is less likely to be useful for other things though, whereas GPUs are starting to threaten to run arbitrary software well.
- richardw 2y agoSure. My base case is that LLM’s find uses and that compute gets cheaper and more efficient, which helps make more business cases possible. Investing in current state GPU’s doesn’t seem that useful in that world. Nvidia is priced for a monopoly and I’m not sure it is one.