4 ms·
Is that not literally the exect opposite of the direction asics for LLM inference is going?
by acedTrex 1mo ago
Is that not literally the exect opposite of the direction asics for LLM inference is going?
- einpoklum 1mo agoMy point is, that if companies develop ASICs for LLM work, then GPUs will stop being the go-to computation device for these workloads, and that will mean, hopefully, that their architectures will stop being warped so as to cater to LLM work.