3 ms·
Haven't CPUs largely plateaued? They're just getting bigger, more power hungry, and multiplying cores. Physics has hard limits and Moore's law is long dead.
by paulryanrogers 2mo ago
Haven't CPUs largely plateaued? They're just getting bigger, more power hungry, and multiplying cores.
Physics has hard limits and Moore's law is long dead.
- girishso 2mo agoAFAIK these don't have to be CPUs. ASICS are well suited for this purpose. This will be the most cost effective way to run LLMs.