3 ms·
What would the equivalent be in AI? A dirt cheap inference chip for consumer hardware? 2T sized networks on a cell phone so we don't need data centers? Your an
by jvanderbot 1y ago
What would the equivalent be in AI? A dirt cheap inference chip for consumer hardware? 2T sized networks on a cell phone so we don't need data centers?
Your analogy required no technological innovation, just a good look at solution space. Where's the microwave tower for AI that everyone is missing?
- zipy124 1y agoMore efficient architecture/training regimes would be a big one.
- lumost 1y agoA breakthrough in grokking/regularization, quantized or sparse training methods, quantum optimization, or more efficient architecture could reduce infrastructure needs. Although any of these could simply advance the parrot frontier without solving the prisoner’s dillema driving infrastructure spend at ai firms.