3 ms·
The big models will never run locally, and I doubt that titan and co will run locally, just way to much resources needed
by Bombthecat 10mo ago
The big models will never run locally, and I doubt that titan and co will run locally, just way to much resources needed
- ben_w 10mo ago"never" vs https://en.wikipedia.org/wiki/Koomey%27s_law https://en.wikipedia.org/wiki/Koomey%27s_law Observably, the biggest models we have right now have similar complexity to a rodent's brain, which runs on far less power. Limiting factors for chips in your phone is power, power efficiency is improving rapidly.