4 ms·
brains do it with 20 watts because theyre analog. llms require massive amounts of power and this isnt changing any time soon without a breakthrough
by modzu 2mo ago
brains do it with 20 watts because theyre analog. llms require massive amounts of power and this isnt changing any time soon without a breakthrough
- dofm 2mo agoAnd a breakthrough in hardware, specifically.
- skohan 2mo agoThere are exciting developments underway in analog computing.
- Arwill 2mo agoThere are arguments that the brain is quantum, as in parts of it locally using quantum effects. Which if true, might make a counter-argument, as there will be bigger data centers needed if the goal is to simulate the brain classically. On the other side, advancement in quantum computers would make current LLM inference much faster. Because of the extreme cooling needed, i dont think the energy demand would become less. With AI companies talking about AGI, i sometimes wonder if they really need the machines for serving inference to customers, or they have a formula for computational capacity that could run an AGI, and they just want to reach that level.
- joquarky 2mo ago> the brain is quantum Doesn't that apply to everything that exists in the material world?
- twodave 2mo agoNaively-speaking, sure. I think GP was referring to the act of information-processing, specifically, though.
- notnullorvoid 2mo agoIf the brain does rely on quantum effects, it's still possible the quantum effects in use are able to be simulated efficiently on a classical computer. For example if it's a matter of signal transfer rather than quantum computation, that could be simulated rather easily.
- HDBaseT 2mo agoI wonder what company will release the first "quantum LLM"
- seanmcdirmid 2mo agoAlibaba probably. They are doing work on both already, that is if a quantum LLM is even feasible.
- Koffiepoeder 2mo agoCan you give me some pointers? Last I heard researches simulated an entire brain of a fruitfly with just a classic neuron approach [0] and if I recall it worked great. I know a human brain is many orders of magnitude more complex, and that there are some birds that use quantum navigation - so it's certainly not impossible by any stretch, though I am quite interested in this statement since it's the first I hear about it. [0]: https://flybrain.app/ https://flybrain.app/
- ziiinq 2mo ago[dead]
- mhjkl 2mo agoIf you adjust for writing speed, this model is already more efficient than humans. It can run at 233 tps on a 5090 which is roughly 10k words per minute compared to human typing speed of 80 wpm. If you duty cycle it down from 575 watts of 5090 to human speeds it’s about 5 watts.