3 ms·
>> 100 trillion synapses (very roughly analogous to transistors?) Not even remotely comparable * its unlikely synapses are binary. Candidly they probably serv
by zer00eyz 3y ago
>> 100 trillion synapses (very roughly analogous to transistors?)
Not even remotely comparable
* its unlikely synapses are binary. Candidly they probably serve more than one purpose.
* transistor count is a bad proxy for other reasons. A pipeline to do floats are not going to be useful for fetch from memory. "Where" the density lies is important.
* Power: On this front transistors are a joke.
* The brain is clockless, and analog... frequency is an interesting metric
Binary systems are going to be bad at simulating complex processes. LLM's are a simulation of intelligence, like forecasting is a simulation of weather. Lorenz shows us why simulation of weather has limits, there isnt some magical math that will change those rules for ML to make the leap to "AGI"
- luyu_wu 3y agoTransistor power is really not a joke. Synapses would take far far FAR more power at close to similar frequencies. Biological neurons are incredibly inefficient.
- goatlover 3y agoBiology is incredibly efficient at what it does well though. Thus only 20 watts of brain energy to coordinate everything we do. We didn't evolve to be mentats.