4 ms·
I am surpised that a lof of folks are surprised that neural networks work that well. I mean, did they really expect that we wouldnt approximate the brain cognit
by trebaud 22d ago
I am surpised that a lof of folks are surprised that neural networks work that well. I mean, did they really expect that we wouldnt approximate the brain cognitive capabilities at some point as we scale up compute??
This is rather obvious to me, but apparently not to everyone. My guess is that a lot of tech people have an immature model of the universe, have not read a lot of scientific, philosophical and cognitive literature. Or have not really taken the time to think or are not interested on such topics because they would rather spend time thinking about the nitty gritty and mundane workings of the framework du jour.
- ben_w 22d agoNeural nets are a toy approximation of biological neurons; and even if every synapse mapped to a weight (it's more complex than that but AFAICT even the brain scientists are not quite sure how much more complex), the biggest LLMs are around 0.2-1% of a human brain.