3 ms·
> Is it not possible that our brains are also just "large scale statistical knowledge assimilation" machines? Yes but we do better generalization, with fewer o
by srvmshr 4y ago
> Is it not possible that our brains are also just "large scale statistical knowledge assimilation" machines?
Yes but we do better generalization, with fewer or even zero data & are contextually aware
- bb88 4y agoOkay, but is that because brains are just better at optimization of linear algebra? Or is quantum mechanics involved? I think we can agree rocks aren't conscious. But are dolphins?
- quinnjh 4y agoSo long and thanks for all the fish. So sad that it has come to this...
- srvmshr 4y ago> Okay, but is that because brains are just better at optimization of linear algebra? Or is quantum mechanics involved? No such magic. The average ML neuron is connected in layers to maybe 100 other neurons. The brain is connected to far more ~1000 -10000 So its the dense interconnectivity at play. Whatever successes we have had with LLM now is because we are increasing the parameters of the network (although we haven't similarly scaled connectivity if I am not wrong, but definitely making progress there - for e.g. Pathways networks from Google by Jeff Dean et. al)
- samoppy 4y ago