18 ms·
tl;dr or ELI5 please?
by giardini 3y ago
tl;dr or ELI5 please?
- x86x87 3y agoThe brain is just a bunch of ifs
- taneq 3y agoQuantity of ifs has a quality all of its own. After all, a CPU is just a bunch of transistors, and a transistor is just an 'if'.
- x86x87 3y agoThis was the ELI5 part. Of course that the wiring of the ifs is as importany as the quantity of ifs
- taneq 3y agoAah, true, and therein lies the rub. I definitely think the structure and function of cortical columns as described by Numenta is getting close to the mark on a part of it. It seems to me like Transformer models are doing something very similar to this, where each attention head is roughly analogous to a cortical column. You can't build a mind on prediction alone, though (or can you?) so we need helper structures like the hippocampus.
- x86x87 3y agoprediction is an essential part. basically between the state you have + the inputs from the sensors you generate a prediction. this prediction is compared to the "real world" and the state is adjusted until the prediction matches the output.
- gridspy 3y agoA hidden state machine plus a neural net appears to be similar to how mice learn to navigate a maze. If you hold them still and probe their brain while they navigate in VR you see a state-machine map appear in their mind. That map varies if the VR map varies.