5 ms·
Sometimes I wonder if our brain is some heuristic tool or just an infinite amount of cobbled together fast paths. Like, there are so many adults that when face
by SecretDreams 2y ago
Sometimes I wonder if our brain is some heuristic tool or just an infinite amount of cobbled together fast paths.
Like, there are so many adults that when faced with a new task, they really struggle to pick it up. Is this because tangentially related fast paths weren't learned in their "training phase"?
- lupire 2y agoA century of neuroscience has said "yes" every time and every way that has been checked.
- zamadatix 2y agoI think a particularly useful "feature" of the brain is it can often identify when it doesn't have a fast path (or the fast path is broken) for something and then revert to trying inefficient and generic approaches, even after the optimal learning period has passed. This is a start difference to LLMs where it's either learned or not, "just add noise". Models like o1 take things in a very small step in that kind of direction.
- SecretDreams 2y agoYa, basically LLMs just always "go for it" even if they've got no chance of getting it right. Just needs a feature where it can identify when it's interpolating vs extrapolating.. since it's not so great at the latter :).