It occurred to me after writing that post that understanding is just what the algorithm feels like from the inside. A human understands English instructions in

It occurred to me after writing that post that understanding is just what the algorithm feels like from the inside. A human understands English instructions in a way that lets them apply those instructions to Chinese language tasks with the same meaning. We might ask, what is this in the physical structure of the human brain? What’s the specific arrangement of neurons and neuronal connections that is doing this? Assume neuroscience has the answer and can give you a picture of the neurons in question and detail their activation pattern. When we use understanding to do our language task, we don’t actually feel our neurons lighting up, we don’t feel an activation pattern rush through our brain. It just feels like we understand, because that’s what the algorithm feels like from the inside. https://www.lesswrong.com/posts/yA4gF5KrboK2m2Xu7/how-an-algorithm-feels-from-inside https://www.lesswrong.com/posts/yA4gF5KrboK2m2Xu7/how-an-alg...