> Let's take language learning as an example: do you consider a foreigner with a dictionary to be just as expressive as a native speaker? Perhaps there is value

> Let's take language learning as an example: do you consider a foreigner with a dictionary to be just as expressive as a native speaker? Perhaps there is value in testing the immediate knowledge of the student rather than their lookup skills? You may be well aware of this, but you've essentially converged on the classical Chinese Room thought experiment [0]. It's usually applied to the philosophical question as to what does and does not constitute intelligence in the context of AI, but it's interesting how it is also applicable to what does and does not constitute knowledge in the context of learning. [0] https://en.wikipedia.org/wiki/Chinese_room https://en.wikipedia.org/wiki/Chinese_room