3 ms·
No, ChatGPT is not a "Chinese Room". It's not big enough. The classic "Chinese Room" is a pure lookup, like a search engine. All the raw data is kept. But the
by Animats 4y ago
No, ChatGPT is not a "Chinese Room". It's not big enough.
The classic "Chinese Room" is a pure lookup, like a search engine. All the raw data is kept. But the network in these large language models is considerably smaller than the training set. They extract generalizations from the data during the training phase, and use them during generation. Exactly how that happens or what it means is still puzzling.
- drdeca 4y agoI don’t think the “Chinese Room” is supposed to necessarily be pure lookup. The point is that the person is the only one doing stuff, and they don’t understand Chinese, and so there’s nothing understanding Chinese. This doesn’t at all use the instructions in the room being just a static lookup table.
- foldr 4y agoIndeed. IIRC Searle’s point is that any finite approximation of a Turing Machine (at least if defined over finite inputs) can in principle be replaced by a ginormous look up table. But if it matters, the person in the Chinese room can of course make notes on scraps of paper and implement a system more like a Turing machine.