3 ms·
> My point of view on this is that this type of AI cannot reason but it can answer the glass door push or pull question (see https://news.ycombinator.com/item?
by chii 3y ago
> My point of view on this is that this type of AI cannot reason
but it can answer the glass door push or pull question (see https://news.ycombinator.com/item?id=35506666 https://news.ycombinator.com/item?id=35506666), albeit a bit off (it didn't understand the mirrored writing).
But some other models had gotten the right answer.
This points to some evidence of being able to derive logical reasoning. Just because the model is "doing statistical guessing of the next word", doesn't mean this process does not produce logical reasoning as an outcome.
- vidarh 3y agoIt's also not at all clear that reasoning is anything more than "doing statistical guessing of the next word" or something very similar. We clearly have some other aspects, but it's not clear it's all that much beyond ongoing stimulus and memory in terms of capabilities.
- sfn42 3y agoIt can only answer questions it has been trained to know the answers to. Ask it an original question that isn't in the training set and it gets it wrong. This is clear evidence that it does not possess logical reasoning skills.
- vidarh 3y agoThis is simply not true. I've asked it many questions it has not been trained to know the answers to because they involve e.g. code it won't have seen in the wild, and gotten the right answer back. In one of my other responses I dug into how I'd asked it to analyse a piece of assembly generated with a compiler I've written, from a test program that didn't exist at GPT4's knowledge cutoff, and it did just fine.
- sfn42 3y agoI'm not saying it has to be trained on the specific question directly, it has to be trained on similar data. It has a decent knowledge of programming languages because it has been trained on a lot of data surrounding them. Being capable of logic and reasoning is more of an illusion that arises as a result of the enormous amount of training they put in. You can make simple questions that it can't answer, so you can't claim it has logical reasoning if it fails at simple tasks. It just looks a lot like it has logical reasoning because it has been trained on text displaying logical reasoning.