3 ms·
It can only answer questions it has been trained to know the answers to. Ask it an original question that isn't in the training set and it gets it wrong. This i
by sfn42 3y ago
It can only answer questions it has been trained to know the answers to. Ask it an original question that isn't in the training set and it gets it wrong. This is clear evidence that it does not possess logical reasoning skills.
- vidarh 3y agoThis is simply not true. I've asked it many questions it has not been trained to know the answers to because they involve e.g. code it won't have seen in the wild, and gotten the right answer back. In one of my other responses I dug into how I'd asked it to analyse a piece of assembly generated with a compiler I've written, from a test program that didn't exist at GPT4's knowledge cutoff, and it did just fine.
- sfn42 3y agoI'm not saying it has to be trained on the specific question directly, it has to be trained on similar data. It has a decent knowledge of programming languages because it has been trained on a lot of data surrounding them. Being capable of logic and reasoning is more of an illusion that arises as a result of the enormous amount of training they put in. You can make simple questions that it can't answer, so you can't claim it has logical reasoning if it fails at simple tasks. It just looks a lot like it has logical reasoning because it has been trained on text displaying logical reasoning.