4 ms·
Why? Are not grammatical errors and idiosyncrasies part of the data set that chatGPT is trained on and thus also a predictable set of tokens?
by krainboltgreene 3y ago
Why? Are not grammatical errors and idiosyncrasies part of the data set that chatGPT is trained on and thus also a predictable set of tokens?
- btilly 3y agoSuch errors are rare enough that they are almost never the most likely next token. Therefore ChatGPT only makes such mistakes when it is given good reason to do so.
- krainboltgreene 3y agoChatGPT cannot reason.