4 ms·
No, ChatGPT isn’t AI in that sense. It can fire back documentation at you, but a lot of what it does is just look at the word it’s spit out, and pick the next w
by Gollapalli 3y ago
No, ChatGPT isn’t AI in that sense. It can fire back documentation at you, but a lot of what it does is just look at the word it’s spit out, and pick the next word or snippet that looks right. Same thing with code. It just spits out what it’s trained to interpolate the next snippet to be.
Anything involving genuine reasoning needs to be done by a human. It’s a great documentation parser. A step up in search engines. But a thinking machine it is not (yet).
- valine 3y agoIf this were true ChatGPT would be useless for any topic that doesn't have a vast Q&A dataset. The purpose of instruct fine tuning is to illicit the model to output in a question answer format. The bulk of the model's knowledge comes from the unstructured dataset. I'm also not sure how "reasoning" at inference time is relevant here. You seem to be conflating unsupervised offline training with inference. The ironic thing is that the behavior you describe actually works, you can try it right now. Add code documentation to your context window and ChatGPT will happily write code using that documentation as reference.