3 ms·
It's not capable of reasoning and it has no knowledge of how the world works. That's why it often spits out nonsense and falsehoods. To oversimplify a bit, it'
by smt88 3y ago
It's not capable of reasoning and it has no knowledge of how the world works. That's why it often spits out nonsense and falsehoods.
To oversimplify a bit, it's a next-word-in-the-sentence prediction engine.
- jstx1 3y agoWhile you're at it, throw out your calculator because it has no conception of numbers and doesn't know anything about mathematics.
- shrimp_emoji 3y agoDamn, what does that say about me then?
- phoe-krk 3y agoAnd your staircases, because they do not have the concept of scaling heights little by little instead of all at once. /s
- smt88 3y agoYou're making my point for me. My calculator doesn't has a conception of numbers or math. It can only do arithmetic algorithms that it was programmed to do. It is a regurgitation machine. GPTs are similar. They can tell you that the sky is blue and they can tell you why the sky is blue, but they can't translate that to a hypothesis about how the wavelengths of light also influence the properties of lasers. If they've ingested information about these different topics, they can make the connection, but otherwise they can't.
- cjbprime 3y ago> To oversimplify a bit, it's a next-word-in-the-sentence prediction engine. Turns out that when you ask LLMs to predict the next word in the sentence, and then train billions of parameters on billions of sentences, they realize the best way to improve at predicting the next word is to understand why the world works the way it does.