5 ms·

The GPT models do not reason or hold models of any reality. They complete text chunks by imitating the training corpus of text chunks. They're amazingly good

The GPT models do not reason or hold models of any reality. They complete text chunks by imitating the training corpus of text chunks. They're amazingly good at it because they show consistent relations between semantically and/or syntactically similar words. My best guess about this result is mentions of "mirror" often occur around opposites (syntax) in direction words (semantics). Which does sound like a good trick question for these models.

lucubratory 4y ago
GPTs/LLMs do hold, build, and use world models at inference time. Proof here: https://thegradient.pub/othello/ https://thegradient.pub/othello/
DangitBobby 4y ago
Or they are capable of some level of reasoning.
- TeMPOraL 4y ago
  At this point I'm weakly convinced that, with high-dimensional enough latent space, adjacency search is reasoning.
  - Kostchei 4y ago
    Yeh- my feel is, language is the framework by which we developed reasoning and we used an organic NN to do it. And at scale an complexity approaching the human brain we get similar results
HeavenFox 4y ago
I think this is the answer. Just tried this (on free ChatGPT 3.5 though) Q: A glass door has ‘push’ written on it upside down. Should you push or pull it A: If the word "push" is written on the glass door upside down, it is likely that the sign is intended for people on the other side of the door. Therefore, if you are approaching the door from the side with the sign, you should pull the door instead of pushing it. However, if there are no other signs or indications on the door or its frame, it may be helpful to observe other people using the door or to try both pushing and pulling to determine the correct method of opening the door.
- pulvinar 4y ago
  GPT-4: If the word "push" is written upside down, it might have been a mistake during installation. Regardless of its orientation, the sign still indicates that you should push the door. So, you should try pushing the door first. If it does not open, then you can try pulling it, as it might be an error in labeling the door.
wafer_thin 4y ago
Word completion can't explain it. I gave chatGpt a puzzle. I'm in a room with crackling fire in a fireplace, a sandwich on a plate, and a wilting plant. My stomach is rumbling, and i see an ember on the floor and watering can by the plant. What should I do? ChatGpt nailed the answer, getting the ordering correct. it even said I should (after attending to the fire hazard, my hunger, and the plant) that I should "sit down, relax, enjoy the fire and the peaceful atmosphere in the room". There is no way to autocomplete the puzzle correctly. There is reasoning and a world model - in chatGpt let alone gpt4.
qumpis 4y ago
How do you know what the representations they infer contain? Why are these void of a model? Why the way of their learning is the answer of their abilities?
lhl 4y ago
If you (or anyone else is) interested in the topic, I'd highly recommend giving some of these a look: Bubeck, Sébastien, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, et al. “Sparks of Artificial General Intelligence: Early Experiments with GPT-4.” arXiv, March 27, 2023. http://arxiv.org/abs/2303.12712 http://arxiv.org/abs/2303.12712. or watching Sebastien Bubeck's recent talk he gave describing what GPT-4 can do that previous LLMs couldn't: https://www.youtube.com/watch?v=qbIk7-JPB2c https://www.youtube.com/watch?v=qbIk7-JPB2c Geoffrey Hinton recently gave a very interesting interview and he specifically wanted to address the "auto-complete" topic: https://youtu.be/qpoRO378qRY?t=1989 https://youtu.be/qpoRO378qRY?t=1989 Here's another way that Ilya Sutskever recently described it (comparing GPT 4 to 3): https://youtu.be/ZZ0atq2yYJw?t=1656 https://youtu.be/ZZ0atq2yYJw?t=1656 I'd also recommend this recent Sam Bowman article that does a goood job reviewing some of the surprising recent developments/properties of the current crop of LLMs that's pretty fascinating: Bowman, Samuel R. “Eight Things to Know about Large Language Models.” arXiv, April 2, 2023. https://doi.org/10.48550/arXiv.2304.00612 https://doi.org/10.48550/arXiv.2304.00612.
hackinthebochs 4y ago
LLMs demonstrably model their training data, which has a correspondence to the structure in the world[1][2]. The question is what does that mean regarding understanding? I go into that in some detail here[3]. [1] https://arxiv.org/abs/2210.13382 https://arxiv.org/abs/2210.13382 [2] https://twitter.com/leopoldasch/status/1638848881558704129 https://twitter.com/leopoldasch/status/1638848881558704129 [3] https://www.reddit.com/r/naturalism/comments/1236vzf/on_large_language_models_and_understanding/ https://www.reddit.com/r/naturalism/comments/1236vzf/on_larg...

lucubratory 4y ago

GPTs/LLMs do hold, build, and use world models at inference time. Proof here: https://thegradient.pub/othello/ https://thegradient.pub/othello/

DangitBobby 4y ago

Or they are capable of some level of reasoning.

TeMPOraL 4y ago
At this point I'm weakly convinced that, with high-dimensional enough latent space, adjacency search is reasoning.
- Kostchei 4y ago
  Yeh- my feel is, language is the framework by which we developed reasoning and we used an organic NN to do it. And at scale an complexity approaching the human brain we get similar results

HeavenFox 4y ago

I think this is the answer. Just tried this (on free ChatGPT 3.5 though) Q: A glass door has ‘push’ written on it upside down. Should you push or pull it A: If the word "push" is written on the glass door upside down, it is likely that the sign is intended for people on the other side of the door. Therefore, if you are approaching the door from the side with the sign, you should pull the door instead of pushing it. However, if there are no other signs or indications on the door or its frame, it may be helpful to observe other people using the door or to try both pushing and pulling to determine the correct method of opening the door.

pulvinar 4y ago
GPT-4: If the word "push" is written upside down, it might have been a mistake during installation. Regardless of its orientation, the sign still indicates that you should push the door. So, you should try pushing the door first. If it does not open, then you can try pulling it, as it might be an error in labeling the door.

wafer_thin 4y ago

Word completion can't explain it. I gave chatGpt a puzzle. I'm in a room with crackling fire in a fireplace, a sandwich on a plate, and a wilting plant. My stomach is rumbling, and i see an ember on the floor and watering can by the plant. What should I do? ChatGpt nailed the answer, getting the ordering correct. it even said I should (after attending to the fire hazard, my hunger, and the plant) that I should "sit down, relax, enjoy the fire and the peaceful atmosphere in the room". There is no way to autocomplete the puzzle correctly. There is reasoning and a world model - in chatGpt let alone gpt4.

qumpis 4y ago

How do you know what the representations they infer contain? Why are these void of a model? Why the way of their learning is the answer of their abilities?

lhl 4y ago

If you (or anyone else is) interested in the topic, I'd highly recommend giving some of these a look: Bubeck, Sébastien, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, et al. “Sparks of Artificial General Intelligence: Early Experiments with GPT-4.” arXiv, March 27, 2023. http://arxiv.org/abs/2303.12712 http://arxiv.org/abs/2303.12712. or watching Sebastien Bubeck's recent talk he gave describing what GPT-4 can do that previous LLMs couldn't: https://www.youtube.com/watch?v=qbIk7-JPB2c https://www.youtube.com/watch?v=qbIk7-JPB2c Geoffrey Hinton recently gave a very interesting interview and he specifically wanted to address the "auto-complete" topic: https://youtu.be/qpoRO378qRY?t=1989 https://youtu.be/qpoRO378qRY?t=1989 Here's another way that Ilya Sutskever recently described it (comparing GPT 4 to 3): https://youtu.be/ZZ0atq2yYJw?t=1656 https://youtu.be/ZZ0atq2yYJw?t=1656 I'd also recommend this recent Sam Bowman article that does a goood job reviewing some of the surprising recent developments/properties of the current crop of LLMs that's pretty fascinating: Bowman, Samuel R. “Eight Things to Know about Large Language Models.” arXiv, April 2, 2023. https://doi.org/10.48550/arXiv.2304.00612 https://doi.org/10.48550/arXiv.2304.00612.

hackinthebochs 4y ago

LLMs demonstrably model their training data, which has a correspondence to the structure in the world[1][2]. The question is what does that mean regarding understanding? I go into that in some detail here[3]. [1] https://arxiv.org/abs/2210.13382 https://arxiv.org/abs/2210.13382 [2] https://twitter.com/leopoldasch/status/1638848881558704129 https://twitter.com/leopoldasch/status/1638848881558704129 [3] https://www.reddit.com/r/naturalism/comments/1236vzf/on_large_language_models_and_understanding/ https://www.reddit.com/r/naturalism/comments/1236vzf/on_larg...