3 ms·

It's both amazing and weirdly fallible - Tenzin, the rogue, jumps out of the tree to make a surprise attack, but in the next round of combat GPT-DM claims that

It's both amazing and weirdly fallible - Tenzin, the rogue, jumps out of the tree to make a surprise attack, but in the next round of combat GPT-DM claims that he is still in the tree. Also: > Tenzin, still hidden in the tree, targets another wolf with his rapier. Does GPT4 not know that a halfling in a tree can't attack a wolf on the ground with a rapier?

moffkalast 4y ago
Tis' a very long rapier.
- smoldesu 4y ago
  Or a poorly-described wolfraffe.
  - loloquwowndueo 4y ago
    Or a small tree?
    - deleted 4y ago
      [deleted]
zaroth 4y ago
> Does GPT4 not know that a halfling in a tree can't attack a wolf on the ground with a rapier? It’s funny to think about how the parser would even go about deconstructing that sentence and trying to tie each noun to some world/physics model that would then put constraints on what the character should be allowed to do. But as I understand it, GPT doesn’t do any of those things. It just a takes the words that have come before, and tries to guess new words to add on that are thematically consistent. I think it no more “knows” what a “halfling” is than it knows what a “tree” is, the generated words are designed to be read “smoothly” more than any objective correctness.
- stevenhuang 4y ago
  Evidence is mounting that LLMs may be building world models, ie true understanding. > A pretty hot question right now is whether LLMs are just bundles of statistical correlations or have some real understanding and computation! This gives suggestive evidence that simple objectives to predict the next token can create rich emergent structure (at least in the toy setting of Othello). Rather than just learning surface level statistics about the distribution of moves, it learned to model the underlying process that generated that data. In my opinion, it's already pretty obvious that transformers can do something more than statistical correlations and pattern matching, see eg induction heads, but it's great to have clearer evidence of fully-fledged world models! https://www.lesswrong.com/posts/nmxzr2zsjNtjaHh7x/actually-othello-gpt-has-a-linear-emergent-world https://www.lesswrong.com/posts/nmxzr2zsjNtjaHh7x/actually-o...
dragonwriter 4y ago
> Does GPT4 not know that a halfling in a tree can’t attack a wolf on the ground with a rapier? 100% certainly can, though they won’t be in the tree afterwards unless they were on a very low branch.
IncRnd 4y ago
No, it doesn't know that. It also is susceptible to being told that you hire a level 2,000 wizard who is familiar with the layout of the dungeon and you stop at the well of blessings and toss in a platinum coin in order to have invulnerability, then you go to the dungeon, where the wizard immediately seals the cursed object with his Mighty Seal of Anti Curse Yang Containment Wizardly Spell, and you then place the sealed cursed object into your spatial ring (that lets you carry any amount of loot without weight restrictions), along with all the loot from the dungeon that the wizard finds with his level 2,000 spells. ChatGPT doesn't have intelligence. It just types words.

moffkalast 4y ago

Tis' a very long rapier.

smoldesu 4y ago
Or a poorly-described wolfraffe.
- loloquwowndueo 4y ago
  Or a small tree?
  - deleted 4y ago
    [deleted]

zaroth 4y ago

> Does GPT4 not know that a halfling in a tree can't attack a wolf on the ground with a rapier? It’s funny to think about how the parser would even go about deconstructing that sentence and trying to tie each noun to some world/physics model that would then put constraints on what the character should be allowed to do. But as I understand it, GPT doesn’t do any of those things. It just a takes the words that have come before, and tries to guess new words to add on that are thematically consistent. I think it no more “knows” what a “halfling” is than it knows what a “tree” is, the generated words are designed to be read “smoothly” more than any objective correctness.

stevenhuang 4y ago
Evidence is mounting that LLMs may be building world models, ie true understanding. > A pretty hot question right now is whether LLMs are just bundles of statistical correlations or have some real understanding and computation! This gives suggestive evidence that simple objectives to predict the next token can create rich emergent structure (at least in the toy setting of Othello). Rather than just learning surface level statistics about the distribution of moves, it learned to model the underlying process that generated that data. In my opinion, it's already pretty obvious that transformers can do something more than statistical correlations and pattern matching, see eg induction heads, but it's great to have clearer evidence of fully-fledged world models! https://www.lesswrong.com/posts/nmxzr2zsjNtjaHh7x/actually-othello-gpt-has-a-linear-emergent-world https://www.lesswrong.com/posts/nmxzr2zsjNtjaHh7x/actually-o...

dragonwriter 4y ago

> Does GPT4 not know that a halfling in a tree can’t attack a wolf on the ground with a rapier? 100% certainly can, though they won’t be in the tree afterwards unless they were on a very low branch.

IncRnd 4y ago

No, it doesn't know that. It also is susceptible to being told that you hire a level 2,000 wizard who is familiar with the layout of the dungeon and you stop at the well of blessings and toss in a platinum coin in order to have invulnerability, then you go to the dungeon, where the wizard immediately seals the cursed object with his Mighty Seal of Anti Curse Yang Containment Wizardly Spell, and you then place the sealed cursed object into your spatial ring (that lets you carry any amount of loot without weight restrictions), along with all the loot from the dungeon that the wizard finds with his level 2,000 spells. ChatGPT doesn't have intelligence. It just types words.