5 ms·

Yes. If you few-shot prime it with prompts of the form "<paragraph> tag:<tags>" and then just feed it "<novel paragraph> tag:" it'll generate <tags> automatical

Yes. If you few-shot prime it with prompts of the form "<paragraph> tag:<tags>" and then just feed it "<novel paragraph> tag:" it'll generate <tags> automatically, just from completion. It does this shockingly well, the paper has specific examples. It can also do fun tricks like condensing a complicated Wikipedia article down to a second grade level, including built in metaphors. An example of this is on the API beta website IIRC.

foldr 6y ago
That doesn't demonstrate comprehension in any interesting sense. You don't necessarily have to comprehend a text in order to generate a plausible nonsense continuation of it.
- SaltyLemonZest 6y ago
  Sure you do. If I hand you a few sentences in a language you can't comprehend at all, you won't be able to create a plausible continuation.
  - foldr 6y ago
    Never mind that - I wouldn't even be able to take on the role of the Emacs doctor in German (as I don't speak any German). It doesn't follow from that that the Emacs doctor does understand German.
- theptip 6y ago
  What would your "interesting sense" of comprehension look like?
  - foldr 6y ago
    Something like the usual sense of the word.
- lanternfish 6y ago
  The point is that it's not nonsense, but a useful and contextual continuation which encodes some level of comprehension (unless you mean a different thing by comprehension than I do). Look at this demo for an example: https://beta.openai.com/?demo=2 https://beta.openai.com/?demo=2.
  - foldr 6y ago
    Sometimes the continuation makes sense, but this is just by chance. It's just nonsense text in the style of the original. There's nothing that prevents internal contradictions. It's just that often these will be absent by chance, or because the output contains regurgitated chunks of coherent text written by humans. OpenAI are, like most AI researchers, utterly shameless in encouraging overinterpretation and wishful thinking.

foldr 6y ago

That doesn't demonstrate comprehension in any interesting sense. You don't necessarily have to comprehend a text in order to generate a plausible nonsense continuation of it.

SaltyLemonZest 6y ago
Sure you do. If I hand you a few sentences in a language you can't comprehend at all, you won't be able to create a plausible continuation.
- foldr 6y ago
  Never mind that - I wouldn't even be able to take on the role of the Emacs doctor in German (as I don't speak any German). It doesn't follow from that that the Emacs doctor does understand German.
theptip 6y ago
What would your "interesting sense" of comprehension look like?
- foldr 6y ago
  Something like the usual sense of the word.
lanternfish 6y ago
The point is that it's not nonsense, but a useful and contextual continuation which encodes some level of comprehension (unless you mean a different thing by comprehension than I do). Look at this demo for an example: https://beta.openai.com/?demo=2 https://beta.openai.com/?demo=2.
- foldr 6y ago
  Sometimes the continuation makes sense, but this is just by chance. It's just nonsense text in the style of the original. There's nothing that prevents internal contradictions. It's just that often these will be absent by chance, or because the output contains regurgitated chunks of coherent text written by humans. OpenAI are, like most AI researchers, utterly shameless in encouraging overinterpretation and wishful thinking.