3 ms·

Surely human language use (GPT-3's training domain) has some connection to reality, however faint.

• scotty79 4y ago
  Yeah. That connection is the source of this accidental side effect.
  • FeepingCreature 4y ago
    That seems a stretch to call an "accidental side effect" though. It's an effect exactly inasmuch as human language use is inextricable from reality. Put otherwise, GPT doesn't interact with reality directly, but mediated through our language. But we also don't experience reality directly, so it's hard to see how much of a hindrance that would pose. Hell, much of our model of the world is just as rooted in language as GPT's. The part of my model of reality of which I have direct sensory experience is tiny.
    • scotty79 4y ago
      > Put otherwise, GPT doesn't interact with reality directly, but mediated through our language. Yes, but the human language is garbage. So while passing throught that filter without maintaining the highest degree of precision barely any of the actual reality remains. Truth sounds exactly the same as a lie. The actual language that decently captures reality is math. Nothing less is even barely sufficient to produce almost anything but nonsense. Nonsense nicely sounding to human ears but still nonsense.