3 ms·

I don’t completely follow this. Can anyone explain?

• rahimnathwani 6y ago
  tl;dr Language models like GPT-3 include incorporate some model of the world. That's why they can generate plausible-sounding text. Future language models will be larger, more powerful, and have more complete models of the world. So we will be able to ask the language model questions, like 'what will happen if we do X?'. By compiling the answers to many such questions, we can figure out the best[0] thing to do. [0] Assuming you have some utility function you can maximize.
  • leogao 6y ago
    This is a great summary!