3 ms·

Does gpt3 have a model of the world inside itself? What could it be like?

• sjg007 6y ago
  No.. it’s more like a probabilistic model of words conditioned on their semantic context given the training data. It also has positional encoding as well.
  • person_of_color 6y ago
    What gives it more power than a Markov chain?
    • gdulli 6y ago
      Moore's Law