3 ms·

LLMs also don't work by generating probability distributions of the next word. Your explanation isn't able to explain why they can generate words, let alone sen

LLMs also don't work by generating probability distributions of the next word. Your explanation isn't able to explain why they can generate words, let alone sentences.

qsera 7mo ago
That is exactly how they work.
- astrange 7mo ago
  No, a token is not a word.
  - qsera 7mo ago
    I mean, it is some text.
    - astrange 7mo ago
      How do you get from a piece of text smaller than a word to an entire coherent sentence?