3 ms·
For that answer, you can refer to the 3blue1brown videos The llm model outputs a vector of probabilities for tokens, and the llm user picks a token from the mo
by 8note 2y ago
For that answer, you can refer to the 3blue1brown videos
The llm model outputs a vector of probabilities for tokens, and the llm user picks a token from the most likely list using a random number