3 ms·Usually there’s a small neural network that makes the choice for each token in an LLM.by telotortium 2y agoUsually there’s a small neural network that makes the choice for each token in an LLM.