> People keep calling it "next next token predictors", but clearly there is something more going on I think this depends what you mean by "something more going

> People keep calling it "next next token predictors", but clearly there is something more going on I think this depends what you mean by "something more going on". Now, if someone says that it is "just" "next token prediction", in a dismissive way, I think that's an error. But, while they RLHF ones aren't exactly trained just to match the observed distribution, but rather are trained with the RLHF objective, it is nonetheless true that the model produces a probability distribution over possible next tokens, conditioned on the previous tokens, and samples from that. (I suppose there's also like, things done as part of the sampling on top of these conditional probabilities, rather than just sampling according to the probabilities given the temperature. (I don't know how this part works really.) But I think this is mostly just a trick to get a little more quality, and not a major part of how it behaves? Not part of the NN itself in any case.)