Basic markov chain models are also next token prediction, so it isn't new, we have done that to make language models for over half a century at this point. It i

Basic markov chain models are also next token prediction, so it isn't new, we have done that to make language models for over half a century at this point. It is one of the earliest things people did with computers. Our modern LLMs are an evolution of that, but the next token prediction part is almost as old as computers.