By the way, there was recently a HN submission about a project studying using diffusion models rather than LLM for token prediction. With diffusion, tokens aren

By the way, there was recently a HN submission about a project studying using diffusion models rather than LLM for token prediction. With diffusion, tokens aren't predicted strictly left to right any more; there can be gaps that are backfilled. But: it's still essentially the same, I think. Once that type of model settles on a given token at a given position, it commits to that. Just more possible permutations of the token filling sequence have ben permitted.