i dont think the stochasticity that's the problem -- the problem is that model gets "locked in" once it picks a token and there's no takesies backsies. that al

i dont think the stochasticity that's the problem -- the problem is that model gets "locked in" once it picks a token and there's no takesies backsies. that also entails information destruction in the form of the logits table, but for the most part that should be accounted for in the last step before final feedforward