My personal suspicion is that there is some kind of grid/beam search at the very end. You can kind of see (imagine?) it as output speed is not constant. So you

My personal suspicion is that there is some kind of grid/beam search at the very end. You can kind of see (imagine?) it as output speed is not constant. So you crank down the iterations and voila. Same weights, poorer output.