They are deterministic in the sense that you get the same output given the same input. We interpret their output as a probability distribution over words. But w

They are deterministic in the sense that you get the same output given the same input. We interpret their output as a probability distribution over words. But we can do this because we intentionally normalize the word scores.