2 ms·
Please do provide a citation for the deterministic nature of LLMs. (They provide probability distributions for the next word. They are not deterministic)
by groby_b 4y ago
Please do provide a citation for the deterministic nature of LLMs. (They provide probability distributions for the next word. They are not deterministic)
- hackinthebochs 4y agoThey are deterministic in the sense that you get the same output given the same input. We interpret their output as a probability distribution over words. But we can do this because we intentionally normalize the word scores.