5 ms·
Actually isn't this good? It means we can run something multiple times to prove itself a bad answer?
by beefnugs 3y ago
Actually isn't this good? It means we can run something multiple times to prove itself a bad answer?
- latexr 3y agoYou can ask LLMs the same question and they might sometimes get it wrong and other times get it right. Having different answers is no indication that none of them is correct. Furthermore, even if an LLM always gives the same answer to a question, there’s no guarantee the answer is correct. https://en.wikipedia.org/wiki/Propaganda https://en.wikipedia.org/wiki/Propaganda https://en.wikipedia.org/wiki/Big_lie#Alleged_quotation https://en.wikipedia.org/wiki/Big_lie#Alleged_quotation
- sroussey 3y agoAn LLM will always give the same output for the same input. It’s sorta like a random number generator that gives the same list of “random” numbers for the same seed. LLMs get a seed too.
- latexr 3y agoThat’s irrelevant for the matter. The person I replied to obviously did not have seeded responses in mind.
- saagarjha 3y agoIt can tell you if the answer is wrong, but it can never tell you if the answer is right.