3 ms·
You're really missing the points with LLMs and truth if you're appealing to Godel's Incompleteness Theorem
by bigmadshoe 1y ago
You're really missing the points with LLMs and truth if you're appealing to Godel's Incompleteness Theorem
- danparsonson 1y agoWhy?
- bigmadshoe 1y agoThe limitations of “truth knowing” using an autoregressive transformer are much more pressing than anything implied by Gödel’s theorem. This is like appealing to a result from quantum physics to explain why a car with no wheels isn’t going to drive anywhere. I hate when this theorem comes up in these sort of “gotcha” when discussing LLMs: “but there exist true statements without a proof! So LLMs can never be perfect! QED”. You can apply identical logic to humans. This adds nothing to the discussion.
- danparsonson 1y agoAh understood, yes that is a bit ridiculous.