5 ms·
> Your understanding is very outdated. And yours may be very optimistic. LLMs are not knowledge bases, and ChatGPT has proven it times and times again by dream
by ezst 4y ago
> Your understanding is very outdated.
And yours may be very optimistic. LLMs are not knowledge bases, and ChatGPT has proven it times and times again by dreaming stories when asked for facts. Even though you could engineer a way to structure answers that seem like lines of reasoning, there is no way to 1- prove that observations aren't entirely made up (the LLM doesn't "know", and worse, this model is not designed to evaluate how much it deviates from a baseline, i.e. what it invented vs. what it thinks it knows for certain) and 2- there is no formal evidence that this way of structuring answers is sound logic (again, you can fool ChatGPT into logic errors that a high schooler would discern, and that makes sense solely based on the fact that LLMs don't work like formal systems by composing axioms and proofs ; that at the moment is impossible because of 1).