4 ms·
That is not correct. You can interrogate an LLM. You can evaluate its responses in the course of interrogation. You can judge whether those responses are coher
by ryanklee 3y ago
That is not correct.
You can interrogate an LLM. You can evaluate its responses in the course of interrogation. You can judge whether those responses are coherent internally and congruent with other sources of information. LLMs can also offer sources and citation for RAG operations.
There is no self-sufficient source of truth in this world. Every information agent must contend with the inevitability of its own production of error and excursions into fallibility.
This does not mean those agents are engaging in bullshit whenever they leave the domain of explicit self-verification.
- blibble 3y agoI feel like I'm chatting with one here
- ryanklee 3y agoBased on what?
- Jensson 3y ago> You can interrogate an LLM No you can't, an LLM doesn't remember what it thought when it wrote what it did before, it just looks at the text and tries to come up with a plausible answer. LLM's doesn't have a persistent mental state, so there is nothing to interrogate. Interrogating an LLM is like asking a person to explain another's persons reasoning or answer. Sure you will get something plausible sounding from that, but it probably wont be what the person who first wrote it was thinking.
- ryanklee 3y agoThis is not correct. You can get an LLM to improve reasoning through iteration and interrogation. By changing the content in its context window you can evolve a conversation quite nicely and get elaborated explanations, reversals of opinions, etc.