6 ms·
Too bad the article neglects to explain in any convincing way why there is no "I" in LLMs. Are we supposed to already know this? My favorite way of illustratin
by pierrec 4y ago
Too bad the article neglects to explain in any convincing way why there is no "I" in LLMs. Are we supposed to already know this?
My favorite way of illustrating this absence of self is to consider that in any conversation with an LLM, measures are always taken to ensure it doesn't happily continue both sides of the conversation, impersonating you and the "agent" in turns. Because that's what LLMs do - they predict what comes next for any given text. Individuals contained in this prediction (such as the "agent") never have any special importance, or selfness, to the LLM.
This is at least exemplified here: https://help.openai.com/en/articles/5072263-how-do-i-use-stop-sequences https://help.openai.com/en/articles/5072263-how-do-i-use-sto...
Notice how in the chat example, the output "Human:" is used as a stop sequence to make sure you don't get impersonated by the model.