3 ms·
This would seem to imply that the model doesn't actually "understand" (whatever that means for these systems) that it has a "system prompt" separate from user i
by zahlman 2y ago
This would seem to imply that the model doesn't actually "understand" (whatever that means for these systems) that it has a "system prompt" separate from user input.
- alfons_foobar 2y agoWell yeah, in the end they are just plain text, prepended to the user input.
- skywhopper 2y agoYes, this is how they work. All the LLM can do is take text and generate the text that’s likely to follow. So for a chatbot, the system “prompt” is really just an introduction explaining how the chat works and what delimiters to use and the user’s “chat” is just appended to that, and then the code asks the LLM what’s next after the system prompt plus the user’s chat.