2 ms·
> Couldn’t we architect or train the models to differentiate between streams of input? Could you? absolutely. Would it solve this problem? Maybe. Would it ma
by dragonwriter 3y ago
> Couldn’t we architect or train the models to differentiate between streams of input?
Could you? absolutely.
Would it solve this problem? Maybe.
Would it make training LLMs to do useful tasks much harder and vastly increase the volume of training data necessary? For sure.
> I believe there’s a little bit of this already with the system prompt in ChatGPT?
Probably not. Likely, both the controllable "system prompt" you can change via the API and probably any hidden system prompt is part of the same prompt as the rest of the prompt, though its deliminited by some token sequence when fed to the model (chat-tuned public LLMs also do this, with different delimiting patterns.)