4 ms·
There is a system prompt, but most LLMs don't seem to "enforce" it enough.
by hnuser123456 6mo ago
There is a system prompt, but most LLMs don't seem to "enforce" it enough.
- embedding-shape 6mo agoSince GPS-OSS there is also the Harmony response format (https://github.com/openai/harmony https://github.com/openai/harmony) that instead of just having a system/assistant/user split in the roles, instead have system/developer/user/assistant/tool, and it seems to do a lot better at actually preventing users from controlling the LLM too much. The hierarchy basically becomes "system > developer > user > assistant > tool" with this.