4 ms·
So I wonder how much of Claude's perceived personality is due to the system prompt versus the underlying LLM and training. Could you layer a "Claude mode"—like
by jdnier 1y ago
So I wonder how much of Claude's perceived personality is due to the system prompt versus the underlying LLM and training. Could you layer a "Claude mode"—like a vim/emacs mode—on ChatGPT or some other LLM by using a similar prompt?
- freehorse 1y agoThis system prompt is not used in the API, so it is not relevant for the perceived personality of the model if you do not use it through claude.ai interface, eg through an editor etc.
- faustocarva 1y agoWhy this? Because for OpenAI you can set it using API.
- mkl 1y agoI think you misread. With the API you're not using this standard chat system prompt, but whatever one you set: https://docs.anthropic.com/en/docs/build-with-claude/prompt-engineering/system-prompts https://docs.anthropic.com/en/docs/build-with-claude/prompt-...
- Oras 1y agoTraining data matters. They used lots of xml like tags to structure the training data. You can see that in the system prompt.
- amelius 1y agoBy now I suppose they could use an LLM to change the "personality" of the training data, then train a new LLM with it ;)
- nonethewiser 1y agoUgh. A derivative. We're in some ways already there. Not in terms of personality. But we're in a post-llm world. Training data contains some level of LLM generated material. I guess its on the model creators to ensure their data is good. But it seems like we might have a situation where the training material degrades over time. I imagine it being like if you apply a lossy compression algorithm to the same item many times. IE resaving a JPEG as JPEG. You lose data every time and it eventually becomes shit.