3 ms·
If it's always the same prompt, can't they have it pre-cached globally for all?
by megous 3mo ago
If it's always the same prompt, can't they have it pre-cached globally for all?
- erikus 3mo agoI'm pretty sure the system instructions are a function of your environment and not the same universally. That said, there should be a finite number of branches so still cacheable.
- megous 3mo agoSystem specific stuff is probably quite limited, it can be a short dynamic segment at the end of the system prompt, perhaps.
- a_c 3mo agoThe system behaviour is totally up to anthropic's discretion. Its current behaviour is verifiable. In claude code, spawn a subagent with 1. Agent("Test") 2. look at your token usage 3. Repeat a few times I didn't check again as I type this message but am somewhat sure subagent doesn't cache system prompt as of maybe last week