2 ms·
I'm pretty sure the system instructions are a function of your environment and not the same universally. That said, there should be a finite number of branches
by erikus 3mo ago
I'm pretty sure the system instructions are a function of your environment and not the same universally. That said, there should be a finite number of branches so still cacheable.
- megous 3mo agoSystem specific stuff is probably quite limited, it can be a short dynamic segment at the end of the system prompt, perhaps.