3 ms·

(BTW, givent token cashing your argument of 3 x 1 = 1 x 3 deserves more scrutiny)

• bahaAbunojaim 10mo ago
  That might be true but if you change the system instructions “which is at the beginning of the prompt” then caching doesn’t hit. So different agents would most likely skip caching unless the last prompt is different then you get the benefit of caching indeed