3 ms·
At launch it was described as being in blocks of 128 https://openai.com/index/api-prompt-caching/ https://openai.com/index/api-prompt-caching/
by IanCal 10mo ago
At launch it was described as being in blocks of 128
https://openai.com/index/api-prompt-caching/ https://openai.com/index/api-prompt-caching/