4 ms·
Response API does support resuming. But it's not gigantic improvement as models don't regenerate "lost"/past parts of conversation, they're heavily cached and
by mirekrusin 11mo ago
Response API does support resuming.
But it's not gigantic improvement as models don't regenerate "lost"/past parts of conversation, they're heavily cached and were from pretty much day 1, that's why they have highly reduced cost.