2 ms·I'm not sure what use that is, other than to maintain the KV cache across requests.by imtringued 3y agoI'm not sure what use that is, other than to maintain the KV cache across requests.