4 ms·The prompt is kv-cached, it's precomputed.by GaggiX 2y agoThe prompt is kv-cached, it's precomputed.WithinReason 2y agoGood point, but it still increases the compute of all subsequent tokens