3 ms·The kv cache is not discretised, only the output tokens.by 0-_-0 2mo agoThe kv cache is not discretised, only the output tokens.