4 ms·They cache the intermediate data (KV cache).by mike_hearn 1y agoThey cache the intermediate data (KV cache).