3 ms·But attention/KV cache is the heavy bit in long context lengths which is what everyone needs…by tacitusarc 3mo agoBut attention/KV cache is the heavy bit in long context lengths which is what everyone needs…