3 ms·

so the utility of the KV cache has nothing to do with available RAM?

• stymaar 4mo ago
  This proposition has no logical link with any of the above. Read again.