I didn't realize that the context would require such so much memory. Is this KV caches? It would seem like a big advantage if this memory requirement could be r

I didn't realize that the context would require such so much memory. Is this KV caches? It would seem like a big advantage if this memory requirement could be reduced.