2 ms·
Are you saying if I ask a prompt "foo" and then a month later another user asks "foo" then it retrieves a cached value?
by chipsrafferty 1y ago
Are you saying if I ask a prompt "foo" and then a month later another user asks "foo" then it retrieves a cached value?
- wkat4242 1y agoNo, the key value cache is the context in a way the model can read it.