4 ms·
interesting. is the answer not context specific most of the time? even if I ask LLM the same question again and again the answer depends on the context. what a
by invisibleink 11mo ago
interesting. is the answer not context specific most of the time? even if I ask LLM the same question again and again the answer depends on the context.
what are some use cases where you need deterministic caching?