3 ms·
> Why does it matter if that output is stored in the LLM's context Context window is expensive and precious. Much better to offload to some medium where it is
by cruffle_duffle 7mo ago
> Why does it matter if that output is stored in the LLM's context
Context window is expensive and precious. Much better to offload to some medium where it isn’t.