2 ms·
> Why does it matter if that output is stored in the LLM's context Context window is expensive and precious. Much better to offload to some medium where it is
by cruffle_duffle 6mo ago
> Why does it matter if that output is stored in the LLM's context
Context window is expensive and precious. Much better to offload to some medium where it isn’t.