3 ms·
You’re forgetting that keeping the context small is better economically and delivers better results.
by stingraycharles 3mo ago
You’re forgetting that keeping the context small is better economically and delivers better results.
- themgt 3mo agoForgetting? I think you mean to say your advice was auto-compacted to keep our context small and deliver better results.
- bob1029 3mo agoI learned some nuance. Small context is important if the context isn't cachable. If most of it is the same prefix every time, the situation changes pretty significantly.