4 ms·
Start by thinking about how big the context window is, and what the rules should be for purging old context. Design patterns can't help you here. The hard part
by zahlman 1y ago
Start by thinking about how big the context window is, and what the rules should be for purging old context.
Design patterns can't help you here. The hard part is figuring out what to do; the "how" is trivial.