4 ms·
Sure, it's useful, once. What we need is a way to manage the dynamic part of the context without just starting from zero each time.
by grim_io 1y ago
Sure, it's useful, once.
What we need is a way to manage the dynamic part of the context without just starting from zero each time.
- SOLAR_FIELDS 1y agoMy theory is that you will never get this from a frontier model provider because as is alluded to in sibling thread the context window management is actually a good hunk of the secret sauce that makes these things effective and companies do not want to give that up