3 ms·
It seems like LLM need to become experts at managing their OWN context. Selectively gripping and searching the code to pull into context only those parts relev
by jimbokun 1y ago
It seems like LLM need to become experts at managing their OWN context.
Selectively gripping and searching the code to pull into context only those parts relevant to the task at hand.
- brulard 1y agoThat's what I'm thinking about a lot. Something like the models "activate" just some subset of parameters when working (if I understand the new models correctly). So that model could activate parts of context which are relevant for the task at hand