2 ms·
AI seems to forget more things as the context window grows. Agents keep scope local and focused, so you can get better/faster results, or use models trained on
by ToJans 2y ago
AI seems to forget more things as the context window grows. Agents keep scope local and focused, so you can get better/faster results, or use models trained on specific tasks.
Just like in real life, there's generalists and experts. Depending on your task you might prefer an expert over a generalist, think f.e. brain surgery versus "summarize this text".