7 ms·
I'm glad to hear you're finding aider useful! The new large context size certainly opens up some possibilities. Most LLMs start to get distracted/confused if y
by anotherpaulg 3y ago
I'm glad to hear you're finding aider useful!
The new large context size certainly opens up some possibilities. Most LLMs start to get distracted/confused if you just put everything and the kitchen sink into their context window. I expect that would be a concern if you just dump in 128k tokens worth of code, most of which isn't relevant to the task at hand.
I imagine we still want to focus GPT on the relevant code and use the larger context window to provide more "code context" along the lines of aider's repository map. Right now the repo-map is optimized to fit within 1k tokens by default. It seems likely that the new GPT-4 Turbo model should be given a much larger map than that.
I'll be experimenting and optimizing aider for this new model over the coming days and weeks.