4 ms·
> They are getting better at medium/large codebases If we are strictly speaking about the cutting-edge models like OpenAI's o1, their context is getting smalle
by talldayo 2y ago
> They are getting better at medium/large codebases
If we are strictly speaking about the cutting-edge models like OpenAI's o1, their context is getting smaller, not larger.
- ado__dev 2y agoI believe o1's context window will increase over time as well. It's a new model that takes a different approach compared to other ones, so testing it with less context seems logical and expanding the context window as it's quality is validated. Even in a large code-base, you don't have to have the full context of every single file for every single question, can usually get away with half a dozen files, it's figuring out which ones to provide to the LLM to get the best response.