I haven't looked at the code honestly, but it's a interesting observation. My impression of the way OpenAI is going is instead of making a larger model smarter,

I haven't looked at the code honestly, but it's a interesting observation. My impression of the way OpenAI is going is instead of making a larger model smarter, they're going wide with just extremely high effort and a lot of parallel agents to get towards a goal. For example, for design and architecture, I prefer fable, but for pull requests I like GPT because it's so pedantic about things.