I keep seeing these takes and I still think OthelloGPT disproves them. So far it really looks like a sufficiently large LLM with a sufficiently large / high-qu

I keep seeing these takes and I still think OthelloGPT disproves them. So far it really looks like a sufficiently large LLM with a sufficiently large / high-quality dataset can learn basically anything (given a slightly generous interpretation of the word "sufficiently"). In case of code completion, I think just training on program output in addition to source code would already unlock huge capability boosts.