Syntax != semantics. The LLM being able to adhere syntax is one thing, the LLM picking up various language-isms is another. In Python, you don't want to see

Syntax != semantics. The LLM being able to adhere syntax is one thing, the LLM picking up various language-isms is another. In Python, you don't want to see for i in range(len(arr)): something(arr[i]) because the pythonic way is simply: for i in arr: something(i) or even: [something(i) for i in arr] The first version is absolutely syntactically correct, but terrible python. How do you teach the LLM that? Bugs don't come from syntax errors. If you've got a syntax error, it doesn't compile/fails to run entirely. So we're not talking about the LLM learning the syntax, I'm asking the LLM learning the deeper semantics of lanng.