4 ms·
> Next up is demonstrating the AI is more productive with better programming languages. This is hard to do given the current reliance on model weights in its p
by seanmcdirmid 3mo ago
> Next up is demonstrating the AI is more productive with better programming languages.
This is hard to do given the current reliance on model weights in its programming language knowledge. You’ll get your best results for python or some variation of python. But
- CuriouslyC 3mo agoNot true. Python performance is actually pretty low, and Elixir, Kotlin and C# trounce it handily.
- seanmcdirmid 3mo agoDo you have citations? Everything I’ve read have said they have an overwhelming bias to Python; eg https://arxiv.org/html/2503.17181v1 https://arxiv.org/html/2503.17181v1 and https://arxiv.org/html/2505.13004v1 https://arxiv.org/html/2505.13004v1
- CuriouslyC 3mo agoAgents love writing Python, but it turns out they're not amazing at it. https://autocodebench.github.io/ https://autocodebench.github.io/
- seanmcdirmid 3mo agoI’m not really sure how to read those charts, but it’s completely possible that python did not work well for the approach they were trying. I would be the first person to give up python for kotlin or some other more natively typed higher performing language. But the python bias is so far too big to ignore.