3 ms·
Do you have citations? Everything I’ve read have said they have an overwhelming bias to Python; eg https://arxiv.org/html/2503.17181v1 https://arxiv.org/html/25
by seanmcdirmid 3mo ago
Do you have citations? Everything I’ve read have said they have an overwhelming bias to Python; eg https://arxiv.org/html/2503.17181v1 https://arxiv.org/html/2503.17181v1 and https://arxiv.org/html/2505.13004v1 https://arxiv.org/html/2505.13004v1
- CuriouslyC 3mo agoAgents love writing Python, but it turns out they're not amazing at it. https://autocodebench.github.io/ https://autocodebench.github.io/
- seanmcdirmid 3mo agoI’m not really sure how to read those charts, but it’s completely possible that python did not work well for the approach they were trying. I would be the first person to give up python for kotlin or some other more natively typed higher performing language. But the python bias is so far too big to ignore.