3 ms·
Tangentially related: has anyone here tried to figure out what programming language a LLM-based generator would be most successful at writing? Or what language
by dpkirchner 4y ago
Tangentially related: has anyone here tried to figure out what programming language a LLM-based generator would be most successful at writing? Or what language features are necessary for LLM's success at code generation?
I've tried but unfortunately all of my searches return results about languages used for building models (e.g., Python, for some reason).
I figure it'd probably be a typed language with a meaty standard library, good type inference, and high-quality low-code packages that would require fewer generated tokens to do useful work. Or maybe a language with fewer ways to do basic tasks -- if there is somehow only one way to do a thing, then the generator would be most likely to write code using that one way. I'll fully admit that these guesses are naive and based on limited understanding of how LLMs work.
- thornewolf 4y agoI have suspicious is is bash, or python. I think bash is good because you can express concepts very concisely giving fewer literal characters to mess up on. Python because the data set is so massive while still maintaining a lot of power-per-character. Conversely, I have seen it underperform for verbose languages like Java, I think primarily due to windowing issues and that less meaningful code can be represented in one prediction window.