4 ms·
I guess it's because LLMs score highest on python code. Which I presume is due to to the popularity of python code in the training data. What language would yo
by irthomasthomas 2y ago
I guess it's because LLMs score highest on python code. Which I presume is due to to the popularity of python code in the training data.
What language would you use?
- lionkor 2y agoTFA says that the AI "unexpectedly" modified code. To avoid issues like this, I would probably prefer to use a programming language that makes it harder for programs to modify themselves, such as any compiled language. The further away a language is from natural language the worse LLMs perform. Make an LLM write assembly and you'll see what I mean ;)
- irthomasthomas 2y agoYou might be right. I was surprised LLMs where not phased by the white-space programming, which, I vaguely recall, melted my mind a little when first I encountered it. On the other hand, LLMs don't really see the white space. They don't see or speak natural language, either. They only see and speak in tokens. A list of numbers. A tokenizer model then converts those numbers to text. I also assume that assembly would not be strongly represented in the data sets used for training, so that test wouldn't prove much. Interesting to think about, anyway.