3 ms·
> If you define a grammar for a new programming language and feed it to an LLM and give it NO EXAMPLES can it write code in your language? Of course it can. It
by bobxmax 1y ago
> If you define a grammar for a new programming language and feed it to an LLM and give it NO EXAMPLES can it write code in your language?
Of course it can. It will experiment and learn just like humans do.
Hacker news people still think LLMs are just some statistical model guessing things.
- yusina 1y ago> Hacker news people still think LLMs are just some statistical model guessing things. That's exactly what they are. It's the definition of what they are. If you are talking about something that is doing something else, then it's not an LLM.
- abletonlive 1y agoyawn. this is so reductive it's almost not even worth talking about. you can prove yourself wrong within 30 minutes but you choose not to.
- yusina 1y agoSorry, I don't follow. How do you define LLMs?
- bobxmax 1y agoNo, it's not. Arrogant developers on HN like to parrot this, but it isn't true. The power of LLMs are the emergent properties that have emerged which weren't specifically taught to the model. That is not a property that exists in statistical, largely more deterministic models. If you think it's just a giant token prediction machine you've just ignored the last 5 years.