3 ms·
> When most code is machine-generated, how much you like a language simply doesn’t matter. Other factors will be more important when choosing what to use. Perfo
by brucethemoose2 4y ago
> When most code is machine-generated, how much you like a language simply doesn’t matter. Other factors will be more important when choosing what to use. Performance, tooling, and knowledge of how to operate it at scale will all be more important than the language itself.
But the popularity of the language does matter. "Write function in Python with numpy" is going to work way better than "Write function in SYCL" because there is orders of magnitude more example code, and LLM usage is only going to exacerbate the issue.
- kbourgoin 4y agoI couldn't agree more. Popularity matters because of training data availability, not that a language is pleasant to write. It means Python probably still has a long life ahead of it, but newcomers have a much higher barrier to entry.
- verdverm 4y agoI'm not sure I agree, there was an interesting result where reading the game instructions drastically reduced training effort. https://singularityhub.com/2023/03/10/an-ai-learned-to-play-atari-6000-times-faster-by-reading-the-instructions/ https://singularityhub.com/2023/03/10/an-ai-learned-to-play-... It seems quite plausible that a well written language spec and fewer examples will give the model enough to work with.
- aatd86 4y agoOne still needs libraries and APIs. The ecosystem matters.
- abraxas 4y agoThat could be queried by the LLM as needed. Tons of work has been done on giving LLMs long term memory
- verdverm 4y agoI wouldn't really call that long term memory, we don't consider stuff we look up to be in our long term memory.
- verdverm 4y agoCould not those libraries and ecosystem projects be developed by the LLM? It could be a great way to build out rapidly with low cost, especially if you can get a mapping from another, broader language, to your own.
- aatd86 4y agoI don't think it will ever be possible below the point of reaching some form of AGI. But even if it were, it's more about design and not sure that a machine will have the same empathy towards a human cognitive shortcomings.