3 ms·
> But what would be the equivalent of "reproductive success" for computer programs? Idea reuse. Whenever an idea is copied and reused, maybe tweaked and compos
by visarga 3y ago
> But what would be the equivalent of "reproductive success" for computer programs?
Idea reuse. Whenever an idea is copied and reused, maybe tweaked and composed in a different way, it achieves reproduction. Useless ideas are not replicated.
For example the attention mechanism, the residual connections, embedding tables for tokens, dropout, efficient matrix operations - they are all ideas that got replicated and reused in many ways to make chatGPT and other current LLMs. Humans act like the reproductive organs of AI. But I expect this process to have the capability of being fully AI driven soon.
Also datasets - bulk collections of useful ideas. The curation and creation of massive datasets is the fuel for AI intelligence. And then all these ideas can replicate every time we interact with the AI. Ideas can self replicate through LLMs today, even autonomously. It's a game changer for the evolution of language.