3 ms·
> I think this can be generalized to, “when you lose the ability to create a certain Form, you also lose some of your ability to imagine new types of that Form,
by TacticalCoder 3y ago
> I think this can be generalized to, “when you lose the ability to create a certain Form, you also lose some of your ability to imagine new types of that Form, and instead just rely on shuffling existing versions of it around to generate novelty.”
And it has a very serious consequence: "when you lose the ability to write, you lose the ability to create new content on which future LLMs are going to be trained".
One guy has been exposed for producing one computer programming book per week, for six months or a year straight, all with 5 stars reviews.
How many people like him are gaming, for their own benefits, the system?
It's all too obvious on GitHub and StackOverflow already: people gaming the system with automatically generated code that just, to reuse you words, "rely on shuffling existing versions".
How can this LLM-generated content possibly be used to created a better LLM?
Basically: how do we train future LLMs using content produced by those among the humans whom didn't lose their ability to think?