4 ms·
Right now, these models were trained almost entirely on content created by humans, since that's what was available. Now that it's so relatively cheap to create
by usefulcat 4y ago
Right now, these models were trained almost entirely on content created by humans, since that's what was available. Now that it's so relatively cheap to create generated content, it seems likely that in the future much if not most of the material used for training will have come from other models, not from humans. I have no idea what the implications of that will be but it seems very likely and does concern me.
- elcomet 4y agoI'm not sure why it's a concern to you. If it works well it's great news, and if it doesn't work, then it won't be used. Companies will not make their AIs less intelligent on purpose.
- toss1 4y ago>>Companies will not make their AIs less intelligent on purpose. That sounds a LOT like saying "companies will not make their products worse on purpose". Yet it happens allt he time, and is almost inevitable once the MBAs, finance people, and marketers get involved - they seek out ways to cheapen the product that (they think) customers won't notice, they undermine "cost centers" like R&D and production, and 1000 other flaws. In internet products they deliberately skew the output to generate more ad revenue (See Enshttification" by Cory Doctorow [0]. And that is all for products that otherwise would stay mostly the same, without some kind of natural degradation. These LLMs and image generators, etc. will definitely degrade by ingesting their own output. Sort of like the jokes about clones becoming worse every generation. Just watch. Thx for provoking me to think for a few seconds and convincing me that it's inevitable... [0] https://doctorow.medium.com/tiktoks-enshittification-bb3f5df91979 https://doctorow.medium.com/tiktoks-enshittification-bb3f5df...
- oldsecondhand 4y agoThat would doom LLMs to mediocrity, which is great news for creative people.