3 ms·
Low-Background Tokens
- catchnear4321 3y agodigital grey goo. this is far worse than dirty metal, not that that’s minor. (it is a fantastic analogy.)
- swyx 3y agothanks! cant take credit for it, as footnoted Huber, Karpathy and Carmack all made similar observations. however once i heard the concept i had to share it.
- h2odragon 3y agoAll the spam skirpts running for the last 20 years are fine for inputs to you models, tho....
- swyx 3y agounironically fine because they mostly get sent to email which is private by default so not in the datasets
- charcircuit 3y agoHow are we running out of them if more are produced everyday? Wikipedia says that radiation in steal has almost returned to the levels it was before the nuclear bomb so that doesn't seem to be an issue anymore.
- tivert 3y agoHonestly: good. I also look forward to the efforts to deliberately feed disruptive garbage into the AI training process (I understand some fan fiction communities are already doing that).