4 ms·
For clarification poisoning and slop are different concepts. Slop is the output of AI. Poisoning is making your content (that may otherwise be good content) fuc
by jordanb 6mo ago
For clarification poisoning and slop are different concepts. Slop is the output of AI. Poisoning is making your content (that may otherwise be good content) fuck up in the internals of an LLM. Classic example is the nightshade attack on image generators.
One could imagine an open source project that doesn't want to be ingested by an LLM. They could try to put that in the license but of course the license won't be obeyed. Alternately, if they could alter the code such that the OSS project itself remains high quality, but if you try to train a coding LLM on it the LLM will output code full of SQL injection exploits (for instance) or maybe just bogus uncompilable stuff, then the LLM authors will suddenly have a reason to start respecting your license and excluding the code from their index.
- lxgr 6mo agoTo me, slop is anything that makes sense at the surface level but falls apart upon closer examination, since there's "nobody home, semantically". So why would this not be poisoning with (in this case human-generated) slop?
- dspillett 6mo agoI may be picking nits on nits here, but… If slop indicates content with no reasoning, then deliberate slop isn't slop as it is generated with both reason and purpose known to, and understood by, the creator. Though if someone deliberately uses a generative model to create slop that line of reasoning might eat itself…
- lxgr 6mo agoMaybe we should extend "death of the author" to non-human author entities as well :)