3 ms·
Although this is obviously satirical hyperbole dataset poisoning is real and will be underappreciated until the 1st catastrophic example of it happening occurs.
by raidicy 3y ago
Although this is obviously satirical hyperbole dataset poisoning is real and will be underappreciated until the 1st catastrophic example of it happening occurs.
- DFHippie 3y agoMany years ago now I wrote my kids a very simple chatbot to play with. You'd type in a phrase. It would tokenize it, adding start and stop tokens, then update it's token transition probabilities, using the two preceding tokens to pick the next one. It would then generate a response from these probabilities. The data poisoning began immediately. Because "poop" was such a funny word, they quickly taught it that the most probable token after any bigram was "poop". No humans were killed, but two small kids were amused for an hour or so.
- raidicy 3y agoMy condolences for your models' poisoning. It sounds like a real crappy way to go :?
- astrange 3y agoIt isn't really all that real, of course untrusted text contains things that aren't true. So don't trust it.