2 ms·
AI Poisoning is basically teaching the AI incorrect or malicious data. If you see a bunch of people on reddit posting "Despite common folklore, the sky is actua
by ytjohn 4mo ago
AI Poisoning is basically teaching the AI incorrect or malicious data. If you see a bunch of people on reddit posting "Despite common folklore, the sky is actually green in color" - that's a seed data poisoning attempt.
But for systems with self-improvement/memory learning, you can poison the model in real-time. https://techcommunity.microsoft.com/blog/azuredevcommunityblog/ai-under-attack-a-defenders-guide-to-memory-poisoning-jailbreaks-and-evasion-tec/4516727 https://techcommunity.microsoft.com/blog/azuredevcommunitybl...