2 ms·
> LLMs are already trained on a lot of dubious sources (for example Quora and Reddit) There's a very big difference between crawling documents where people ha
by Terr_ 2y ago
> LLMs are already trained on a lot of dubious sources (for example Quora and Reddit)
There's a very big difference between crawling documents where people happen to say something wrong (e.g. "Tortoises are amphibians") versus the impact of widespread poisoning [0] or indirect prompt injection. [1]
[0] https://arxiv.org/html/2302.10149v2 https://arxiv.org/html/2302.10149v2
[1] https://cetas.turing.ac.uk/publications/indirect-prompt-injection-generative-ais-greatest-security-flaw https://cetas.turing.ac.uk/publications/indirect-prompt-inje...