3 ms·

AI Hallucinations Are Fueling a New Class of Supply Chain Attacks

• jruohonen 2y ago
  "They found that 8.7% of hallucinated Python packages were actually valid npm (JavaScript) packages"
  • warkdarrior 2y ago
    So those package names are not really hallucinated, since the packages actuualy exist?
    • faut_reflechir 2y ago
      it's two different languages
    • citizenkeen 2y ago
      I’m not sure if you know this, but Python and JavaScript are different languages. Their libraries are different ecosystems, so that’s definitely a hallucination.
      • foogazi 2y ago
        Yes, but the names are not hallucinated They being python is the hallucination- the names exist in its training data
• pera 2y ago
  I was talking about this issue with a friend a while ago: If an LLM often hallucinates the same package name for a common problem you could copy an existing library, adapt the API to fit the hallucination, use the same hallucinated name and finally include a backdoor.
• deleted 2y ago
  [deleted]