This isn't really earth shattering and if you understand the basic concept of running untrusted code you should. All language models would have this as a flaw

This isn't really earth shattering and if you understand the basic concept of running untrusted code you should. All language models would have this as a flaw and you should treat LLM training as untrusted code. Many LLMs are just data structures that are pickled. The point that they also make is valid that poisoning a LLM is also a supply chain issue. Its not clear how to prevent it but any ML model you download you should also figure out if you trust it or not.