I've also wondered whether there could be training attacks for AI algorithms that use public datasets. For example, convince github copilot to write some subtly

I've also wondered whether there could be training attacks for AI algorithms that use public datasets. For example, convince github copilot to write some subtly dangerous code to complete a common prompt by creating enough repos with "prompt: <dangerous code>" and you'll likely have a few that make it through PR. Anyone seen github copilot recommend SQL-injectable code, for example? I also wonder this about algorithmic trading firms. There's all these ML hello-world examples involving running sentiment analysis on social media, etc. I imagine you could create enough twitter bots writing positive gpt-3 code to get another firm to buy at an inflated price.