HFT algorithms aren't even AI but are capable of doing large amounts of damage when they become synchronized - the resulting flash crashes can wipe out large am

HFT algorithms aren't even AI but are capable of doing large amounts of damage when they become synchronized - the resulting flash crashes can wipe out large amounts of capital. And it's most likely that these things will emerge from industries that have no effective regulatory oversight (e.g. HFT/SEC), so effective controls against damage will most likely just not exist. There won't be a shotgun welded to the main processing core of the Wintermute AI that decides, for whatever reason, to bankrupt your company, halt food shipments to your grocery store, or shutdown the systems that clean the water supply. What scares me about AI is the ineffective controls that will exist on these things, and given the state of most software development practices I don't think that's a huge stretch.