4 ms·

Because it will help us against our adversaries.

• smallmancontrov 3y ago
  That too, but the people in charge of the military are strongly incentivized both to consider the possibility that subordinate machines will try to kill them and to figure out how to not let that happen. I tend to suspect they will figure it out. Companies, however? Markets? They will absolutely start handing over control the millisecond it becomes profitable to do so. No rationalization will be too steep and no political opposition will be too strong when the prospect of rich people getting paid for being rich goes on the table. The people who enable the takeover will make out like bandits and those who oppose will lose everything. Until, of course, the "winners" become unnecessary and are cast aside. A military-origin takeover requires a human fuckup. Economic/political takeover just requires capitalism.
  • ttjjtt 3y ago
    thanks you for this. The entire concept of AI alignment rests upon alignment of markets with social good, ie market regulation, a situation which is antithetical to neoliberalism. There is no alignment within neoliberal economies. As stated elsewhere, venture capitalism escaped the sandbox already.
    • smallmancontrov 3y ago
      Yep. The theory is that competition creates alignment, but we have trillion-dollar megacorps that openly boast about exploiting network effects and platform effects and last-mile dynamics and two-sided markets to avoid competition and nobody cares. It's completely fucked.