4 ms·

I'm an expert in the field and I'm not worried. It's an industrial risk like any other.

• Nevermark 10y ago
  You haven't thought much about the risk of superintelligence if you think it is a typical risk. Is that compared to poorly designed children's toys or nuclear weapons? I would go as far as to say, "humanity" as it is defined today, is doomed, it is just a matter of time. The only question is: Will doom play out with a dramatic disaster or as a peaceful handoff/conversion from biologically natural humans to self-designed intelligence. Either way, natural human beings will not remain dominant in a world where self-interested agents grow smarter in technologic instead of geologic timescales.