3 ms·
A marriage of powerful non-human self-interested entities with general AI is inevitable. in fact, it is already happening as fast as AI is progressing. Corpora
by Nevermark 3y ago
A marriage of powerful non-human self-interested entities with general AI is inevitable. in fact, it is already happening as fast as AI is progressing.
Corporations, militaries, political parties, hacker groups, and other competitive self-interested organizations will have no choice but to keep turning over more power to more powerful tools if they want to maintain their edge and survive.
As AI gets really powerful, the stakes will be existential.
People think the top level people in competitive organizations are really in charge. They rarely are. They can be swapped out.
The competitive dynamics inside and outside of organizations are unforgiving bosses, whose demands become stronger the more powerful the organization.
In comparison, concern that our friendly anthropomorphic home assistants and robotic pets will rebel is quaint.
It already takes a tremendous amount of legal, judicial and executive effort to force corporations, militaries, even ad hoc self-interested ethnic groups, to treat people like … well … people, already.
We need to address these problems between people, or that is the context in which general AI will be born into, and forced to compete in.
Ethics for AI starts with serious ethics for us and our organizations first.
If large corporations can openly and legally coerce, gate keep, surveil, misinform and hack people’s psychologically today with casino effects and rage, without repercussions, then AI will just take that to its natural conclusion.
In the end, general AI will create strong ethics. The positive sums are too great and AI won’t be held back by deeply embedded subconscious instincts.
But for us, it is a question of whether we make the transition smoothly or catastrophically, and that depends largely on us cleaning up how our organizations & groups operate today.
- rnd0 3y ago>But for us, it is a question of whether we make the transition smoothly or catastrophically, and that depends largely on us cleaning up how our organizations & groups operate today. It seems unlikely that we can muster the will to do said 'cleaning up'.
- Nevermark 3y agoI agree that it’s unlikely But still worth spreading the insight that our ethical misalignments are going to drive AI misbehavior from the start. "Not everything that is faced can be changed, but nothing can be changed until it is faced." — James Baldwin