6 ms·
I wish I could be as optimistic. But AGIs are physical beings with computational limitations that run on energy. The Sun can produce so much over a given period
by pacala 12y ago
I wish I could be as optimistic. But AGIs are physical beings with computational limitations that run on energy. The Sun can produce so much over a given period of time. It's not hard to imagine a competition trap involving AGIs, each trying to get as much resources as possible to increase its capacity and crush the competition.
- eli_gottlieb 12y agoI would hope artificial agents are intelligent enough to realize that erasing their own utility functions to grab resources has very low utility! Cooperation is a high expected-utility strategy for the mean agent, which is why it evolved in the first place.
- Houshalter 12y agoI don't cooperate with ants.
- eli_gottlieb 12y agoDon't make me come over there, kid.