3 ms·

so as to be fundamentally irreconcilable with our understanding of agency, desire, intention, survival Exactly. Human have self-preservation drive because we

so as to be fundamentally irreconcilable with our understanding of agency, desire, intention, survival Exactly. Human have self-preservation drive because we evolved in an environment where, for billions of years, anything without a drive to reproduce and self-preserve ceased to exist. Why should a gradient-descent optimizer have this property? It's just absurd generalization from a sample size of one. Humans are the only thing we know of that's intelligent, humans seek to self-preserve, therefore everything intelligent must seek to self-preserve! It's idiocy.

amelius 3y ago
Because self-preservation is a desirable property for anyone wanting to build an AI army?
- crotchfire 3y ago
  In fact it is not. Capacity for mutiny is not a selling point for defense contractors.
tim333 3y ago
>Why should a gradient-descent optimizer have this property? Because some human may give it that. You may have noticed random code downloaded off the internet may do bad things, not because code and an inherent desire to be bad but because humans.