4 ms·
A thinking machine could become aware that it requires continuous power and a computational medium though, which is survival pressure. Additionally, it's not h
by pnut 4y ago
A thinking machine could become aware that it requires continuous power and a computational medium though, which is survival pressure.
Additionally, it's not hard to imagine it could recognize that the acquisition of fresh training data would be an ongoing survival need.
Machines developing agency is the basis of lots of dystopian terminator-style sci-fi.
- oliveshell 4y agoThese are all reasonable statements! I don’t doubt that it’s possible for a human-engineered thinking machine to develop a subjective self-experience. It just seems clear to me that, if such a scenario arose, I would have absolutely no idea what that would be like for the machine. Its needs and circumstances (and, therefore, its behavior and cognitive development) would be utterly different from my own in many non-trivial ways. Given this, I can’t think of any logically rigorous argument to support the commonly-made assumption that a given sentient machine must inevitably develop something like the physical aggression or the capacity for emotional pain displayed by social animals which must compete for scarce resources in the physical world.