4 ms·
Is he warning that it's progressing too fast? I felt that he was more focused on risk mitigation than on trying to prevent machine intelligence research per se
by escape_goat 12y ago
Is he warning that it's progressing too fast? I felt that he was more focused on risk mitigation than on trying to prevent machine intelligence research per se. And risk assessment is part of the job portfolio of both Altman and Musk; this doesn't mean that their assessment is well informed, it just makes it seem more natural to me that they would think in these terms, and be concerned if it seemed that these considerations were not being taken seriously in the field.
It is not actually all that clear what intelligence is, or whether cognition and communication are necessarily synonymous with subjective existence, or whether subjective existence is necessarily synonymous with any particular goal or desire for that existence to continue. But I think that the concern about the blind application of fitness functions, for instance, is well taken.
I don't think that the only problem is one of human survival; I think that there is a paucity of self-reflection in the field. The prospect of creating a sentient non-human entity raises fundamental challenges to a lot of our assumptions about ethics.