6 ms·
Such things may not have personhood but they do have internal reasoning, can be built to have real-world goals, can solve any "intelligence-bound" problem (like
by cousin_it 15y ago
Such things may not have personhood but they do have internal reasoning, can be built to have real-world goals, can solve any "intelligence-bound" problem (like math or physics) better than any human, and can cause something like the Singularity to occur (which the essay was arguing against in the first place).
It seems that conceptualizing AIs as human-like is the #1 top mistake that leads people to think AIs are impossible (or, alternatively, safe once they're built). It's more enlightening to think of an AI as a cold mathematical machine that uses computational power to achieve whatever goal the original programmer specified, possibly increasing its own power in the process. It will happily eat your babies if it needs more atoms. Its lack of personhood won't save you.
- loup-vaillant 15y agoEliezer Yudkowsky has a very good synonym for "AI" that doesn't trigger anthropomorphism: "Optimization Process". An example is Darwinian Evolution. And it is quite obvious that Evolution isn't alive, sentient, let alone human-like.
- klipt 15y agoGood old evolution. Humans are just one of its fruits, yet we think so highly of ourselves. If a superhuman AI exists, exactly what evolutionary niche are humans going to fill? Because there's a word for species which don't have an evolutionary niche: extinct.
- dmbass 15y ago"It seems that conceptualizing AIs as human-like is the #1 top mistake that leads people to think AIs are impossible (or, alternatively, safe once they're built). It's more enlightening to think of an AI as a cold mathematical machine" But really, even humans are just cold mathematical machines when you get below a certain layer.