4 ms·
The AI becomes much smarter than us and potentially destroys everyone and everything we care about. Unless you are supremely confident in humanity's intelligenc
by mindcrime 11y ago
The AI becomes much smarter than us and potentially destroys everyone and everything we care about. Unless you are supremely confident in humanity's intelligence, you should be concerned about AI risk.
I acknowledge it as a real risk, but it's not terribly high on my personal list of things to worry about right now. I like what Andrew Ng said about how worrying about this now is "like worrying about over-population on Mars".
- ggreer 11y agoPlease notice that your reply is a different argument than the one you first put forth. Originally, you weren't worried about AI because you thought it could never –even in principle– vastly exceed human abilities. Now you're basically saying, "I don't need to worry because it won't happen for a long time." That is a huge amount of ground to cede. I'm not so confident that human-level AI will take a long time. The timeline depends on algorithmic insights, which are notoriously difficult to predict. It could be a century. It could be a decade. Still, it seems like something worth worrying about.
- mindcrime 11y agoPlease notice that your reply is a different argument than the one you first put forth. Originally, you weren't worried about AI because you thought it could never –even in principle– vastly exceed human abilities. I never said I wasn't worried about AI. You're extrapolating from what I did say; which I've said all along was just a thought experiment, not a position I'm actually arguing for.
- mattmanser 11y agoI really recommend you read Bostrom, he really does succinctly argue the relevant positions, if a bit drily. It's one of those books that put the arguments so clearly you're suddenly catapulted to having a vastly superior knowledge of the subject than someone trying to do simple thought experiments. Both of your arguments look out-dated if you're one of the people 'in the know'. Also, I suggest looking a bit more into what's going on in machine learning, it's suddenly got far more sophisticated than I personally realized until a couple of months ago when I was chatting to someone developing in it at the moment.
- mindcrime 11y agoI actually have the Bostrom book, but just haven't found time to read it yet. But it is definitely in the queue!
- astrofinch 11y agoOr like worrying about global warming back when it would have been easier to prevent? Ng's statement is, at best, equivalent to a student who is putting off starting their semester project until finals week. Yes it seems far away, but the future is going to happen.
- mindcrime 11y agoI don't know. I mean, we don't seem to even be close to actually beginning to colonize Mars, much less be close to the point of overpopulation. I think Ng's statement, formed in an analogy similar to yours, would be closer to "a freshman student who is putting off studying for his Senior final project until his Senior year". The question Ng asked was something like "is there any practical action we can take today, to address over-population on mars" as an analogy to "is there any practical step we can take today to address the danger of a super-AGI". And honestly, I'm not convinced there is anything practical to do about super-AGI today. Well, nothing besides pursuing the "open AI" strategy. But I'm willing to be convinced otherwise if somebody has a good argument.
- astrofinch 11y agoDid you have thoughts on the FLI research priorities document? http://futureoflife.org/data/documents/research_priorities.pdf http://futureoflife.org/data/documents/research_priorities.p...
- mindcrime 11y agoI wasn't familiar with that until now, but I'll definitely give it a look.