3 ms·
I spent an hour of my life that I'll never get back reading Yudkowski's overly-long article and I believe I can summarise it thusly: "We don't know how AGI wil
by YeGoblynQueenne 9y ago
I spent an hour of my life that I'll never get back reading Yudkowski's
overly-long article and I believe I can summarise it thusly:
"We don't know how AGI will arise; we don't know when; we don't know why; we
don't know anything at all about it and we won't know anything about it until
it's too late to do anything anyway; We must act now!!"
The question is- if we don't know anything about this unknowable threat, how can
we protect ourselves against it? In fact, since we're starting from 0
information, anything we do has equal chances of backfiring and bringing forth
AGI as it has of actually preventing it. Yudkowski is calling for random action,
without direction and without reason.
Besides, if Yudkowski is none the wiser about AGI than anyone else, then how is
he so sure that AGI _will_ happen, as he insists it will?
Yudkowski is fumbling around in the dark like everyone else in AI. Except he
(and a few others) has decided that it's a good strategy, under the
circumstances, to raise a hell of a racket. "It's dark!" he yells. "Beware of
the darkness!". Yeah OK, friend. It's dark- we can all tell. Why don't you pipe
down and let us find the damn light?
- gliptic 9y agoSo, in your view, starting MIRI, doing fundamental research into AI safety and advocating for it, is not trying to find the damn light? You exemplify exactly the attitude he's trying to combat. "Oh, nobody knows anything, let's not care about consequences and do whatever."
- deleted 9y ago[deleted]
- YeGoblynQueenne 9y agoSorry but I don't really see Yudkowski's contributions as "fundamental research into AI safety". More like navel-gazing without any practical implications. At best, listening to him is just a waste of time. At worse, AGI is a real imminent threat and having people like him generating useless noise like he does will make it harder for legitimate concerns to be heard, when the time comes.
- gliptic 9y agoSo you don't think they're doing anything worthwhile at https://intelligence.org/ https://intelligence.org/. I'm going to guess you actually have no idea and are just extrapolating from some articles you read. What are _you_ doing to make legitimate concerns heard then? Did you even read the article you were complaining about?
- YeGoblynQueenne 9y agoYes, I did and it's very bad form to go around asking people if they read the article. Try to remember that different people form different opinions from similar information.
- gliptic 9y agoWell, then you should have noticed what the article was about, which was not to detail a research program about AI safety. Different articles can address different aspects of a problem without being accused of advocating "random action". That's just ridiculous.
- Tenoke 9y ago>The question is- if we don't know anything about this unknowable threat, how can we protect ourselves against it? In fact, since we're starting from 0 information, anything we do has equal chances of backfiring and bringing forth AGI as it has of actually preventing it. Yudkowski is calling for random action, without direction and without reason. Are you sure you read the essay? That's literally the question he answers. At any rate, we do have more than '0 information', and if you make an honest effort to think of what to do you can likely come up with better than 'random actions' for helping (as many have).
- YeGoblynQueenne 9y ago>> Are you sure you read the essay? That's literally the question he answers. My reading of the article is that he keeps calling for action without specifying what that action should be and trying to justify it by saying he can't know what AGI would look like (so he can't really say what we can do to prevent it). >> if you make an honest effort to think of what to do you can likely come up with better than 'random actions' for helping (as many have). Sure. If my research gets up one day and starts self-improving at exponential rates I'll make sure to reach for th