3 ms·
An old but good counterpoint to the "rapture of the nerds": http://web.archive.org/web/20110718031848/http://www.acceleratingfuture.com/steven/?p=21 http://web.
by TeMPOraL 3y ago
An old but good counterpoint to the "rapture of the nerds": http://web.archive.org/web/20110718031848/http://www.acceleratingfuture.com/steven/?p=21 http://web.archive.org/web/20110718031848/http://www.acceler....
There's a good breakdown and cliche-by-cliche comparison in there, but I find the penultimate paragraph both memorable and quotable:
> It’s also interesting to think about what would happen if we applied “Rapture of the Nerds” reasoning more widely. Can we ignore nuclear warfare because it’s the Armageddon of the Nerds? Can we ignore climate change because it’s the Tribulation of the Nerds? Can we ignore modern medicine because it’s the Jesus healing miracle of the Nerds? It’s been very common throughout history for technology to give us capabilities that were once dreamt of only in wishful religious ideologies: consider flight or artificial limbs. Why couldn’t it happen for increased intelligence and all the many things that would flow from it?
- ang_cire 3y agoWe cannot ignore those other things you list, because they are here already. AGI is not, and there is no evidence that it is even possible. So it, we can safely ignore for now. Once some evidence exists that it may actually be achievable, we'll need to pay attention. People in 1000 CE could (and did) safely ignore all those things, for this exact reason.
- ben_w 3y ago> AGI is not, and there is no evidence that it is even possible. We ourselves are an existence proof that minds like ours can be made, that these minds can be made from matter, and that the design for the organisation of that matter can come from a simple process of repeatedly making imprecise copies and then picking the best at surviving long enough to make more imprecise copies. > People in 1000 CE could (and did) safely ignore all those things Whereas the people, and specifically leadership, of Japan unsafely ignored one of them on the 5th August 1945. Some of the leadership were still saying it couldn't possibly have been a real atomic bomb as late as the 7th, which is ultimately why the second bomb fell on the 9th.
- tivert 3y ago>> AGI is not, and there is no evidence that it is even possible. > We ourselves are an existence proof that minds like ours can be made, that these minds can be made from matter, and that the design for the organisation of that matter can come from a simple process of repeatedly making imprecise copies and then picking the best at surviving long enough to make more imprecise copies. I think that "proof" rests on an as-yet circular assumption. Even if that assumption is accepted, there no evidence that humans are capable of designing a new mind or that it's possible to make a mind that greatly exceeds ours in capability.
- TeMPOraL 3y agoYou won't get a proof until the deed is done. But that's the same with nuclear armageddon - you can't be sure it'll happen until after the planet's already glassed. Until then, evidence for probability of the event is all you have. > there no evidence that humans are capable of designing a new mind or that it's possible to make a mind that greatly exceeds ours in capability There's plenty of good reasons to assume it's possible, all while there's no evidence suggesting it's not.
- ang_cire 3y ago"good reasons" sounds like another way of saying "no actual evidence, but a lot of hope". There is no actual evidence that it's possible, certainly not anytime soon. People pushing this narrative that AGI is anywhere close are never people working in the space, it's just the tech equivalent of the ancient aliens guys.
- ben_w 3y ago> People pushing this narrative that AGI is anywhere close are never people working in the space Apart from the most famous AI developer group since near the beginning of this year, on the back of releasing an AI that's upset a lot of teachers and interview-question writers because it can pass so many of their existing quizzes without the student/candidate needing to understand anything. I suppose you could argue that they are only saying "AGI could happen soon or far in the future" rather than "it will definitely be soon"…