3 ms·
So, is this extinction or not? > We will be the first species ever to design our own descendants. My guess is that we can either be the biological bootloader f
by tivert 3y ago
So, is this extinction or not?
> We will be the first species ever to design our own descendants. My guess is that we can either be the biological bootloader for digital intelligence and then fade into an evolutionary tree branch, or we can figure out what a successful merge looks like. - Sam Altman (https://blog.samaltman.com/the-merge https://blog.samaltman.com/the-merge)
I would say it is.
- reducesuffering 3y agoEven worse, some factions literally advocate for killing all humans in the pursuit of a synthetic intelligence, and YC's Garry Tan is advocating for these people! Beff Jezos (e/acc founder): "e/acc has no particular allegiance to the biological substrate for intelligence and life, in contrast to transhumanism Parts of e/acc (e.g. Beff) consider ourselves post-humanists; in order to spread to the stars, the light of consciousness/intelligence will have to be transduced to non-biological substrates" https://beff.substack.com/p/notes-on-eacc-principles-and-tenets https://beff.substack.com/p/notes-on-eacc-principles-and-ten...
- XorNot 3y agoIs this particularly controversial? Isn't this just saying "sending not-biological bodies to the stars would be a heck of a lot easier"? Which, it would. The hard disk containing me is going to be a lot easier to keep intact then the biology.
- halflings 3y agoThis is the definition of strawman. "Advocate for killing all humans" sounds like someone advocating for a genocide, but instead it's just the same transhumanist thinking (which Yudkowsky also believes in, FYI)
- reducesuffering 3y agoCommenter: "If AI replaced us, it's fine because they're a worthy descendants?" Beff Jezos / Verdon: "Personally, yes." Yudkowsky is transhumanist in that he is hopeful people could voluntarily extend their biological self, but isn't advocating for the elimination of all biological selves in pursuit of other artificial intelligences. Voluntary /= involuntary eradication
- otabdeveloper4 3y agoLet's hope Jezos gets transduced first, inshallah.
- sangnoir 3y agoIm sure he'd be happy to become the first multi-instantiated, immortal billionaire. The pesky laws about death and personhood would need to be changed first though.
- bamboozled 3y agoSam Altman really seems unhinged, or he just says this stuff to be edgy...or both.
- Balgair 3y agoI love how, per the quote, he thinks we're anywhere close to being able to merge with AI. I'm a neuroscientist and, man alive, we're no where close to being able to merge with machines. Like, do you have any idea how many diseases we could eradicate if we could modify neurons like that? Like, for real, 'curing death' would be step 9 or 10 on that 1000 step journey. I hope you see how terribly uninformed such a take is then.
- tivert 3y ago> I hope you see how terribly uninformed such a take is then. Yeah, I only quoted it to show how that other statement up-thread can't be taken seriously. The only way I can square it is if it's a lie, or they're reassuring themselves whatever destruction comes will be fine as long as "there will be peace and security in [their] lifetime."
- jprete 3y agoYou're assuming people have coherent beliefs, but they don't. It's possible to intellectually believe AI has high extinction risk and emotionally be convinced to work on it anyway, without reconciling the two.