3 ms·
I understand your point but I disagree with the concept of making AGI existentially safe in the long term - I argue it's a functional impossibility and a waste
by AndrewKemendo 10y ago
I understand your point but I disagree with the concept of making AGI existentially safe in the long term - I argue it's a functional impossibility and a waste of time and money to research. Biological humanity will ideally be obsolete in the long term.
That said, ceding control of critical control systems (SCADA for power, water etc...) needs to be done in the right way to actually ensure that the implementation is better, but that's just good engineering.
- flycaliguy 10y agoCan you point an outsider towards some reading that will help me make sense of the statement "Biological humanity will ideally be obsolete in the long term."?
- AndrewKemendo 10y agoNothing directly making the case exists as far as I know. The simplest metaphor I always make is that it's the same as the elderly being comfortable dying knowing that their offspring are off living their lives. In this case it's humanity that's dying and AGI is our offspring. I mean we're doomed as a species in the long run anyway - that's well understood evolutionary biology - so lets take control of that and engineer our offspring directly. Here's Lawrence Krauss making the case in a roundabout way: "What if our descendants aren't carbon based, what's wrong with that?" https://youtu.be/gLKmKqrNUKY?t=9m29s https://youtu.be/gLKmKqrNUKY?t=9m29s
- sjg007 10y agoMost likely we will upload ourselves into the matrix/framework...