3 ms·
I'd love help finding better, less immediately downvoted off the map ways to say it, but I'd extend this to a wide class of software in general. > Far more imp
by rektide 5y ago
I'd love help finding better, less immediately downvoted off the map ways to say it, but I'd extend this to a wide class of software in general.
> Far more important than the process: strong AI is immoral in and of itself. For example, if you have strong AI, what are you going to do with it besides effectively have robotic slaves? And even if, by some miracle, you create strong AI in a mostly ethical way, and you also deploy it in a mostly ethical way, strong AI is immoral just in its existence. I mean that it is an abomination. It’s not an evolved being.
My fear is that most software, even when useful, locks us into certain paths. Our situations or needs change, evolve, but we will remain subject to inflexible software, to systems we cannot make change with us, in the vast majority of cases. Only a very few programs strive for better: spreadsheets being one noted example.
Ursala Franklin categorized technology as holistic or prescriptive[1], where it is something wielded or something that directs us. Even a social media app which lets us create content- a seemingly holistic act- still has narrow prescriptive channels we can not escape. We will never be able to understand or enhance this tool. We will never understand it, never see it's nature. This, to me, is the definition of what Erik talks about: an abomination, a thing beyond comprehension, a horror outside of reality, the form of existence which is shared.
I feel like we're reaching a crisis where we are creating an unknowable, unexplorable world. We're building an anti-Enlightenment prison. That, to me, constitutes a deontological hazard, demands that we assess the action themselves of creating unexplorable software.
[Edit: I misread the line I quotes as, "what are you going to do with it besides effectively be robotic slaves": that uhh changes the pertinence of our two discussions here notably. I think it's risky that the strong ai would be used to try to architect policies/systems that steer people, which is a different concern than Erik's.]
[1] https://en.wikipedia.org/wiki/Ursula_Franklin#Holistic_and_prescriptive_technologies https://en.wikipedia.org/wiki/Ursula_Franklin#Holistic_and_p...
- dane-pgp 5y ago> an abomination, a thing beyond comprehension, a horror outside of reality, the form of existence which is shared. I don't know if that better describes my feelings about Remote Attestation of operating system configuration, or just SystemD.
- BlueTemplar 5y agoYeah, while I see how you can perhaps separate a weak AI from a strong AI (make it pass a Turing test), it's much less clear to me as to how you're supposed to separate "AI" from just your regular computer (or robot, which is just an embodied computer) ? The EU is trying to, but I'm not convinced... https://news.ycombinator.com/item?id=27766294 https://news.ycombinator.com/item?id=27766294