4 ms·
Skimming the article, I don't see how it's feasible to ethically engineer a "human equivalent intelligence". The author talks about engineering a toddler level
by jimbokun 19y ago
Skimming the article, I don't see how it's feasible to ethically engineer a "human equivalent intelligence".
The author talks about engineering a toddler level intelligence, the reasoning being that the toddler program would not be capable of figuring out a way to "escape" its box and getting into mischief that humans would be unable to control or prevent.
But the thought of "turning off" a toddler equivalent makes me queasy. Will the toddler think it is a person? What an awful, worse-than-Truman's-World-nightmare it would be for that "toddler" to find out the truth. Could we ethically "turn off" such a program?
Even if it knows that it is not human, if it is truly equivalent to a toddler it is almost certain to introduce some kind of ethical quandries we cannot possibly predict before the program actually exists. I do not see any safe way to pursue this project and successfully avoid ethical landmines.
I am also troubled by the vaguely utopian hopes this man has for his personal project. Attempts by people to implement any kind of utopian vision tend to end badly.