4 ms·
The significant disanalogy is the amount of control parents have over their child's character compared to a programmer. Parents can pretty much do their best to
by sullyj3 5y ago
The significant disanalogy is the amount of control parents have over their child's character compared to a programmer. Parents can pretty much do their best to raise a child, but the child may still end up screwed up. I wouldn't really put the blame at their feet. If they deliberately raise their child to be a killer, that's obviously another matter. By contrast, an AGI designer is in an unprecedented situation where they essentially have total control over the character of the being they're bringing into existence. If the AGI does bad things, it's very much on the programmer.
- selfhoster11 5y agoThat's assuming the AGI designer even understands what they built. If the first AGI is built via some semi-automated bootstrapping process based on a lesser intelligence, you can't really predict how the resulting intelligence will behave.
- sullyj3 5y agoFor sure, which means it's the designer's responsibility to do due diligence in making certain they do understand it. Kickstarting such a process is not an ethically responsible thing to do, unless they are sure it and its future iterations are aligned.