4 ms·
Isn't the selection bias imposed by the humans who are developing the AI? If humans want an AI that can drive a car, it probably won't care about making money
by ridgeguy 11y ago
Isn't the selection bias imposed by the humans who are developing the AI?
If humans want an AI that can drive a car, it probably won't care about making money but it'll put Stirling Moss to shame.
If humans want an AI that can make money, it may be a lousy driver but will run the world's best hedge fund - and might try to gather every bit of the world's wealth to itself, depending on unforeseen consequences of its developers' instructions.
As for survival instinct - one supposes human AI developers will select out (i.e., kill) lots of AI variants that don't meet their criteria. This seems tailor-made to ensure the emergence of "survival instinct", which might not conform to the humans' criteria for continued existence.
What if a variant found that falsifying its performance data got it picked to "live" while "honest" reporters got culled? There are so many attack surfaces in complex systems.
I think we should expect the full range of human good and bad behavior from human-developed AI, just a lot faster and more effective.