45 ms·
> That makes an assumption that there aren't limits on intelligence regimes and that you can just recursively improve intelligence without much friction. No it
by naasking 9y ago
> That makes an assumption that there aren't limits on intelligence regimes and that you can just recursively improve intelligence without much friction.
No it doesn't. AI just needs to get smarter than humans for it to be dangerous to us. The costs C and C' the parent comment described can include an upper bound on the cost of the self-improvement needed to achieve each respective goal.
- colordrops 9y agoI don't disagree with you seem to have missed the hypothetical situation I was responding to: > It can’t, so it spends some time recursively improving itself
- naasking 9y agoI was responding to your response to that. Recursive improvement doesn't need to be unbounded, it just needs to supercede us.