4 ms·
>I really don't see that critical thinking is at all required for a raw optimization process. The problem they are trying to solve is what happens when that opt
by logicchains 3y ago
>I really don't see that critical thinking is at all required for a raw optimization process. The problem they are trying to solve is what happens when that optimization process isn't aligned with human flourishing.
I agree it's possible to have a dangerous AI that lacks human "critical thinking", but I don't think it's reasonable to refer to an AI as much more intelligent than humans if there's any class of intellectual tasks humans can do but the AI cannot.
- unlikelymordant 3y agoIf a 'superintelligence' achieves the same outcomes as humans without engaging in the same class of intellectual tasks that humans do, wouldnt it still be a superitelligence? Deep blue was beating everybody at chess without engaging in the same process as humans. If chess is a metaphor for life, it seems some algorithm might do better at all the things a human does while not arriving at its decisions in a remotely similar way.
- ball_of_lint 3y ago(argued at various places better than I can. For example https://www.lesswrong.com/posts/7dkH5i7T8a78Da3ty/why-will-an-agi-be-rational https://www.lesswrong.com/posts/7dkH5i7T8a78Da3ty/why-will-a... ) Rationality is an attractor for high intelligence architectures. You may be able to get good results another way (and even good results that surpass a human) but at the limit rationality is the way to have high intelligence.