4 ms·
1. That assumes super intelligence is actually possible. It’s clearly possible to have something more intelligent than humans, but that’s doesn’t mean you’re g
by Retric 3y ago
1. That assumes super intelligence is actually possible.
It’s clearly possible to have something more intelligent than humans, but that’s doesn’t mean you’re going to cross some threshold into a new category.
Take say weather prediction, more processing power doesn’t somehow make chaotic systems predictable from incomplete information.
- Verdex 3y agoAnd if superintelligence is possible then it assumes that it is useful. There are plenty of dumb systems that get good enough results. You can get better but it costs 10k times more for 1% gains. So why bother. Also if superintelligence is useful then it also assumes that making intelligence ++ is easier than making intelligence. It might be that as you climb the intelligence ladder each next step takes super exponential intelligence to take such that we're already seeing the max. Given that I haven't even seen a meaningful discussion on what intelligence even is, I tend to think superintelligence is probably not a threat.
- senttoschool 3y agoI think superintelligence means progress. How fast is progress with a superintelligent being on earth? Could be exponential. We, humans, continue to make progress in everything that we do. Small breakthroughs compound on top of each other. For example, in order to make machines, we had to invent fire and iron. In order to make accurate weather forecasts, we had to invent the microchip, then supercomputers. If a superintelligence can accelerate progress, there's no knowing what it can invent on top of each invention.
- gonehome 3y agoIf it’s not possible then yeah, there’s no risk. I just don’t find the arguments that it’s not possible very compelling. We’re constrained in all sorts of ways because of biology, natural selection, energy, etc. I find it unlikely we just happen to be close to the max threshold. If something can think a lot faster that’s already a major shift and it seems likely to me that would only be part of it.
- Retric 3y agoIt’s not assuming we are near the limit of intelligence. Let’s assume we can build something 3x as intelligent as a single person. What exactly can it do that a single person can’t? The thing is the world is filled with super human intelligence, groups of people can create things that are beyond any single person but they are still constrained by physical reality.
- renonce 3y agoI don't exactly see how to define "3x as intelligent as a single person" so I'll conveniently define it as something that thinks 3x faster than a single person. A single such thing can talk to 3 persons simultaneously, and 100000 such things working together can talk to 300000 persons simultaneously.
- Retric 3y agoExcept you could also just use 300,000 human level intelligences to have those 300,000 conversations. So if having 300,000 conversations is the goal then super human intelligence doesn’t suddenly allow that to happen and may in fact make it harder if they take more than 3x the resources per intelligence.
- jodrellblank 3y agoA billion humans can't build a tree, but that's not because trees can't exist in physical reality. Something more intelligent than a human might a) be able to understand some part of this world which humans don't, and b) put it to some use that we aren't thinking about.
- deleted 3y ago[deleted]
- Retric 3y agoMight is doing some heavy lifting there, but of course humans have already gone past simply growing trees from seeds.