3 ms·
Assuming it's aligned and we're still around… AGI? Lots of people are still talking like it will be an assistant, perhaps using the "centaur" metaphor, and ref
by ben_w 3y ago
Assuming it's aligned and we're still around…
AGI? Lots of people are still talking like it will be an assistant, perhaps using the "centaur" metaphor, and refusing to believe that it could[0] result in everyone's mental capacities having all the economic relevance of equine muscle power.
ASI? We don't know how far above us IQ can go, but it seems reasonable to guess that the smallest possible margin above us is such that even asking that question is like asking the question is akin to asking Chimpanzees to imagine the moon landing, while at worst it's like asking your lawn the same question.
[0] I say "could" rather than "will" because there's always the question of "how much does it cost to run that software?" — but the cost of 3430 W at $0.03/kWh matches the World Bank's international poverty line inflation adjusted to 2022: https://www.wolframalpha.com/input?i=%283430+watts+*+%240.03%2FkWh%29+in+per+day https://www.wolframalpha.com/input?i=%283430+watts+*+%240.03...
- darkerside 3y agoWhy do we act like people all have an approximately uniform intelligence that will be surpassed by AI intelligence by orders of magnitude in all dimensions? In my experience, different people are smart about different things, sometimes yes by orders of magnitude. Couldn't an AI being smarter than some people be no more surprising than some people being smarter than some other people?
- ben_w 3y ago> Why do we act like people all have an approximately uniform intelligence that will be surpassed by AI intelligence by orders of magnitude in all dimensions? I at least don't consider people to be uniform. If I act like I do, that's illusory. For orders of magnitude higher performance by AI: all have a massive intrinsic speed advantage already (which is currently balanced by an almost but not quite equally massive training set required disadvantage — they can read the entire internet, but they need to too), and the go and chess AI have already vastly exceeded human capacity. I think this kind of thing is also part of why AGI means different things to different people. By my standards, ChatGPT is already an AGI, it's able to operate on text-based tasks in general (the G in AGI) at a level higher than some humans and lower than others — if I'm right, a lot of people are already no longer capable of being economically viable, and their only hope in the current economic system is that the market for their labour doesn't act with perfect information. I may also just be wildly over-estimating the capabilities of ChatGPT.
- melagonster 3y agoyes, chatGPT had let people lose their jobs. this also prove that we have no chance when AI got everyone's job. do anyone care people who displace by chatGPT?
- ben_w 3y ago> this also prove that we have no chance when AI got everyone's job. Not "prove", but it is suggestive. To prove it, ChatGPT would have to also prevent them getting another one. > do anyone care people who displace by chatGPT? I can't parse this sentence. Are you asking: 1. Does anyone care about the people who are displaced by ChatGPT? 2. Does anyone care for the people who are displaced by ChatGPT? 3. Does anyone care that people are displaced by ChatGPT? 4. Does anyone care about the people who are using ChatGPT to displace others? Or something else?
- melagonster 3y ago>Not "prove", but it is suggestive. To prove it, ChatGPT would have to also prevent them getting another one. Maybe it won't take all jobs. but this displayed that it is impossible to implement UBI or other strategies before most of people losing job. >I can't parse this sentence. thanks for your free English class, bro.
- pixl97 3y agoThere are a lot of things we can define with physics because they can be easily measured. The particular problem with intelligence it is a measure of systems complexity which is something us as humans are very bad at measuring. As far as I know all measures of intelligence we have are relative. That is one person/system is more intelligent than another. But there is no meaningful measure if how intelligent a system can be. That is, what is peak intelligence?
- svieira 3y ago> it seems reasonable to guess that the smallest possible margin above us is such that even asking that question is like asking the question is akin to asking Chimpanzees to imagine the moon landing, while at worst it's like asking your lawn the same question. "You mustn't be afraid to dream a little bigger" with regards to the hierarchy of intelligence - the "at worst" is much further away than human-to-lawn. Look at the intellectual power of angels in Catholic theology and consider an intelligence that can reason from universals to all particular instances as its default mode of operation. Then consider that each angelic being is distinct from each other one by nature (since they are immaterial). Which means that there is a species-level difference between each of them and the lowest one is already far above us. Then consider that there are (at least) billions of them, each one order of magnitude more intelligent than the one below it. Then consider the kind of intellect that can create those kinds of intellects. Fortunately, you can't give what you don't have, so we're quite safe from the basilisk. But the wild imaginings of John C. Wright's Count to the Eschaton Sequence are probably not far off for "hey how weird could it get?"
- ben_w 3y agoThe point of my comparison was not to indicate the exact scale of thought difference, but the incomprehensibility gap. In this regard, while I've not read Count to the Eschaton, I'm confident any work written by humans isn't weird enough.
- svieira 3y agoWhereas, what I'm saying is, given that you can't give what you don't have, we don't have to worry about creating something more intelligent than we can be. But just how intelligent we can be is a pretty surprisingly large horizon in the first place.