4 ms·
>except ourselves. Good argument, lets ignore the (human) elephant in the room! >worrying about deadly quantum laser weapons If humans were shooting smaller
by pixl97 3y ago
>except ourselves.
Good argument, lets ignore the (human) elephant in the room!
>worrying about deadly quantum laser weapons
If humans were shooting smaller less deadly quantum lasers out of their eyes I'd be very fucking worried that we'd make a much more powerful artificial version.
Tell me why do you think humans are the pinnacle of intelligence? What was the evolutionary requirement that somehow pushed us to this level?
You simply cannot answer that last question. Humans have a tiny power budget. We have a fit out of the birth canal limitation that cuts down on our brain size. We have a "don't starve to death" evolutionary pressure that was the biggest culling factor of all up to about 150 years ago. The idea that we couldn't build a better intelligence optimized system than nature is foreign to me, nature simply was not trying to achieve that goal.
- revelio 3y agoAI also has a power budget. It has to fit in a datacenter. Inconveniently for AI, that power budget is controlled by us.
- pixl97 3y agoDo you remember the days the computing power that's in your pocket took up an entire floor of a building? Because I do. If that is somehow the only barrier between humanity and annihilation, then things don't bode well for us.
- revelio 3y agoSure. Despite all that progress, computers still have an off switch and power efficiency still matters. It actually matters more now than in the past.
- pixl97 3y agoWhat you're arguing is "what is the minimum viable power envelope for a super intelligence". Currently that answer is "quite a lot". But for the sake of cutting out a lot of argument lets say you have a cellphone sized device that runs on battery power for 24 hours that can support a general intelligence. Lets say, again for arguments sake, there are millions of devices like this distributed in the population. Do you mind telling me how exactly you turn that off? Now we're lucky in the sense we don't have that today. AI still requires data centers inputting massive amounts of power and huge cooling bills. Maybe we'll forever require AI to take stupid large amounts of power. But at the same time, a cray super computer required stupid amounts of power and space, and your cellphone has leaps and bounds more computing power than that.
- tome 3y ago> lets say you have a cellphone sized device that runs on battery power for 24 hours that can support a general intelligence I can accept that it would be hard to turn off. What I find difficult to accept is that it could exist. What makes you think it could?
- pixl97 3y agoYou, a general intelligence operate on around 20 watts of power, so we could use that as a base floor. Analog inference is one of the areas being worked on that may massively lower power requirements.
- tome 3y agoOK, sure, in principle, somewhere in the universe, such a thing could arise. Why do you think there's a path to it arising on planet earth within human timescales?
- pixl97 3y agoBecause humans keep pouring massive amounts of money into making this happen. When you invest dedicated effort in making something happen you greatly increase the probability that it happens. And in this case it is a reinforcing feedback loop. Better technology begots better technology. Intelligence begots more intelligence. Evolution has to take a random walk to get where it is, it doesn't necessarily have a goal past continuation, intelligence shortcuts that. It can apply massively iterative efforts towards a goal.
- tome 3y agoYeah, but they can't make it happen if it's impossible. If humans poured massive amounts of money into a perpetual motion machine I wouldn't expect it to happen. So what is it that makes you believe that artificial general intelligence is possible to get to at all?
- 3y ago
- deleted 3y ago[deleted]
- Vecr 3y agoHumans also have an "off switch". It's fail safe as well, they die of dehydration and starvation even if you do nothing. If that's too slow you can just shoot them in the head.