3 ms·

Reading the lesswrong link, the parts I get hung up on are that it appears in these doomsday scenarios humans lose all agency. Like, no one is wondering why thi

Reading the lesswrong link, the parts I get hung up on are that it appears in these doomsday scenarios humans lose all agency. Like, no one is wondering why this computer is placing a bunch of orders to DNA factories? Maybe I’m overly optimistic about the resilience of humans but these scenarios still don’t sound plausible to me in the real world.

LouisSayers 3y ago
AI arguments are basically: Step 1. AI Step 2. #stuff Step 3. Bang Maybe this is just what happens when you spend all your time on the internet...
patrec 3y ago
> Like, no one is wondering why this computer is placing a bunch of orders to DNA factories? I'm not that confident that if we put you in a box, tron-style, where you basically continued to enjoy your existing level of intelligence, but think 10'000x faster, have Petabytes of information at your fingertips and can clone yourself and losslessly and rapidly exchange knowledge with your clones and had a few days to think about it (~a few thousand years of thought at your normal speed) you couldn't figure out a way to effect a bunch of orders to DNA factories without anyone raising an alarm. Are you? Now what if we actually consider an actual AI after a few self-improvement steps. Any reasons to expect it wouldn't be 10'000x+ smarter than you as well, or roughly the difference in intelligence between you and an ant? Could you outsmart a bunch of ultra-ultra-slow-motion ants?
- patch_cable 3y ago
  Maybe that’s the difference in our views, but yes I am confident.
Vitorystar 3y ago
You could place a bunch of orders into services that syntetize DNA or proteins rn. Some people are even working on stuff like automating protein design whith AI. There's no reason why humans should notice anything word about a particular order on a service like that.

3 ms·

Reading the lesswrong link, the parts I get hung up on are that it appears in these doomsday scenarios humans lose all agency. Like, no one is wondering why thi

by patch_cable 3y ago

LouisSayers 3y ago
AI arguments are basically: Step 1. AI Step 2. #stuff Step 3. Bang Maybe this is just what happens when you spend all your time on the internet...
patrec 3y ago
> Like, no one is wondering why this computer is placing a bunch of orders to DNA factories? I'm not that confident that if we put you in a box, tron-style, where you basically continued to enjoy your existing level of intelligence, but think 10'000x faster, have Petabytes of information at your fingertips and can clone yourself and losslessly and rapidly exchange knowledge with your clones and had a few days to think about it (~a few thousand years of thought at your normal speed) you couldn't figure out a way to effect a bunch of orders to DNA factories without anyone raising an alarm. Are you? Now what if we actually consider an actual AI after a few self-improvement steps. Any reasons to expect it wouldn't be 10'000x+ smarter than you as well, or roughly the difference in intelligence between you and an ant? Could you outsmart a bunch of ultra-ultra-slow-motion ants?
- patch_cable 3y ago
  Maybe that’s the difference in our views, but yes I am confident.
Vitorystar 3y ago
You could place a bunch of orders into services that syntetize DNA or proteins rn. Some people are even working on stuff like automating protein design whith AI. There's no reason why humans should notice anything word about a particular order on a service like that.