4 ms·

Pandora's box has already been opened. There is no way any government could prevent what is coming.

ChatGTP 3y ago
Let’s make this more constructive, why is there nothing that can’t be done ? If we really as a civilisation wanted to avoid catastrophe do you really think at this stage we couldn’t pull back ? We’re on hacker news, you need to be creative and be a hacker, but just a person who likes the Internet. If people start using ChatGPT-5 to hack critical infrastructure and take down power grids, do we just give up and die ? Or adapt ? I’m going to float a pretty controversial idea…the technology we have today is an experiment, the digital world. Humans can survive without it. Already it’s causing problems such as the spread of misinformation, addiction and social division. There is nothing to say that we can’t unwind a lot of it endangers our futures. Technology is supposed to be a tool to help us out, it’s not supposed to endanger our lives. Clearly it’s out of control and causing a lot of anxiety, we’re moving quicker than we can adapt and that’s also not good for technological progress either, so we’re on the wrong path. Edit: Have a read of this: https://www.reddit.com/r/singularity/comments/12by8mj/i_used_autogpt_and_babyagi_today_we_are_not_ready/ https://www.reddit.com/r/singularity/comments/12by8mj/i_used... , if we don’t tear ourselves apart, there’s a good chance the backbone of the Internet will be torn apart long before much else happens.
- BoorishBears 3y ago
  "If people start using ChatGPT-5 to hack critical infrastructure and take down power grids, do we just give up and die ? Or adapt ?" Why do I keep hearing stuff like this? First off, if ChatGPT-5 comes out and makes hacking critical infrastructure and taking down power grids easy, what makes you think its ability to counter that by hardening systems won't go up too? And second, what makes you think that ease is the main thing stopping people from committing terrorism? We know that you can cause widespread and long lasting damage by firing at a fragile metal boxes that take months to replace and affects the ability to power entire regions. There's something to be said about not needing to be physically there... but fear of getting caught is not really what keeps people from being terrorists. The fact is for all the unfounded pessimism the 24 hour news cycle has birthed, people just generally don't want to take down power grids, even for fun, or even if it's easy, our just out of curiosity. - There are reasonable angles if you want to argue for responsible AI, "it's going to turn people into terrorists" is not one of them.
  - ChatGTP 3y ago
    Yes but for the people who do want to be terrorists, you now have a much much more powerful weapon in order to inflict damage with no ? How many autogpt scripts have you seen that upgrade the security of critical infrastructure ?
    - BoorishBears 3y ago
      How many autogpt scripts can trivialize taking down the power grid? At that point why are you imagining we have something like the current power grid? We'd have a tool that's drive massive advancements that trivialize decentralized power generation, reduce scarcity, find cures for mental illness, improve equality. People need to really expand their understanding of how this will disrupt human existence if it can actually reach that point. It's like imagining what would happen if you gave the roman nuclear warheads instead of what would happen if you gave them all of modern technology
      - 13years 3y ago
        > How many autogpt scripts can trivialize taking down the power grid? Why does it need to be autogpt? It can rather create sophisticated plans for humans to exploit. Early nefarious use is more likely to go this route. > We'd have a tool that's drive massive advancements that trivialize decentralized power generation, reduce scarcity, find cures for mental illness, improve equality. Intellectual knowledge and cyber capabilities will vastly outstrip physical manufacturing. These threats will likely appear long before this transformation occurs.
        BoorishBears 3y ago
        >Why does it need to be autogpt? It can rather create sophisticated plans for humans to exploit. Early nefarious use is more likely to go this route. That'd be infinitely harder for an LLM: Problems where the context window can grow based on feedback of its actions (like automated attacks) are the ones that will be solved much much earlier. The teams defending against attacks will be able to trivially apply LLMs in an automated fashion to finding mitigations, if you're already admitting it's going to be LLMs writing plans that then need humans to implement them, you're countering your own point... > Intellectual knowledge and cyber capabilities will vastly outstrip physical manufacturing. These threats will likely appear long before this transformation occurs. Right, so you're imagining the intellectual knowledge and cyber capabilities to trivially commit terrorism, but scarcity and equality are untouched because of manufacturing. Sci-fi has really done a number on some people.

Let’s make this more constructive, why is there nothing that can’t be done ? If we really as a civilisation wanted to avoid catastrophe do you really think at this stage we couldn’t pull back ? We’re on hacker news, you need to be creative and be a hacker, but just a person who likes the Internet. If people start using ChatGPT-5 to hack critical infrastructure and take down power grids, do we just give up and die ? Or adapt ? I’m going to float a pretty controversial idea…the technology we have today is an experiment, the digital world. Humans can survive without it. Already it’s causing problems such as the spread of misinformation, addiction and social division. There is nothing to say that we can’t unwind a lot of it endangers our futures. Technology is supposed to be a tool to help us out, it’s not supposed to endanger our lives. Clearly it’s out of control and causing a lot of anxiety, we’re moving quicker than we can adapt and that’s also not good for technological progress either, so we’re on the wrong path. Edit: Have a read of this: https://www.reddit.com/r/singularity/comments/12by8mj/i_used_autogpt_and_babyagi_today_we_are_not_ready/ https://www.reddit.com/r/singularity/comments/12by8mj/i_used... , if we don’t tear ourselves apart, there’s a good chance the backbone of the Internet will be torn apart long before much else happens.

BoorishBears 3y ago
"If people start using ChatGPT-5 to hack critical infrastructure and take down power grids, do we just give up and die ? Or adapt ?" Why do I keep hearing stuff like this? First off, if ChatGPT-5 comes out and makes hacking critical infrastructure and taking down power grids easy, what makes you think its ability to counter that by hardening systems won't go up too? And second, what makes you think that ease is the main thing stopping people from committing terrorism? We know that you can cause widespread and long lasting damage by firing at a fragile metal boxes that take months to replace and affects the ability to power entire regions. There's something to be said about not needing to be physically there... but fear of getting caught is not really what keeps people from being terrorists. The fact is for all the unfounded pessimism the 24 hour news cycle has birthed, people just generally don't want to take down power grids, even for fun, or even if it's easy, our just out of curiosity. - There are reasonable angles if you want to argue for responsible AI, "it's going to turn people into terrorists" is not one of them.
- ChatGTP 3y ago
  Yes but for the people who do want to be terrorists, you now have a much much more powerful weapon in order to inflict damage with no ? How many autogpt scripts have you seen that upgrade the security of critical infrastructure ?
  - BoorishBears 3y ago
    How many autogpt scripts can trivialize taking down the power grid? At that point why are you imagining we have something like the current power grid? We'd have a tool that's drive massive advancements that trivialize decentralized power generation, reduce scarcity, find cures for mental illness, improve equality. People need to really expand their understanding of how this will disrupt human existence if it can actually reach that point. It's like imagining what would happen if you gave the roman nuclear warheads instead of what would happen if you gave them all of modern technology
    - 13years 3y ago
      > How many autogpt scripts can trivialize taking down the power grid? Why does it need to be autogpt? It can rather create sophisticated plans for humans to exploit. Early nefarious use is more likely to go this route. > We'd have a tool that's drive massive advancements that trivialize decentralized power generation, reduce scarcity, find cures for mental illness, improve equality. Intellectual knowledge and cyber capabilities will vastly outstrip physical manufacturing. These threats will likely appear long before this transformation occurs.
      - BoorishBears 3y ago
        >Why does it need to be autogpt? It can rather create sophisticated plans for humans to exploit. Early nefarious use is more likely to go this route. That'd be infinitely harder for an LLM: Problems where the context window can grow based on feedback of its actions (like automated attacks) are the ones that will be solved much much earlier. The teams defending against attacks will be able to trivially apply LLMs in an automated fashion to finding mitigations, if you're already admitting it's going to be LLMs writing plans that then need humans to implement them, you're countering your own point... > Intellectual knowledge and cyber capabilities will vastly outstrip physical manufacturing. These threats will likely appear long before this transformation occurs. Right, so you're imagining the intellectual knowledge and cyber capabilities to trivially commit terrorism, but scarcity and equality are untouched because of manufacturing. Sci-fi has really done a number on some people.