4 ms·

The point is, it greatly reduces the amount of resources needed to do some serious damage, as well as the level of sophistication needed. You don't need AGI to

The point is, it greatly reduces the amount of resources needed to do some serious damage, as well as the level of sophistication needed. You don't need AGI to do damage, current LLMs are already dangerous. IMO, an open-source affordable unfiltered GPT-5 would ruin the internet in a few months.

shawn-butler 3y ago
Provide a specific example of what you have in mind to further the conversation not just more opining on “dangerous” is my suggestion.
- FrenchDevRemote 3y ago
  Tailored propaganda, scams, spams, and harassment at a scale that was never seen before. Plugging metasploit into an unfiltered GPT-5 with a shell and a few proxies could be devastating. Undetectable and unstoppable bots would be available to anyone. Don't like someone? You could spend a hundred bucks to ruin their life anonymously. Each of us could unknowingly interact with multiple LLMs everyday which would only have one purpose: manipulate us with a never-seen before success rate at a lower cost than ever. At some point AI generated content could become more common than human content, while still being indistinguishable. Good enough automated online propaganda could routinely start (civil)wars or genocides, Facebook already let that happen in the past, manipulating elections would become systematical even in the most democratic countries. What already happened in those areas in the last few years, is really nothing compared to what could happen without enough regulation or barriers to entry in the next few years. What's worse is that all of this, would not just be possible, but available to every sociopath on earth, not just the rich ones.
  - pk-protect-ai 3y ago
    >> Tailored propaganda, scams, spams, and harassment at a scale that was never seen before. I believe the state of these subjects right now is already alarming without AGI. You can't exacerbate the horror about the level of tailored propaganda and scams, etc., which you can't even foresee yourself. It isn't quantifiable. >>Each of us could unknowingly interact with multiple LLMs everyday which would only have one purpose: manipulate us with a never-seen before success rate at a lower cost than ever. You would build resistance pretty quickly. >> At some point AI generated content could become more common than human content, while still being indistinguishable. Oh, there were some numbers on that one. The number of images generated with AI is already several magnitudes larger than the number of photos humanity has produced since the invention of photography. No AGI is required either. >> Good enough automated online propaganda could routinely start (civil)wars or genocides, It already does, without AGI. The Black Rock guys say it's good, - war is good for business. You can squeeze the markets, make money on foreseeable deficits. >> What's worse is that all of this, would not just be possible, but available to every sociopath on earth, not just the rich ones. But guns available to every sociopath on earth too... All of your arguments concern how those with malicious intent can harm us further. I would argue that Sam Altman as the sole controller of AGI is a rather unsettling prospect. If only one country possessed a nuclear weapon, that country would certainly use it against its adversaries. Oh wait, that's already a part of history...
    - warkdarrior 3y ago
      > >>Each of us could unknowingly interact with multiple LLMs everyday which would only have one purpose: manipulate us with a never-seen before success rate at a lower cost than ever. > You would build resistance pretty quickly. That is adorably naive. The current thrust in LLM training is towards improving their outputs to become indistinguishable from humans, for any topic, point of view, writing style, etc.
      - pk-protect-ai 3y ago
        But that has already happened. There is no way to distinguish between human and machine-written text.
IKantRead 3y ago
> ruin the internet in a few months. I'm sure the internet will be fine, and the web has already been essentially destroyed as the drive for extracting revenue from every human interaction has rendered it just an amusing advertisement for the most part. Most of the content of the web today is already generated by "bots" even if those "bots" happen to be human beings.
- lawlessone 3y ago
  Youtube is rife with AI(edit: this is not necessarily AI) voiced videos of copy pasted wikipedia articles. I find i am blocking new ones everyday. LLM's didn't do that.
pk-protect-ai 3y ago
A squad of marines at Nigerian telecom (or any other country telecom) with access to change BGP routing, will make equivalent harm in under 24h and may enforce month of harms with the changes.
- FrenchDevRemote 3y ago
  If any middle schooler had the same destructive power as a squad of marines embedded clandestinely in a foreign country the world would be in shambles.
Brian_K_White 3y ago
gpt5 6 11 90 will exist regardless. The option where they don't exist doesn't exist, and so it is utterly pointless to spend one second fretting about how you don't like that or why one should not like that. A nova could go off 50 light years from here, and that would kill every cell on the planet. That is even worse than child porn. And there is nothing anyone can do about that except work towards the eventual day we aren't limited to this planet, rather than against that day. It's the same with any tech that empowers. It WILL empower the bad as well as the good equally, and it WILL exist. So being scared of it's mere existense, or it's being in the hands of people you don't approve of, is pointless. Both of those things can not be avoided. Might as well be scared of that nova. There isn't even a choice about who gets to use it. It will be available one way or another to both good and bad actors for any purpose they want. The only choices available to make, are who gets a few different kinds of advantage, who gets their thumb on the scale, who gets official blessing, who gets to operate in secrecy without oversight or auditing or public approval. When you try to pretend that something uncontrollable is controlled, all it does is put the general populations guard down and make them blind and open to be manipulated, and gives the bad actors the cover of secrecy. The government can use it on it's own citizens without them objecting, and other bad guys aren't affected at all, but honest people are inhibited from countering any of these bad users. Which is a shame because honest or at least reasonably so outnumber the really bad. The only long term way to oppose the bad is to empower everyone equally as much as possible, so that the empowered good outnumber the empowered bad.

shawn-butler 3y ago

Provide a specific example of what you have in mind to further the conversation not just more opining on “dangerous” is my suggestion.

FrenchDevRemote 3y ago
Tailored propaganda, scams, spams, and harassment at a scale that was never seen before. Plugging metasploit into an unfiltered GPT-5 with a shell and a few proxies could be devastating. Undetectable and unstoppable bots would be available to anyone. Don't like someone? You could spend a hundred bucks to ruin their life anonymously. Each of us could unknowingly interact with multiple LLMs everyday which would only have one purpose: manipulate us with a never-seen before success rate at a lower cost than ever. At some point AI generated content could become more common than human content, while still being indistinguishable. Good enough automated online propaganda could routinely start (civil)wars or genocides, Facebook already let that happen in the past, manipulating elections would become systematical even in the most democratic countries. What already happened in those areas in the last few years, is really nothing compared to what could happen without enough regulation or barriers to entry in the next few years. What's worse is that all of this, would not just be possible, but available to every sociopath on earth, not just the rich ones.
- pk-protect-ai 3y ago
  >> Tailored propaganda, scams, spams, and harassment at a scale that was never seen before. I believe the state of these subjects right now is already alarming without AGI. You can't exacerbate the horror about the level of tailored propaganda and scams, etc., which you can't even foresee yourself. It isn't quantifiable. >>Each of us could unknowingly interact with multiple LLMs everyday which would only have one purpose: manipulate us with a never-seen before success rate at a lower cost than ever. You would build resistance pretty quickly. >> At some point AI generated content could become more common than human content, while still being indistinguishable. Oh, there were some numbers on that one. The number of images generated with AI is already several magnitudes larger than the number of photos humanity has produced since the invention of photography. No AGI is required either. >> Good enough automated online propaganda could routinely start (civil)wars or genocides, It already does, without AGI. The Black Rock guys say it's good, - war is good for business. You can squeeze the markets, make money on foreseeable deficits. >> What's worse is that all of this, would not just be possible, but available to every sociopath on earth, not just the rich ones. But guns available to every sociopath on earth too... All of your arguments concern how those with malicious intent can harm us further. I would argue that Sam Altman as the sole controller of AGI is a rather unsettling prospect. If only one country possessed a nuclear weapon, that country would certainly use it against its adversaries. Oh wait, that's already a part of history...
  - warkdarrior 3y ago
    > >>Each of us could unknowingly interact with multiple LLMs everyday which would only have one purpose: manipulate us with a never-seen before success rate at a lower cost than ever. > You would build resistance pretty quickly. That is adorably naive. The current thrust in LLM training is towards improving their outputs to become indistinguishable from humans, for any topic, point of view, writing style, etc.
    - pk-protect-ai 3y ago
      But that has already happened. There is no way to distinguish between human and machine-written text.

IKantRead 3y ago

> ruin the internet in a few months. I'm sure the internet will be fine, and the web has already been essentially destroyed as the drive for extracting revenue from every human interaction has rendered it just an amusing advertisement for the most part. Most of the content of the web today is already generated by "bots" even if those "bots" happen to be human beings.

lawlessone 3y ago
Youtube is rife with AI(edit: this is not necessarily AI) voiced videos of copy pasted wikipedia articles. I find i am blocking new ones everyday. LLM's didn't do that.

pk-protect-ai 3y ago

A squad of marines at Nigerian telecom (or any other country telecom) with access to change BGP routing, will make equivalent harm in under 24h and may enforce month of harms with the changes.

FrenchDevRemote 3y ago
If any middle schooler had the same destructive power as a squad of marines embedded clandestinely in a foreign country the world would be in shambles.

Brian_K_White 3y ago

gpt5 6 11 90 will exist regardless. The option where they don't exist doesn't exist, and so it is utterly pointless to spend one second fretting about how you don't like that or why one should not like that. A nova could go off 50 light years from here, and that would kill every cell on the planet. That is even worse than child porn. And there is nothing anyone can do about that except work towards the eventual day we aren't limited to this planet, rather than against that day. It's the same with any tech that empowers. It WILL empower the bad as well as the good equally, and it WILL exist. So being scared of it's mere existense, or it's being in the hands of people you don't approve of, is pointless. Both of those things can not be avoided. Might as well be scared of that nova. There isn't even a choice about who gets to use it. It will be available one way or another to both good and bad actors for any purpose they want. The only choices available to make, are who gets a few different kinds of advantage, who gets their thumb on the scale, who gets official blessing, who gets to operate in secrecy without oversight or auditing or public approval. When you try to pretend that something uncontrollable is controlled, all it does is put the general populations guard down and make them blind and open to be manipulated, and gives the bad actors the cover of secrecy. The government can use it on it's own citizens without them objecting, and other bad guys aren't affected at all, but honest people are inhibited from countering any of these bad users. Which is a shame because honest or at least reasonably so outnumber the really bad. The only long term way to oppose the bad is to empower everyone equally as much as possible, so that the empowered good outnumber the empowered bad.