4 ms·

Open source AI development is possibly the worst idea in history. Yes, let's just put a demon summoning circle in every household.

squarefoot 4y ago
That might be still a bit less evil than letting a single private company control it.
- flangola7 4y ago
  Part of the reason we're still here is because nukes are only controlled by a small number of powerful but mostly rational actors. If you give everyone nukes then Terrorist Timmy and Dumbass David will push the button 30 seconds after they get a hold of it. https://www.youtube.com/watch?v=gA1sNLL6yg4 https://www.youtube.com/watch?v=gA1sNLL6yg4
  - squarefoot 4y ago
    That's a valid point, but the assumption should be that Timmy and David can't afford today the tools and facilities to build nukes as much as they won't have enough power to do anything harmful with an AI. At least for a while, hopefully.
    - flangola7 4y ago
      "A while" might be 12 months given the pace we are at. LLaMA is already going to be rather dangerous once malignant interests interests fine tune it for social engineering, offensive security missions, and astroturfing, and general emotional manipulation. That by itself will be enough to reshape the internet and remote interaction as we know it.
      - squarefoot 4y ago
        I agree on principle, but we already know for sure it will be used as it is in advertising, politics, news reporting, and pretty much every field in which there is constant need of new tools of mass manipulation. It's probably too late.
JohnFen 4y ago
If demon-summoning circles are going to be a thing that exists, I'd much rather have them in every household than have them used exclusively by the rich and powerful. But more than that, I'd rather they not be used by either group.
- flangola7 4y ago
  > If demon-summoning circles are going to be a thing that exists, I'd much rather have them in every household than have them used exclusively by the rich and powerful. I generally agree with "democratization" of technology but this is one that should be available to as few people as possible (ideally 0). Treat it like a biological weapon or a nuclear stockpile, the area of effect will be so large that it doesn't really matter who uses it or who they point it at; everyone ends up suffering once it is activated. This is true under both limited tool-AI (under human command, but powerful and weaponized) and existential risk paperclip AI scenarios. A disappointing number of otherwise intelligent people are unwilling or incapable of seeing how this technology will be able to inflict mass human suffering and death.
  - selfhoster11 4y ago
    The time to stop that would have been the early 1940s. Once you invent computers, that's it.
  - Schroedingersat 4y ago
    Giving it exclusively to the most evil and cretinous money addicts is much worse than giving it to everyone.
    - flangola7 4y ago
      Why is it worse for AI and not for nukes?
      - JohnFen 4y ago
        I understand that we probably disagree about this, but I don't think AI poses risks that are even remotely in the ballpark of the risks of nukes. If my neighbor has a nuke, he can (accidentally or deliberately) take out everyone around him with ease. AI can't.
Nasrudith 4y ago
Wow somebody "AI safety/ethics" actually said the quiet part out loud! That they are so superstitious, ignorant, and cowardly that they equate language models with demons. What is up next, declaring reading and writing demonic?
- flangola7 4y ago
  It's literally a quote from Elon Musk right before he dumped in $100M to help OpenAI start. https://techcrunch.com/2014/10/26/elon-musk-compares-building-artificial-intelligence-to-summoning-the-demon/ https://techcrunch.com/2014/10/26/elon-musk-compares-buildin... Maybe avoid flying off the handle before you've done so much as a Google search?

squarefoot 4y ago

That might be still a bit less evil than letting a single private company control it.

flangola7 4y ago
Part of the reason we're still here is because nukes are only controlled by a small number of powerful but mostly rational actors. If you give everyone nukes then Terrorist Timmy and Dumbass David will push the button 30 seconds after they get a hold of it. https://www.youtube.com/watch?v=gA1sNLL6yg4 https://www.youtube.com/watch?v=gA1sNLL6yg4
- squarefoot 4y ago
  That's a valid point, but the assumption should be that Timmy and David can't afford today the tools and facilities to build nukes as much as they won't have enough power to do anything harmful with an AI. At least for a while, hopefully.
  - flangola7 4y ago
    "A while" might be 12 months given the pace we are at. LLaMA is already going to be rather dangerous once malignant interests interests fine tune it for social engineering, offensive security missions, and astroturfing, and general emotional manipulation. That by itself will be enough to reshape the internet and remote interaction as we know it.
    - squarefoot 4y ago
      I agree on principle, but we already know for sure it will be used as it is in advertising, politics, news reporting, and pretty much every field in which there is constant need of new tools of mass manipulation. It's probably too late.

JohnFen 4y ago

If demon-summoning circles are going to be a thing that exists, I'd much rather have them in every household than have them used exclusively by the rich and powerful. But more than that, I'd rather they not be used by either group.

flangola7 4y ago
> If demon-summoning circles are going to be a thing that exists, I'd much rather have them in every household than have them used exclusively by the rich and powerful. I generally agree with "democratization" of technology but this is one that should be available to as few people as possible (ideally 0). Treat it like a biological weapon or a nuclear stockpile, the area of effect will be so large that it doesn't really matter who uses it or who they point it at; everyone ends up suffering once it is activated. This is true under both limited tool-AI (under human command, but powerful and weaponized) and existential risk paperclip AI scenarios. A disappointing number of otherwise intelligent people are unwilling or incapable of seeing how this technology will be able to inflict mass human suffering and death.
- selfhoster11 4y ago
  The time to stop that would have been the early 1940s. Once you invent computers, that's it.
- Schroedingersat 4y ago
  Giving it exclusively to the most evil and cretinous money addicts is much worse than giving it to everyone.
  - flangola7 4y ago
    Why is it worse for AI and not for nukes?
    - JohnFen 4y ago
      I understand that we probably disagree about this, but I don't think AI poses risks that are even remotely in the ballpark of the risks of nukes. If my neighbor has a nuke, he can (accidentally or deliberately) take out everyone around him with ease. AI can't.

Nasrudith 4y ago

Wow somebody "AI safety/ethics" actually said the quiet part out loud! That they are so superstitious, ignorant, and cowardly that they equate language models with demons. What is up next, declaring reading and writing demonic?

flangola7 4y ago
It's literally a quote from Elon Musk right before he dumped in $100M to help OpenAI start. https://techcrunch.com/2014/10/26/elon-musk-compares-building-artificial-intelligence-to-summoning-the-demon/ https://techcrunch.com/2014/10/26/elon-musk-compares-buildin... Maybe avoid flying off the handle before you've done so much as a Google search?