4 ms·
Let’s ban this before it gets too powerful !
by thefounder 4mo ago
Let’s ban this before it gets too powerful !
- simulator5g 4mo agoI don't think it should be outright banned, automated intelligence is like a gun, hammer, knife, nuclear warhead, etc.
- tearwear 4mo agonot really, though. you don't see automated intelligence in the hands of junkies et al. ... and you don't see it coming, either ...
- simulator5g 4mo agoJunkies et al can log into chatgpt right now and use it to create a phishing email to steal drug money from your Grandma. Many people saw this coming.
- orphea 4mo agoAnd they don't need castrated Fable for that.
- pkal 4mo agoI see that intelligence itself is a tool, but that doesn't mean I want an automated gun, automated hammer, automated nuclear warhead, etc.
- xaxfixho 4mo ago[dead]
- thefounder 4mo agoOk I may agree with this. Instead to ban it we should nerf it to the point it’s useless.
- naveen99 4mo agoMaybe nerf should start selling ai models.
- Obscurity4340 4mo agoHow are they not already??
- UltraSane 4mo agoI don't really want the average LLM being able to tell anyone exactly how to syntheize lethal nerve agents.
- bouncycastle 4mo agoyou can already get that information by reading books in the library. The biggest barrier is not information, it's the ability to secure enough of the materials and equipment. For example, information for how to make a nuclear weapon is already there in the library. However, mining enough yellow cake and then purifying it is an industrial scale operation, out of reach unless you are a nation state, and have good mountain tunnels, etc. To a lesser extent, this is also true for producing chemical weapons. The theory is there, but actual production extremely out of reach. No LLM can help you there. (You can verify by reading up on Aum Shinrikyo to get an idea of the staggering scale required)
- defrost 4mo ago> mining enough yellow cake and then purifying it is an industrial scale operation, out of reach unless you are a nation state or a transnational (or even national scale) energy and or minerals company. Might be hard to slip past the shareholders, but dark projects have flown under the annual reports of several large players.
- bouncycastle 4mo agoHighly unlikely. Just the energy cost of running centrifuges, let alone manufacturing them is impossible to hide. It's staggering when you consider it. To put some more perspective, an LLM could show you how to make a Boeing 747 in detail, but the actual chance of someone making one with no tools and logistics would be 0. LLMs haven't changed the economic realities.
- defrost 4mo ago> Highly unlikely. Just the energy cost of running centrifuges, let alone manufacturing them is impossible to hide. And yet that has happened twice already. Eg: NUCLEAR ANXIETY: THE BLUNDERS; U.S. Blundered On Intelligence, Officials Admit https://www.nytimes.com/1998/05/13/world/nuclear-anxiety-the-blunders-us-blundered-on-intelligence-officials-admit.html https://www.nytimes.com/1998/05/13/world/nuclear-anxiety-the... There are numerous large companies with the resources and technical know how to match either Pakistan or India's efforts here, companies already experienced in yellowcake extraction and complex production processing equipment manufacture. > To put some more perspective, an LLM could show you how to make a Boeing 747 in detail, but the actual chance of someone making one with no tools and logistics would be 0. Pakistan, India, and many companies have resources, tools, logistics experience .. I have no idea how this sentence is meant to meaningfully refute those facts. > LLMs haven't changed the economic realities. I don't recall mentioning LLM's and I remind all that the bulk of nuclear weapons development happened before LLM's were a thing. FWiW there are better actual arguments why it is unlikely (but not impossible) for a non state actor to put together a nuclear weapon .. the comment above is not one.
- ed_mercer 4mo agoI wonder if every future announcement will be met with this criticism. Like, what's the point if they'll ban it in a few days.