3 ms·

Want to stop AI from destroying the world? Make it Open Source

3 points by foxtrot8672 17d ago

Make Claude and Chat GPT open source. Give everyone the ability to build advanced AI systems. Don't take all the guns, give them all away, so no one has a monopoly on power.

JohnFen 17d ago
How would that mitigate risk?
- foxtrot8672 17d ago
  it wouldn't, but it would distribute it equally.
  - JohnFen 17d ago
    And that would stop AI from destroying the world?
- verdverm 17d ago
  Because the overall upside is greater than the doomerism, transparency is one of the best disinfectants humans know of. Encryption used to be considered too dangerous, yet here we all are, safer on the internet because of free and open encryption. What if instead of seeing the agents as more helpful to the red team, we see them as more helpful to the blue team? In other words, we'll be able to fix security issues without having to be granted access to some model controlled by a few ultra wealthy people. The guardrails they have to stop hacking also stops people working to improve their code security, and also when they get hacked, re: HF incident and needing to turn to Chinese Ai after American Ai refused to help. Actually open Ai is here, it's on the internet, GLM 5.3 has been shown to be nearly as capable as Mythos when given a better harness. I find it highly unlikely the US will be able to convince China to stop making their models open and available to everyone. A, that's not their ethos, B the US has been and is increasingly hostile towards them in the Ai space. I for one look forward to a world where China leads the US in Ai. I think it is a shock we need to break out of the funk we are in. I also think they are being both more responsible and building towards a future where not just a few elite control one of the most significant technologies humans have engineered.
  - JohnFen 17d ago
    That's all well and good, but doesn't answer the question. If you think genAI is going to destroy the world (I don't, by the way), then how does making it open source stop that? I truly don't understand. It's like saying "we can neutralize this doomsday device by making it easy for everyone to build one of their own." If you really think genAI is a mortal threat, then putting it in the hands of everybody only increases the danger. There are many problems that genAI being open source would address. It just seems to me this isn't one of them.
    - verdverm 16d ago
      I don't buy into the mortal threat doomerism, but it is still better if anyone can inspect models for this trait than a few select chosen. (eg. cyber security today)

3 points by foxtrot8672 17d ago

Make Claude and Chat GPT open source. Give everyone the ability to build advanced AI systems. Don't take all the guns, give them all away, so no one has a monopoly on power.

JohnFen 17d ago

How would that mitigate risk?

foxtrot8672 17d ago
it wouldn't, but it would distribute it equally.
- JohnFen 17d ago
  And that would stop AI from destroying the world?
verdverm 17d ago
Because the overall upside is greater than the doomerism, transparency is one of the best disinfectants humans know of. Encryption used to be considered too dangerous, yet here we all are, safer on the internet because of free and open encryption. What if instead of seeing the agents as more helpful to the red team, we see them as more helpful to the blue team? In other words, we'll be able to fix security issues without having to be granted access to some model controlled by a few ultra wealthy people. The guardrails they have to stop hacking also stops people working to improve their code security, and also when they get hacked, re: HF incident and needing to turn to Chinese Ai after American Ai refused to help. Actually open Ai is here, it's on the internet, GLM 5.3 has been shown to be nearly as capable as Mythos when given a better harness. I find it highly unlikely the US will be able to convince China to stop making their models open and available to everyone. A, that's not their ethos, B the US has been and is increasingly hostile towards them in the Ai space. I for one look forward to a world where China leads the US in Ai. I think it is a shock we need to break out of the funk we are in. I also think they are being both more responsible and building towards a future where not just a few elite control one of the most significant technologies humans have engineered.
- JohnFen 17d ago
  That's all well and good, but doesn't answer the question. If you think genAI is going to destroy the world (I don't, by the way), then how does making it open source stop that? I truly don't understand. It's like saying "we can neutralize this doomsday device by making it easy for everyone to build one of their own." If you really think genAI is a mortal threat, then putting it in the hands of everybody only increases the danger. There are many problems that genAI being open source would address. It just seems to me this isn't one of them.
  - verdverm 16d ago
    I don't buy into the mortal threat doomerism, but it is still better if anyone can inspect models for this trait than a few select chosen. (eg. cyber security today)