4 ms·

>Since then the DoD has started to take an interest in AGI, and in fact today, during my one weekend a month drill at the Pentagon, I had a great long conversat

>Since then the DoD has started to take an interest in AGI, and in fact today, during my one weekend a month drill at the Pentagon, I had a great long conversation with Maj. General Seng [1] who is heading up efforts around implementing ISR systems with more autonomous capabilities and exploring how an AGI would be utilized in defense. Isn't that basically the most obviously bad idea ever, so terribly stupid that there have been several movies chronicling how massively bad an idea it actually is to build "AGI" for military goals?

AndrewKemendo 11y ago
I think you have been watching too many movies.
- TeMPOraL 11y ago
  Movies sometimes get this thing right though. Don't forget that Dr. Strangelove pretty much turned out to be a documentary!
  - deleted 11y ago
    [deleted]
- eli_gottlieb 11y ago
  So your answer is, "Sure, let's weaponize brains, nothing can possibly go wrong"?
  - AndrewKemendo 11y ago
    We already weaponize brains.
    - sawwit 11y ago
      However, we mostly only arm brains that have an IQ of <120 and some human values baked in (e.g. empathy to other humans and living beings; a family to protect, or dependence on other social structures that demand pro-social attitudes).
    - eli_gottlieb 11y ago
      Well no, mostly we don't, because the brains who happen to be the weapons still need a world to live in after they fight. The difference is that with artificial brains, hey, why would they give a crap what comes after the killing?
TeMPOraL 11y ago
This idea is cliché precisely because it's the most obvious course of action for the military. Don't forget that it's DoD who sponsored the previous AI summer. Besides, if they don't do on it, the enemy surely will!
- deleted 11y ago
  [deleted]
- eli_gottlieb 11y ago
  Because arms races and cold wars with we-all-die-grade weaponry are an obviously excellent idea! /s
JoshTriplett 11y ago
If you still have a military (or the need for one) after you build an AGI, you built it horribly, horribly wrong.

AndrewKemendo 11y ago

I think you have been watching too many movies.

TeMPOraL 11y ago
Movies sometimes get this thing right though. Don't forget that Dr. Strangelove pretty much turned out to be a documentary!
- deleted 11y ago
  [deleted]
eli_gottlieb 11y ago
So your answer is, "Sure, let's weaponize brains, nothing can possibly go wrong"?
- AndrewKemendo 11y ago
  We already weaponize brains.
  - sawwit 11y ago
    However, we mostly only arm brains that have an IQ of <120 and some human values baked in (e.g. empathy to other humans and living beings; a family to protect, or dependence on other social structures that demand pro-social attitudes).
  - eli_gottlieb 11y ago
    Well no, mostly we don't, because the brains who happen to be the weapons still need a world to live in after they fight. The difference is that with artificial brains, hey, why would they give a crap what comes after the killing?

TeMPOraL 11y ago

This idea is cliché precisely because it's the most obvious course of action for the military. Don't forget that it's DoD who sponsored the previous AI summer. Besides, if they don't do on it, the enemy surely will!

deleted 11y ago
[deleted]
eli_gottlieb 11y ago
Because arms races and cold wars with we-all-die-grade weaponry are an obviously excellent idea! /s

JoshTriplett 11y ago

If you still have a military (or the need for one) after you build an AGI, you built it horribly, horribly wrong.