3 ms·
I missed the AMA, but glad to see it here and it looks like there are some team members monitoring this thread so I'll throw some questions out there. I did my
by AndrewKemendo 11y ago
I missed the AMA, but glad to see it here and it looks like there are some team members monitoring this thread so I'll throw some questions out there.
I did my MS in AGI at the National Intelligence University with Ben Goertzel as my outside research advisor. My thesis was to determine what were defense implications of an AGI and who was making the best progress toward actually building one.
Since then the DoD has started to take an interest in AGI, and in fact today, during my one weekend a month drill at the Pentagon, I had a great long conversation with Maj. General Seng [1] who is heading up efforts around implementing ISR systems with more autonomous capabilities and exploring how an AGI would be utilized in defense.
One of our big open questions is what's the "stack" for AGI, conceptually? I didn't come to any conclusion on this and had to make a lot of assumptions to close out the research. I would be curious to hear the OpenAI team's thoughts on it.
Will you all be coming to AGI 16 this year in New York?
[1] http://www.af.mil/AboutUs/Biographies/Display/tabid/225/Article/108644/major-general-jocelyn-m-seng.aspx http://www.af.mil/AboutUs/Biographies/Display/tabid/225/Arti...
- eli_gottlieb 11y ago>Since then the DoD has started to take an interest in AGI, and in fact today, during my one weekend a month drill at the Pentagon, I had a great long conversation with Maj. General Seng [1] who is heading up efforts around implementing ISR systems with more autonomous capabilities and exploring how an AGI would be utilized in defense. Isn't that basically the most obviously bad idea ever, so terribly stupid that there have been several movies chronicling how massively bad an idea it actually is to build "AGI" for military goals?
- AndrewKemendo 11y agoI think you have been watching too many movies.
- TeMPOraL 11y agoMovies sometimes get this thing right though. Don't forget that Dr. Strangelove pretty much turned out to be a documentary!
- deleted 11y ago[deleted]
- eli_gottlieb 11y agoSo your answer is, "Sure, let's weaponize brains, nothing can possibly go wrong"?
- AndrewKemendo 11y agoWe already weaponize brains.
- sawwit 11y agoHowever, we mostly only arm brains that have an IQ of <120 and some human values baked in (e.g. empathy to other humans and living beings; a family to protect, or dependence on other social structures that demand pro-social attitudes).
- eli_gottlieb 11y agoWell no, mostly we don't, because the brains who happen to be the weapons still need a world to live in after they fight. The difference is that with artificial brains, hey, why would they give a crap what comes after the killing?
- TeMPOraL 11y agoThis idea is cliché precisely because it's the most obvious course of action for the military. Don't forget that it's DoD who sponsored the previous AI summer. Besides, if they don't do on it, the enemy surely will!
- deleted 11y ago[deleted]
- eli_gottlieb 11y agoBecause arms races and cold wars with we-all-die-grade weaponry are an obviously excellent idea! /s
- JoshTriplett 11y agoIf you still have a military (or the need for one) after you build an AGI, you built it horribly, horribly wrong.
- argonaut 11y agoI would like to point out that AGI is incredibly abstract and entirely theoretical right now (and philosophical, depending on the researcher, e.g. Bostrom). Deep learning is very engineering driven and very much focused on working systems that produce real world results. Even though there is some work being done on theory, it is very shaky. As such, as far as deep learning is concerned there is no stack for AGI yet, because a lofty goal that is so far away from what is currently possible.
- AndrewKemendo 11y agoI was hoping that someone out there knew something I didn't on this, because that was the conclusion I came to in my research, that nobody even has a conceptual stack. That said, I think OpenCOG has the closest to something of a larger conceptual stack in mind based on the atom-space approach. I think the folks over at Deep Mind might have some thoughts, and perhaps the numenta people as well.
- tim333 11y agoI only take a hobby interest in this stuff but one approach is the one DeepMind has taken to learning video games described a bit here: http://webcache.googleusercontent.com/search?q=cache:http://googleresearch.blogspot.com/2015/02/from-pixels-to-actions-human-level.html http://webcache.googleusercontent.com/search?q=cache:http://... Their system is I think an AGI as in artificial general intelligence system though not at human levels yet (apart from playing Breakout and Space Invaders). Here's Demis Hassabis talking about it https://www.youtube.com/watch?v=0X-NdPtFKq0&feature=youtu.be&t=11m26s https://www.youtube.com/watch?v=0X-NdPtFKq0&feature=youtu.be... Stack is their Torch machine learning library partly https://en.wikipedia.org/wiki/Torch_(machine_learning) https://en.wikipedia.org/wiki/Torch_(machine_learning)
- rl3 11y agoI know you don't particularly subscribe to the "AGI is extremely dangerous" line of thinking, but let's say for the sake of argument we're a decade in the future and it's starting to become very evident that it in fact is dangerous—like in a recursively self-improving nightmare type way—and it could be realized via a few thousand AWS instances with the application of some very specialized knowledge. What do you imagine the U.S. Government's reaction might be?
- fsam 11y agoI know that this is completely off topic, but for the sake of argument, let's imagine that we are thirty years into the future, we have invented efficient teleportation and have colonized mars. What do you think the government should do to encourage family ties to remain strong when loved ones are living on another planet?
- rl3 11y agoWhile I appreciate you mocking me, I can't help but disagree with the implication that my post was completely off-topic. AndrewKemendo has conducted research into AGI on behalf of the military. My hypothetical was intended as a near-term scenario in which the technology proved far more dangerous than originally thought. Asking him how he thinks USG would react to such a scenario doesn't strike me as unreasonable given his background.
- fsam 11y agoDid you really expect to get a response other than "It's basically impossible to have a plan of response for something that nobody even knows how to build"? I'm just tired of hearing unproductive questions like this to which any response other than "we don't know" is literally science fiction. Andrew's response would have applied equally to teleportation. Why don't we talk instead about how methods such as deep learning actually do work, and what problems that have been successfully applied to?
- AndrewKemendo 11y ago