6 ms·
>> What is the responsible disclosure process for ideas and research around AI? Basically, we're so far away from AGI that there's no need to worry about discl
by YeGoblynQueenne 9y ago
>> What is the responsible disclosure process for ideas and research around AI?
Basically, we're so far away from AGI that there's no need to worry about disclosig anything. The recent advances in machine vision and speech processing are impressive, but only in the context of the last 50 years or so. A trully intelligent agent will need much more than this and there doesn't seem to be anyone alive today who knows how to go from where we are to where AGI will be.
In other words, all this is really premature. If we're talking about responsible and regulated use of what you call "dumb AI/automation" on the other hand, then that's a differen tissue. But AGI, currently, is science fiction. You may as well regulate research in time travel, or teleportation.
- 3pt14159 9y agoThe maluse of AI is a continuum that ends with AGI. If we don't have a process for handling responsible disclosure of dumb AI that could kill millions then why should we expect that a process will be available once AGI is within a reasonable time horizon. If I have other shit in my head that I'm worried about today who do I tell?
- YeGoblynQueenne 9y agoThere are no realistic prospects of building AGI with modern understanding and equipment. We'll probably need many generations and a paradigm shift (or two) in computer science before we can build machines that can run intelligence like a program, let alone being able to write that program. Hence my comment about how you might as well worry about time travel and teleportation. They're just as likely to happen in any timeframe that you might be interested in. If you're going to be worried about how AGI might be misused, you can start worrying about how time machines or teleporters might be misused. >> If I have other shit in my head that I'm worried about today who do I tell? You could look at joining the Campaing Against Killer Robots, or look around for a similar group.
- throwaway84742 9y agoI think the current maluse of AI is about as likely to produce AGI as finger painting of a toddler is to produce a Mona Lisa, and the whole AGI drama is overblown way out of proportion. Right now the state of the field is such that no one can even begin to contemplate how to create the very basic underpinnings of anything remotely resembling AGI. That’s how fundamental this problem still is. That’s not to say that there’s no way the humanity can be fucked with the more pedestrian “garden variety” AI that is with our technical capabilities. It’s to say that AGI is a nebulous, unobtainable red herring which only serves to detract from the more immediate issues.
- erikpukinskis 9y ago> I think the current maluse of AI is about as likely to produce AGI as finger painting of a toddler is to produce a Mona Lisa YES FELLOW HUMAN AN APT METAPHOR
- tim333 9y agoAlphaZero is existing general AI that learns boardgames on its own and reaches superhuman levels in less than a day. It seems to me quite plausible something like that could be generalised to understanding the physical world rather than that of chess or go. Admittedly we can't do that today but am not sure it's far off. Musk gives it five years in the recent movie https://www.youtube.com/watch?v=rqlwUAxoxa8&feature=youtu.be&t=46m58s https://www.youtube.com/watch?v=rqlwUAxoxa8&feature=youtu.be...
- YeGoblynQueenne 9y agoAlphaZero is not general AI. It can play Go (and chess and shogi) but that's very literally all it can do- it can't process speech or recognise objects in images, or any other task you might choose to test it against. It is extremely powerful, but also extremely limited, in the same way that computers have been for a very long time. For instance, computers are decidedly better than humans at arithmetic. Yet nobody (today) thinks that just because computers can do arithmetic very quickly and accurately, they are more intelligent than humans. Is there anything special in Go or chess that makes a specific skill at them a necessary and suficient condition for general intelligence? We are impressed at the performance of AlphaZero because humans find it very hard to play Go etc well. On the other hand, we also find it extremely hard to, e.g. divide two arbitrary 100-digit numbers -but we are not impressed by a pocket calculator as much as we are by AlphaZero. Might there be an element of psychological bias in our ability to be impressed, then?
- tim333 9y agoGo and chess are different in that they are designed as a competition for human thinking in a similar way that say marathons are designed to show off human running. Dividing 100 digit numbers less so. Also there was something human like in the way alphazero learns unlike say stockfish which is more calculator like.
- YeGoblynQueenne 9y agoThere are competitions where people try to do arithmetic with very large numbers [1], or memorise very long sequences. The point is not what is an actual competition, which is a matter of tradition or culture; but what is easy and hard for a human to do, which is not (entirely) culturally determined. I guess you could say that the difference between human and computer intelligence is that humans don't have total recall, while computers do. This allows computers to add large numbers without trouble or play millions of entire games at random and choose the best, etc. On the other hand, there's always a chance that humans' incomplete recall is a hallmark of general intelligence. >> Also there was something human like in the way alphazero learns unlike say stockfish which is more calculator like. That's a matter of interpretation. AlphaZero plays by searching a huge space of possible moves- humans dont' play like that. It learns by playing itself millions of times. Again, humans don't learn like that. There's nothing human about AlphaZero, nor Stockfish far as I can tell. ____________________ [1] https://en.wikipedia.org/wiki/Mental_Calculation_World_Cup https://en.wikipedia.org/wiki/Mental_Calculation_World_Cup
- edanm 9y agoWhen would be a good time to start worrying? What external indicator will we get that we need to worry? And what makes you sure that, whenever that external indicator happens, we'll have enough time to stop problems from happening? If you're not familiar with it, I'm making the argument from here and it makes good further reading: https://intelligence.org/2017/10/13/fire-alarm/ https://intelligence.org/2017/10/13/fire-alarm/
- YeGoblynQueenne 9y agoWhen would be a good time to start worrying? Let's say two hundred years from now, give or take a few decades. I imagine that by that time we might have made some progress on the subject of intelligence, what it is and how to reproduce it. At that point, it might be prudent to worry about an AI getting out of control. We have no way of knowing what external indicators we might get. We have no idea what AGI would look like. That is often offered up as the very reason to "act now!" by Singularitarians, but if there is a threat that you don't know anything about, there is also nothing you can do about it. Unless you know what you're trying to stop, your actions are as good as random. In this sort of discussion, you can replace "AGI" with "alien invasion". The threat from a Superintelligence is as serious and as predictable as that from an alien civilisation. We can prepare against AGI as much as we can prepare against an alien invasion. And we have exactly as much to fear from a hostile AGI as we have from a hostile alien species.
- edanm 9y agoOk, so what makes you say 200 years? And more importantly, what would make you change your mind about that number (in either direction)? > [...] if there is a threat that you don't know anything about, there is also nothing you can do about it. I disagree with this, at least somewhat. For one thing, even without knowing the specific threat, there's lots of stuff you can do which is just generally helpful - e.g., try to spread to other planets. Will it necessarily help? No. But there are a lot of threats it will protect against. More importantly, people actually working on the problem of AI safety say they are doing things that appear, at least to them, to be useful. What makes you so sure they're wrong? From the little I know of their research, it certainly seems like stuff that will likely be pretty helpful. Last point - considering just how big a problem AGI could be if they're right, just how many resources would you want to devote to it? Literally zero?
- nl 9y agoI agree 100% with your comments about AGI. The discussion is completely pointless - we can't even agree on a definition for intelligence. AI (as in "machine learning") on the other hand is something which should be worried about. Universities are actively building autonomous, ML powered weapons systems. Just last week a pretty serious boycott of a South Korean university was announced over their autonomous weapons research. Signatories of the boycott include some of world’s leading AI researchers, most notably professors Geoffrey Hinton, Yoshua Bengio, and Jürgen Schmidhuber. The boycott would forbid all contact and academic collaboration with KAIST until the university makes assurances that the weaponry it develops will have “meaningful human control.[1] That's a real problem, and it is unclear if OpenAI's approach is relevant. Personally I think the academic boycott is a good start (what ML researcher will want to work there?), but it is unclear how to deal with commercial research labs in a similar space. [1] https://www.theverge.com/2018/4/4/17196818/ai-boycot-killer-robots-kaist-university-hanwha https://www.theverge.com/2018/4/4/17196818/ai-boycot-killer-...
- eb3c90 9y agoI could do with a sceptical take on some of my views on AGI. I think it somewhat predictable, taking into consideration some old/new ideas. Interested in an off-ycombinator discussion?
- YeGoblynQueenne 9y agoSure, why not. Please feel free to email me (address in my profile). I'm going through a bit of crunch at the moment so answers may be a little slow but I always like a good discussion :)