7 ms·
What Do You Think about Machines That Think?
- logn 12y agoIf corporations are people, then robots are people too. Corporations pretty much only understand monetary fines, and robots will only understand some form of disconnecting the cord. Similarly, corporations have a corporate veil to shield their owners form liability, assuming their business finances are separated from personal. Robot designers would have limited liability assuming their personal decision making was separated from the algorithmic reasoning. And we've managed to pass the CAN-SPAM Act, so either we should restore robot 1st Amendment rights, or otherwise overturn Citizens United.
- icebraining 12y agoIf corporations are people, then robots are people too. Corporations have legal personhood because they're an association of people. I don't see how this applies to robots. If you do, I don't want to see your robots!
- _-__--- 12y agoASSIMILATE
- logn 12y agoCorporations can be wholly owned by other corporations. And they often have an obligation to seek to maximize profits above all other concerns. How's that an association of people? They're treated as people because there was a similar conundrum as to how to apply laws to corporations. Justices decided to start applying laws as though they're people. It's the same situation Schneier is describing with robots.
- TheCraiggers 12y ago>Corporations can be wholly owned by other corporations. [...] How's that an association of people? If you follow that tread long enough, you will eventually find people running the show. You will not find robots, sentient trees, or rocks sitting around a board table.
- Retric 12y agoIt would be fairly easy to create a bot that makes random corporations. Legally I don't think there is anything that would separate them from actual corporations. Granted, their corporate officers would presumably need to be people. But, HFT demonstrates bot's can make legally binding decisions so that might be a grey area.
- icebraining 12y agoSomeone is still responsible for those bots.
- Retric 12y agoWhat if the bot creator dies before the bot makes a decision. We could even go so far as to have a cosmic ray flip one or more bits in memory that causes this to be released into the wild.
- icebraining 12y agoThen the sole shareholder of the company dies. I'm sure there's plenty of case law regarding this situation.
- Retric 12y agoSure, but shareholders are rarely responsible for a companies actions: http://en.wikipedia.org/wiki/Piercing_the_corporate_veil http://en.wikipedia.org/wiki/Piercing_the_corporate_veil Anyway, my point is if bot's can create and run companies then at some point they could gain the use of corporate personhood.
- deleted 12y ago[deleted]
- jacquesm 12y agoHm... now you have me wondering if I could slip a circular chain of ownership past the chambers of commerce here. I'm pretty sure you could bootstrap this: Person 'X' incorporates company 'A' and receives the shares. Company 'A' incorporates company 'B'. Company 'B' makes some money. Company 'B' buys the shares of company 'A' from person 'X'. Presto, no more people involved, just two companies owning each other. It might even be possible to have company 'A' buy the shares of company 'A' directly of the person that incorporated it, so it would own itself. You'd have to fiddle with the valuation during the transaction because you're using the company capital to do the purchase, essentially ending with a valuation (temporarily) of zero when the transaction has completed after which the company would have to create some more income to become liquid again. Tricky. Very much tempted to try this.
- icebraining 12y agoAnd they often have an obligation to seek to maximize profits above all other concerns. Only if the people who form that association demand it. There's no legal obligation - that's a common myth.
- deleted 12y ago[deleted]
- avodonosov 12y agoAnd what they think about you?
- TheCraiggers 12y agoMy first thought was to make a hard rule that it must obey the laws in the location it's in. In the US, that would be federal, state, and the various local laws of your city or township or whatever. And then I laughed at the mental image of a robot stuck in a deadlock due to all the mutually exclusive laws we have. (Of course, in Hollywood, replace "deadlock" with "exterminating all humans".)
- jkubicek 12y agoAttempting to adhere to two conflicting laws results in undefined behavior. And as we all know, undefined behavior can mean anything, including exterminating all humans.
- ta_28k198 12y agoswitch(getJurisdictionalPrecedence(&law)){ case FEDERAL: { setPrimeDirective(law[FEDERAL]); } break; case STATE: { setPrimeDirective(law[STATE]); } break; case CITY: { setPrimeDirective(law[CITY]); } break; default: { setPrimeDirective(this->ExterminateAllHumans()); } break; };
- superobserver 12y agoThat made me LOL. This might actually make for an interesting way (via A.I.) to find loopholes in law, seeing law as a programmatic way to determine acceptable societal PID's.
- thirdtruck 12y agoYou forgot to add this case before the rest: case PHYSICS: { setPrimeDirective(law[PHYSICS]); } break /* at your peril */; :)
- thirdtruck 12y agoEven attempting to implement such a rule could have benefits. We could end up with formalized proofs of how those are are objectively contradictory, which in turn could be factored into the design of future laws as a preventative measure. Imagine "test-driven legislation," if you will.
- fein 12y agoWhat do machines think about machines that think?
- superobserver 12y agoThe machine (software program) lacks sufficient awareness beyond mechanical execution of the programmer's own will; therefore, it holds infinitesimal responsibility for its actions. In order to prevent further violations of law, it should be decommissioned. The programmer should be fined equivalent to the amount of illegal purchases the bot made in addition to $1K for each offending purchase. As for other machines in the future (androids), it seems obvious enough to me that - insofar as they are intelligent and thus responsible (IQ testing is commonly used in US judicial system, with the cutoff being an IQ of 70 or above) - they can be tried like any human being.
- avodonosov 12y agoWe can give them negative reward (decrement some counter in the machine memory). The machine will want to avoid that!
- humanfromearth 12y agoWe'll figure something out when we get there. What I found quite annoying lately (more than usual) is that there is a lot of "what if machines, terminator, bla bla bla death! destruction!". I'm not sure if it's the recent developments with the deep neural nets, maybe it is.. Maybe it's the high profile neo-luddites like Hawkins or Musk. I wish I could have a megaphone and shout: AI that would be classified as having comparable human intelligence is way too far and there are a lot of pieces missing. Just because we can identify with 95.4% accuracy some MNIST dataset or 200 species of dogs, or some guys playing baseball, it's still a long way to getting to a working AGI. But instead on focusing on doing the actual work that would get us to these machine 'thugs' or at least promoting more research in that direction most prefer to sit in their armchair and argue to the death the hypothetical T-1000. Thankfully there are smart people out there doing real work and getting results so that is reassuring. My problem with these extremists is that they produce hype. Hype that got us the AI research winter last time.
- deleted 12y ago[deleted]
- humanfromearth 12y agoAnd you think I don't want to live on my own platform in some giant habitat with drones that do everything for me. Where disease and famine is eradicated, where I can change my body however I want and I have no concept of money? Sure! Just as much as the other guy, but to get there we need some hard science, funding and steady progress. AI is one of the hardest problems facing us so doing things we so notoriously bad at like estimating the difficulty of a such problems will not get us any results. I encourage skepticism and careful research as opposed to ignorance and fear-mongering. On that note why was not Lecun's FAIR project not on front-page HN? Instead we have this shit... Is there any hope that we'll grow up?
- deepsearch 12y agoWe are already gearing them toward good... "A Search Engine that Thinks, Almost" http://newscenter.lbl.gov/2005/03/31/a-search-engine-that-thinks-almost/ http://newscenter.lbl.gov/2005/03/31/a-search-engine-that-th...
- swframe 12y agoWe will build very smart machines before we build machines that think. Those very smart machines will probably change the world the way the internet did. Imagine having smart machines than can farm, build houses, clean up pollution, etc. Thinking machines are too far off to know what to expect. We need to first consider what an increasingly automated world would mean. In particular, what will it mean for employment and average income?
- known 12y agoMachines killing Machines is BETTER than Humans killing Humans
- mcguire 12y agoSure, but machines killing humans scales better than humans killing humans.
- Houshalter 12y agoWhy was the title changed to the Edge.org question of the year?
- pnathan 12y agoThe article has nothing to do with thinking. But in the scope of the article, it's an interesting legal conundrum. I expect the end result is that the class of software which can perform illegal actions autonomously will have to be brought under warranty and the creators held responsible. "Acme Inc. Warrants that under Factory Conditions and Standard Programming, Software Agent R2-D2 will not conduct illegal actions". This is not out of the range of possibility and even feasibility today, but it will require genuine engineering mentalities to create such systems.
- avodonosov 12y agoThe same way we deal with other entities: rats, viruses, hurricanes. If they harm us, we don't "punish" them, we just seek a way to prevent them harming us.
- zackmorris 12y agoCulpability goes all the way to the top. So the top ranking official who orders use of the machine is to blame, which could very well be the president. And it goes deeper than that, because the society that elected the president endorses its use if it doesn't recall him or her. Since recalls are rare, collateral damage from thinking machines is basically inevitable and I don't think most people have any idea what is coming. That said, I expect that AI is going to transcend the way people solve problems to such a degree that it may even alleviate the underlying causes of war like artificial scarcity and ignorant intolerance.
- cafebeen 12y agoJust follow Asimov's laws of robotics: 0) A robot may not harm humanity, or, by inaction, allow humanity to come to harm. 1) A robot may not injure a human being or, through inaction, allow a human being to come to harm. 2) A robot must obey the orders given it by human beings, except where such orders would conflict with the First Law. 3) A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.