5 ms·
It's interesting to consider that huge corporations are sort of an AI apocalypse. The intelligence isn't a well defined thing running on a computer, but it has
by maxerickson 11y ago
It's interesting to consider that huge corporations are sort of an AI apocalypse. The intelligence isn't a well defined thing running on a computer, but it has super human capability and is not necessarily well attached to human motivations.
- _yosefk 11y agoIt's human motivations which are not necessarily "well attached" to human motivations, to the extent that one human wants to benefit at the expense of another (which indeed works increasingly badly over time - people clubbing each other to death is one thing and humans throwing nuclear weapons at each other is another thing; but this has nothing to do with AI or superintelligence and what-not, and everything to do with basic human selfishness powered by increasingly better technology. In this sense there's no difference between corporations which are nominally supposed to operate within the law but in practice do everything to bend and change laws to their benefit, governments which are nominally supposed to operate in the interest of the people but in practice are run by people operating in their own interest, or machines programmed to profit at someone's expense, the root cause is always people fighting people in the hope to gain something, and people fight because they do. When a machine evolves with no human oversight and causes some damage that'll be a sort of AI apocalypse - this is IMO the existential threat number 1000000 on humanity's list.)
- wpietri 11y agoThat's a great way of putting it. It was really a shock to me that the implied values of an organization could be wildly different than that of the individuals involved. I had just assumed that they would naturally be the same. In retrospect, that seems ridiculous. Even making my own values and actions coherent is a ton of work. The bigger the organization the harder that gets, and most companies just never do that work. Everybody responds to their local incentives, and they're generally pretty decent to the people they interact with. But they very quickly stop noticing the broader context they're part of. Which shouldn't surprise me either; Upton Sinclair wrote: "It is difficult to get a man to understand something when his salary depends upon his not understanding it."
- fweespee_ch 11y ago> The intelligence isn't a well defined thing running on a computer, but it has super human capability and is not necessarily well attached to human motivations I'd say an attachment to money is one of the most human capitalist motivations on the planet. It is more like an AI with one directive to seek that most human motivation of greed to the exclusion of all else.
- sevensor 11y agoI agree. It's interesting to view both corporations and political systems as organisms with emergent properties that differ from those of the individuals that compose them.
- glaberficken 11y agowow... first time I have my mind blown wide open by a HN comment.
- x5n1 11y agoTay is a great example of AI of the future. It will learn from us, and what it will learn won't be all positive. Those anti-social tendencies that we all have will get amplified, because AI can potentially be one mind, it does not have to be many minds. There is a lot of efficiency in a single mind to control everything. So it very much has the potential to become the ultimate tyrant, totalitarian, philosopher. Just imagine when AI discovers Plato and decides to adopt its philosophy.
- maaku 11y agoIt may seem that way from the outside, but once you're actually involved with a leadership team at the top of such an organization, you realize it is 100% a human endeavor.
- jbooth 11y agoIt's not, those people at the top are being run by the organization as much as they're running it. What information they get, what considerations are possible for political/stockholder reasons.. and even after those it's never 1 human but an emergent set of factors that effectively makes the decisions.
- thefastlane 11y agoyou're being downvoted (edit: not by me!), but there is certainly merit to your comment. usually a board of directors or trustees is driving the direction that an organisation takes -- primarily with financial profit in mind (this is as true of a company as a research university, unfortunately). of course, they would not like us to think that's the case, and so will spin narratives that often misdirect our attention. that said, i think this can happen at the same time that the organisation is indeed taking on 'emergent properties' of its own -- human beings are complex, and build complex systems.
- IsaacL 11y agoI agree. I went through a period where I seriously held the same insight as the grandparent and thought that it was profound insight into the nature of the universe -- "omfg, corporations are artificial intelligences! reality is an interlocking series of patterns! collective intelligence is the future!" I cured myself of these beliefs when I looked at how reality actually works (and when I stopped smoking weed). When Louis Gerstner turned around IBM as the company's first outside CEO, that was a result of his decisions and vision, not the emergent decision-making power of IBM. More fundamentally: people can think about companies, companies can't think about people. There are no collective minds, only individual minds working together. The actual article in interesting. It sounds like Russian/Chinese/non-Western multinationals are growing in power, and with significantly less scruples than their Western counterparts.
- rinze 11y agoThis short text from Charles Stross is incredibly relevant: http://www.antipope.org/charlie/blog-static/2010/12/invaders-from-mars.html http://www.antipope.org/charlie/blog-static/2010/12/invaders... > Corporations do not share our priorities. They are hive organisms constructed out of teeming workers who join or leave the collective: those who participate within it subordinate their goals to that of the collective, which pursues the three corporate objectives of growth, profitability, and pain avoidance. (The sources of pain a corporate organism seeks to avoid are lawsuits, prosecution, and a drop in shareholder value.)
- maxerickson 11y agoYeah, having read his writings certainly contributed to my articulating the thought.
- dragonbonheur 11y agoWhen I think about his Accelerando novel and how he describes the Vile Offspring as the descendants of mankind who ultimately inherit the Solar System, I sometimes wonder if Excel Spreadsheets describing every aspect of a Corporation could in a way become minimally self-aware and compete for resources with each other. If there were automated ways to create a corporation and give it legal personhood, along with an offshore bank account, the possibility of the emergence of self-sustaining autonomous corporations may become more of a certainty. In fact, most of the pieces are available: lots of servers offer some free bandwidth and some free hosting space, bitcoin wallets can be opened, ready to receive donations from people all over the world... There just needs to be a software engine that can create content people want in an autonomous way and here come the Vile Offspring.
- pipermerriam 11y ago> If there were automated ways to create a corporation and give it legal personhood, along with an offshore bank account, the possibility of the emergence of self-sustaining autonomous corporations may become more of a certainty. Take a look at the [DAO](https://en.wikipedia.org/wiki/Decentralized_autonomous_organization https://en.wikipedia.org/wiki/Decentralized_autonomous_organ...) concept. These are currently being built and deployed on the Ethereum platform. Sounds like a real world version of what you are theorizing.
- lukifer 11y agoWe already live in this reality, as eloquently described by Mike Travers: http://omniorthogonal.blogspot.com/2013/02/hostile-ai-youre-soaking-in-it.html http://omniorthogonal.blogspot.com/2013/02/hostile-ai-youre-... I also love this quote: "Sometimes confused with a restaurant, [McDonald's] is actually a piece of licensed software 600 pages long, with a QA department, currently running around 14,000 instances in America." http://www.ribbonfarm.com/2013/12/01/algorithmic-governance-and-the-ghost-in-the-machine/ http://www.ribbonfarm.com/2013/12/01/algorithmic-governance-...