3 ms·

> And one possibility might be that AIs could “improve themselves” to produce a single “apex intelligence” that would in a sense dominate everything else. I wo

> And one possibility might be that AIs could “improve themselves” to produce a single “apex intelligence” that would in a sense dominate everything else. I worry about the opposite, at least in the early phase of AI. There will be many AI instances/variants in many hands, and they will be used in different ways. Companies will have their own for commercial needs, countries will have them for economy, defense purposes etc. Established countries will approach them conservatively, using them in an advisory role, rather than giving them direct access. "Rogue" countries (think North Korea, Iran, maybe Russia) which are more accepting of risk might give their AIs a much more direct role, including building them right into the weapon systems. This can backfire spectacularly, but in some cases may be successful and provide the rogue country with an effective equalizer or perhaps even an edge. An obvious way to equalize this for "non-rogue" countries is to give their own AI more direct access to decision-making. In the end, we might end up with multiple AIs fighting for dominance, with humans on the sidelines.

prox 4y ago
What is really interesting is that we are so accustomed to the tale of dominance and tribes that we are taking it for granted (because we live in it). Love and kindness, how naive it may sound is the bedrock of cooperation and humans have a hard time grappling with the concept that. We want to be wise (well some of us) yet what wisdom means is insight into our behavior from the bottom up. We are at a crossroads of a moment of what we want to be. We are often led into being by our circumstances and conditioning, and that is still a relic of our evolution, but also a door for the one willing to look at it. If AI is really smarter than us, I also hope it is also wise, because the two are not the same.
- The_Colonel 4y ago
  > What is really interesting is that we are so accustomed to the tale of dominance and tribes that we are taking it for granted (because we live in it). Love and kindness Right, but love, kindness, cooperation are human concepts as well. One way to look at it is that these AIs will be developed by humans and to be able to even understand one another, it has to internalize at least some elements of human psychology. AIs will be developed/trained for particular purpose, AIs used for military needs will probably understand more of dominance as opposed to love. It's possible that some AIs will not be anthropomorphic at all, but that's a complete wildcard. Humanity has certain biology-dictated common ground in values, which leads us often to an illusion that some things are universal. But AI with no biological baggage might not see any value in life, for example.

prox 4y ago

What is really interesting is that we are so accustomed to the tale of dominance and tribes that we are taking it for granted (because we live in it). Love and kindness, how naive it may sound is the bedrock of cooperation and humans have a hard time grappling with the concept that. We want to be wise (well some of us) yet what wisdom means is insight into our behavior from the bottom up. We are at a crossroads of a moment of what we want to be. We are often led into being by our circumstances and conditioning, and that is still a relic of our evolution, but also a door for the one willing to look at it. If AI is really smarter than us, I also hope it is also wise, because the two are not the same.

The_Colonel 4y ago
> What is really interesting is that we are so accustomed to the tale of dominance and tribes that we are taking it for granted (because we live in it). Love and kindness Right, but love, kindness, cooperation are human concepts as well. One way to look at it is that these AIs will be developed by humans and to be able to even understand one another, it has to internalize at least some elements of human psychology. AIs will be developed/trained for particular purpose, AIs used for military needs will probably understand more of dominance as opposed to love. It's possible that some AIs will not be anthropomorphic at all, but that's a complete wildcard. Humanity has certain biology-dictated common ground in values, which leads us often to an illusion that some things are universal. But AI with no biological baggage might not see any value in life, for example.