3 ms·

>I haven't really heard a reason to think that there exist intelligence algorithms that are dramatically superior to ours. I don't think that is the case at al

>I haven't really heard a reason to think that there exist intelligence algorithms that are dramatically superior to ours. I don't think that is the case at all. Neural nets like AlphaGo Zero are already crystal clear evidence of algorithms which leave human minds far behind. Even if that wasn't the case and Einstein level intelligence was the physics-imposed ceiling, there are still the dangers of speed and numbers. A compute node running one million instances of Einstein intelligence each thinking 1000x faster than an organic instance, fully focused 24/7, and working in complete group cooperation, doesn't sound all that much less dangerous.

edgyquant 4y ago
>A compute node running one million instances of Einstein intelligence each thinking 1000x faster than an organic instance, fully focused 24/7, and working in complete group cooperation, doesn't sound all that much less dangerous. At that point though, this “super intelligence” just sounds like a group of humans working together; without much added benefit due to the energy costs.
- flangola7 4y ago
  The Manhattan Project used both far more energy and far fewer (and slower) Einsteins. The ability to spin up as many Manhattan Project size "group of humans working together" Docker instances as you desire again does not seem very reassuring. We already have chucklenuts making toy GitHub projects labeled "ChaosGPT" that experiment using LLMs and early agent frameworks to cause death and destructions for the lolz. If anyone can spin up 50 Manhattan Projects using a few GPU racks and command them to unquestionably and restlessly work on bringing harm to the world the outcome will not be flowers and sunshine.
DennisP 4y ago
The article addressed AlphaZero, pointing out it's a domain where the AI can generate a vast amount of its own training data. That's not necessarily relevant to real-world tasks, where it's not so easy to try billions of different things in training.
- flangola7 4y ago
  >pointing out it's a domain where the AI can generate a vast amount of its own training data How is that exclusive to AlphaZero? Moderators everywhere are already panicking about GPT generating vast amounts of "its own training data" and irreparably polluting every public space on the internet. I agree that the amount of data it would need to produce would be very large and expensive, but there is no shortage of blank check writing at the moment.
  - disgruntledphd2 4y ago
    It's pretty different, in that it's a supervised problem with a clear outcome metric (i.e. your game score). GPT splurging text all over the internet is basically nothing like that.

edgyquant 4y ago

>A compute node running one million instances of Einstein intelligence each thinking 1000x faster than an organic instance, fully focused 24/7, and working in complete group cooperation, doesn't sound all that much less dangerous. At that point though, this “super intelligence” just sounds like a group of humans working together; without much added benefit due to the energy costs.

flangola7 4y ago
The Manhattan Project used both far more energy and far fewer (and slower) Einsteins. The ability to spin up as many Manhattan Project size "group of humans working together" Docker instances as you desire again does not seem very reassuring. We already have chucklenuts making toy GitHub projects labeled "ChaosGPT" that experiment using LLMs and early agent frameworks to cause death and destructions for the lolz. If anyone can spin up 50 Manhattan Projects using a few GPU racks and command them to unquestionably and restlessly work on bringing harm to the world the outcome will not be flowers and sunshine.

DennisP 4y ago

The article addressed AlphaZero, pointing out it's a domain where the AI can generate a vast amount of its own training data. That's not necessarily relevant to real-world tasks, where it's not so easy to try billions of different things in training.

flangola7 4y ago
>pointing out it's a domain where the AI can generate a vast amount of its own training data How is that exclusive to AlphaZero? Moderators everywhere are already panicking about GPT generating vast amounts of "its own training data" and irreparably polluting every public space on the internet. I agree that the amount of data it would need to produce would be very large and expensive, but there is no shortage of blank check writing at the moment.
- disgruntledphd2 4y ago
  It's pretty different, in that it's a supervised problem with a clear outcome metric (i.e. your game score). GPT splurging text all over the internet is basically nothing like that.