4 ms·
Humans are built out of neural structures, which are black-box learners. Any AI built out of a white-box learner would at least hypothetically be able to self-
by eli_gottlieb 13y ago
Humans are built out of neural structures, which are black-box learners. Any AI built out of a white-box learner would at least hypothetically be able to self-improve up to some fundamental physical-mathematical limit imposed by its supply of raw compute-power.
The interesting question is: where is that upper limit on intelligence-per-FLOPS?
EDIT: Fixed it to "FLOPS". We already have AI algorithms that Solve The Problem if given unlimited "thinking time" between steps of interaction with their environment (up to the point of needing a Halting Oracle), and we have extensions of those that are asymptotically speed-optimal modulo some additive or multiplicative constants (which are larger than our current universe). I strongly suspect that scaling down these Idealized AI Agents to real, useful programs isn't going to just involve feeding raw instances of the Ideal Agents small enough environments to be tractable, but actually finding or deriving some algorithm that can scale continuously up and down with available computing power per unit of real time, where the time units are the actual real-time length of an interaction cycle.
- seiji 13y agoCheck out Accelerando. Basically, mumble mumble computronium mumble mumble.
- eli_gottlieb 13y agomumble mumble stop giving them ideas mumble mumble
- ars 13y ago> are black-box learners. Any AI built out of a white-box learner To have a white-box learner would imply that humans were smart enough to build it. Yet it's unlikely that humans can build something significantly smarter than a human, so this AI would have the same limitation: It's unable (not smart enough) to build a smarter AI.
- eli_gottlieb 13y agoIntelligence is not magic, and in some way almost definitely scales with computing power. For instance, if you have infinite computing power, you just have to dovetail over every possible Turing Machine until one of them "wakes up" and does AI-y things. Yes, there are in fact real approaches based on a more sophisticated version of such a Universal Search. In fact, we routinely make use of machine-learning algorithms that are "smarter than a human" in particular narrow domains. Are they smarter than a human at general intelligence, of the kind necessary to start looking more like a scifi "AI" than a cheap trick? No, but they are an indication that such a thing could be possible. Overall, I would say that with Machine Learning maturing and Universal AI being a formal science at all, we are only just now beginning to find out where the actual tradeoffs lie in the design and construction of intelligent agents.
- ars 13y ago> Intelligence is not magic, and in some way almost definitely scales with computing power. The speed of intelligence scales. But not the quality of it. The quality of intelligence is something very hard to quantify. But as simply as I can state it, it's the quality of coming up with an idea that is not just an extension of an existing one, but an idea that came seemingly from nowhere. To someone else the idea appears magic, and no amount of thinking by that other person can lead him in a path that will end up there. > but they are an indication that such a thing could be possible. Real genius is not just "more" intelligence, it's intelligence of a different type that a non-genius simply can not do, no matter how they try. Analogously, just because a computer can do something fast does not give it that hard to define quality of true intelligence. To make (rather than randomly search for) a computer with real intelligence we need to understand what it is, and where it comes from, and we don't know either one of those things. Our best (smartest) computers are all variations of "search randomly" (for example chess engines). Those can do some amazing things, but their limitations will not be overcome by doing more of the same. > infinite computing power .. every possible Talking about infinity is a total red herring and you know that - especially because if your method of increasing intelligence is "search randomly" then an AI will not be able to make a better AI - all it can do is continue the random search humans already started.