4 ms·
Can someone explain what people mean when they say AI these days? Statistical clustering algorithms like neural-networks? Natural language algorithms? Any algor
by pron 11y ago
Can someone explain what people mean when they say AI these days? Statistical clustering algorithms like neural-networks? Natural language algorithms? Any algorithm that didn't work well a decade ago due to a lack of computation resources? Algorithms that mimic everyday human activities? All of the above?
I think that applying the label "AI" to some algorithms only serves to give us a very impartial sense of awe towards them that goes far beyond what their actual performance merits.
- tomp 11y agoAI is what works instead of humans. The next step of automation. We used to walk, then we rode horses, now we're driving cars, next cars will be driving themselves, and human command will move to higher and higher levels of abstraction.
- pron 11y ago> AI is what works instead of humans. But all algorithms do what humans used to do. So is AI the name for algorithms that do the work humans (in Western societies) still do, or did until recently? > human command will move to higher and higher levels of abstraction So am I on a different level of abstraction when a human is driving my taxi than when a computer does it? ;)
- matt4077 11y agoYou are not. But your former driver certainly is.
- varjag 11y agoA set of statistical methods coupled with computational power. Kind of like nanotech is really renamed material science instead of self assembling tiny robots.
- pron 11y agoSo statistics is now synonymous with intelligence? It used to be quite the opposite... :)
- simonh 11y agoI think it's about machines learning how to do things and improve at them rather than the decision parameters being hard coded. Most process automation is completely deterministic, the computer isn't being smart itself because all the smarts were pre-determined by humans. Neural nets and learning algorithms that are trained to do things are different and can cope with decision spaces involving a numerous variables where deterministically working out all the possible values and corresponding expected outputs isn't viable.
- pron 11y ago> I think it's about machines learning how to do things and improve at them rather than the decision parameters being hard coded. Yes, it's just that there's nothing necessarily intelligent about learning through statistical clustering. I mean humans don't learn something by looking at many thousands of examples; usually a couple suffices. Maybe that's just a higher-level statistical induction that yields intelligent deduction[1], but we have no idea. We know that statistical clustering, at least in biological brains, is a more primitive computation than, say, bubble-sort, but we don't know if it is necessarily the primitive building block for an "intelligent" algorithm. It's also true that we don't have a good definition of what intelligence is, but we do have a probably-reasonable intuition about it. Now, don't get me wrong, I understand why people feel like this should be called AI (for various reasons, both backward- and forward-looking), but it's important to remember that we have no idea where these algorithms are placed on the spectrum between bubble-sort and human intelligence. If anything, machine learning is more of a testament to how effective statistical algorithms can be (which is either "very" or "hardly", depending on the problem and the problem) without doing anything that could be called intelligent. This is not too surprising. Insects are also extremely effective -- and adaptive -- at some tasks without being intelligent at all. [1]: Word embedding (vector representation of words) is probably the closest we've ever got to deduction, but we don't know that this model generalizes well.
- simonh 11y agoI didn't say anything about that being how humans learn. Neural nets are only vaguely similar to the neural networks in organic brains anyway. But this is how our (non sentient) AIs are trained and what distinguishes them from predetermined deterministic algorithms. It allows them to operate more independently from humans than 'traditional' programming techniques. theres not much to be gained from arguing about the definition of intelligence, but however we use the term I think the above is what distinguishes these systems. What term would you prefer to use for them?
- vintermann 11y agoI'd say it's using computers for solving problems in a wide open model space. Any algorithm for solving practical problems embodies a model of the problem domain. Traditionally we try to bake in as much of our own experience as possible in the model/algorithm. In some fields, we're now seeing for the first time that it's better to not do that, to make fewer assumptions, build in less of our own knowledge, and just use (new, powerful) general purpose learning algorithms. With enough data, they can make sense of it themselves - our attempts at explaining it through model-building just get in the way.
- pron 11y agoI think that you'll find that the learning algorithms that actually work well in practice have more built-in assumptions and heuristics than you may think. But, yeah, as a general rule that's a good categorization. A far cry from intelligence, though, so the name AI is still misleading. Not all adaptive behavior is intelligent, although it often gives the illusion of intelligence, so I guess we make this labeling mistake not only when computers are concerned. Anyway, statistical algorithms, adaptive algorithms or inductive algorithms would be much better, less misleading and less breathless -- if less inspiring -- names for those programs than "AI".
- vintermann 11y agoThe main built-in assumptions in neural network are usually extremely high-level and abstract things, such as "this and this can be approximated with more or less smooth functions", or "things that are near are more likely to matter than things that are far away". Before, using machine learning to build models from the data was in some sense a last resort, for things you couldn't get a grip on modelling by hand from your own understanding. When you could, you preferred hand-made models because they did better. To take a concrete example, the top computer go program before Alphago, CrazyStone, still had hand-crafted patterns to prioritize which moves to explore during playouts. The author (and even more his competitors) tried to find better patterns with machine learning but they couldn't. The weights of the patterns were tuned with machine learning, but any attempt to e.g. evolve patterns with genetic algorithms just did worse. Now, it's going the other direction, we're seeing very general models only constrained by training data beat carefully hand-crafted models in area after area. And models are becoming more similar, more generalized as well - many people have noticed that state of the art recurrent and feedforward nets increasingly look more like each other. I disagree that it's a far cry from intelligence. I think people's ideas of intelligence are fuzzy and inconsistent, and it's far too often confused with things we associate with intelligence (from consciousness to independence and arrogance).