15 ms·
Noam Chomsky on Where Artificial Intelligence Went Wrong
- deleted 14y ago[deleted]
- hodder 14y agoNorvig on Chomsky: http://norvig.com/chomsky.html http://norvig.com/chomsky.html
- Goronmon 14y agoThis is actually linked in the article.
- jholman 14y agoI haven't finished reading TFA yet, but so far it's really good, because it sounds like Chomsky is actually getting to the point.... which he sometimes does, and sometimes absolutely doesn't (or so it often seems to me). If you're interested in this area, which you might call the philosophy of artificial mind, or philosophy of cognitive science, I strongly suggest reading the link to Norvig's article (linked in TFA, but here it is again: http://norvig.com/chomsky.html http://norvig.com/chomsky.html ). In particular, I'd suggest reading it before reading the actual interview with Chomsky (maybe ideally reading it after the prefatory part of TFA). My own inclination is that on the face of it, I find Norvig's approach less satisfying, as Chomsky appears to, but upon much consideration my current belief is that Chomsky's approach is too mystical and too just-so, and Norvig's approach at least has the merit of bearing fruit... fruit that one day might be concentrated into a concise and elegant theory.
- hvs 14y agoI think I agree with you. Chomsky is astoundingly intelligent and (I think) I understand what he is getting at (i.e. develop a theory of how something happens and use it to find evidence that supports or refutes that theory, rather than using statistical methods to develop a predictive model that doesn't teach you anything about the underlying system), but you can't but feel a sense of "yeah, but how?" You can hardly blame the AI researchers for sticking with methods that have been very successful (at least practically speaking) after they had their funding cut out from under them in the 90's for the perceived "failures of AI". I do like the idea of developing a theory (e.g. vision is processed via algorithm in the brain represented by X) and then attempting to find evidence of that. It can help to avoid the reductionist idea that you need to model everything down to the cellular level in order to understand the brain. It's like trying to disassemble code in memory and then read the algorithm rather than examining every 1 and 0 in memory and trying to make heads or tails of them. That's enough rambling from me..
- meric 14y agoI am not well acquainted with Noam Chomsky and his work, but the dichotomy you refer to I'd like to call "design vs evolution". If the extreme "design" part the spectrum is what Chomsky talks about: "develop a theory of how something happens and use it to find evidence that supports or refutes that theory", then the extreme end of the "evolution" part of the spectrum must be this: Choose a set of rules, use genetic programming techniques to rearrange those rules. Evidence you require will be acquired and utilised by the algorithm itself. The only crux is the set of rules to choose from and implementation of the technique. IMO, the more complicated the rules and the more they interact with each other, the better. ...only then can you get results like this: "...Five individual logic cells were functionally disconnected from the rest– with no pathways that would allow them to influence the output– yet when the researcher disabled any one of them the chip lost its ability to discriminate the tones." http://www.damninteresting.com/on-the-origin-of-circuits/ http://www.damninteresting.com/on-the-origin-of-circuits/ While we don't know whether the design approach will work, we have examples of evolution creating working intelligence[1]. [1] You.
- Evbn 14y agoSee also the story of the MIT magic switch that toggled between Magic and More Magic, required to make a certain machine function, with no wires behind the switch.
- AndyNemmity 14y agoI don't see any mysticism in Chomsky's approach. You seem to agree with Norvig that doing massive data analysis on language will come to a scientific understanding, which would be a first in science. Chomsky doesn't. If anything, Chomsky is grounded in reality, and Norvig and AI researchers are grounded in hope that this way of mapping out something will create meaningful understanding of the system.
- mjn 14y agoThis reminds me a bit of what scientists in other fields refer to as "empirical equations", which are equations fit from data without any particular theoretical backing or reason to believe that their components are a good model of reality. They're useful in that they may predict observations well, especially over a specific range of observables, but they don't necessarily give us an understanding of what's going on. An example is the historical Prony equation for hydraulic pressure loss (http://en.wikipedia.org/wiki/Prony_equation http://en.wikipedia.org/wiki/Prony_equation), which doesn't actually correctly model what happens in fluid flow, but does happen to empirically produce fairly good results over a range of values, partly through the use of two magic numbers fit from data. Another example might be the winning entry in the Netflix competition. If your goal is to predict film preferences (which is Netflix's goal, of course), it appears to give pretty good estimates. But I don't think even its authors would claim that it's a a scientific model of how humans form preferences. In both cases the underlying problem is that there are fairly general functional forms, such as a few terms of a Taylor series, or a forest of decision trees, that can empirically model almost anything to a certain degree of accuracy, given enough data, even if the underlying process looks nothing like them. Therefore they can give accurate predictions that work in practice, without being accurate models of what's happening in the underlying system. Chomsky appears to be of the opinion that statistical NLP systems are more of that variety, so may be good engineering solutions without being good scientific models.
- AndyNemmity 14y agoExactly. Well said, and clearly articulates the point here. What I don't get is, what Chomsky is saying is all together the standard, and yet people are insulting him for what is all together a very simple idea you expressed plainly. Yes, NLP systems are going to have many engineering uses, and Chomsky agrees. Are they going to help in the true scientific understanding of the systems? It's unlikely. It's likely to be "good engineering solutions without being good scientific models" as you elegantly put it.
- lsb 14y agoThe "right" way is to take endless numbers of videotapes of what's happening outside the video, and feed them into the biggest and fastest computer, gigabytes of data, and do complex statistical analysis -- you know, Bayesian this and that -- and you'll get some kind of prediction about what's gonna happen outside the window next. In fact, you get a much better prediction than the physics department will ever give. Well, if success is defined as getting a fair approximation to a mass of chaotic unanalyzed data, then it's way better to do it this way than to do it the way the physicists do, you know, no thought experiments about frictionless planes and so on and so forth. But you won't get the kind of understanding that the sciences have always been aimed at -- what you'll get at is an approximation to what's happening. Chomsky seems to keep using naïve models as a strawman, and Norvig rightly calls him on it. If you use simple models, you can only get simple insights, but statistical machine translation (for example) builds probabilistic context-free grammars, which maps human notions of language far better than "make sure every three words in sequence is plausible".
- AndyNemmity 14y agoChomsky is agreeing that it's making a map. He just doesn't think that map is very useful on a scientific level, but is useful on an engineering level. You're responding that he's wrong, because it's useful on an engineering level. Right? I'm reading many comments here and they seem to keep boiling down to this notion. Am I wrong?
- mturmon 14y agoAt the top level, I think this captures it. If, like Chomsky, you value having a model of the underlying cognition process rather than a set of black-box predictors for aspects of that problem (e.g., various corpus-driven translators), then you might be really annoyed that the black-box people are so satisfied with their results.
- Evbn 14y agoThe Church was angry that the sun didn't revolve around the Earth. We don't get to pick the prettiest models. Right makes right.
- anigbrowl 14y agoMeh, he's just trotting out warmed-over Searle without bothering to give his ideas any credit. I have to admit to an intense dislike of Noam Chomsky.
- KVFinn 14y agoChomsky is damn sharp at 83. I sure hope I hold up that well.
- iandanforth 14y agoChomsky is right up there with Minsky in being part of the problem. His ideas about language being part of the genome are fanciful nonsense. Skinner produce reams of reproducible empirical observations of behavior which are, today, critical to the evaluation of the performance of AIs. Chomsky has produced interesting theories, but mostly derailed linguistics on the basis of the argument 'language is complicated, something magical must be going on.' His contributions to political debate are monumental. His contributions to science are negligible if not entirely detrimental.
- deleted 14y ago[deleted]
- barrkel 14y agoWhat do you think of http://en.wikipedia.org/wiki/Nicaraguan_Sign_Language http://en.wikipedia.org/wiki/Nicaraguan_Sign_Language ? It certainly makes me doubt language (the technology of it) as purely cultural and learned.
- iandanforth 14y agoLanguage is a set of behaviors Behavior for humans and other animals requires a brain and body (almost always) The organisation, growth, and function of the brain and body are influenced by genetics. So we can say first and formost that language is influenced by genetics. Having a tongue, vocal chords, hands, ears. These all help to acquire language. So now the question is to what degree does genetics influence language and language acquisition? Is it fully governed by genetics? We know that removing a child from the company of others during development eliminates complex language and severely stunts their ability to acquire language. So, in a single individual, language has never been observed to arise spontaneously and the facility to acquire language is something you can lose. If you damage certain portions of the brain aspects of language can be removed. See Fluent Aphasia for a particularly odd example. However, these aphasias are known to remit and studies show that other portions of the brain have taken over from the damaged portion. So we know that the capacity for language is not entirely localized to a genetically determined location. We also know there was a time when there wasn't language and now there is, so at least once in human history language did arise spontaneously. The article you mention is evidence that language can evolve spontaneously in groups of humans. In fact there is evidence that the rudiments of language arise in groups of many animal species including apes, whales, and dolphins. Many animals communicate, but with insufficient sophistication as to be described as a language. So it is safe to say that there are genetic factors in producing communicative behavior. Sounds, postures, marking etc. I feel it is also safe to say that there are genetic factors that predispose groups of some species to develop more complex systems of communication (but these are not limited to humans) and that groups of humans are particularly good at complex communication. Unfortunately for Chomsky there is little to no evidence that any one type of language is more likely than another. Grammars, phonemes, words, abstract concepts ... all of these have huge between language variation. The similarities between languages are well explained by either physical characteristics of speech production or regularities in the environment of the languages origin. So yes, language is both learned, and cultural, even if it isn't purely so.
- dbaupp 14y agoAI hasn't "gone wrong" yet. At least, we don't know that it has, and we can't truly know until we've solved it (for some concrete value of solved).
- zepolud 14y agoI've always considered Norvig's position pretty much self-evident for anybody who has dealt with real world problems. At the same time, Chomsky is still way more interesting to read, even if he's wrong. And he's wrong mostly for assuming that unsupervised learning has to be the end result when in fact it could be an intermediate step to more refined symbolic theories. In any case, this kind of antagonism between the two approaches might be useful as it keeps the field more vital, preventing yet another stagnation.
- AndyNemmity 14y agoBy real world problems you're talking about engineering and not science. Chomsky says Norvig's position is great for engineering, just not science. The whole disagreement stems from the idea that this will help us with a scientific understanding of language or not. The burden is on Norvig's side to prove it, and it hasn't.
- snowwrestler 14y agoI think the phrase "scientific understanding" is essentially qualitative, meaning that humans can disagree about what we "understand" and how "scientific" it is, and there's no objective way to adjudicate that fight. How many physicists really believe they fully understand quantum mechanics? The theory is probablistic and strange but produces very accurate predictions. The true measure of science is matching observations to hypotheses, and in that respect the approach that Norvig defends has demonstrated success. Google's language tools work well much of the time. Watson beat Ken Jennings. Other branches of science are beginning to make more use of "big data" approaches as well. A friend doing post-doctoral research on evolution spends most of his time behind a laptop coding against big sets of digitized genetic information.
- brianstorms 14y agoChomsky's famous review of Verbal Behavior was from 1959. He REISSUED it in 1967, as the document the article links to plainly and clearly states. Geez, this is a pretty stupid mistake for Katz and The Atlantic to make. They should fix it.
- achy 14y agoLike many things, Chomsky is both right and wrong. He's right in that if we studied the structure and functioning of the brain we could built more accurate AI. He's terribly wrong because the structures of the brain are fuzzy and give rise to probabilistic and 'statistical' functioning that is itself based on training (much like the models he derides).
- zerostar07 14y agoHow are brain structures fuzzy?
- jklio 14y agoOptical illusions where we see one thing then another are numerous, e.g. https://en.wikipedia.org/wiki/Rubin_vase https://en.wikipedia.org/wiki/Rubin_vase In these there is obviously some contest going on between fuzzy classifiers, as there is in conceptual association games, misinterpretations of song lyrics between people and errors like the Freudian slip. There are at least large parts of our brains that seem to operate in this manner. That said our use of logic and reason certainly says there is a part of our brain that works in a non-fuzzy way, or at least can be trained to work like. However, while there are people who understand the odds and are just there for a good time, it's instructive to go to a Casino and see how many people believe they can win and believe in lucky charms. This topic is a minefield of semantic games with hidden assumptions and people arguing across each other though.
- zerostar07 14y agoI think you mean human behavior is fuzzy. Brain circuits are sometimes chaotic but pretty deterministic. The sensory input is noisy though.
- 6ren 14y agoWhat it strongly suggests is that in the evolution of language, a computational system developed, and later on it was externalized. So, the beginning of human language was not communication, but a computational system. Interesting stuff starting at that quote. NB: lots of mistakes in the transcript, sometimes rendering it unintelligible.
- jhales 14y agoReminds me Einstein arguing God doesn't play dice. (Not claiming Chomsky is wrong,just a similar figure making a similar claim.)
- sh_vipin 14y agoTo some extent, I agree. But for some reason, I have a feeling that "Wearable Computing" is gonna have similar fate.
- gavanwoolery 14y agoWhile I respect (some of Chomsky's work) it is amazing to me that he thinks language is something more than mathematics/statistics. Language is math, it is basically an advanced form of discreet mathematics. We can reproduce virtually anything on a computer, and it is no more "shallow" than artificial light from a lightbulb is "artificial." There is no magic going on, we are biological computers, walking number crunchers. Our brains just happen to operate with chemicals and analog signals, rather than transistors and digital signals. His view on this carries the drawbacks of academia, which has a tendency to over-complicate and over-formalize thinking.
- Cacti 14y agoI completely agree. The fact that math = language, and that it's built into our DNA, is astounding. And from there that the Halting Problem is basically tied into our DNA, that is, how we think, how our brains work, our ability to conceive ideas, is just mind-blowing. What Chomsky has done in his academic career in on par with the greatest scientists in our history.
- thewarrior 14y agoWhat do you mean ?
- koningrobot 14y agoMath is a model of reality. Math does not exist in your DNA; DNA exists subject to the rules of that which math models.
- adrianhoward 14y agoit is amazing to me that he thinks language is something more than mathematics/statistics He doesn't think that. Look at his linguistics work - google Chomsky Hierarchy. He very much does not think that it's magic. All he's saying is that some kinds of statistical modeling - while stupidly useful and practical - don't give us a lot of explanatory power. He's, metaphorically, complaining about folk who are happy using Boyle's Law because "it works", when he'd like more folk figuring out what atoms are all about.
- confluence 14y agoNoam Chomsky irritates me here's why - he's vague, so astonishingly vague that he can hide his uselessness within it. > Chomsky derided researchers in machine learning who use purely statistical methods to produce behavior that mimics something in the world, but who don’t try to understand the meaning of that behavior. Chomsky compared such researchers to scientists who might study the dance made by a bee returning to the hive, and who could produce a statistically based simulation of such a dance without attempting to understand why the bee behaved that way. -- http://www.tor.com/blogs/2011/06/norvig-vs-chomsky-and-the-fight-for-the-future-of-ai http://www.tor.com/blogs/2011/06/norvig-vs-chomsky-and-the-f... What does that even mean? > But the number of parameters in his theory continued to multiply, never quite catching up to the number of exceptions, until it was no longer clear that Chomsky’s theories were elegant anymore. In fact, one could argue that the state of Chomskyan linguistics is like the state of astronomy circa Copernicus: it wasn’t that the geocentric model didn’t work, but the theory required so many additional orbits-within-orbits that people were finally willing to accept a different way of doing things. AI endeavored for a long time to work with elegant logical representations of language, and it just proved impossible to enumerate all the rules, or pretend that humans consistently followed them. Norvig points out that basically all successful language-related AI programs now use statistical reasoning > But his fundamental stance, which he calls the “algorithmic modeling culture,” is to believe that “nature’s black box cannot necessarily be described by a simple model.” He likens Chomsky’s quest for a more beautiful model to Platonic mysticism, and he compares Chomsky to Bill O’Reilly in his lack of satisfaction with answers that work. “Tide goes in, tide goes out. Never a miscommunication. You can’t explain that,” O’Reilly once said, apparently unsatisfied with physics as an explanation for anything. -- http://www.tor.com/blogs/2011/06/norvig-vs-chomsky-and-the-fight-for-the-future-of-ai http://www.tor.com/blogs/2011/06/norvig-vs-chomsky-and-the-f... AI went wrong when Chomsky came around with his rule based translation ideas that were hideously wrong and probably set us back 20 years - see here: http://norvig.com/chomsky.html http://norvig.com/chomsky.html He's a more irritating linguistic version of Richard Dawkins (who doesn't have an active research career). > Every time I fire a linguist, the performance of the speech recognizer goes up -- http://en.wikipedia.org/wiki/Frederick_Jelinek http://en.wikipedia.org/wiki/Frederick_Jelinek
- Cacti 14y ago
- reso 14y agoSo much hate in this thread for one of men who laid the foundations of Computer Science. We may disagree with his ideas now, and possibly his theories are out of date, but the magnitude of his contribution to linguistics, and by extension, neurology, psychology, and computer science, puts him in the very highest rank of scientists.
- Evbn 14y agoAd hominem cuts both ways. Being right once, no matter how significant, doesn't grant a free pass to BS through other topics.
- TheAudientVoid 14y ago"The approach taken by Chomsky and Marr toward understanding how our minds achieve what they do is as different as can be from behaviorism. The emphasis here is on the internal structure of the system that enables it to perform a task, rather than on external association between past behavior of the system and the environment. The goal is to dig into the 'black box' that drives the system and describe its inner workings, much like how a computer scientist would explain how a cleverly designed piece of software works and how it can be executed on a desktop computer." The article completely misunderstands what Behaviorism actually is. Once again, the misunderstanding comes from confusing the Methodological Behavoirism advocated by John Watson, Edward Thorndike and others, who did indeed try to model people as a "black box", with Skinner's Radical Behavoirism, which denies that there's even a box to be opened; rather, Skinner holds that there is only a locus where a series of environmental processes happen to converge and interact in interesting ways. Some of these processes are much older than the others, and are expressed in genes; others are relatively newer, and are learned. Skinner did not deny that genetics played a role in language acquisition, nor did he ever maintain people are born a blank slate. While Skinner found Chomsky's work regarding universal grammar unconvincing, he maintained that it was not, as Chomsky claimed, directly opposed to his own work -- the two theories were orthogonal, and would succeed or fail independently of each other.
- chj 14y agoGiven enough time, a monkey can type out a Hamlet. But who can live that long to wait? I think that is why I tend to agree with Chomsky.
- ilaksh 14y agoThe field is now called AGI. It isn't mentioned in this article. Everyone seems to be ignoring the whole field of AGI (artificial general intelligence). Or maybe they truly are ignorant of it. Anyway, suffice to say, AI and AGI didn't stop progressing, and Chomsky is no longer any sort of expert in those fields. Even Norvig isn't up to speed on the most advanced approaches to AGI, but at least he enters the same room with people who are aware of the field. For example, he gave a talk at the recent Singularity Summit. The Fifth Conference on Artificial General Intelligence is going to be in Oxford in December. http://agi-conference.org/2012/ http://agi-conference.org/2012/ Here is some information for people who are interested in pertinent ideas related to AGI. http://www.amazon.com/How-Create-Mind-Thought-Revealed/dp/0670025291 http://www.amazon.com/How-Create-Mind-Thought-Revealed/dp/06... http://opencog.org/theory/ http://opencog.org/theory/ >OpenCog is a diverse assemblage of cognitive algorithms, each embodying their own innovations — but what makes the overall architecture powerful is its careful adherence to the principle of cognitive synergy. >The human brain consists of a host of subsystems carrying out particular tasks — some more specialized, some more general in nature — and connected together in a manner enabling them to (usually) synergetically assist rather than work against each other. http://wiki.opencog.org/w/Probabilistic_Logic_Networks http://wiki.opencog.org/w/Probabilistic_Logic_Networks > PLN is a novel conceptual, mathematical and computational approach to uncertain inference. In order to carry out effective reasoning in real-world circumstances, AI software must robustly handle uncertainty. However, previous approaches to uncertain inference do not have the breadth of scope required to provide an integrated treatment of the disparate forms of cognitively critical uncertainty as they manifest themselves within the various forms of pragmatic inference. Going beyond prior probabilistic approaches to uncertain inference, PLN is able to encompass within uncertain logic such ideas as induction, abduction, analogy, fuzziness and speculation, and reasoning about time and causality. http://wiki.opencog.org/w/AtomSpace http://wiki.opencog.org/w/AtomSpace Conceptually, knowledge in OpenCog is stored within large [weighted, labeled] hypergraphs with nodes and links linked together to represent knowledge. This is done on two levels: Information primitives are symbolized in individual or small sets of nodes/links, and patterns of relationships or activity found in [potentially] overlapping and nesting networks of nodes and links. (OCP tutorial log #2). http://www.izhikevich.org/publications/large-scale_model_of_human_brain.htm http://www.izhikevich.org/publications/large-scale_model_of_... Large-Scale Model of Mammalian Thalamocortical Systems > The understanding of the structural and dynamic complexity of mammalian brains is greatly facilitated by computer simulations. We present here a detailed large-scale thalamocortical model based on experimental measures in several mammalian species. The model spans three anatomical scales. (i) It is based on global (white-matter) thalamocortical anatomy obtained by means of diffusion tensor imaging (DTI) of a human brain. (ii) It includes multiple thalamic nuclei and six-layered cortical microcircuitry based on in vitro labeling and three-dimensional reconstruction of single neurons of cat visual cortex. (iii) It has 22 basic types of neurons with appropriate laminar distribution of their branching dendritic trees. The model simulates one million multicompartmental spiking neurons calibrated to reproduce known types of responses recorded in vitro in rats. It has almost half a billion synapses with appropriate receptor kinetics, short-term plasticity, and long-term dendritic spike-timing-dependent synaptic plasticity (dendritic STDP). The model exhibits behavioral regimes of normal brain activity that were not explicitly built-in but emerged spontaneously as the result of interactions among anatomical and dynamic processes. We describe spontaneous activity, sensitivity to changes in individual neurons, emergence of waves and rhythms, and functional connectivity on different scales. http://www.sciencebytes.org/2011/05/03/blueprint-for-the-brain/ http://www.sciencebytes.org/2011/05/03/blueprint-for-the-bra... Essentials of General Intelligence: The direct path to AGI http://www.adaptiveai.com/RealAI_chap_ver2c.htm http://www.adaptiveai.com/RealAI_chap_ver2c.htm >General intelligence, as described above, demands a number of irreducible features and capabilities. In order to proactively accumulate knowledge from various (and/ or changing) environments, it requires: >1. Senses to obtain features from ‘the world’ (virtual or actual), >2. A coherent means for storing knowledge obtained this way, and >3. Adaptive output/ actuation mechanisms (both static and dynamic). >Such knowledge also needs to be automatically adjusted and updated on an ongoing basis; new knowledge must be appropriately related to existing data. Furthermore, perceived entities/ patterns must be stored in a way that facilitates concept formation and generalization. An effective way to represent complex feature relationships is through vector encoding (Churchland 1995). >Any practical applications of AGI (and certainly any real-time uses) must inherently be able to process temporal data as patterns in time – not just as static patterns with a time dimension. Furthermore, AGIs must cope with data from different sense probes (e.g., visual, auditory, and data), and deal with such attributes as: noisy, scalar, unreliable, incomplete, multi-dimensional (both space/ time dimensional, and having a large number of simultaneous features), etc. Fuzzy pattern matching helps deal with pattern variability and noise. >Another essential requirement of general intelligence is to cope with an overabundance of data. Reality presents massively more features and detail than is (contextually) relevant, or that can be usefully processed. This is why the system needs to have some control over what input data is selected for analysis and learning – both in terms of which data, and also the degree of detail. Senses (‘probes’) are needed not only for selection and focus, but also in order to ground concepts – to give them (reality-based) meaning. http://en.wikipedia.org/wiki/Hierarchical_temporal_memory http://en.wikipedia.org/wiki/Hierarchical_temporal_memory > A typical HTM network is a tree-shaped hierarchy of levels that are composed of smaller elements called nodes or columns. A single level in the hierarchy is also called a region. Higher hierarchy levels often have fewer nodes and therefore less spacial resolvability. Higher hierarchy levels can reuse patterns learned at the lower levels by combining them to memorize more complex patterns. > Each HTM node has the same basic functionality. In learning and inference modes; sensory data comes into the bottom level nodes. In generation mode; the bottom level nodes output the generated pattern of a given category. The top level usually has a single node that stores the most general categories (concepts) which determine, or are determined by, smaller concepts in the lower levels which are more restricted in time and space. When in inference mode; a node in each level interprets information coming in from its child nodes in the lower level as probabilities of the categories it has in memory. >Each HTM region learns by identifying and memorizing spatial patterns - combinations of input bits that often occur at the same time. It then identifies temporal sequences of spatial patterns that are likely to occur one after another.
- jimdanz 14y agoI just came here to thank OP for passing single_page=true in the url.
- ChristianMarks 14y agoLike maybe when you add 7 and 6, let's say, one algorithm is to say "I'll see how much it takes to get to 10" -- it takes 3, and now I've got 4 left, so I gotta go from 10 and add 4, I get 14. That's an algorithm for adding -- it's actually one I was taught in kindergarten. That's one way to add. I get 13.
- naturalethic 14y agoWake me when Chomsky finds some principals.
- cuspy 14y agoThose who argue that Chomsky singularly "pioneered" or "revolutionized" the study of formal language should thoroughly read the book "Linguistics and the Formal Sciences" by Marcus Tomalin. It is a great historical account of the development of this particular strain of formal linguistic study. Knowing more about the intellectual environment and his predecessors and contemporaries helps to erode the mythology of Chomsky as the sole revolutionary catalyst in the development of formal language theory. In fact the major principles of his classic theory of syntax can be thought of as fairly incremental developments from previous work. Many of the specific claims he is well known for had been made by others before. As for his contributions to cognitive science, I think one side of the field simply feels that he is clinging to some outmoded notions of what Bayesian modeling can achieve in terms of explanatory power. As a counterpoint, EVERYONE should read Andy Clark's beautifully written BBS paper "Whatever Next? Predictive Brains, Situated Agents, and the Future of Cognitive Science."
- jmmcd 14y ago> if success is defined as getting a fair approximation to a mass of chaotic unanalyzed data, then it's way better to do it this way than to do it the way the physicists do, you know, no thought experiments about frictionless planes and so on and so forth This is factually incorrect! For physicists, those thought experiments are absolutely essential, and we would need many, many more orders of magnitude of statistical processing of video signals in order to get close to the real-world-useful physical predictions that we arrive at through thought experiments, equations, and so on. The contrast that Chomsky is missing is that for language, the statistical processing is amazingly successful, and the thought experiment style of investigation, while productive, has not been shown useful in real world tasks like translation. For those arguing against Chomsky, none of the above means that we should abandon a theory-driven or symbolic approach to language. If Chomsky and his opponents would just recognise that they have different goals (not just different ways of approaching the same goal), we wouldn't have to have this same argument every few months.