9 ms·
Artificial intelligence systems found to excel at imitation, but not innovation
- anthk 3y ago[flagged]
- i8comments 3y agoAI systems are not like people.
- anthk 3y agoPeople collectively can act like systems.
- rambambram 3y agoBut can systems act like human beings? People calling an LLM an AI say so, but I doubt it.
- baz00 3y agoNo they don't. They create systems and act within in them. Subtle but important difference.
- tivert 3y ago> AI systems are not like people. But in my fantasies, they are!
- HPsquared 3y agoInnovation involves a lot of "standing on the shoulders of giants"... imitation is a necessary first step.
- rambambram 3y agoThe article seems to talk about the systems themselves, not the intelligent people making these systems.
- jplusequalt 3y agoI say we leave the innovation to humans.
- graphe 3y agoSave you a click. According to the article all artificial intelligence are LLMs and the biased benchmark they used got a low score.
- deleted 3y ago[deleted]
- trident5000 3y agoTraining based on a bunch of dull bickering humans on Reddit and elsewhere would produce that result.
- kayo_20211030 3y agoI'm shocked; shocked to learn that no innovation is going on at this AI establishment. Mimicry needs information, of which an AI has heaps; but, innovation needs will, of which it has none. Maybe some day, but not now.
- visarga 3y ago> innovation needs will feedback Innovation needs feedback, otherwise all ML papers would not run evaluations. Humans come up with 100 stupid ideas that fail at eval before stumbling onto a good one. Improving innovation is a matter of putting the AI inside a system that can provide feedback. Remember AlphaGo move 37? The model created feedback by self-play games, and beat all humans at Go - feedback made it really more creative than expert human players. It upturned centuries of strategy. Feedback is also similar to the scientific method. We come up with theories and then test them out. That's how science advances, by validation, not by will. Humans are not magically more capable, we just have better feedback. A few days ago there was a story "Earliest Carpenters: 476k-year-old log structure discovered in Zambia". It took so many years of feedback for humans to evolve from log cabins to LLMs. We had to discover or invent everything in the meantime, it's a slow, cultural process of feedback assimilation into language. And now that same language experiential data is being learned by LLMs, and used contextually to solve problems. Most of our intelligence is either in language or feedback. Language is just our reservoir of past feedback. When AIs will generate their own experience and feedback, which will be targeted to their weak points, they will improve and even surpass humans. Learning from your own mistakes is better than learning from other people's mistakes which might be unrelated to your issues.
- kayo_20211030 3y agoKnown feedback is already encoded in the inputs. I don't remember move 37, but I think I know to what you're referring. Playing games against itself, and remembering, meant that outcomes (i.e. feedback) were already encoded in the inputs for the next run. It had a goal - win the game - but it's hard to claim that the machine itself was wilful. The people who designed it were. But, the machine was just an incredibly effective goal-seeking instrument. The rules were clear, the goal was clear; everything was pretty constrained. Just because move 37 never happened to have been used previously in the recorded history of Go, except in the games the machine played against itself, is meaningless in a claim to innovation. It was just both novel and effective. The will sets the goal, it precedes it. The scientific method is neither here nor there. I don't understand its relevance to the point I believe you're trying to make. Theorize, test, refine or abandon. It's mechanical, except in the theorization and the decision making around refinement or abandonment. What can we imagine? and how shall we judge? Both efforts of will. Someone has to decide that shelter is a good thing, and some smart person in Zambia, a long time ago, came up with the idea and pushed it forward. That person must have wanted to do it, without prompting and without prior knowledge; at least, the first one must have. I recall Einstein's own story that he came up with the original theory of relativity by imagining what it would be like to sit on a light beam. Innovative stuff. Imagining doesn't seem very AI-ish to me. My personal view is that, right now, AI's have only memory, and that they don't have experience. Experience is the why?-part and the judgement part without an external entity establishing a goal-seeking mechanism. Maybe they'll get there. Who knows?
- anentropic 3y ago> Artificial intelligence systems found to Excel at imitation, but not innovation And they do it using the Microsoft spreadsheet software?
- topherclay 3y agoIs this one of those quirky HN automatic title edits or was this just a typo from the post author?
- syngrog66 3y agobeta test of GPT6
- solardev 3y agoThat's the Word on the street
- kevindamm 3y agoI Sheet you not, it was a PowerPoint
- thanatos519 3y agoNo, they use Excel, the Canadian chewing gum.
- danhodgins 3y agoExcel-erate your breath... or spreadsheet
- deleted 3y ago[deleted]
- vemv 3y agoOne can casually observe that LLMs quite excel at composition though: gluing together pieces of knowledge in ways no one did before (examples: a program that does X using language Y, a painting that mashes up two themes). Most knowledge workers' activities aren't innovative or imitational - similarly, we compose stuff, so LLMs are a fair competitor.
- troelsSteegin 3y ago... and our judgments of composition favor recall over precision. Which is to say that as human judges we're good at finding sense in something generated if it's plausible. We'll take a proposition (eg in a composition) and construct a justification for it. "I can see how that makes sense". I am conflating plausible combination with high recall. Precision, in this sense, is that no proposition would be acceptable without evidence or precedent. With all precision, no new idea is ok. So a "knob" for recall vs precision on a generative system would nice. Is "temperature" that knob?
- deleted 3y ago[deleted]
- b33j0r 3y agoThe very first python app I wrote was a statistical bard generator. I had python calculate word frequencies from a Shakespeare corpus and spit them back out with a probability distribution. Honestly it read just as well ;) We’re simpler than we imagine.
- Qem 3y ago> We’re simpler than we imagine. Indeed, creativity (not just randomness) is a quite high bar, that I think even most humans don't pass. Most of us don't create a lot of new things and ideas in our daily lives. We mostly follow the steps of those that came before them, with small adjustments here and there.
- b33j0r 3y ago
- vannevar 3y agoThe innovation test they use relies heavily on reasoning, something that the stock LLMs tested are known to be deficient in. Adding reasoning to large language models is an active research area (see e.g. https://arxiv.org/abs/2212.10403 https://arxiv.org/abs/2212.10403). Link to actual paper FTA: https://journals.sagepub.com/doi/10.1177/17456916231201401 https://journals.sagepub.com/doi/10.1177/17456916231201401
- k__ 3y agoEven their imitation is just superficial, at least for the prompts the average user is motivated to write. I might not be able to differentiate AI content from any human content, but I can differentiate it from high quality human content. Which is a bit sad, since AI will probably eliminate most lower end content creation jobs. This doesn't improve the state of the content industry for users, but saves companies quite some money...
- jplusequalt 3y ago>but saves companies quite some money That's all that matters to companies.
- syngrog66 3y ago"found to Excel" on a positive note: at least HN didn't use an LLM on that headline
- dwringer 3y agoKind of funny that the word was capitalized, presumably, due to imitation. [EDIT: Now changed, so this thread makes less sense, but the original headline was "Artificial intelligence systems found to Excel at ..."]
- Geee 3y agoInnovation is simply a result of trying to imitate, but adding errors. That's how humans do it. Add in some darwinism so that the best 'innovations' survive. Made a mistake in making food? Oh, that's a new recipe. Can't really remember how to tell the story? Well, that's a new story. Accidentally kicked a ball while trying to just walk? I just invented soccer. And so on.
- klabb3 3y agoPartly yes. But if you throw a million items at the wall you also have tell which ones stick. An infinite random walk isn’t useful unless you have infinite verification to determine what is promising, so you can guide your next steps and continue discovering stuff.
- hackerlight 3y ago> An infinite random walk It's not purely random. Alpha Go doesn't search random moves, it searches a subset of possible moves that are probably good. The Darwinian analogy of the GP is apt. We're not as cognitively flexible as we like to believe. We die, and our children are exposed to new training data which causes them to believe different things. That's part of how we adapt as a species. Sort of like how GPT keeps changing as it gets retrained on new data.
- BobaFloutist 3y agoDeliberate innovation is absolutely possible, I don't know why you would claim it's not.
- speed_spread 3y agoSo, James Murphy is an AI? "Yeah you wanted it smart But honestly, I'm not smart No, honestly, we're never smart We fake it, fake it all the time" - LCD Soundsystem
- gibsonf1 3y agoHow could a statistical system trained on data display intelligence let alone innovation? It's just very good statistics at the end of the day. Artificial Perception is about as far as you can get with ml/dl tech if you point the sensors at the world of space-time. If you point it at words, as with LLM, you get statistics about words - that is, no actual understanding of what the words model in the minds of the original authors of those words. So utterly unreliable for any kind of mission critical or autonomous use.
- hackinthebochs 3y agoLLMs aren't statistical systems in any substantive sense. They are deterministic programs over the input sequence. They capture statistical relationships about words, but so do human minds. That they are sensitive to statistical relationships does not discount their ability to understand.
- simbolit 3y ago> That they are sensitive to statistical relationships does not discount their ability to understand. The claim is that nothing but sensitivity to statistical relationships somehow leads to an ability to understand? I am not going to believe it.
- stevenhuang 3y agoHow do you think our brains work?
- simbolit 3y agoI don't know how our brains work. If you don't just want to be snarky: I think the difference between acquisition and learning is important, I think the role of instruction might be important, I think the role of practice is important.
- stevenhuang 3y ago
- mrangle 3y agoArguably the human-ness (or even animal-ness) of thought is, at its root, characterized as the ability abstract in a novel manner (the neurocog term for innovate). In other words, it is the ability to find patterns between two concepts that weren't, ever, prior announced. A computer that could do this would then be AI. A computer that cannot would fall short of that category, however otherwise dazzling in stitching together established patterns. A quick human, and therefore, machine test of this ability might be decoding of prior unseen allegory. How fast and accurately can a human or machine identify (abstract) any true pattern in an allegory that can be applied to another seemingly unrelated concept or story? Again, this would have to be a new allegory to the subject. Ideally, harboring a pattern that isn't discussed anywhere in training data. The AI would be held to be improved as its ability improved to decode and apply increasingly abstract or otherwise complex patterns from allegory or stories. Not that I would be, but I'm un aware of any LLM / AI progress toward that type of processing.
- corethree 3y agoLLMs can do this already. They are well past this. It's just they can't do it as well as humans and they can hallucinate as well. The problems we are having with LLMs aren't the fact that they aren't creative. It's the fact that they are too creative. They make up too much stuff that isn't true.
- mrangle 3y agoShow me where ChatGPT4 can solve for a novel allegory. That type of processing is not within the scope of its capability. Ask it. Prod it. Try to force it. It'll tell you. I like Ai. But It's important to be realistic. It can't abstract in a completely creative way from a basis of language with embedded and only-implied meta-patterns, the latter which is the nature of human cognition. I just tried asking Bing ChatGPT to solve the most rudimentary allegory: presented in a single sentence and with given three solution options. It deflected endlessly, before telling me that it couldn't solve it for the benefit of my self-growth and then signing itself off! It'll be nice when open source Ai renders these clownish interactions obsolete, but there still isn't evidence that it can begin to mimic the plasticity of human cognition. What it can do is bs a lot when it hits a dead end. Ai can match shapes, as a rudimentary part of its ability. That is a start. But what it needs to be able to do is decaode complex narrative as a shape, and then identify the same shape in other narratives and concepts. Thereby making a novel connection born out of abstract thought. Or it even might create a new model (ie: allegory) using the prior undetected pattern. As high IQ humans do, subconsciously and sometimes consciously.
- licomo 3y agoAs a human, I often find innovation harder than imitation as well! * I do love trying to innovate, and it feels so good when it's a success!
- MeImCounting 3y agoAs I see it the AI schism is more about the debate between functionalism/computationalism and the idea that the chinese room thought experiment was an argument for, "biological naturalism". There is a lot of effort dedicated to showing that AIs dont have some innate quality called "consciousnes" or "sentience" or what have you. There is not just a lot of effort to show that, but also to show that that is somehow a limitation to the capabilities of an "AI". Personally I think "consciousness" or "sentience" or whatever you want to call it, is really not that useful in making logical decisions or solving engineering problems. It is certainly a useful trait to humans but if nobody can tell that the person/program in the chinese room doesnt actually "understand" chinese then why does it matter? If it walks and talks like a duck you can probably use it for whatever ducks are useful for.
- corethree 3y agoConsciousness and sentience are just poorly defined vocabulary that delude people into thinking it's meaningful categorizations. There's just a bunch of traits related to intelligence and we categorize that if something has enough of those traits then it's "alive". But the words "consciousness" and "sentience" are so poorly defined that we can't pinpoint the formal grouping of what these traits actually are. So for a person to be conscious one can say the person must have feelings, another definition could be no emotions needed but the ability to reason is required... Etc.. etc. First up these definitions are just arbitrary categorizations. We each individually choose the traits that define the word consciousness, and second we don't even formalize the choice we sort leave the words impartially defined and all debates on whether LLMs are conscious are simply debating about this impartiality. It's a debate about a vocabulary issue for a word that isn't fully defined and people don't realize there's nothing profound or meaningful about the debate at all. These words are everywhere in the English language and causes us to debate certain concepts as if it's meaningful without us realizing we are just debating a vocabulary problem. Take for instance a car and a boat. These words are less fuzzy and more rigorously defined so debates on whether something is a car or a boat don't seem that profound. But the words are fuzzy enough that I can generate an example to help you see my point. Let's say I built something that can both drive and sail on the water. Is that thing a car or a boat? Is that question meaningful or is it just a categorization problem with inadequate vocabulary leaving me unable to specify exactly when an object classification transitions from boat to car? From this example it becomes evident that the debate is ludicrous that it's all an illusion. You are debating vocabulary. For words that are more fuzzy the same problem exists. But it's harder to see that it's just a vocabulary problem because the words are so fuzzy. Take for example, what is life? Is a bug alive? Is a plant? Or what is philosophy and what is not philosophy? Or what is good and what is evil? The discussion around all these issues are not profound. They are simply a discussion around vocabulary and categorization. We are too deluded by language to move past it. Many concepts exist as a gradient and we are simply trying to discretize this gradient into fixed categories and then spending an endless amount of time debating on where the lines of demarcation goes. So are LLMs conscious? It's loaded question. Let's not talk about vocabulary.
- panarchy 3y agoWhy would a system (LLMs in this case) designed to produce the most likely next output be innovative? A truly innovative AI would probably hallucinate or produce so many nonsensical outputs as to be deemed useless and broken.
- corethree 3y agoGot a question for people who know this stuff well. Let's say I have a generic feed forward network the size of chatGPT and structurally interconnected in the same way. Does there exist a set of weights for that network that will essentially represent the LLM that doesn't hallucinate and is similar to the perfect ai assistant we are all currently striving towards? My question is, that is it essentially a training problem?
- anon291 3y ago> In one task, for example, participants were asked how they could draw a circle without using a typical tool such as a compass. This is a completely useless question. LLMs are trained only on language. Humans are trained both on language and on physical activities. The LLM has no conception of 'drawing'. It cannot draw. Its inputs and outputs are tokens. Humans can draw. A better question would be to ask it to compose stories... something it's trained on. In particular, it would seem to me that a multimodal model trained on both action, sensory information, and language, would be better able to innovate in this regard. How could ChatGPT have any true understanding of spatial responses... it's never moved anything in its existence.
- marcosdumay 3y agoWell, you mean the systems designed to predict the next words based on analysis of the text they were feed excel at imitation?! We have plenty of AIs designed to create new things. Those excel in creating new things. But they don't excel into bullshiting journalists into believing they are intelligent, so you don't hear about them.
- mrtksn 3y agoIMHO The perceived lack of creativity comes from their low fidelity access to the world. They are trained on text and images which loosely captures the world and then their output is also limited to text and images. Once the machines have high fidelity connection to the world, for example a machine with microphone, camera and ways to manipulate objects resides among humans they will be actually trained and generate output on much higher spectrum. Human's creativity comes from continuous observation as they mess with the world. Once the machine is in that position, I fully expect tho have human like and even beyond creativity.
- carabiner 3y agoThat's the PowerPoint of AI though... replacing all of the computer manual labor.
- Nekorosu 3y agoPardon my superficial understanding, but how'd it innovate if it tries to get the most probable result or energy-spending efficient result, which feels like the opposite of thinking out of the box?
- seeingnature 3y agoYou've got it backwards. The article claims that the AI does not have a tendency to innovate, specifically stopping when it doesn't have the most probably result at hand.
- westurner 3y agohttps://news.ycombinator.com/item?id=12999516 https://news.ycombinator.com/item?id=12999516 : "CogPrime: An Integrative Architecture for Embodied Artificial General Intelligence" (2012) > "Competencies and Tasks on the Path to Human-Level AI": https://wiki.opencog.org/w/CogPrime_Overview#A_CogPrime_Thought_Experiment:_Build_Me_Something_I_Haven.E2.80.99t_Seen_Before https://wiki.opencog.org/w/CogPrime_Overview#A_CogPrime_Thou... : > [Perception, Actuation, Memory, Learning, Reasoning, Planning, Attention, Motivation, Emotion, Modeling Self and Other, Social Interaction, Communication, Quantitative, Building/Creative ] http://wiki.opencog.org/w/CogPrime_Overview#Competencies_and_Tasks_on_the_Path_to_Human-Level_AI http://wiki.opencog.org/w/CogPrime_Overview#Competencies_and... And then, "A CogPrime Thought Experiment: Build Me Something I Haven’t Seen Before"
- westurner 3y agoFor the arts, On creating something sufficiently novel, EDA tools solve part of the problem in chip design, for example; furthermore sometimes with logic instead of imitation. Will any LLM ever output a formally verified design and implementation without significant tree filtering, Even if trained solely on formally verified code? Synthesis without understanding, and worse without ethics.
- zubairq 3y agoAgree with the headline
- raymondh 3y agoWhat counts as an innovation is in the eye of the beholder. Mark Rober demonstrated Gemini's creative ability by having it suggest a video, details of contents, and how to produce it. The results were impressive but far from world changing: https://www.youtube.com/watch?v=mHZSrtl4zX0 https://www.youtube.com/watch?v=mHZSrtl4zX0
- natpalmer1776 3y agoI would argue that just because it can suggest a new video with all the fixings does not necessarily mean that it is being innovative in the sense that the concepts produced would in some way alter the 'state of art' at a cultural level.
- digitcatphd 3y agoI suspect that is temporary... V1 was an imitation engine, V2 is a reasoning engine. If it develops a world model and general understand about what humans like, a metaphysical understanding of it, then innovation is easy.
- atleastoptimal 3y agosame with 99% of humans
- gwern 3y ago"In the next stage of the experiment, 85% of children and 95% of adults were also able to innovate...Effective tools were selected...75% by the best-performing model." "AI lacks the crucial human ability of innovation, researchers at the University of California, Berkeley have found." It says a lot about how we evaluate AI these days, and how we move the goalposts at hypersonic speed, that the summary of benchmarking this astounding leap in AI capabilities is 'AI unable to innovate, only imitate' instead of 'AI goes from zero to near-human level in just a few years, no limit in sight'. When it comes to DL, if the glass is even 1% empty, then it 'lacks the crucial property of having contents', I guess...
- onos 3y agoThere’s plenty of content lauding ai. When initial goals are met is it not a good time to set new ones?
- 1vuio0pswjnm7 3y agoWhy would anyone think "AI" would excel at innovation. Honest question. Innovation is defined as "introducing something new". "AI" is autocomplete and autoselection based on _past_ input. "AI" is regurgitating, rehashing or recombining something that has come before. It might do this in a new (=yet untried) way, but it cannot "introduce something new". Only man can do that. Make no mistake, recombining can be useful. With AI we can screen a large number of possible recombinations that would be practically infeasible without it. But the only way something new can be "introduced" is for man to produce new data for "AI" to process. "AI" is always one step behind. There is no way for "AI" to have "new thoughts". All "thinking" by AI is always just regurgitation, rehashing or recombination of man's past thoughts.
- hnfong 3y agoIn a deterministic physical world, all actions are based on the last state. So your actions are based on the state of the universe a split second prior. Why would you think anyone could innovate? (Ecclesiastes 1:9 - What has been will be again, what has been done will be done again; there is nothing new under the sun.) By now I'm quite surprised people haven't realized most of their arguments about fundamental limitations of AI apply to themselves as well.
- DrSiemer 3y agoThe current generation of language models is only rewarded for how well it can mimic human communication. There is no incentive for innovation. Give it a few generations and we'll add that. A current model could already run a chain of "what if" scenarios and grade the results for how unique and how beneficial they are. Supercharge that and you'll probably end up with something useful. Everything is a remix.