12 ms·
Cargo Cult AI
- deleted 3y ago[deleted]
- okasaki 3y ago[flagged]
- andsoitis 3y ago> Neither can the vast majority of humans Many can and do.
- KaoruAoiShiho 3y agoThat's what we're currently building now for AI. It takes vast investment to get there but the foundation blocks of LLMs make the target in sight.
- andsoitis 3y agoIt will indeed be interesting to see whether our intelligence can build something that is, or can evolve itself, to be as intelligent or more intelligent than our intelligence!
- SkyMarshal 3y ago> Remember when the superiority of man was his ability to create art? Nope. Are you straw manning here, or was that really a thing?
- rsynnott 3y agoNot in real life. It was a really common theme in sci-fi, though; Data on Star Trek TNG could manage logical reasoning but not painting, say. This is more how we imagined we’d be superior to a non-existent form of AI (the Asimov/Star Trek style) than anything to do with LLMs.
- ben_w 3y agoHuh. I'm still reading and hearing the claim that AI can't create art, no matter how good the output, because they can't feel the pain or joy that inspires it in humans. Basically the same argument that predates the Turing test, and which Turing quoted in the paper where he described the test: - """Not until a machine can write a sonnet or compose a concerto because of thoughts and emotions felt, and not by the chance fall of symbols, could we agree that machine equals brain—that is, not only write it but know that it had written it. No mechanism could feel (and not merely artificially signal, an easy contrivance) pleasure at its successes, grief when its valves fuse, be warmed by flattery, be made miserable by its mistakes, be charmed by sex, be angry or depressed when it cannot get what it wants.""" - Off-print, ‘The mind of mechanical man’, The Lister Oration delivered at the Royal College of Surgeons of England on 9 June 1949 from the British Medical Journal, (Vol. 1, 25 June, 1949)
- emmender1 3y agoa very small percentage of humans make big advances. think euclid, newton, einstein. the rest of us squawk memes on hacker news. calculators can do better on arithmetic than all humans, does that make them smarter ?
- javajosh 3y ago>Despite our self-proclaimed intelligence, humans are apt to believe remarkable fallacies based on a paucity of correlated information rather than rigorously seek to determine causal foundations. Hey! I thought we're not supposed to get political on HN!
- 26fingies 3y agohonestly the LLM stuff is pretty neat but im way more excited about how good ML has gotten for things like signal processing and superresolution.
- fergal_reid 3y ago>Today's AI models are missing the ability to reason abstractly, including asking and answering questions of "Why?" and "How?" This claim seems over general, because you can ask gpt-4 'Why' and 'How' questions and it seems to do a pretty good job. The author doesn't provide a lot of contrary evidence. There's so many articles saying "LLMs can't do X" that leave me wondering whether the author has even tried. Maybe they've tried and have some more sophisticated argument, but I often don't see it. If I was going to knock LLMs for being unable to do basic science, in particular, I'd make sure to do some experiments first!
- famouswaffles 3y agoThe problem is that today's state of the art is far too good for low hanging fruit. There isn't a testable definition of GI that GPT-4 fails that a significant chunk of humans wouldn't also fail so you're often left with weird ad-hominins ("Forget what it can do and results you see. It's "just" predicting the next token so it means nothing") or imaginary distinctions built on vague and ill defined assertions ( "It sure looks like reasoning but i swear it isn't real reasoning. What does "real reasoning" even mean ? Well idk but just trust me bro")
- timmytokyo 3y ago>There isn't a testable definition of GI [...] This to me is the fundamental issue in discussions and debates about LLMs. Despite assertions by some psychologists (who themselves are practitioners of perhaps the fuzziest of "sciences"), intelligence is an entirely nebulous concept. Everyone means something different when they use the word. I can think of no better illustration of the problem than the authors of the "Sparks of AGI" paper resorting to a definition of intelligence presented in the Wall Street Journal of all places. That the WSJ definition was part of an editorial defending the Bell Curve is just the cherry on top.
- janalsncm 3y agoDo you know what their definition was by any chance? And yes, a cursory glance at the Wikipedia page for intelligence shows there’s no one agreed upon definition of intelligence. A more useful framing is to say we’re not creating “intelligence” per se but automating tasks. GPT4 is an automated writer. Stable diffusion is an automated image creator. Alpha Go was an automated Go player. Google search automates the work of a reference librarian. With that in mind, it’s immediately obvious how much of a waste of time it is to argue whether ChatGPT is “intelligent” or not. Who cares. What we are doing is automating all of the things which brains used to do.
- Barrin92 3y agoRather than going into these strange discussions about the scientific method, nondeterminism and philosophical debates I'm still scratching my head when language became synonymous with AGI. Forget all this highbrow stuff, my still intact test is, can something walk into any random house on the street, plumb a toilet and brew a cup of coffee. Moravec was right in the 80s when he pointed out that the easy things are hard and the hard things are easy. Simulating human cognitive abilities primarily exists to satisfy human testers, it doesn't say much about general intelligence.
- grandmczeb 3y ago> can something walk into any random house on the street, plumb a toilet and brew a cup of coffee. Stephen Hawking would have failed this test.
- danielbln 3y agoI would fail that test, you'd end up with a pretty good coffee and a still broken toilet, yet I consider myself generally intelligent on most days.
- Barrin92 3y agoI'm not sure if that's a quip or a serious point but that is because Stephen Hawking in old age lost that capacity, not because he principally lacked it. ChatGpt et al did not walk around last week and are now suffering from robot ALS because there servers have too much dust on them, they just lack that modality altogether (like any other apart from generating text)
- pixl97 3y agoLanguage has become synonymous with intelligence, not only in AI, but just regular I. It is a means of transferring information from a source to a sink. If the sink is intelligent it will be able reconstitute the ideas that were transferred too it. We consider animals less intelligent because almost none have the ability to transfer intelligence via some other medium. You're also hitting on a problem with the word intelligence and the fact it's about all encompassing as the word universe. There is cellular intelligence encoded in RNA and DNA. There is multicellular intelligence between organs and different components. There multiple layers of the mind, one part for organs and constantly running system, one for locomotion, and another for abstract thinking. Trying to lump this as one thing makes it very difficult to understand the capabilities of a system. Also, you're not paying much attention to LLM enabled robots these days. For example some of Google's larger robot models can travel into a room they have not seen before and look in cabinets for an object they have not seen before and successfully find it. Not a good time to be in denial about evolving robotic capabilities.
- skybrian 3y agoThere’s a different model of chatbot interaction where the AI provides hints that may be wrong, but they’re helpful, because you consider solutions that you didn’t think of yet. This doesn’t require intelligence. The Oblique Strategies card deck does a similar thing, and you’re drawing randomly from a deck of cards. AI-provided hints are considerably better guesses than a deck of cards can give you. When writing code using GPT4 and Code Interpreter, it often guesses right the first time about what the bug is in some code. Other times it will guess wrong, repeatedly, so I need to undo and tell it more specifically what to do. Does GPT4 understand trigonometry? I went back and forth on this. Yes, it does! But no it doesn’t, it just got lucky. But yes, it does, if you ask it to explain the math first. But no, it doesn’t, it got lucky again. What seems clear is that it “understands” context very well. It will make guesses that are entirely appropriate when writing code that does calculations using trigonometry. It will come up with plausible explanations, given that we are doing trigonometry. They still seem to be guesses, though. In the short term, AI chatbots don’t learn, cannot learn, because they implement a pure function. When you start a new chat, the state is reset. Instead, we learn to give them better context and get better results. The learning is in the prompt engineering.
- bloopernova 3y agoI feel/think[1] that when AGI happens, it will be so alien to us that we won't recognize it. There will be a "that's... odd." situation in science and maybe years later will we realize what we had/have. As the article states, there's no understanding, "just" a regurgitation of sufficiently-trained language (which is utterly astonishing, don't get me wrong). So how does an LLM-AI turn into an AGI? Can it? Should it? How do we tell? What should be a 21st century Turing Test? Perhaps giving an AGI-candidate a novel situation and seeing how it reacts. I think that trying to apply a rigorous scientific method to such a test might end up being as "messy" as psychology is viewed as being today. It would be quite gratifying if we really did need Asimov's Susan Calvin to tell jokes to Johnny 5! I also find the prospect of an utterly incomprehensible AGI really interesting in that maybe intelligence isn't only possible via a big messy blob of neurons soaked in a chemical soup of weirdness. Maybe there's a regimented, strict path towards an intelligence that surpasses us in every way? Does anyone else think we'll be unable to recognize AGI when we see it? [1] A little column a, a little column b[2]. It's a gut feeling. Will AGIs have guts? [2] Aren't footnotes great? I still think HN needs more markdown support, but I wouldn't want to be the one to implement it!
- rmilejczz 3y agoI think the logical conclusion to all of this is that our own intelligence is not some kind of special magic. It’s easy to see it that way, and I think that will make people mostly incapable of accepting something as being AGI. I’m sure some folks will recognize it ahead of others, but most will fail to see it or it might be better to say many people will be incapable of seeing it.
- LegionMammal978 3y agoAs I see it, the problem with that is that "a sufficiently unrecognizable AGI does not exist" is the unprovable null hypothesis: anything in the past or present could contain an unrecognizable AGI, since by definition we wouldn't have recognized its influence. For instance, how would one go about proving that there's no unrecognizable AGI in the otherwise-banal GPT-2, that would make itself apparent if only we found the right prompts? In the absence of any hard negative answers, we're left to try to empirically glean the answer to the not-AGI vs. AGI question for each model by poring over the text outputs as we understand them, arguing endlessly over how much is "regurgitation" or "pattern-matching" and how much is "original thought".
- melvinmelih 3y agoYou can consider all of humanity's knowledge in the aggregate to be our biological version of AGI. Sure someone's invented LK-99 in South Korea, but that's now been added to our collective human knowledge within hours of sharing. For AGI to compete with that it would have to have the equivalent compute power of 8 billion independent agents who can collaborate with each other to achieve a certain goal. It's not going to be easy to beat that with a singular system.
- frankreyes 3y agoI had once the experience of talking with someone who did a machine learning neural network model, to fit a linear polynomial function. f(x) = mx + b When I showed my simpler approach they were confused... What do you mean by linear polynomial function?
- firesteelrain 3y agoPut aside for a bit that ChatGPT is or isn’t AI- It is pretty good at what it does. Why can’t people just appreciate that? I have found it really good at brainstorming, generating code, outlining, rephrasing on command various text, etc.
- creata 3y ago> Why can’t people just appreciate that? Because money sucks the joy out of everything? * There's a lot of money in LLMs right now, and people are desperate to find new and profitable uses for them. * Separately, there are a lot of people who feel that their job might be made redundant by LLMs.
- dinvlad 3y ago> pretty good at what it does. Why can’t people just appreciate that? I tried very hard to make it work, and it’s a frustrating experience every single time. I cannot understand how people can consider it to be “good” if they cannot trust its output, unless by “good” they mean “entertaining”. It’s like we’re living in two completely different realities, where some folks appear to get something useful out of it, while others just don’t, no matter the amount of effort. Maybe our standards/expectations are just vastly different, I don’t know. I’d really like an ELI5 on it.
- firesteelrain 3y agoIt’s all in how you prompt it. I had it design an entire process for handling multiple Azure tenants, plans and offerings. It gave suggestions on how to secure the shared services vnet and peer them to the tenants. I find it useful. I have even had to generate code. Fairly accurately too (it even compiles and works)
- dinvlad 3y agoHave you tried generating Arm templates too? I think my attempts were unsuccessful. What I have consistent troubles with is it losing the context as I try to guide it through something. And as I try to fix some mistakes, it fixes them and introduces others at the same time. Not sure what I'm doing wrong. This process ends up being so time-consuming and frustrating that it's faster for me to just find some good examples using the new (and awesome!) GitHub search.
- nicechianti 3y ago[dead]
- GMoromisato 3y agoThe article does a sleight of hand when it conflates the output of Science, which is performed by millions over centuries, with the ability of one person or an AGI to create scientific models. Moreover, I think it misses the true novelty of LLMs. One ancient debate in AGI (greatly simplified here) is whether intelligence can emerge from brute force computation alone (statistics) or from sophisticated algorithms (logic). I certainly started on the logic side. For example, it seemed that if we could create an algorithm or data structure to encode (and retrieve) arbitrary knowledge, then we'd be well on our way to intelligence. Thus all the work on logic programming, symbolic representations, and efforts like Cyc. But by the time Deep Blue beat Kasparov in NYC--something that many people thought impossible--there was evidence that brute force computation was enough. Chess is a great example because humans do not play chess like Deep Blue does. Humans play chess by pattern matching and not by exhaustively generating move trees (brute force). For a while it seemed like true intelligence depended on pattern matching, and that brute force was a neat parlor trick but ultimately a dead-end. But LLMs are brute force pattern matchers. Instead of encoding the rules of grammar, we just feed it a trillion tokens and let it find the patterns. The amazing thing is that you can get intelligent behavior and even creativity just by pattern matching. In fact, think about what creativity is. Creativity is coming up with novel solutions satisfying certain constraints. How do humans do that? Individually we do it by coming up with lots of different solutions (sometimes only as fleeting thoughts) and testing them to see if they satisfy the constraints. Even when humans get a "flash of inspiration" it's often because their subconscious is busy testing various ideas. Collectively, humans invent and discover by having the best ideas, the best art, the best scientific models, win in the competitive marketplace of ideas. But it's still just trial and error. I think that's the genius of the scientific method: that it takes many ideas--some good, most bad--and keeps only the best. But it's not magic. It's just a process. In my opinion, the article is using old arguments against AGI ("computers cannot be creative") exactly when LLMs are exhibiting the very traits that they say can't exist. LLMs are absolutely exhibiting "creativity". Maybe they are only as creative as an average human and not a genius. Maybe they're only as creative as a five-year-old. LLMs are forcing us to confront the fact that intelligence isn't some magic force or elusive unobtanium--it's just the product of brute force pattern matching. It's like when Copernicus postulated that the Earth is not the center of the universe. It's bound to upset people.
- abeppu 3y agoWhile I think there are a bunch of legitimate reasons to be skeptical that LLMs are going to turn out to be the primary ingredient of AGI, I think this take is just a bit off the rails. You don't get to hold up Newton and Kepler etc and say that their level of scientific insight is the bar for "intelligence" unless you're willing to say that almost all humans, who have not extracted some beautifully simple and concise mathematical rule underpinning the noisy data of our experience, are not intelligent. Feynman, in his original cargo cult speech, pokes holes at broad sections of academia in saying they aren't sufficiently scientific, including a physics example where an experiment is compromised by re-using data from a different apparatus b/c they couldn't get accelerator time for the "boring" half of it. Are all the physicists involved not "intelligent" because they don't rise to Feynman's high standards? There are lots of good questions to ask about LLMs, reasoning and intelligence -- but this really seems like it's just goal-post moving to "intelligence is what's displayed by the very best scientists, not 99.999% of humans."
- samstave 3y ago[flagged]
- oefnak 3y agoNo offense, but I have no idea what this comment is supposed to mean. Is this an example of random nonsense, or is it me?
- samstave 3y agoThanks, I failed to relay the following: Color code every container for the things they are transporting. WhenI worked at Lockheed, we built traffick tags to determine if crates were tampered with, or had nuclear materials in them - if they were cut open, etc... What I am saying is that this model didnt work well (for dark reasons you dont want to know about) but a fundamental thing would be to have the most strident laws on [if container is THIS color, then it MUST be of THIS cargo type, ELSE ; PENALTIES) Its FN simple. But human trafficking and other trafficking is the sole reason why not. GTFO with ANY rebuttle
- Netcob 3y agoI'm not sure what point the part about nondeterminism is making, but I would be very curious how much of a chaotic system the brain really is. I think many of us would like our consciousness to be rooted in quantum noise, where it's possible to imagine ourselves having "free will", whatever that is, or anything that doesn't make us completely deterministic machines with a helpless observer. Unfortunately I can't find any evidence of that, but I do know about people who suffered the loss of all but their short-term memory, and they react so predictably to the same sensory inputs (even with some variance in the input) that it's spooky. Using current LLMs as an example, you could argue that they are a lot more nondeterministic than humans as it's normal to add some "random" values iirc.
- Lichtso 3y ago"The opposite of free will is not determinism or coercion, it's compulsion" - Joscha Bach Joscha Bach argues that nondeterminism would not sustain will at all, because it is all unguided randomness. Only determinism can lead to order and structure of will. The "free" as in liberated part is the way more philosophically involved one. Anyway, I don't think that the notion of "free will" is even interesting, the question should rather be does it (AGI) have agency?
- deleted 3y ago[deleted]
- AtNightWeCode 3y agoI fail to see how these issues really matters. My issues with LLMs is that there is no score to tell the quality of an answer. The second thing is that it adds cognitive load and noise. In automations that might be fine but tools like Github Copiliot are more problematic. Once I got rid of it my dev speed clearly went up.
- ReptileMan 3y ago>>Today's AI models are missing the ability to reason abstractly, including asking and answering questions of "Why?" and "How? So are majority of humans it seems.
- lewhoo 3y agoIt's a catchy phrase but my experience with children is that "why" and "how" is painfully frequent in their vocabulary. So as far as asking those questions I think every healthy human mind is capable and does pretty frequently (at least at some point of development). Answering is a different matter.
- ReptileMan 3y agoYeah but after 15years of the prison industrial complex known as school and 15 more in working bullshit job 9 to 5 they have it thoroughly beaten out of them
- rhuru 3y agoI once boarded a small 8 seater plane in Alaska and joked with the pilot if there would be an air-hostess serving drinks. He said no but he said he won't weigh my luggage before it is put in the card. A lot of LLM criticism is like that joke. People seem to complain too much about LLM not being what they want it to be without realizing that they are indeed much better than what we could have built 20 years ago. If LLMs can be proven to add economic value that is good enough. They are in themselves useful with all their limitations. If they are profitable people will invest more in them and over time we will have better understanding of AGI and other aspects of intelligence.
- deanCommie 3y ago"Add economic value" is the crux of the problem, don't you see? If it increases the GDP by 5%, but the result is a massive redistribution of wealth to the infrastructure holders at the expense of millions of people losing their livelyhood is that worth it? You don't have to answer, most of HN would say yes because we (including me) are part of the class of people that will also benefit as society's demand for technologists continues strong. And there is also the argument that all of this has happened before with every technical revolution - from the cotton gin to the car to Excel. So this is where the question of LLM's true capabilities becomes essential. Because if everyone approached them cautiously and adopted use cases gradually and increased individual people's productivity, before realizing that in time whole jobs would cease to be essential - no problem. But instead - and we've already seen this happen with ML and customer service - whole industries are eager to absolutely decimate their fixed human costs - and all their flaky human problems - to replace them with LLMs, and let the chips fall where they may. THIS is why so many people are pushing back to challenge the true utility of LLMs and not over-inflate their capabilities. Because we can see the inevitable wave that will make society and technology worse for consumers, and worse for most of the employees in the short term. It will be better for the "Economy" (as measured solely by GDP), and will make some new millionaires and double up some billionaires. But my (and others') claim is that it will not create a better world for humanity. And it may decimate artistic creativity for a generation before we recover. Parents already see it as terrifying to figure out how to teach children to handle all the HUMAN-generated misinformation over the last decade. It's only going to get worse when it becomes machine-generated.
- bbor 3y agoHow much more improvement can really be eked out of this approach on the pathway to AGI, and is it really sustainable? Ah yes, the old “criticism via rhetorical question” tactic.
- alehlopeh 3y agothe old “criticism via quoting a single sentence from a much larger piece” tactic
- bbor 3y agoIt is worth noting the major difference between two types of models: those used in AI and those encountered in theoretical physics. THIS drives me more than a little crazy. Scruffies vs Neats, stochastic vs symbolic, cognitive vs connectionist, whatever - name the two main AI camps what you want, but naming them “AI” and “physicals models” makes me irrationally frustrated lol
- sergiotapia 3y ago>Today's AI models are missing the ability to reason abstractly, including asking and answering questions of "Why?" and "How?" Doesn't matter really, even with this limitation AI models today can produce extraordinary value for businesses. AI's are useful today. I don't see how this is even contested, when it's empirically true.
- natch 3y ago>Today's AI models are missing the ability to reason abstractly, including asking and answering questions of "Why?" and "How?" But today's models do ask and answer those questions. The author may be confused by the fact that the UI of most systems is currently set up to be driven by human prompts, but this is nothing to do with the nature of the AI model; it's more of how the system is integrated into its environment. We can easily choose to give these systems their own initiative, with much (even) simpler programming than was required to make the AI models in the first place. We can get into a semantics argument about whether it's the AI model that has the initiative, or the runloop driving it, but that's missing the point that what matters is the total effect of the entire system, not whether you can point to some subcomponent of it and say that component by itself doesn't meet the definition of whatever term (consciousness, reason, etc.) you are gatekeeping.
- potbelly83 3y agoThere's been a lot of discussion in these comments regarding the author's definition of intelligence. What I haven't seen people address is the author's correct (in my opinion) criticism in the amount of data needed to train these LLMs versus what the human brain of a child is exposed to. Unless of course part of a child's knowledge is passed down through DNA/RNA/...
- jamilton 3y agoIt's true, and it is a weakness of LMs relative to humans, but it's kind of obviously true and something that's being actively pursued as a topic of research, so it's not a remarkable criticism. It's also kinda apples-to-oranges - a human child also has thousands of hours of other rich sensory input. Multi-modal models are not as well-developed as LMs.
- richk449 3y ago“I have recently taken to asking candidates who interview with me for research positions whether it is possible to hear the shape of a drum. This seemingly innocuous problem was posed by mathematician Mark Kac in 196612 and stumped the mathematical community for several decades. The quick answer I am often given is, "Yes, of course hearing a drum's shape is possible. All that is needed is a sufficiently large dataset of sounds associated with drumhead shapes (for supervised learning) or indeed even without association to the shapes (for unsupervised learning) and use of an effective training algorithm and validation methodology. Once a model has been trained on the data, it will infer the shape of a drum from any recorded spectrum it is given." This answer is wrong, and it is the reason Kac's famous question merits being revisited in the context of today's AI to solve complex problems. In the 1990s, mathematicians finally proved that it is, in fact, not possible to hear the shape of a drum, or at least not uniquely.9 This is because drumheads exist of different shapes that produce exactly the same sound, or in mathematical terms, are isospectral.” That seems entirely unfair. The question is if you hear the shape of a drum. The actual answer is yes. But he says this answer is wrong, because you can’t uniquely hear the shape of the drum. I’m trying to decide if this goalpost moving is a better metaphor for this full piece, or for much of the analysis of AI in general.
- conformist 3y agoI think this is a relatively weak argument, because in colloquial English “the shape” sort of implies uniqueness in the question?
- richk449 3y agoI don’t think so. Can you tell the shape of a vase by looking at it? Would you say “yes” or would you infer that the speaker was asking if you could distinguish all unique vases from one another by looking at them?
- conformist 3y agoYes, like, all uniquely shaped ones?
- richk449 3y agoThe author uses the example of Kepler and Newton to claim that NN based AI can’t generalize like humans can, so it can’t become a AGI. Was Urek, the first caveman able to generalize a physical theory of orbital motion when he looked up at the sky? It took humans millions of tries and hundreds of thousands of generations to come up with Kepler. Why does he give up on NNs so quickly?
- ilaksh 3y agoOne issue here is the term AGI never had a specific meaning and has become even more fuzzy in it's use. Obviously, LLMs are a specific type of AI that do not emulate many of the characteristics and capabilities of animals like humans. However, they absolutely do have general-purpose applications and the leading edge ones can reason, although in some ways not quite as robustly as some humans at this time. But one core aspect of "AGI" used to be distinguishing general purpose versus narrow AI. GPT-4 clearly has general purpose utility. So part of what has happened has just been goal post moving. The other aspect of it is a failure to recognize that there are a variety of cognitive abilities or characteristics that go into animal (human) cognition rather than just one thing. LLMs simulate some of the language abilities but not other things like stream of subjective experience tied to high bandwidth sensory experience, emotions, certain types of very fast adaptation, properties of life, self-preservation and reproduction, advanced spatial and motion systems, etc. There are a number of cognitive characteristics that animals and/or humans have which are entirely missing from LLMs. However, again, it's clear that LLMs, multimodal LLMs, and similar systems, do have general purpose application in a way that many may have previously assumed only a more complete emulation of a human would require. Within a decade or two, when we have hyperspeed superintelligent AI, we may find out the hard way (and maybe too late) that not having all of those animal characteristics in AI systems was a _good_ thing.
- pixl97 3y agoWe need some kind of set theory for describing both human and AI capabilities so we can classify their differences as time goes on. For example if we say ( AI != Human ) it's both obvious and useless as saying ( John != Bob ). If we were comparing John and Bob it would be easy for most people to see the differences, we would use our internal understanding of being a human and make a list of differences. Bob is tall. John is athletic. Bob is good at math. etc. How do we do this with AI, and will producers of AI perform valid tests and publically release them? Defining in a more scientific method of the differences between human and AI should at least help us some as these thing progress.
- valine 3y ago> Today's AI models are missing the ability to reason abstractly, including asking and answering questions of "Why?" and "How?" I’m convinced the author has never used an LLM before.
- dang 3y agoCargo Cult AI - https://news.ycombinator.com/item?id=35991362 https://news.ycombinator.com/item?id=35991362 - May 2023 (174 comments)
- nologic01 3y agoImho LLM's are just a least-square algorithm on steroids [0]. Their conceptual inventor is arguably Carolus Fridericus Gauss (30 April 1777 – 23 February 1855). In any case, if he would somehow reappear today he would immediately grasp how they work despite skipping a few centuries. Assuming he would not be promptly hired by some FAANG to boost their AI prestige, he would likely proceed to sharply criticize the cargo cult AI movement. He would invent a few new classes of neural networks for breakfast but crucially, he might construct a meta-theory about how, when and why something based on least-squares can convincingly fit the structure of a corpus of human generated information artifacts. The article does a good job to review of the various loose arguments [1] which point to the vast difference between human intelligence and least-square type models. It is unlikely to move the debate forward though. AI "ultras" have developed a sophistry that negates any intelligent discussion. It consists of repeating ad nauseam: the brain is an input-output machine that learns on data, software is an input-output machine that learns on data, ergo, software = brain, and ergo, it is only a matter of (unspecified) time before super-software becomes super-brain. [0] This stance does not reduce their utility, it just removes the metaphysics [1] They are loose because we know so little about how the higher functions of the brain come about and work. E.g., when Gauss invented the least-squares method something remarkable happened in his brain that is unlikely to have much to do with least-squares. The fact that not every human is Gauss does not mean that this capability is not innate and latent in the structure of all human brain.
- semessier 3y agonot sure about this article despite ACM, it's a little a johnny-come-late trying to take measure of something without real grasp. Disqualifier includes that the number of parameters in a NN is not equal to connections, but commonly to connections plus a bias scalar for each node. A NN is not a function, it's characterized as functioning under the universal approximation theorem approximating functions. Finally, as a author one could have actually typed in what's being reasoned about into the Chat-GPT under a 'construct your answers scientifically, ask yourself why and how prior to answering and incorporate the why and how in your answers' as a pretense prompt. The transcript in https://chat.openai.com/share/73210b2e-d57f-44b4-a4ad-24e9fe13a1ab https://chat.openai.com/share/73210b2e-d57f-44b4-a4ad-24e9fe... is quite contrarty to the letter's argument.
- csomar 3y ago> Today's AI models are missing the ability to reason abstractly, including asking and answering questions of "Why?" and "How?" The author lost me here. GPT-4 regularly asks me these questions, or sort of. This depends on your prompting. GPT-4 can understand when you are approaching a problem from the wrong side, and suggest a different and more correct approach. The problem is the default prompting. GPT-4 will be biased by your prompt and tries to go along with it even if it internally ("knows") or has biases against it.