8 ms·
The LLMentalist Effect
- zahlman 2y agoOriginal title (too long for submission): > The LLMentalist Effect: how chat-based Large Language Models replicate the mechanisms of a psychic's con
- JKCalhoun 2y ago> 1 The tech industry has accidentally invented the initial stages a completely new kind of mind, based on completely unknown principles... > 2) The intelligence illusion is in the mind of the user and not in the LLM itself. I've felt as though there is something in between. Maybe: 3) The tech industry invented the initial stages a kind of mind that, though misses the mark, is approaching something not too dissimilar to how an aspect of human intelligence works. > By using validation statements, … the chatbot and the psychic both give the impression of being able to make extremely specific answers, but those answers are in fact statistically generic. "Mr. Geller, can you write some Python code for me to convert a 1-bit .bmp file to a hexadecimal string?" Sorry, even if you think the underlying mechanisms have some sort of analog there's real value in LLM's, not so psychics doing "cold readings".
- ianbicking 2y agoYeah, the basic premise is off because LLM responses are regularly tested against ground truth (like running the code they produce), and LLMs don't get to carefully select what requests they fulfill. To the contrary they fulfill requests even when they are objectively incapable of answering correctly, such as incomplete or impossible questions. I do think there is a degree of mentalist-like behavior that happens, maybe especially because of the RLHF step, where the LLM is encouraged to respond in ways that seem more truthful or compelling than is justified by its ability. We appreciate the LLM bestowing confidence on us, and rank an answer more highly if it gives us that confidence... not unlike the person who goes to a spiritualist wanting to receive comforting news of a loved one who has passed. It's an important attribute of LLMs to be aware of, but not the complete explanation the author is looking for.
- everdrive 2y agoI think it's fair to argue that part of human intelligence is actually just a statistical matching. The best example which comes to mind is actually grammar. Grammar has a very complex set of rules, however most people cannot really name them or describe them accurately; instead, they just know whether or not a sentence _sounds_ correct. This feels a lot like the same statistical matching performed by LLMs. An individual's reasoning iterates in their mind what words follow each other, and what phrases are likely. Outside of grammar, you can hear a lot of this when people talk; their sentences wander, and they don't always seem to know ahead of time where their sentences will end up. They start anchored to a thought, and seem to hope that the correct words end up falling into place. Now, does all thought work like this? Definitely not, and more importantly, there are many other facets of thought which are not present in LLMs. When someone has wandered badly when trying to get a sentence out, they are often also able to introspect and see that they failed to articulate their thought. They can also slow down their speaking, or pause, and plan out ahead of time; in effect, using this same introspection to prevent themselves from speaking poorly in the first place. Of course there's also memory, consciousness, and all sorts of other facets of intelligence. What I'm on the fence about is whether this point, or your point actually detracts from the author's argument.
- mock-possum 2y agoRecognizing a pattern and reproducing it is a huge part of the human experience, and that’s the main thing that’s intelligent-like about LLMs. A lot of time they’re lack context / cohesion, and they’re at a disadvantage for not being able to follow normal human social cues to course correct, as you point out.
- pockmarked19 2y agoWhich aspect of how a human leg works is a truck tire similar to?
- prideout 2y agoI lost interest fairly quickly because the entire article seems to rely on a certain definition of "intelligent" that is not made clear in the beginning.
- deleted 2y ago[deleted]
- dist-epoch 2y agoYeah, when I read about AI solving international math olympiad problems it's not intelligence, it's just me projecting my math skills upon the model. > LLMs are a mathematical model of language tokens. You give a LLM text, and it will give you a mathematically plausible response to that text. > The tech industry has accidentally invented the initial stages a completely new kind of mind, based on completely unknown principles, using completely unknown processes that have no parallel in the biological world. Or maybe our mind is based on a bunch of mathematical tricks too.
- pona-a 2y ago> AI solving international math olympiad problems is not intelligence But couldn't it be overfitting? LLMs are very good at deriving patterns, many of which humans simply can't tell apart from noise. With a few billion parameters and whatever black magic is going on inside CoT, it's not unreasonable to think even small amounts of fine-tuning combined with many epochs of training would be enough for it to conjure a compressed representation of that problem type. Without an extensive audit, I'd be skeptical of OpenAI's claims, especially given how o1 is often wrong on much more trivial compositional questions. What defines intelligence is generalization, the ability to learn new tasks from few examples, and while LLMs have made some significant progress here, they are still many orders below a child and arguably even many animals.
- svachalek 2y agoI suspect that's actually what's going on, LLMs are finding patterns that apply to their question and figure out how to combine them in the correct way. However, I'd also say this is how vast majority of humans solve math problems. What I've seen from o1/R1 is that they are more capable at this process than the average human, more capable than the vast majority of humans. We can say that they're not "intelligent" because they're not capable of solving problems they can't map to something in their training at all, but that would also put 99.9% of humanity in the unintelligent bucket.
- dist-epoch 2y agoA trained LLM can learn from a few examples. A human takes 14+ years until it's intelligent, also requires extensive training.
- swaraj 2y agoYou should try the arc agi puzzles yourself, and then tell me you think these things aren't intelligent https://arcprize.org/blog/openai-o1-results-arc-prize https://arcprize.org/blog/openai-o1-results-arc-prize I wouldn't say it's full agi or anything yet, but these things can definitely think in a very broad sense of the word
- daveguy 2y agoLLMs don't do too well on those ARC-AGI problems. Even though they're pretty easy for a person.
- dosinga 2y agoThis feels rather forced. The article seems to claim both that LLMs don't actually work, it is all an illusion and that of course the LLMs know everything, they stole all our work from the last 20 years by scraping the internet and underpaying people to produce content. If it was a con, it wouldn't have to do that. Or in other words, if you had a psychic who actually memorized all biographies of all people ever, they wouldn't need their cons
- pona-a 2y agoWhy would it have to be one or the other? Yes, it's been proven LLMs do create world models, how good they are is a separate matter. There still could be goal misalignment, especially when it comes to RLHF. If the model has in its internal world model knowledge it likely does not know how to solve a coding question, but the RLHF stage has reviewers rate refusals lower, it would in turn force its hand when it comes to tricks it knows it can pull based on its model of human reviewers. It can only implement the surface level boilerplate and pass that off as a solution, write its code in APL to obfuscate its lack of understanding, or keep misinterpreting the problem into a simpler one. A psychic that read on ten thousand biographies might start to recall them, or he might interpolate the blanks with a generous dose of BS, or more likely do both in equal measure.
- dosinga 2y agoThanks. That is a good point. The RLHF phase indeed might "force" the LLM to adopt con artist tricks and probably does.
- EagnaIonat 2y agoI was hoping it was talking about how it can resonate with users using those techniques. Or some experiments to prove the point. But it is not even that. There is nothing of substance in this and it feels like the author has a grudge against LLMs.
- manmal 2y agoWell they have a book to sell, at the bottom of the article.
- s1mplicissimus 2y ago[flagged]
- EagnaIonat 2y agoWell happy to hear your conclusions from reading the article.
- deleted 2y ago[deleted]
- bbor 2y agoAbsolutely -- there is a whole cottage industry of people who know that LLMs are big news and decide to chime in, without ever considering that maybe this is a scientific discussion, not a cultural/"take-driven" one. Bluesky in particular is probably their biggest source of income! You can spot them easily, because instead of critiquing some specific thing and sticking to it, they can't resist throwing in "obviously, LLMs are all 100% useless and anyone who says otherwise is a Tech Bro" somewhere. Like: completely unknown processes that have no parallel in the biological world. c'mon... Anyone who knows a tiny bit about ML knows that both of those claims are just absurdly off base.
- thinkingemote 2y agoInteresting. Resonate with people is what a mentalist does. More generically a good bedside manner is what a good doctor does and it's the same thing. Many times we like being cold read and comforted and comfortable! Agreed on the experiments. What would they look like? Can a chat bot give the same info without any bedside manner?
- pama 2y agoThis is from 2023 and is clearly dated. It is mildly interesting to notice how quickly things changed since then. Nowadays models can solve original math puzzles much of the time and it is harder to argue they cannot reason when we have access to R1, o1, and o3-mini.
- Terr_ 2y ago> Nowadays models can solve original math puzzles much of the time Isn't that usually by not even trying, and delegating the work regular programs?
- bbor 2y agoIn what way is your mathematical talent truly you, but a python tool called by an LLM-centric agent not truly that agent?
- deleted 2y ago[deleted]
- Terr_ 2y agoFor starters, it means you should not take the success of the math and ascribe it to an advance in the LLM, or whatever phrase is actually being used to describe the the new fancy target of hype and investment. An LLM is at best, a possible future component of the speculative future being sold today. How might future generations visualize this? I'm imagining some ancient Greeks, who have invented an inefficient reciprocating pump, which they declare is a heart and that means they've basically built a person. (At the time, many believed the brain was just there to cool the blood.) Look! The fluid being pumped can move a lever: It's waving to us.
- bbor 2y agoInteresting metaphor, but I’m not sure you’re fully appreciating the hypothetical. The agent didn’t seem like it was going to solve a math problem, it did. Before intuitive computing, the best we could do with word problems was Wolfram-esque regex stuff, which I’m guessing we all know was quite error-prone. Now, we have agents that can take quite vague word problems and use any sequence of KB/web searches, python programs, and further intuitive reasoning steps to arrive at the requested answer. That’s pretty impressive, and I don’t think “well technically it relies on tools” makes it less impressive! Something that wasn’t possible yesterday is possible today; that alone matters. Re:general skepticism, I’ve given up on convincing people that AGI is close, so all ill say is “hedge your bets” ;)
- jbay808 2y agoI was interested in this question so I trained NanoGPT from scratch to sort lists of random numbers. It didn't take long to succeed with arbitrary reliability, even given only an infinitesimal fraction of the space of random and sorted lists as training data. Since I can evaluate the correctness of a sort arbitrarily, I could be certain that I wasn't projecting my own beliefs onto its response, and reading more into the output than was actually there. That settled this question for me.
- dartos 2y agoI don’t really understand what you’re testing for? Language, as a problem, doesn’t have a discrete solution like the question of whether a list is sorted or not. Seems weird to compare one to the other, unless I’m misunderstanding something. What’s more, the entire notion of a sorted list was provided to the LLM by how you organized your training data. I don’t know the details of your experiment, but did you note whether the lists were sorted ascended or descended? Did you compare which kind of sorting was most common in the output and in the training set? Your bias might have snuck in without you knowing.
- tossandthrow 2y agoCommenter is merely saying that LLMs indeed are able to approximate arbitrary functions exemplified through sorting. It is nothing new and has been well established in the literature since the 90s. The shared article really is not worth the read and mostly uncovers an author who does not know what he write about.
- dartos 2y agoYou’re talking specifically about perceptrons and feed forward neural networks. LLMs didn’t exist in then. Attention only came out in 2017…
- tossandthrow 2y agoYes? Are you saying that attention is less expressive?
- Terr_ 2y agoThere's another illusory effect here: Humans are being encouraged to confuse a fictional character with the real-world "author" system. I can create a mad-libs program which dynamically reassembles stories involving a kind and compassionate Santa Claus, but that does not mean the program shares those qualities. I have not digitally reified the spirit of Christmas, not even if excited human kids contribute some of the words that shape its direction and clap with glee. P.S.: This "LLM just makes document bigger" framing is also very useful understanding how prompt injection and hallucinations are constant core behaviors, which we just ignore except when they inconvenience us The assistant-bot in the story can be twisted or vanish so abruptly because it's just something in a digital daydream.
- bloomingkales 2y agoAnd only to your eyes and those you force your vision onto. The rest of the universe never sees it. You don’t exist to much of the universe (if a tree falls and no one is around to hear it, you understand what I mean). So you simultaneously exist and don’t exist. Sorry about this, your post took me on this tangent.
- karmakaze 2y agoAlphaGo also doesn't reason. That doesn't mean it can't do things that humans do by reasoning. It doesn't make sense to make these comparisons. It's like saying that planes don't really fly because they aren't flapping their wings. Edit: Don't conflate mechanisms with capabilities.
- psytrancefan 2y agoAt this point I think it is because of a type of religious sentimentality about the sanctity of human reasoning. To take your analogy even further, it is like asking when is the plane going to improve enough that it can really fly by flapping it's wings.
- IshKebab 2y ago> But there isn’t any mechanism inherent in large language models (LLMs) that would seem to enable this Stopped reading here. What is the mechanism in humans that enables intelligence? You don't know? Didn't think so. So how do you know LLMs don't have the required mechanism?
- twobitshifter 2y agoLost me here - “LLMs are not brains and do not meaningfully share any of the mechanisms that animals or people use to reason or think.“ “the initial stages a completely new kind of mind, based on completely unknown principles, using completely unknown processes that have no parallel in the biological world.” We just call it a neural network because we wanted to confuse biology with math for the hell of it? “There is no reason to believe that it thinks or reasons—indeed, every AI researcher and vendor to date has repeatedly emphasised that these models don’t think.” I mean just look at the Nobel Prize winners for counter examples to all of this https://www.cnn.com/2024/10/08/science/nobel-prize-physics-hopfield-hinton-machine-learning-intl/index.html https://www.cnn.com/2024/10/08/science/nobel-prize-physics-h... I don’t understand the denialism behind replicating minds and thoughts with technology - that had been the entire point from the start.
- exclipy 2y agoYeah I was expecting the article to give an argument to back up this claim by talking about the mechanisms behind LLMs and the mechanisms behind human thought and demonstrating a lack of overlap. But I don't see any discussion of multilayer perceptrons or multi-head attention. Instead, the rest of the article is just saying "it's a con" with a lot of words.
- olddustytrail 2y ago> One of the issues in during this research—one that has perplexed me—has been that many people are convinced that language models, or specifically chat-based language models, are intelligent. Different people have different definitions of intelligence. Mine doesn't require thinking or any kind of sentience so I can consider LLMs to be intelligent simply because they provide intelligent seeming answers to questions. If you have a different definition, then of course you will disagree. It's not rocket science. Just agree on a definition beforehand.
- bloomingkales 2y ago[flagged]
- habitue 2y agoThis kind of "LLMs don't really do anything, it's all a trick" / "they're stochastic parrots" argument was kind of maybe defensible a year and a half ago. At this point, if you're making these arguments you're willfuly ignorant of what is happening. LLMs write code, today, that works. They solve hard PhD level questions, today. There is no trick. If anything, it's clear they haven't found a trick and are mostly brute forcing the intelligence they have. They're using unbelievable amounts of compute and are getting close to human level. Clearly humans still have some tricks that LLMs dont have yet, but that doesn't diminish what they can objectively do.
- habitue 2y agoApparently, this article was written almost exactly a year and a half ago so... I guess the author is forgiven!
- fleshmonad 2y agoUnfounded cope. And I know this will get me downvoted, as these arguments seem to be popular among the intellectuals on this glorious page. The machanism of intelligence is not understood. There isn't even a rigorous definition of what intelligence is. "All it does is combine parts it has seen in its training set to give an answer", well then the magic lies in how it knows what parts to combine, if one wants to go with this argument. Also conveniently, the fact that we have millions of years of evolution behind us, plus exabytes of training data over the years in form of different stimuli since birth gets shoved under the rug. I don't want to say that the conclusion is necessarily wrong, but the argument is always bad. I know it is hard to come to terms with the thought that intelligence may be more fundamental in nature and not exclusively a capability of carbon based life forms.
- kelseyfrog 2y agoIntelligence feels like a hard scientific concept, but scratch the surface and you find a circular definition: we measure it with tools we designed for the purpose, then declare it real because the tools say so. That’s affirming the consequent. If intelligence were an objective property of the universe, we’d define it like mass or charge—quantifiable, invariant, fundamental. Instead, it shifts to match whatever we decide to measure. The instruments don’t quantify intelligence; they create it.
- viach 2y ago> 1 The tech industry has accidentally invented the initial stages a completely new kind of mind, based on completely unknown principles... > 2) The intelligence illusion is in the mind of the user and not in the LLM itself. 3) The intelligence of the users is illusion either?
- scandox 2y agoYou're right! AI makes us ask really important questions about our own intelligence. I think it will lead to greater recognition that we are first and foremost animals: creatures of intention and action. I think we've put way too much emphasis on our intellectual dimension in the last few hundred years. To the point that some people started to believe that was what we are.
- viach 2y agoYup. And the real danger of AI is not that it enslaves humans but in that it will bring great disillusionment and existential crisis. Someone should write a blog post about this to warn humanity.
- ImPostingOnHN 2y agothe real danger isn't that it enslaves humans, but that it makes most humans useless to those with capital and robots and AI at that point, capital can tell most humans to just go away and die, and can use their technology to protect themselves in the meantime
- Earw0rm 2y agoPerhaps we're confusing intelligence with awareness. What LLMs seem to emulate surprisingly well is something like a person's internal monologue, which is part of but not the whole of our mind. It's as if it has the ability to talk to itself extremely quickly and while plugged directly into ~all of the written information humanity has ever produced, and what we see is the output of that hidden, verbally-reasoned conversation. Something like that could be called intelligent, in terms of its ability to manipulate symbols and rearrange information, without having even a flicker of awareness, and entirely lacking the ability to synthesise new knowledge based on an intuitive or systemic understanding of a domain, as opposed to a complete verbal description of said domain. Or to put it another way - it can be intelligent in terms of its utility, without possessing even an ounce of conscious awareness or understanding.
- GuB-42 2y ago"Do LLMs think?" is a false problem outside of the field of philosophy. The real question that gets billions invested is "Is it useful?". If the "con artist" solves my problem, that's fine by me. It is like having a mentalist tell me "I see that you are having a leaky faucet and I see your future in a hardware store buying a 25mm gasket and teflon tape...". In the end, I will have my leak fixed and that's what I wanted, who care how it got to it?
- yannyu 2y agoIt has to both be useful and economical. If that answer cost $2 to get you and a search+youtube video would have been just as effective and much cheaper, then it's possible that the new way to get the answer isn't significantly better than the old way. The graveyards of startups are littered with economically infeasible solutions to problems.
- deleted 2y ago[deleted]
- cratermoon 2y agoSo far it seems LLM-based systems are still reaching for a use.
- crummy 2y agoDoes copilot not count?
- cratermoon 2y agoIf copilot is so good why does MS/Github keep pushing it on people who haven't asked for it and don't want it? They're now giving it away for free, just to be able to put it everywhere.
- crummy 2y agoI don't think trial versions of software reek of desperation. They are pushing trials because they think you'll like it and sign up for the paid version.
- ripped_britches 2y agoThis article confuses conscious, felt experience with intelligence.
- tomohelix 2y agoOn a bit of a tangent and hypothetical, but what if we pool eough resources together to do a training that includes everything a human can experience? I am thinking of all the five senses and all the data that comes with it, e.g. books, movies, songs, recitals, landscape, the wind brushing against the "skin", the pain of getting burned, the smell of coffee in the morning, the itchiness of a mosquito's bite, etc. It is not impossible I think, just require so much effort, talents, and funding that the last thing resembling such an endeavor was the Manhattan project. But if it succeeded, the impact could rival or even exceed what nuclear power had done. Or am I deluded and there is some sort of fundamental limit or restriction on the transformer that would completely prevent this from the start?
- cratermoon 2y agoHow would you model embodiment and embodied experience?
- s1mplicissimus 2y agoIs there anything except sensory input that you assume part of the embodied experience? What would that be? Apart from that, I'm afraid that at this point research on sensory input apart from audio and visual needs much more advancement. For example, it's not clear to me what kind of data structure would be a good fit for olfactory or sensory training data
- tomohelix 2y agoAs mentioned above, olfactory data can be just chemical fingerprints. Mass spectrometers already do this and provide very distinct signals for every chemical component. Touch and such can have some approximation done through various sensors like temperature, force, humidity, electromagnetic, etc.
- s1mplicissimus 2y agoSure you can punch in a chemical fingerprint for say the smell of a specific type of rose. Maybe it doesn't matter for the learning process that in an equivalent human experience it was preceeded by someone making you a compliment a couple minutes earlier, or that it was combined with all the other chemical fingerprints present at the moment, like maybe it just rained shortly before and there's a slight smell of wet earth in the air or someone smoking a cigarette walked by and there's minimal leftovers of that, or the window wasn't opened for a couple hours and everything has a slight tint of "used air" to it, which might add a factor of dampened learning, which might be necessary for the specific learning process to happen slow enough to sink in properly etc... Don't get me wrong I would be curious to see such research done to see whether it would improve anything above the stochastic parrot level - it's just going to take a while to figure out what is even relevant
- tmnvdb 2y agoI'm amazed people are upvoting this piece which does not grapple with any of the real issues in a serious way. I guess some folks just really want AI to go away and are longing to hear that it is just all newfangled nonsense from the city slickers!
- grayhatter 2y agohow come you elected not to enumerate *any* of the real issues you expected?
- ImPostingOnHN 2y agolooks like nobody asked if you wish for GP to do that, ask them to do that
- cratermoon 2y agoI've never gotten a good answer to my question regarding why Open AI chose a chat UI for their gpt, but this article comes closest to explaining it.
- orbital-decay 2y ago>LLMs <snip> do not meaningfully share any of the mechanisms that animals or people use to reason or think. This seems to be a hard assumption the entire post, and many other similar ones, rely upon. But how do you know how people think or reason? How do you know human intelligence is not an illusion? Decades of research were unable to answer this. Now when LLMs are everywhere, suddenly everybody is an expert in human thinking with extremely strong opinions. To my vague intuition (based on understanding of how LLMs work) it's absolutely obvious they do share at least some fundamental mechanisms, regardless of vast low-level architecture/training differences. The entire discussion on whether it's real intelligence or not is based on ill-defined terms like "intelligence", so we can keep going in circles with it. By the way, OpenAI does nothing of this, see [1]: >artificial general intelligence (AGI)—by which we mean highly autonomous systems that outperform humans at most economically valuable work Neither do others. So the author describes "tech industry" unknown to me. [1] https://openai.com/charter/ https://openai.com/charter/
- aaplok 2y ago> Decades of research were unable to answer this. From the article: > The field of AI research has a reputation for disregarding the value of other fields [...] It’s likely that, being unaware of much of the research in psychology on cognitive biases or how a psychic’s con works, they stumbled into a mechanism and made chatbots that fooled many of the chatbot makers themselves. Just because cognitive scientists don't know everything about how intelligence works (or on what it is) doesn't mean that they know nothing. There has been a lot of progress in cognitive science, in the last decade in particular on reasoning. > based on ill-defined terms like "intelligence". The whole discussion is about "artificial intelligence". Arguably AI researchers ought to have a fairly well defined stance of what "intelligence" means and can't use a trick like "nobody knows what intelligence is" to escape criticism.
- mewpmewp2 2y agoAs far as I know the best definition of intelligence is "ability to solve problems".
- deleted 2y ago[deleted]
- xg15 2y ago> But that isn’t how language models work. LLMs model the distribution of words and phrases in a language as tokens. Their responses are nothing more than a statistically likely continuation of the prompt. Not saying the author is wrong in general, but this kind of argument always annoys me. It's effectively a Forer statement for the "sceptics" side: It appears like a full-on refutation, but really says very little. It also evokes certain associations which are plain incorrect. LLMs are functions that return a probability distribution of the next word given the previous words; this distribution is derived from the training data. That much is true. But this does not tell anything about how the derivation and probability generation processes actually work or how simple or complex they are. What it does however, is evoke two implicit assumptions without justifying them: 1) LLMs fundamentally cannot have humanlike intelligence, because humans are qualitatively different: An LLM is a mathematical model and a human is, well, a human. Sounds reasonable until you have a look at the human brain and find that human consciousness and thought too could be represented as nothing more than interactions between neurons. At which point, it gets metaphysical... 2) It implies that because LLMs are "statistical models", they are essentially slightly improved Markov chains. So if an LLM predicts the next word, it would essentially just look up where the previous words appeared in its training data most often and then return the next word from there. That's not how LLMs work at all. For starters, the most extensive Markov chains have a context length of 3 or 4 words, while LLMs have a context length of many thousand words. Your required amounts of training data would go to "number of atoms in the universe" territory if you wanted to create a Markov chain with comparable context length. Secondly, as current LLMs are based on the mathematical abstraction of neural networks, the relationship between training data and the eventual model weights/parameters isn't even fully deterministic: The weights are set to initial values based on some process that is independent of the training data - e.g. they are set to random values - and then incrementally adjusted so that the model can increasingly replicate the training data. This means that the "meaning" of individual weights and their relationship to the training data remains very unclear, and there is plenty of space in the model where higher-level "semantic" representations might evolve. None of that is proof that LLMs have "intelligence", but I think it does show that the question can't be simply dismissed by saying that LLMs are statistical models.
- ramesh31 2y agoIt feels like we are stuck in two different worlds with this stuff right now. One being the AI users that interface solely through app based things like ChatGPT, who have been burned over and over again by hallucinations or lack of context, to the point of disillusionment. The other world is the one where developers who are working with agentic systems built on frontier models right now are literally watching AGI materialize in front of us in real time. I think 2025 will be the year those worlds converge (for the better).
- dostick 2y agoWhy LLM has incentive to provide answer that sounds suitable regardless of quality, is there a feedback loop? If I am asking for the first time without previous context, it considers quality and suitability based on other users interactions?
- yetihehe 2y ago> Why LLM has incentive to provide answer that sounds suitable regardless of quality, is there a feedback loop? Yes, that is how LLM's work. They are trained with feedback loops to answer plausibly.
- throwaway87543 2y agoSome people seem to want to believe that true thought is spiritual in nature. They will never accept that something physical and made by man could do it. They would stop believing humans are intelligent if given conclusive proof of how the brain works.
- casey2 2y agoIt's very telling that this author conflates thinking, reasoning and intelligence. It shows a heavy European bias. Since this article is biased and confused it can be easily dismissed with no further reasoning needed.
- casey2 2y agoAs an example, standards (and European) committees have a great deal of thinking and reasoning, but very little intelligence.
- throw-qqqqq 2y ago> It shows a heavy European bias Can you please explain that a bit further? I don’t catch the connection you’re making between the conflation and being european.
- Centigonal 2y agoMy hot take is that "consciousness" is a gestalt perception phenomenon that occurs (as far as I know) exclusively inside the minds of human observers.
- floppiplopp 2y agoThere's already the ELIZA effect (https://en.wikipedia.org/wiki/ELIZA_effect https://en.wikipedia.org/wiki/ELIZA_effect) that describes LLMs and the credulous people who believe in them pretty well.