3 ms·
> They admitted it internally, to me It's becoming an increasingly apparent problem that people don't understand that LLMs frequently hallucinate, especially w
by Trasmatta 2y ago
> They admitted it internally, to me
It's becoming an increasingly apparent problem that people don't understand that LLMs frequently hallucinate, especially when asked to introspect about themselves. This was 100% a hallucination.
- davidw 2y ago"I know, let's release an AI bot that pretends to be something that's likely to be viewed through a charged political lense and have it hallucinate random answers to people"
- asveikau 2y agoIt's getting weird that people cite ChatGPT to settle debates. Even on places like HN where supposedly people have a technical background and know they shouldn't blindly trust an LLM as a source of truth. Even with the banners it has warning about this.
- deleted 2y ago[deleted]
- add-sub-mul-div 2y agoTechnical knowledge and wisdom are two very different things. There is an excess of the former here, on this site, in this field, but a comical dearth of the latter.
- MrMcCall 2y agoI have but one upvote to give you, good sir/madam, when I wish I had 100.
- asveikau 2y agoI would argue that there is not an excess of the former. A lot of the so-called techies don't know tech either.
- add-sub-mul-div 2y agoThat's fair. I suppose it's more that there's a worship of knowledge outside the context of wisdom.
- pockmarked19 2y agoThere are wise people here, they are just lurkers though (wisely).
- yifanl 2y agoPeople don't understand that LLMs are just statistical magic, by design of the LLM providers because LLMs wouldn't take off if people understood they are just statistical magic.
- jjulius 2y agoYou and I understand this. Heck, most of us on HN understand this. When the media and companies with a financial interest in AI have been shouting from the rooftops that "AI is going to replicate humans very soon and all of your jobs will go bye-bye because this thing will do everything better than you", can we really be surprised when the broader populace looks at it that way?
- brookst 2y agoIt was likely a hallucination, right? You didn’t check to confirm? But this is a solved problem that Meta chose to implement poorly. It can be done right. I just asked o1 “create a diversity report for openai” and its very first paragraph is: > Below is a *sample* diversity report for OpenAI. Please note that the numbers, programs, and initiatives are provided as *illustrative examples*. This report is not an official document, and the data contained here is *fictional* and for demonstration purposes only.
- MrMcCall 2y agoLLMs just predict the next word, based upon the texts they were trained on. They are, by definition, a hallucination. It's just that, sometimes, they put words together that fool people. They're just ELIZA on steroids, people.
- CamperBob2 2y agoHow did ELIZA do on the Advent of Code?
- MrMcCall 2y agoIt hallucinated less, that's for sure, because we know exactly how it works, though I doubt any of the AoC's challenges were suitable for its 1980s logic (that's when I typed in a magazine's C64 version). "There's lies, damned lies, and statistics." --Unknown
- kristiandupont 2y agoLLM's did well: https://blog.scottlogic.com/2024/12/15/llms-vs-aoc.html https://blog.scottlogic.com/2024/12/15/llms-vs-aoc.html
- bongodongobob 2y agoRight and computers just do boolean math, not anything useful.
- MrMcCall 2y agoA hammer can bonk someone or help Jimmy Carter build a house for someone. We digital logic folks are both tool builders and tool wielders. Usefulness is in the hands of the user, but that doesn't mean the creator isn't a dipsh_t who made a crap tool, or that the user isn't a moron. My computer allows me to build stores of digital information representations, with functional integrations to other systems, including me. It's useful for me and my family, for sure.