3 ms·

> You picked one trivial failure and built an entire worldview around it They gave one small example of a larger problem we have all seen, including yourself I

> You picked one trivial failure and built an entire worldview around it They gave one small example of a larger problem we have all seen, including yourself I’m sure. This is hardly a fair response. It’s also incredibly easy to verify it was wrong when given a very simple question. That’s the really alarming thing. This isn’t niche information. Their example really effectively highlights one of the major problems with LLM’s: you can’t use them unless you already have at least a foundational knowledge of what you are asking because you have to be able to identify the inevitable mistakes it regularly makes. So someone like me who is not very confident cooking cannot use an LLM to help in the kitchen. It is going to get me in trouble on a regular basis. And if I have to search online to double check everything it says, why am I using it in the first place? Now apply this to car maintenance, coding, gardening, etc. all of which are fair examples because everyone seems so intent on making generalized LLM “assistants.” I am not saying LLM’s are worthless, just to be clear. But there are severe limitations that seem to get glossed over constantly, especially when it’s brought up that you have to be able to regularly verify the information which is very regularly at least partially wrong.

ninetyninenine 1y ago
I disagree. Not with the part that it gets things severely wrong at times. I disagree that it gets glossed over. It’s fucking obvious how wrong LLMs get and I think this part is over exaggerated while the parts it gets right like basically slowly replacing parts of your average HNers day job as a programmer is deliberately ignored and scoffed at. The sentiment against AI by the overwhelming majority is hatred and negativity especially on HN. It is a small minority (especially among entrepreneurs and founders) that are overly positive about AI. But make no mistake the overwhelming sentiment is negative to the point of delusion like the LLMs themselves. Like it’s unmistakable to me how LLMs can basically up developer productivity to a much much higher degree than ever before. Yet we have plenty and plenty of people who can’t even take the middle ground and say it kind of helps. All kinds of developers everywhere saying LLMs are fucking completely useless. Which is mind bogglingly irrational. Most Artists for example are decrying it because it produces soulless work. I agree the work is soulless but indistinguishable and often materially better than what a human can do. In fact the concept of soul becomes utter bullshit in a double blind test. They aren’t decrying it because it’s soulless that’s bullshit. They decry it because it’s on the trajectory of becoming better than them. That’s the same fucking reason you see HNers siding with the best possible scaffolding of logic and reasoning that will support their day job. That’s why you see people claiming random shit like LLMs don’t actually understand anything when we in fact have no clue or ability to even properly answer that question.
- Forgeties79 1y ago
  > Not all content needs to be real. A huge portion of what humans appreciate is fiction. There's a huge amount of that content and hallucination is the name of the game in these contexts. I didn’t realize this was you as I was pulling this up as an example. You literally said “we appreciate fiction” as a defense of LLM’s giving us bad results. I don’t know how that isn’t glossing over it - if anything it doesn’t accurately communicate how wild of a take that is. You’re functionally saying false information is desirable. Unless you were taking the piss there and I totally missed it, it was truly baffling to read.
  - ninetyninenine 1y ago
    Baffling? Is just the HN way of calling someone a fucking idiot without violating the rules and pretending to be polite. Just say it to my face. Is it not obvious human society likes fiction? Is it not obvious that creating fiction requires immense intelligence? That’s my point. If your genius mind can only bend that argument in a singular direction of a “wild take” well I hate to break it to you but you’re baffling. False information is desirable. Watch tv, read a book. The human race makes billions off of lies not because we are being duped. But because we desire to be lied to. only a genius savant like you needs to be told what the rest of the human race knows. Look it’s not a “defense” against LLMs as if it’s something that needs defending. It’s like saying I’m defending a ray of light or a gust of wind. Doesn’t make any sense. All im saying is that the LLM is a form of intelligence that has a use versus your brain dead argument that it slipped up when talking to you.
    - Forgeties79 1y ago
      > Baffling? Is just the HN way of calling someone a fucking idiot without violating the rules and pretending to be polite. Just say it to my face. Maybe that has been your experience with other users in which case I am sorry people have been so rude to you, but in my case it’s just a word I personally use a lot. If it’s too severe a term than my and and reading back I am coming in a it hot so I am sorry for the tone. I do not think you’re an idiot and I am absolutely not personally attacking you. I tend to have a dramatic way of speaking, I can admit that. But again, this is not a personal attack. The point I am trying to communicate is that it’s (to me) a very surprising and difficult to square take. Comparing a tool failing to do its job correctly to appreciating a work of written fiction just seems bizarre to me. That’s the truth. The people building LLMs do not want that result. I do not want that result. Nobody wants it to spit out inaccurate information disguised as correct information. I don’t want my calculator to spit out fiction literally ever - the same goes for LLM’s outside of deliberately prompting it to do so. If I want fiction as you describe (art and such), I seek it out deliberately. I will grab a book off my shelf or watch a show (or prompt the LLM with intent). Put another way: The difference between the fiction in a novel and what an LLM spits out is that I am seeking it out in the former, not the latter. When an LLM gives me incorrect information disguised as correct information (undesired fiction), it is failing to do its job correctly. It is a tool that is not functioning properly. I absolutely 100% never want fiction emerging in key instructions when I am cooking or am fixing my car. It is always an undesired result. So to circle back to why I find this “baffling,” or another word if you find that too severe, it’s that I don’t understand how something that is so concretely undesirable can be described as a positive thing comparable to creating works of literature for us to appreciate. You’re telling me it’s good that something does not function properly/as expected and gives me results I absolutely do not want. To get away from “baffling”: That is a very bold and unexpected take that I struggle to find any agreement with.

ninetyninenine 1y ago

I disagree. Not with the part that it gets things severely wrong at times. I disagree that it gets glossed over. It’s fucking obvious how wrong LLMs get and I think this part is over exaggerated while the parts it gets right like basically slowly replacing parts of your average HNers day job as a programmer is deliberately ignored and scoffed at. The sentiment against AI by the overwhelming majority is hatred and negativity especially on HN. It is a small minority (especially among entrepreneurs and founders) that are overly positive about AI. But make no mistake the overwhelming sentiment is negative to the point of delusion like the LLMs themselves. Like it’s unmistakable to me how LLMs can basically up developer productivity to a much much higher degree than ever before. Yet we have plenty and plenty of people who can’t even take the middle ground and say it kind of helps. All kinds of developers everywhere saying LLMs are fucking completely useless. Which is mind bogglingly irrational. Most Artists for example are decrying it because it produces soulless work. I agree the work is soulless but indistinguishable and often materially better than what a human can do. In fact the concept of soul becomes utter bullshit in a double blind test. They aren’t decrying it because it’s soulless that’s bullshit. They decry it because it’s on the trajectory of becoming better than them. That’s the same fucking reason you see HNers siding with the best possible scaffolding of logic and reasoning that will support their day job. That’s why you see people claiming random shit like LLMs don’t actually understand anything when we in fact have no clue or ability to even properly answer that question.

Forgeties79 1y ago
> Not all content needs to be real. A huge portion of what humans appreciate is fiction. There's a huge amount of that content and hallucination is the name of the game in these contexts. I didn’t realize this was you as I was pulling this up as an example. You literally said “we appreciate fiction” as a defense of LLM’s giving us bad results. I don’t know how that isn’t glossing over it - if anything it doesn’t accurately communicate how wild of a take that is. You’re functionally saying false information is desirable. Unless you were taking the piss there and I totally missed it, it was truly baffling to read.
- ninetyninenine 1y ago
  Baffling? Is just the HN way of calling someone a fucking idiot without violating the rules and pretending to be polite. Just say it to my face. Is it not obvious human society likes fiction? Is it not obvious that creating fiction requires immense intelligence? That’s my point. If your genius mind can only bend that argument in a singular direction of a “wild take” well I hate to break it to you but you’re baffling. False information is desirable. Watch tv, read a book. The human race makes billions off of lies not because we are being duped. But because we desire to be lied to. only a genius savant like you needs to be told what the rest of the human race knows. Look it’s not a “defense” against LLMs as if it’s something that needs defending. It’s like saying I’m defending a ray of light or a gust of wind. Doesn’t make any sense. All im saying is that the LLM is a form of intelligence that has a use versus your brain dead argument that it slipped up when talking to you.
  - Forgeties79 1y ago
    > Baffling? Is just the HN way of calling someone a fucking idiot without violating the rules and pretending to be polite. Just say it to my face. Maybe that has been your experience with other users in which case I am sorry people have been so rude to you, but in my case it’s just a word I personally use a lot. If it’s too severe a term than my and and reading back I am coming in a it hot so I am sorry for the tone. I do not think you’re an idiot and I am absolutely not personally attacking you. I tend to have a dramatic way of speaking, I can admit that. But again, this is not a personal attack. The point I am trying to communicate is that it’s (to me) a very surprising and difficult to square take. Comparing a tool failing to do its job correctly to appreciating a work of written fiction just seems bizarre to me. That’s the truth. The people building LLMs do not want that result. I do not want that result. Nobody wants it to spit out inaccurate information disguised as correct information. I don’t want my calculator to spit out fiction literally ever - the same goes for LLM’s outside of deliberately prompting it to do so. If I want fiction as you describe (art and such), I seek it out deliberately. I will grab a book off my shelf or watch a show (or prompt the LLM with intent). Put another way: The difference between the fiction in a novel and what an LLM spits out is that I am seeking it out in the former, not the latter. When an LLM gives me incorrect information disguised as correct information (undesired fiction), it is failing to do its job correctly. It is a tool that is not functioning properly. I absolutely 100% never want fiction emerging in key instructions when I am cooking or am fixing my car. It is always an undesired result. So to circle back to why I find this “baffling,” or another word if you find that too severe, it’s that I don’t understand how something that is so concretely undesirable can be described as a positive thing comparable to creating works of literature for us to appreciate. You’re telling me it’s good that something does not function properly/as expected and gives me results I absolutely do not want. To get away from “baffling”: That is a very bold and unexpected take that I struggle to find any agreement with.