3 ms·

If you think programs are predictable, I have a bridge to sell you. The only relevant metric here is how often each thing makes mistakes. Programs are the most

If you think programs are predictable, I have a bridge to sell you. The only relevant metric here is how often each thing makes mistakes. Programs are the most reliable, though far from 100%, humans are much less than that, and LLMs are around the level of humans, depending on the humans and the LLM.

watwut 1y ago
When human makes a mistake, we call it a mistake. When human lies, we call it a lie. In both cases, we blame the human. When LLM does the same, we call it hallucination and blame the human.
- raincole 1y ago
  Which is the correct reaction, because LLM isn't a human and can't be held accountable.
wat10000 1y ago
Programs can be very close to 100% reliable when made well. In my life, I've never seen `sort` produce output that wasn't properly sorted. I've never seen a calculator come up with the wrong answer when adding two numbers. I have seen filesystems fail to produce the exact same data that was previously written, but this is something that happens once in a blue moon, and the process is done probably millions of times a day on my computers. There are bugs, but bugs can be reduced to a very low level with time, effort, and motivation. And technically, most bugs are predictable in theory, they just aren't known ahead of time. There are hardware issues, but those are usually extremely rare. Nothing is 100% predictable, but software can get to a point that's almost indistinguishable.
- stavros 1y ago
  > Programs can be very close to 100% reliable when made well. This is a tautology. > I've never seen a calculator come up with the wrong answer when adding two numbers. https://imgz.org/i6XLg7Fz.png https://imgz.org/i6XLg7Fz.png > And technically, most bugs are predictable in theory, they just aren't known ahead of time. When we're talking about reliability, it doesn't matter whether a thing can be reliable in theory, it matters whether it's reliable in practice. Software is unreliable, humans are unreliable, LLMs are unreliable. To claim otherwise is just wishful thinking.
  - jakelazaroff 1y ago
    That's not a tautology. You said "programs are the most reliable, though far from 100%"; they're just telling you that your upper bound for well-made programs is too low.
  - sjsdaiuasgdia 1y ago
    RE: the calculator screenshot - it's still reliable because the same answer will be produced for the same inputs every time. And the behavior, though possibly confusing to the end user at times, is based on choices made in the design of the system (floating point vs integer representations, rounding/truncating behavior, etc). It's reliable deterministic logic all the way down.
    - stavros 1y ago
      > I've never seen a calculator come up with the wrong answer when adding two numbers. 1.00000001 + 1 doesn't equal 2, therefore the claim is false.
      - sjsdaiuasgdia 1y ago
        Sure it does, if you have made a system design decision about the precision of the outputs. At the precision the system is designed to operate at, the answer is 2.
  - faeyanpiraat 1y ago
    You mixed up correctness and reliability. The ios calculator will make the same incorrect calculation, but reliably, every time.
    - stavros 1y ago
      Don't move the goalposts. The claim was: > I've never seen a calculator come up with the wrong answer when adding two numbers. 1.00000001 + 1 doesn't equal 2, therefore the claim is false.
- mrguyorama 1y ago
  >I've never seen a calculator come up with the wrong answer when adding two numbers. Intel once made a CPU that barely got some math wrong that probably would not affect the vast majority of users. The backlash from the industry was so strong that intel spent half a billion (1994) dollars replacing all of them. Our entire industry avoids floating point numbers for some types of calculations because, even though they are mostly deterministic with minimal constraints, that mental model is so hard to manage that you are better off avoiding it entirely and removing an entire class of errors from your work But now we are just supposed to do everything with a slot machine that WILL randomly just do the wrong thing some unknowable percentage of the time, and that wrong thing has no logic? No, fuck that. I don't even call myself an engineer and such frivolity is still beyond the pale. I didn't take 4 years of college and ten years of hard earned experience to build systems that will randomly fuck over people with no explanation or rhyme or reason. I DO use systems that are probabilistic in nature, but we use rather simple versions of those because when I tell management "We can't explain why the model got that output", they rightly refuse to accept that answer. Some percentage of orders getting mispredicted is fine. Orders getting mispredicted that cannot be explained entirely from their data is NOT. When a customer calls us, we cannot tell them "Oh, that's just how Neural networks are, you were unlucky". Notably, those in the industry that HAVE jumped on the neural net/"AI" bandwagon for this exact problem domain have not demonstrated anything close to seriously better results. In fact, one of our most DRAMATICALLY effective signals is a third party service that has been around for decades, and we were using a legacy integration that hadn't been updated in a decade. Meanwhile, Google's equivalent product/service couldn't even match the results of internally developed random forest models from data science teams that were.... not good. It didn't even match the service Microsoft has recently killed, which was similarly bragadocious about "AI" and similarly trash. All that panopticon's worth of data, all that computing power, all that supposed talent, all that lack of privacy and tracking, and it was almost as bad as a coin flip.

watwut 1y ago

When human makes a mistake, we call it a mistake. When human lies, we call it a lie. In both cases, we blame the human. When LLM does the same, we call it hallucination and blame the human.

raincole 1y ago
Which is the correct reaction, because LLM isn't a human and can't be held accountable.

wat10000 1y ago

Programs can be very close to 100% reliable when made well. In my life, I've never seen `sort` produce output that wasn't properly sorted. I've never seen a calculator come up with the wrong answer when adding two numbers. I have seen filesystems fail to produce the exact same data that was previously written, but this is something that happens once in a blue moon, and the process is done probably millions of times a day on my computers. There are bugs, but bugs can be reduced to a very low level with time, effort, and motivation. And technically, most bugs are predictable in theory, they just aren't known ahead of time. There are hardware issues, but those are usually extremely rare. Nothing is 100% predictable, but software can get to a point that's almost indistinguishable.

stavros 1y ago
> Programs can be very close to 100% reliable when made well. This is a tautology. > I've never seen a calculator come up with the wrong answer when adding two numbers. https://imgz.org/i6XLg7Fz.png https://imgz.org/i6XLg7Fz.png > And technically, most bugs are predictable in theory, they just aren't known ahead of time. When we're talking about reliability, it doesn't matter whether a thing can be reliable in theory, it matters whether it's reliable in practice. Software is unreliable, humans are unreliable, LLMs are unreliable. To claim otherwise is just wishful thinking.
- jakelazaroff 1y ago
  That's not a tautology. You said "programs are the most reliable, though far from 100%"; they're just telling you that your upper bound for well-made programs is too low.
- sjsdaiuasgdia 1y ago
  RE: the calculator screenshot - it's still reliable because the same answer will be produced for the same inputs every time. And the behavior, though possibly confusing to the end user at times, is based on choices made in the design of the system (floating point vs integer representations, rounding/truncating behavior, etc). It's reliable deterministic logic all the way down.
  - stavros 1y ago
    > I've never seen a calculator come up with the wrong answer when adding two numbers. 1.00000001 + 1 doesn't equal 2, therefore the claim is false.
    - sjsdaiuasgdia 1y ago
      Sure it does, if you have made a system design decision about the precision of the outputs. At the precision the system is designed to operate at, the answer is 2.
- faeyanpiraat 1y ago
  You mixed up correctness and reliability. The ios calculator will make the same incorrect calculation, but reliably, every time.
  - stavros 1y ago
    Don't move the goalposts. The claim was: > I've never seen a calculator come up with the wrong answer when adding two numbers. 1.00000001 + 1 doesn't equal 2, therefore the claim is false.
mrguyorama 1y ago
>I've never seen a calculator come up with the wrong answer when adding two numbers. Intel once made a CPU that barely got some math wrong that probably would not affect the vast majority of users. The backlash from the industry was so strong that intel spent half a billion (1994) dollars replacing all of them. Our entire industry avoids floating point numbers for some types of calculations because, even though they are mostly deterministic with minimal constraints, that mental model is so hard to manage that you are better off avoiding it entirely and removing an entire class of errors from your work But now we are just supposed to do everything with a slot machine that WILL randomly just do the wrong thing some unknowable percentage of the time, and that wrong thing has no logic? No, fuck that. I don't even call myself an engineer and such frivolity is still beyond the pale. I didn't take 4 years of college and ten years of hard earned experience to build systems that will randomly fuck over people with no explanation or rhyme or reason. I DO use systems that are probabilistic in nature, but we use rather simple versions of those because when I tell management "We can't explain why the model got that output", they rightly refuse to accept that answer. Some percentage of orders getting mispredicted is fine. Orders getting mispredicted that cannot be explained entirely from their data is NOT. When a customer calls us, we cannot tell them "Oh, that's just how Neural networks are, you were unlucky". Notably, those in the industry that HAVE jumped on the neural net/"AI" bandwagon for this exact problem domain have not demonstrated anything close to seriously better results. In fact, one of our most DRAMATICALLY effective signals is a third party service that has been around for decades, and we were using a legacy integration that hadn't been updated in a decade. Meanwhile, Google's equivalent product/service couldn't even match the results of internally developed random forest models from data science teams that were.... not good. It didn't even match the service Microsoft has recently killed, which was similarly bragadocious about "AI" and similarly trash. All that panopticon's worth of data, all that computing power, all that supposed talent, all that lack of privacy and tracking, and it was almost as bad as a coin flip.