4 ms·

As a math teacher, this is such a funny comparison to keep reading. Yes, there's a difference between a deterministic outcome and a non-deterministic one. But

by japhyr 4y ago

As a math teacher, this is such a funny comparison to keep reading. Yes, there's a difference between a deterministic outcome and a non-deterministic one. But throw humans into the loop, and it becomes more interesting. I can't count the number of times I've listened to someone argue their answer must be right because they got it from the calculator. And it's not just students; as a teacher I've always paid attention to how adults use math. With calculators or GPT tools, or any other automated assistant, judgement and validation continues to matter.

Wowfunhappy 4y ago
> I can't count the number of times I've listened to someone argue their answer must be right because they got it from the calculator. Answers from calculators are always right! But the human may have asked the wrong question.
- lolsowrong 4y ago
  Go type .1*.2 into any JavaScript console. Edit: slapping a few more in here: https://learn.microsoft.com/en-us/office/troubleshoot/excel/floating-point-arithmetic-inaccurate-result https://learn.microsoft.com/en-us/office/troubleshoot/excel/... https://daviddeley.com/pentbug/index.htm https://daviddeley.com/pentbug/index.htm
  - tricksforfree 4y ago
    One deck is made of wood. One deck is made made of steel. They will behave differently after years of weathering. Just because they are both both decks doesn't mean they are the same.
    - lolsowrong 4y ago
      Are both useful in some context?
      - whynaut 4y ago
        In the same way that nearly any two arbitrary objects are useful in some context.
      - falcolas 4y ago
        From the perspective of an investor who just wants their stonks to go up, sure. From the perspective of a sailor who wants the deck to not crumble beneath their feet in a storm, no.
  - Wowfunhappy 4y ago
    The answer in the Javascript console is still a correct answer. The user did not specify a level of precision, and web browsers are programmed to use a precision level which is reasonable under most circumstances. If the user needs a higher level of precision, he or she needs to specify that as part of the question (such as by not using floating point numbers). I don't mean to be pedantic. I teach coding to elementary school students, and this is something fundamental I try to make them understand. A computer will always do what you tell it to do. A bug is when you accidentally tell a computer to do something different than what you'd intended. Going back to the calculator example, if a student used a calculator and got the wrong answer, the problem didn't come from the calculator. This is useful to understand; it can help the student work backwards to figure out what did go wrong. AI is different in that we've instructed the computer to develop and follow its own instructions. When ChatGPT gives the wrong answer, it is in fact giving the right answer according to the instructions it was instructed to write for itself. With this many layers of abstraction, however, the maxim that computers "always do what you tell them" is no longer useful. No human truly knows what the computer is trying to do.
    - bradjohnson 4y ago
      >The answer in the Javascript console is still a correct answer. It's wrong in the same way that saying 1/1 = 1.0004 is wrong. It's not a matter of chosen precision in that it doesn't make the answer correct when you increase the number of zeros between 1 and 4.
      - lanstin 4y ago
        It makes it less wrong. For most calculations people do we don’t that very many digits of precision for any one calculation.
        bradjohnson 4y ago
        That's true. I think that it is analogous to the discussion of AI limitations. Both of these are tools and are not categorically exclusive. In the case of translation of floating point numbers from base-2 to base-10 we have to make approximations which will often be slightly wrong forever without regard for amount of precision. With AI, depending on the pre-conditions, the AI could be stuck in a state of being slightly wrong forever for a specific question without regard to further refinement of the query. These are both still useful as tools. We just need to be able to work on the amount of refinement of the answer that the AI gives, which may be able to be solved fairly well through prompt engineering, if not through the advancement of GPT itself.
- arroz 4y ago
  No they are not
- AlecSchueler 4y ago
  Answers from AI might not always be right and a human has to learn to judge them or refine their prompts accordingly. In either case there's a tool that a human must use and become savvy with.
- actsasbuffoon 4y ago
  There are a bunch of well-known areas where popular calculators tend to give incorrect answers: https://apcentral.collegeboard.org/courses/resources/examples-of-calculator-errors https://apcentral.collegeboard.org/courses/resources/example... It’s mostly fine until it isn’t. AI will probably operate in the same capacity. We already have so much incorrect information out there that’s part of our pop culture. Even down to things like the fact that Darth Vader never said, “Luke, I am your father,” and Mae West never said, “Why don’t you come see me sometime?” Even basic movie quotes are beyond our ability to get right. Hilariously, I just asked ChatGPT about these quotes and it explained that these are common misquotes, told me what was actually said in these movies, and explained some relevant context. Sherlock never said, “Elementary, my dear Watson” even once in the books. Kirk never said, “Beam me up, Scotty.” We’re much less correct than we like to think. And somehow we’ve survived. ChatGPT is fallible just like we are. We’ll manage, just like we always have.
  - jakubmazanec 4y ago
    I have another theory about all those quotes. Regarding that Darth Vader quote, if quoted exactly, i.e. "I am you father", it isn't immediately obvious the quote is from Star Wars. "Luke" gives you a context. Sherlock and Kirk quotes are synthesized from what the characters actually said, and arguably the precise wording doesn't matter, because the point of the quote is to bring up images of the characters and situations, not of those specific words.
- A4ET8a8uTh0 4y ago
  << Answers from calculators are always right! But the human may have asked the wrong question. I actually agree with you, but, in the same vein, does it not mean that user did not ask correct prompt?
deleted 4y ago
[deleted]
EugeneOZ 4y ago
Calculators have no hallucinations, LLMs do. They can literally say that 1+1 is not 2.

by japhyr 4y ago

Wowfunhappy 4y ago

> I can't count the number of times I've listened to someone argue their answer must be right because they got it from the calculator. Answers from calculators are always right! But the human may have asked the wrong question.

lolsowrong 4y ago
Go type .1*.2 into any JavaScript console. Edit: slapping a few more in here: https://learn.microsoft.com/en-us/office/troubleshoot/excel/floating-point-arithmetic-inaccurate-result https://learn.microsoft.com/en-us/office/troubleshoot/excel/... https://daviddeley.com/pentbug/index.htm https://daviddeley.com/pentbug/index.htm
- tricksforfree 4y ago
  One deck is made of wood. One deck is made made of steel. They will behave differently after years of weathering. Just because they are both both decks doesn't mean they are the same.
  - lolsowrong 4y ago
    Are both useful in some context?
    - whynaut 4y ago
      In the same way that nearly any two arbitrary objects are useful in some context.
    - falcolas 4y ago
      From the perspective of an investor who just wants their stonks to go up, sure. From the perspective of a sailor who wants the deck to not crumble beneath their feet in a storm, no.
- Wowfunhappy 4y ago
  The answer in the Javascript console is still a correct answer. The user did not specify a level of precision, and web browsers are programmed to use a precision level which is reasonable under most circumstances. If the user needs a higher level of precision, he or she needs to specify that as part of the question (such as by not using floating point numbers). I don't mean to be pedantic. I teach coding to elementary school students, and this is something fundamental I try to make them understand. A computer will always do what you tell it to do. A bug is when you accidentally tell a computer to do something different than what you'd intended. Going back to the calculator example, if a student used a calculator and got the wrong answer, the problem didn't come from the calculator. This is useful to understand; it can help the student work backwards to figure out what did go wrong. AI is different in that we've instructed the computer to develop and follow its own instructions. When ChatGPT gives the wrong answer, it is in fact giving the right answer according to the instructions it was instructed to write for itself. With this many layers of abstraction, however, the maxim that computers "always do what you tell them" is no longer useful. No human truly knows what the computer is trying to do.
  - bradjohnson 4y ago
    >The answer in the Javascript console is still a correct answer. It's wrong in the same way that saying 1/1 = 1.0004 is wrong. It's not a matter of chosen precision in that it doesn't make the answer correct when you increase the number of zeros between 1 and 4.
    - lanstin 4y ago
      It makes it less wrong. For most calculations people do we don’t that very many digits of precision for any one calculation.
      - bradjohnson 4y ago
        That's true. I think that it is analogous to the discussion of AI limitations. Both of these are tools and are not categorically exclusive. In the case of translation of floating point numbers from base-2 to base-10 we have to make approximations which will often be slightly wrong forever without regard for amount of precision. With AI, depending on the pre-conditions, the AI could be stuck in a state of being slightly wrong forever for a specific question without regard to further refinement of the query. These are both still useful as tools. We just need to be able to work on the amount of refinement of the answer that the AI gives, which may be able to be solved fairly well through prompt engineering, if not through the advancement of GPT itself.
arroz 4y ago
No they are not
AlecSchueler 4y ago
Answers from AI might not always be right and a human has to learn to judge them or refine their prompts accordingly. In either case there's a tool that a human must use and become savvy with.
actsasbuffoon 4y ago
There are a bunch of well-known areas where popular calculators tend to give incorrect answers: https://apcentral.collegeboard.org/courses/resources/examples-of-calculator-errors https://apcentral.collegeboard.org/courses/resources/example... It’s mostly fine until it isn’t. AI will probably operate in the same capacity. We already have so much incorrect information out there that’s part of our pop culture. Even down to things like the fact that Darth Vader never said, “Luke, I am your father,” and Mae West never said, “Why don’t you come see me sometime?” Even basic movie quotes are beyond our ability to get right. Hilariously, I just asked ChatGPT about these quotes and it explained that these are common misquotes, told me what was actually said in these movies, and explained some relevant context. Sherlock never said, “Elementary, my dear Watson” even once in the books. Kirk never said, “Beam me up, Scotty.” We’re much less correct than we like to think. And somehow we’ve survived. ChatGPT is fallible just like we are. We’ll manage, just like we always have.
- jakubmazanec 4y ago
  I have another theory about all those quotes. Regarding that Darth Vader quote, if quoted exactly, i.e. "I am you father", it isn't immediately obvious the quote is from Star Wars. "Luke" gives you a context. Sherlock and Kirk quotes are synthesized from what the characters actually said, and arguably the precise wording doesn't matter, because the point of the quote is to bring up images of the characters and situations, not of those specific words.
A4ET8a8uTh0 4y ago
<< Answers from calculators are always right! But the human may have asked the wrong question. I actually agree with you, but, in the same vein, does it not mean that user did not ask correct prompt?

deleted 4y ago

[deleted]

EugeneOZ 4y ago

Calculators have no hallucinations, LLMs do. They can literally say that 1+1 is not 2.