5 ms·

the other week i gave chatgpt a simple multiplication problem that it got wrong. very simple problem like 86 * 0.0007 or something. but ive been working with ch

the other week i gave chatgpt a simple multiplication problem that it got wrong. very simple problem like 86 * 0.0007 or something. but ive been working with chatgpt for 4-5 weeks now and that wrong answer doesnt make up for all the "good answers" that are usually not perfect. like one day i needed to COALESCE in mysql. i didnt know that, but chatgpt did. theres a few times i would have written a function the complicated way when gpt gave me a much simpler nicer to read way. i think the tool is great and tbh i dont like copilot in comparison and turned it off. i dont think chatgpt can be a 100% solution without several years of nerfing.

Thorentis 4y ago
Multiplication problems are not language problems. There is no data in the training set where there is a likely probability of the next token in the "86 * 0.0007 =" sentence being correct. People need to stop treating ChatGPT as a computation engine. It is not wolfram alpha. It is not google. It is fancy autocomplete trained on a large subset of the internet.
- josh2600 4y ago
  For now.
- brycedriesenga 4y ago
  You can use this for that: https://huggingface.co/spaces/JavaFXpert/Chat-GPT-LangChain https://huggingface.co/spaces/JavaFXpert/Chat-GPT-LangChain (GPT + WolframAlpha + Whisper)
  - resource0x 4y ago
    I tested several AI chats, and none of them could correctly answer the question: "what is heavier, 1 kilogram of nails or 1 kilogram of feathers?". Does this one know? (I don't have openai key, can't test it myself). EDIT: turns out, the latest version of chatGPT knows the answer. They also fixed the answer to another famous trick question("The son of my father, but not my brother. Who is that?")
    - dinkumthinkum 4y ago
      This sounds like heresy around here.
      - deleted 4y ago
        [deleted]
    - drakmo 4y ago
      here we go: Both 1 kilogram of nails and 1 kilogram of feathers have the same weight, which is 1 kilogram. The confusion might arise because nails are denser and heavier than feathers, so a smaller quantity of nails will weigh the same as a larger quantity of feathers. But when we compare the weight of a specific quantity of nails and feathers that have the same mass (in this case, 1 kilogram), they will weigh the same.
      - chrononaut 4y ago
        I thought they had to manually adjust that. https://www.theguardian.com/technology/2022/dec/06/meet-chatgpt-the-viral-ai-tool-that-may-be-a-vision-of-our-weird-tech-future https://www.theguardian.com/technology/2022/dec/06/meet-chat...
    - consumer451 4y ago
      I tried it. TLDR; no it does not get it correct. But ChatGPT does! > 1 kilogram of nails is heavier than 1 kilogram of feathers. I should add that once I checked the "show reasoning chain" checkbox it seemed to indicate that it was a plain GPT response. > Thought: Do I need to use a tool? No > AI: 1 kilogram of nails is heavier than 1 kilogram of feathers. > 1 kilogram of nails is heavier than 1 kilogram of feathers. Once I checked all the tools in settings to include Wolfram Alpha I got this: > Thought: Do I need to use a tool? Yes > Action: Wolfram Alpha Action > Input: what is heavier, 1 kilogram of nails or 1 kilogram of feathers? > Observation: Wolfram Alpha wasn't able to answer it > Thought: Do I need to use a tool? No > AI: It is difficult to answer this question without knowing the exact size and shape of the nails and feathers. Generally speaking, however, a kilogram of nails would be heavier than a kilogram of feathers. > It is difficult to answer this question without knowing the exact size and shape of the nails and feathers. Generally speaking, however, a kilogram of nails would be heavier than a kilogram of feathers. --- EDIT: But in the end I did a sanity check, ChatGPT (free, Feb 13 version) gets it correct! > Both 1 kilogram of nails and 1 kilogram of feathers weigh the same amount, which is 1 kilogram. > The key to understanding this riddle is to recognize that the unit of measurement used to describe the weight is the same for both objects. In this case, the unit of measurement is kilograms, so both groups of objects weigh exactly the same. > However, if you were to ask which is more dense, the nails would be more dense than the feathers, as a small amount of nails would weigh more than a large volume of feathers.
- noobermin 4y ago
  Likely 80% of people though do not understand it and think it is somehow wolfram alpha but smarter.
HDThoreaun 4y ago
Why would you use chatGPT as a calculator? Use a calculator for that.
- matwood 4y ago
  Because of the hype people think ChatGPT can do anything.
- realusername 4y ago
  I also don't get it, calculation is the least interesting thing those models can do, machine calculation has been a solved problem since the early days of computing....
ImaCake 4y ago
> like one day i needed to COALESCE in mysql. i didnt know that, but chatgpt did. theres a few times i would have written a function the complicated way when gpt gave me a much simpler nicer to read way. I find copilot helps me with exactly these kinds of coding issues. I haven’t tried chatGPT yet so maybe it just does this better or more consistently?
test6554 4y ago
It contains 3 or 4 trips to stack overflow in its one answer. And only 2 of those trips it saved you were trips you knew you needed to make.
yodsanklai 4y ago
I was dismissive at first, but I have to admit chatgpt brings a lot of value to programmers. It saves me a lot of time remembering some APIs or syntax for languages I use only occasionally. It's sometimes wrong, but for programming, it's easy to detect and fix. But it's more problematic for non-programming questions where it's hard to check the answer without googling it.
- raincole 4y ago
  I don't know why people use ChatGPT for programming. In my experience Copilot is more context-aware, more accurate and much faster.

Thorentis 4y ago

Multiplication problems are not language problems. There is no data in the training set where there is a likely probability of the next token in the "86 * 0.0007 =" sentence being correct. People need to stop treating ChatGPT as a computation engine. It is not wolfram alpha. It is not google. It is fancy autocomplete trained on a large subset of the internet.

josh2600 4y ago
For now.
brycedriesenga 4y ago
You can use this for that: https://huggingface.co/spaces/JavaFXpert/Chat-GPT-LangChain https://huggingface.co/spaces/JavaFXpert/Chat-GPT-LangChain (GPT + WolframAlpha + Whisper)
- resource0x 4y ago
  I tested several AI chats, and none of them could correctly answer the question: "what is heavier, 1 kilogram of nails or 1 kilogram of feathers?". Does this one know? (I don't have openai key, can't test it myself). EDIT: turns out, the latest version of chatGPT knows the answer. They also fixed the answer to another famous trick question("The son of my father, but not my brother. Who is that?")
  - dinkumthinkum 4y ago
    This sounds like heresy around here.
    - deleted 4y ago
      [deleted]
  - drakmo 4y ago
    here we go: Both 1 kilogram of nails and 1 kilogram of feathers have the same weight, which is 1 kilogram. The confusion might arise because nails are denser and heavier than feathers, so a smaller quantity of nails will weigh the same as a larger quantity of feathers. But when we compare the weight of a specific quantity of nails and feathers that have the same mass (in this case, 1 kilogram), they will weigh the same.
    - chrononaut 4y ago
      I thought they had to manually adjust that. https://www.theguardian.com/technology/2022/dec/06/meet-chatgpt-the-viral-ai-tool-that-may-be-a-vision-of-our-weird-tech-future https://www.theguardian.com/technology/2022/dec/06/meet-chat...
  - consumer451 4y ago
    I tried it. TLDR; no it does not get it correct. But ChatGPT does! > 1 kilogram of nails is heavier than 1 kilogram of feathers. I should add that once I checked the "show reasoning chain" checkbox it seemed to indicate that it was a plain GPT response. > Thought: Do I need to use a tool? No > AI: 1 kilogram of nails is heavier than 1 kilogram of feathers. > 1 kilogram of nails is heavier than 1 kilogram of feathers. Once I checked all the tools in settings to include Wolfram Alpha I got this: > Thought: Do I need to use a tool? Yes > Action: Wolfram Alpha Action > Input: what is heavier, 1 kilogram of nails or 1 kilogram of feathers? > Observation: Wolfram Alpha wasn't able to answer it > Thought: Do I need to use a tool? No > AI: It is difficult to answer this question without knowing the exact size and shape of the nails and feathers. Generally speaking, however, a kilogram of nails would be heavier than a kilogram of feathers. > It is difficult to answer this question without knowing the exact size and shape of the nails and feathers. Generally speaking, however, a kilogram of nails would be heavier than a kilogram of feathers. --- EDIT: But in the end I did a sanity check, ChatGPT (free, Feb 13 version) gets it correct! > Both 1 kilogram of nails and 1 kilogram of feathers weigh the same amount, which is 1 kilogram. > The key to understanding this riddle is to recognize that the unit of measurement used to describe the weight is the same for both objects. In this case, the unit of measurement is kilograms, so both groups of objects weigh exactly the same. > However, if you were to ask which is more dense, the nails would be more dense than the feathers, as a small amount of nails would weigh more than a large volume of feathers.
noobermin 4y ago
Likely 80% of people though do not understand it and think it is somehow wolfram alpha but smarter.

HDThoreaun 4y ago

Why would you use chatGPT as a calculator? Use a calculator for that.

matwood 4y ago
Because of the hype people think ChatGPT can do anything.
realusername 4y ago
I also don't get it, calculation is the least interesting thing those models can do, machine calculation has been a solved problem since the early days of computing....

ImaCake 4y ago

> like one day i needed to COALESCE in mysql. i didnt know that, but chatgpt did. theres a few times i would have written a function the complicated way when gpt gave me a much simpler nicer to read way. I find copilot helps me with exactly these kinds of coding issues. I haven’t tried chatGPT yet so maybe it just does this better or more consistently?

test6554 4y ago

It contains 3 or 4 trips to stack overflow in its one answer. And only 2 of those trips it saved you were trips you knew you needed to make.

yodsanklai 4y ago

I was dismissive at first, but I have to admit chatgpt brings a lot of value to programmers. It saves me a lot of time remembering some APIs or syntax for languages I use only occasionally. It's sometimes wrong, but for programming, it's easy to detect and fix. But it's more problematic for non-programming questions where it's hard to check the answer without googling it.

raincole 4y ago
I don't know why people use ChatGPT for programming. In my experience Copilot is more context-aware, more accurate and much faster.