3 ms·

EDIT: oops this is the correct link: https://chat.openai.com/share/69839da8-317a-4e3b-b215-f9e9fffc8a8d https://chat.openai.com/share/69839da8-317a-4e3b-b215-f9

EDIT: oops this is the correct link: https://chat.openai.com/share/69839da8-317a-4e3b-b215-f9e9fffc8a8d https://chat.openai.com/share/69839da8-317a-4e3b-b215-f9e9ff... Previous comment: GPT-4 failing with a math question: https://chat.openai.com/share/53116ac3-0c44-410a-b367-c5df0ab4872b https://chat.openai.com/share/53116ac3-0c44-410a-b367-c5df0a... (I didn't discover this. I was just trying to confirm something that was reported elsewhere.)

varenc 3y ago
Wasn't its answer correct, 4/9? Though agreed its reasoning is nonsensical.
- rahimnathwani 3y ago
  Sorry please see my edit.
fma 3y ago
It screws up if you ask it to use 10,000 which is what Dr. Loh gave it per his interview. I just tested it, gave me this big long proof and says Therefore, the largest fraction less than 1/2 with a numerator and denominator that are positive integers less than or equal to 10000 is 9999/10000
- deleted 3y ago
  [deleted]
e1g 3y ago
Seems to do fine if you instruct it to get to the answer step-by-step: https://chat.openai.com/share/62a8cdf2-6de6-4988-b286-3b7debfc4b65 https://chat.openai.com/share/62a8cdf2-6de6-4988-b286-3b7deb...
- usaar333 3y ago
  No, that's wrong. The answer is 4999/9999
  - arthurcolle 3y ago
    Default model is GPT-3.5-TURBO not going to perform as well as GPT-4
deleted 3y ago
[deleted]
quirino 3y ago
To be fair to ChatGPT, I got the same (wrong) answer :P
tstrimple 3y ago
It's a language model, not a mathematical model. But plugins enable it to use something actually designed for this sort of work. https://www.wolfram.com/wolfram-plugin-chatgpt/ https://www.wolfram.com/wolfram-plugin-chatgpt/ Part of effectively using a tool like ChatGPT is understanding the boundaries and how to mitigate them. ChatGPT has lots of problems, but can still be incredibly useful.
- worrycue 3y ago
  But but people told me me it can actually reason because it can use abstraction or something … /s Seriously though, if it can really reason I wonder if you feed it Peano’s Axioms will it from first principles be able to do arithmetic? Then again I guess it already know about Peano’s Axioms since it’s on Wikipedia, so the answer is “no”?
- rahimnathwani 3y ago
  A few things: 1. We're already finding uses for LLMs that go beyond what they've been trained to do. They act as if they have some model of the world. What is special about math? 2. It's impossible to understand the boundaries without probing them. 3. Here's ChatGPT's response after it called Wolfram Alpha: https://chat.openai.com/share/421fb625-ef57-40e5-bdee-b423b424f4ef https://chat.openai.com/share/421fb625-ef57-40e5-bdee-b423b4...

varenc 3y ago

Wasn't its answer correct, 4/9? Though agreed its reasoning is nonsensical.

rahimnathwani 3y ago
Sorry please see my edit.

fma 3y ago

It screws up if you ask it to use 10,000 which is what Dr. Loh gave it per his interview. I just tested it, gave me this big long proof and says Therefore, the largest fraction less than 1/2 with a numerator and denominator that are positive integers less than or equal to 10000 is 9999/10000

deleted 3y ago
[deleted]

e1g 3y ago

Seems to do fine if you instruct it to get to the answer step-by-step: https://chat.openai.com/share/62a8cdf2-6de6-4988-b286-3b7debfc4b65 https://chat.openai.com/share/62a8cdf2-6de6-4988-b286-3b7deb...

usaar333 3y ago
No, that's wrong. The answer is 4999/9999
- arthurcolle 3y ago
  Default model is GPT-3.5-TURBO not going to perform as well as GPT-4

deleted 3y ago

[deleted]

quirino 3y ago

To be fair to ChatGPT, I got the same (wrong) answer :P

tstrimple 3y ago

It's a language model, not a mathematical model. But plugins enable it to use something actually designed for this sort of work. https://www.wolfram.com/wolfram-plugin-chatgpt/ https://www.wolfram.com/wolfram-plugin-chatgpt/ Part of effectively using a tool like ChatGPT is understanding the boundaries and how to mitigate them. ChatGPT has lots of problems, but can still be incredibly useful.

worrycue 3y ago
But but people told me me it can actually reason because it can use abstraction or something … /s Seriously though, if it can really reason I wonder if you feed it Peano’s Axioms will it from first principles be able to do arithmetic? Then again I guess it already know about Peano’s Axioms since it’s on Wikipedia, so the answer is “no”?
rahimnathwani 3y ago
A few things: 1. We're already finding uses for LLMs that go beyond what they've been trained to do. They act as if they have some model of the world. What is special about math? 2. It's impossible to understand the boundaries without probing them. 3. Here's ChatGPT's response after it called Wolfram Alpha: https://chat.openai.com/share/421fb625-ef57-40e5-bdee-b423b424f4ef https://chat.openai.com/share/421fb625-ef57-40e5-bdee-b423b4...