5 ms·

I think this is a person imitating an LLM. For instance, it seems to "understand" that 15 is greater than 10. I've yet to find an LLM that can internalize tha

I think this is a person imitating an LLM. For instance, it seems to "understand" that 15 is greater than 10. I've yet to find an LLM that can internalize that.

pests 3y ago
What? I have had no issues ever comparing numbers in an LLM context. > Me: you have the numbers 3, 15, 10, and 72. can you put them in order, from least to greatest? > GPT3.5Turbo: Sure! The numbers in order from least to greatest are: 3, 10, 15, 72. > Me: now add 15, 13, 0, 293, and 1023 to the list > GPT3.5Turbo: If you add 15, 13, 0, 293, and 1023 to the list of numbers we had before (3, 15, 10, and 72), the resulting list would be: 0, 3, 10, 13, 15, 15, 72, 293, 1023 Seems to handle duplicates, larger factors having a lesser leading digit, and making changes to it. > Me: now add -5 and 5 > GPT3.5Turbo: Adding -5 and 5 to the previous list of numbers in order, we have: -5, 0, 3, 5, 10, 13, 15, 15, 72, 293, 1023 Negatives are fine too.
- OhMeadhbh 3y ago
  Hmm... that's not been my experience. But I wasn't using GPT3.5Turbo.
  - dexwiz 3y ago
    ChatGPT does seem to have gotten better at math. It was pretty garbage at it about a year ago, and really easy to trick it so you could get some sweet "haha, LLM dumb content." Choose a random number between 100 and 200, divide it by 5, multiple it by the original number, add 10, and then multiple by pi. What is the final number? ChatGPT3.5: Certainly, let's choose a random number between 100 and 200. Let's say the randomly chosen number is 150: Chosen number: 150 150 / 5 = 30 30 \* 150 = 4500 4500 + 10 = 4510 4510 \* π ≈ 14171.03 (rounded to 2 decimal places) So, the final number is approximately 14171.03 when using the randomly chosen number of 150. If you were to choose a different random number within the specified range, you would get a different result. ChatGPT4: analyzing import random import math # Choose a random number between 100 and 200 random_number = random.randint(100, 200) # Perform the calculations result = (((random_number / 5) \* random_number) + 10) \* math.pi result, random_number Result (10487.264596213448, 129) The final number, after choosing 129 as the random number between 100 and 200, is approximately 10487.26. If you ask ChatGPT 4 for a multiple step equation it appears to first translate the equation into python, run the script, and then give you the output.

I think this is a person imitating an LLM. For instance, it seems to "understand" that 15 is greater than 10. I've yet to find an LLM that can internalize that.

pests 3y ago

What? I have had no issues ever comparing numbers in an LLM context. > Me: you have the numbers 3, 15, 10, and 72. can you put them in order, from least to greatest? > GPT3.5Turbo: Sure! The numbers in order from least to greatest are: 3, 10, 15, 72. > Me: now add 15, 13, 0, 293, and 1023 to the list > GPT3.5Turbo: If you add 15, 13, 0, 293, and 1023 to the list of numbers we had before (3, 15, 10, and 72), the resulting list would be: 0, 3, 10, 13, 15, 15, 72, 293, 1023 Seems to handle duplicates, larger factors having a lesser leading digit, and making changes to it. > Me: now add -5 and 5 > GPT3.5Turbo: Adding -5 and 5 to the previous list of numbers in order, we have: -5, 0, 3, 5, 10, 13, 15, 15, 72, 293, 1023 Negatives are fine too.

OhMeadhbh 3y ago
Hmm... that's not been my experience. But I wasn't using GPT3.5Turbo.
- dexwiz 3y ago
  ChatGPT does seem to have gotten better at math. It was pretty garbage at it about a year ago, and really easy to trick it so you could get some sweet "haha, LLM dumb content." Choose a random number between 100 and 200, divide it by 5, multiple it by the original number, add 10, and then multiple by pi. What is the final number? ChatGPT3.5: Certainly, let's choose a random number between 100 and 200. Let's say the randomly chosen number is 150: Chosen number: 150 150 / 5 = 30 30 \* 150 = 4500 4500 + 10 = 4510 4510 \* π ≈ 14171.03 (rounded to 2 decimal places) So, the final number is approximately 14171.03 when using the randomly chosen number of 150. If you were to choose a different random number within the specified range, you would get a different result. ChatGPT4: analyzing import random import math # Choose a random number between 100 and 200 random_number = random.randint(100, 200) # Perform the calculations result = (((random_number / 5) \* random_number) + 10) \* math.pi result, random_number Result (10487.264596213448, 129) The final number, after choosing 129 as the random number between 100 and 200, is approximately 10487.26. If you ask ChatGPT 4 for a multiple step equation it appears to first translate the equation into python, run the script, and then give you the output.