4 ms·

ChatGPT 4: Ten elephants would have a total of 32 legs if two of them are legless. Analysis: # Calculating the total number of legs for ten elephants, consid

by fear91 3y ago

ChatGPT 4: Ten elephants would have a total of 32 legs if two of them are legless. Analysis: # Calculating the total number of legs for ten elephants, considering two of them are legless # Number of legs each elephant normally has legs_per_elephant = 4 # Total number of elephants total_elephants = 10 # Number of legless elephants legless_elephants = 2 # Total number of legs # (Total elephants - Legless elephants) * Legs per elephant total_legs = (total_elephants - legless_elephants) * legs_per_elephant total_legs

8organicbits 3y ago
Did you use the same prompt?
- fear91 3y ago
  Yes, I copy pasted it (How many legs do ten elephants have, if two of them are legless?).
opheliate 3y ago
Was this its raw response to the same query as in the OP? It seems odd it would provide a response using variables named with underscores, rather than using spaces, or more traditional algebraic notation (x/y/z).
- AndroTux 3y ago
  ChatGPT (paid version at least) writes a quick python script in cases like these, and then executes it to get the result. For transparency, the script is shown in the output as well. Probably to avoid embarrassments like the ones we saw above. Example (expand the program by clicking the little link at the end of the response): https://chat.openai.com/share/31e9a077-4c24-4c17-b30d-8d0c4d1fe910 https://chat.openai.com/share/31e9a077-4c24-4c17-b30d-8d0c4d...
bhaney 3y ago
It's cool how rapidly these oft-called "fundamental problems with LLMs" vanish with bigger/better models.
- 8organicbits 3y ago
  GPT-4 examples elsewhere in the comments suggest otherwise.
- ahahahahah 3y ago
  That's just you showing that you clearly misunderstand. These aren't examples of fundamental problems, instead they are clear examples that these things are just autocomplete regardless of how many people think they are doing something more complex. It's not that getting the example correct is interesting, it's that getting it wrong is a clear sign of stupidity.
sp332 3y ago
Even the small Mixtral model gets this one right.

by fear91 3y ago

8organicbits 3y ago

Did you use the same prompt?

fear91 3y ago
Yes, I copy pasted it (How many legs do ten elephants have, if two of them are legless?).

opheliate 3y ago

Was this its raw response to the same query as in the OP? It seems odd it would provide a response using variables named with underscores, rather than using spaces, or more traditional algebraic notation (x/y/z).

AndroTux 3y ago
ChatGPT (paid version at least) writes a quick python script in cases like these, and then executes it to get the result. For transparency, the script is shown in the output as well. Probably to avoid embarrassments like the ones we saw above. Example (expand the program by clicking the little link at the end of the response): https://chat.openai.com/share/31e9a077-4c24-4c17-b30d-8d0c4d1fe910 https://chat.openai.com/share/31e9a077-4c24-4c17-b30d-8d0c4d...

bhaney 3y ago

It's cool how rapidly these oft-called "fundamental problems with LLMs" vanish with bigger/better models.

8organicbits 3y ago
GPT-4 examples elsewhere in the comments suggest otherwise.
ahahahahah 3y ago
That's just you showing that you clearly misunderstand. These aren't examples of fundamental problems, instead they are clear examples that these things are just autocomplete regardless of how many people think they are doing something more complex. It's not that getting the example correct is interesting, it's that getting it wrong is a clear sign of stupidity.

sp332 3y ago

Even the small Mixtral model gets this one right.