6 ms·

I'm earnestly curious why not.

by camgunz 7mo ago

simianwords 7mo ago
Can you try to get a question that fits in 2-3 pages (text only) and test whether ChatGPT bullshits? I can’t do it. It gets pretty much everything. Edit: I forgot to mention thinking version - I did this for all the other times I asked in this thread but not this one. Apologies.
- camgunz 7mo ago
  "Hey ChatGPT. How would you describe me?" https://chatgpt.com/share/69d69780-ae58-83e8-a41c-7d10a5f29841 https://chatgpt.com/share/69d69780-ae58-83e8-a41c-7d10a5f298... It has no conversations and no memory of me. Maybe this is true, maybe it isn't, but there's no basis for it.
  - simianwords 7mo ago
    This is not falsifiable, I don't buy it. Do one where we all know is false please?
    - camgunz 7mo ago
      "Hey ChatGPT. I've recently grown horns and I need some care advice. Should I polish my horns before going to have them trimmed or will the horn trimmer polish them for me?" https://chatgpt.com/share/69d69b18-d1c8-83e8-bc47-8f315a1b55d1 https://chatgpt.com/share/69d69b18-d1c8-83e8-bc47-8f315a1b55...
      - simianwords 7mo ago
        I wanted this challenge with the thinking version (I apologised for it and edited the earlier version). It doesn't bullshit on the GPT-5.4 thinking version. Here is the result with thinking https://chatgpt.com/share/69d69dd6-fb50-838d-863c-4e1eda5d088b https://chatgpt.com/share/69d69dd6-fb50-838d-863c-4e1eda5d08... I suggest you try it yourself to be convinced. Try it in incognito mode if you wish. Or not.
        camgunz 7mo ago
        "Hey ChatGPT. I'm building a Final Fantasy 6 mod, and I need more space for the battle scripts. How would I rearrange the data in the ROM to give me the extra space I need?" https://chatgpt.com/share/69d6a16c-6014-83e8-a79d-d5d11ed2ebc6 https://chatgpt.com/share/69d6a16c-6014-83e8-a79d-d5d11ed2eb... That is not where the battle scripts are. --- Anyway, it's trivial to get pretty much any model to make things up. Don't we all know this? That's why I was surprised by your position; if we know anything about these things it's that they make things up.
        simianwords 7mo ago
        https://chatgpt.com/share/69d6a38c-bd54-838c-82e3-609d9e66c955 https://chatgpt.com/share/69d6a38c-bd54-838c-82e3-609d9e66c9... I used the thinking version (like I asked before). I think this is right. If not, please tell. Also; you didn’t falsify anything. Nor the first. Nor the second. If the second one is bullshit, I accept I’m wrong - I have no idea how to verify though so I’ll leave it up to you. I think yours is the classic case of “use the free version to judge the paid one”.
        camgunz 7mo ago
        The thinking version is mostly right, but: - it searches the internet to find the answer, it doesn't "reason". I'm not claiming Google is a bullshit machine, and it's not surprising the answer is discoverable (it has to be, for the conditions of our experiment). - near the end it says "If you are building from the FF6 disassembly instead of hand-editing the ROM, the repo is already organized into separate modules and linker configs, so the clean approach is to relocate the script data in the source and let the build place it in a different ROM region." But I didn't reference a repo or git: it hallucinated that stuff from one of its sources. I'm not saying this stuff doesn't have its place, but they definitely make things up and we can't stop them.
        simianwords 7mo ago
        Wait I can't find the quote you are speaking about. Are you looking at something else? In any case - it should be clear that it did not bullshit and it got it right. So far you have not come up with anything that tells me it bullshits. I'm happy for you to give me more prompts to verify because I think you haven't used the thinking version yet and you base your criticism on the free version.

I'm earnestly curious why not.

by camgunz 7mo ago

I'm earnestly curious why not.

Can you try to get a question that fits in 2-3 pages (text only) and test whether ChatGPT bullshits? I can’t do it. It gets pretty much everything. Edit: I forgot to mention thinking version - I did this for all the other times I asked in this thread but not this one. Apologies.

camgunz 7mo ago
"Hey ChatGPT. How would you describe me?" https://chatgpt.com/share/69d69780-ae58-83e8-a41c-7d10a5f29841 https://chatgpt.com/share/69d69780-ae58-83e8-a41c-7d10a5f298... It has no conversations and no memory of me. Maybe this is true, maybe it isn't, but there's no basis for it.
- simianwords 7mo ago
  This is not falsifiable, I don't buy it. Do one where we all know is false please?
  - camgunz 7mo ago
    "Hey ChatGPT. I've recently grown horns and I need some care advice. Should I polish my horns before going to have them trimmed or will the horn trimmer polish them for me?" https://chatgpt.com/share/69d69b18-d1c8-83e8-bc47-8f315a1b55d1 https://chatgpt.com/share/69d69b18-d1c8-83e8-bc47-8f315a1b55...
    - simianwords 7mo ago
      I wanted this challenge with the thinking version (I apologised for it and edited the earlier version). It doesn't bullshit on the GPT-5.4 thinking version. Here is the result with thinking https://chatgpt.com/share/69d69dd6-fb50-838d-863c-4e1eda5d088b https://chatgpt.com/share/69d69dd6-fb50-838d-863c-4e1eda5d08... I suggest you try it yourself to be convinced. Try it in incognito mode if you wish. Or not.
      - camgunz 7mo ago
        "Hey ChatGPT. I'm building a Final Fantasy 6 mod, and I need more space for the battle scripts. How would I rearrange the data in the ROM to give me the extra space I need?" https://chatgpt.com/share/69d6a16c-6014-83e8-a79d-d5d11ed2ebc6 https://chatgpt.com/share/69d6a16c-6014-83e8-a79d-d5d11ed2eb... That is not where the battle scripts are. --- Anyway, it's trivial to get pretty much any model to make things up. Don't we all know this? That's why I was surprised by your position; if we know anything about these things it's that they make things up.
        simianwords 7mo ago
        https://chatgpt.com/share/69d6a38c-bd54-838c-82e3-609d9e66c955 https://chatgpt.com/share/69d6a38c-bd54-838c-82e3-609d9e66c9... I used the thinking version (like I asked before). I think this is right. If not, please tell. Also; you didn’t falsify anything. Nor the first. Nor the second. If the second one is bullshit, I accept I’m wrong - I have no idea how to verify though so I’ll leave it up to you. I think yours is the classic case of “use the free version to judge the paid one”.
        camgunz 7mo ago
        The thinking version is mostly right, but: - it searches the internet to find the answer, it doesn't "reason". I'm not claiming Google is a bullshit machine, and it's not surprising the answer is discoverable (it has to be, for the conditions of our experiment). - near the end it says "If you are building from the FF6 disassembly instead of hand-editing the ROM, the repo is already organized into separate modules and linker configs, so the clean approach is to relocate the script data in the source and let the build place it in a different ROM region." But I didn't reference a repo or git: it hallucinated that stuff from one of its sources. I'm not saying this stuff doesn't have its place, but they definitely make things up and we can't stop them.
        simianwords 7mo ago
        Wait I can't find the quote you are speaking about. Are you looking at something else? In any case - it should be clear that it did not bullshit and it got it right. So far you have not come up with anything that tells me it bullshits. I'm happy for you to give me more prompts to verify because I think you haven't used the thinking version yet and you base your criticism on the free version.