14 ms·

If you tell it it's wrong, it often comes up with a better answer on the second try. It seems like you could maybe automate that. Let it spit out its first dra

If you tell it it's wrong, it often comes up with a better answer on the second try. It seems like you could maybe automate that. Let it spit out its first draft of an answer, have the framework tell it "please correct the errors" and then let it have another go and only present the second attempt to the user.

simmerup 4y ago
But how do you know it's wrong until a human tries the output
- mirekrusin 4y ago
  You don't need to, you always tell it it's wrong.
  - notahacker 4y ago
    But if you always tell it it's wrong, it will sometimes come up with worse answers on the second try. Which means you still need to know whether the first answer is correct or not (or neither of them) I'm reminded particularly of a screenshot of someone gaslighting ChatGPT into repeatedly apologising and providing different suggestions for Neo's favourite pizza topping, despite it answering correctly that the Matrix did not specify his favourite pizza topping first time round, but it applies equally to non-ridiculous questions
    - jstanley 4y ago
      The idea isn't that you tell it to simply change what it wrote on the first try. The idea is that having a first draft to work with allows it to rewrite a better version.
      - notahacker 4y ago
        This technique works fine if you're creating new iterations of creative work, or have a specific thing you want it to fix It's not much use if ChatGPT gives you a diagnosis of your symptoms which may or may not be accurate.
        hammyhavoc 4y ago
        Great example! What if someone refers to x part of their body incorrectly? What if they're not able to think clearly due to y reasons and tell it something completely wrong? An LLM is wholly inappropriate. As for its "bedside manner"/how polite or friendly it is, that's meaningless if it isn't good at what it does. Some of the best docs/profs I've known have been very detached and seemingly unfriendly, but I'll be damned if they weren't great at what they do. Give me the stern and grumpy doc that knows what they're doing over the cocksure LLM that can't reason.
    - hammyhavoc 4y ago
      That's assuming it doesn't just enter a fail state and keep providing the same answer again and again and again, despite explaining what about the answer is wrong.
  - deleted 4y ago
    [deleted]
ChatGTP 4y ago
Is there a bot writing these comments, I’d say everyone who used ChatGPT 4 had to know this by now and takes this into account ?
andreagrandi 4y ago
the point is: my job is not to train a deep learning model, my job is to write code. If I already know the answer, I'm not asking the question. If I can recognise something is wrong, it means I should have done that task by myself. Can it do certain things faster than me? Sure! Can it do them correctly? Most of the time it can't and if I have to spend my time to check every output, the time I saved is already wasted again.
- birdyrooster 4y ago
  The whole point of computing is to have it do tasks for us and here you are advocating that we should do tasks by ourselves. I hate everything about this.

simmerup 4y ago

But how do you know it's wrong until a human tries the output

mirekrusin 4y ago
You don't need to, you always tell it it's wrong.
- notahacker 4y ago
  But if you always tell it it's wrong, it will sometimes come up with worse answers on the second try. Which means you still need to know whether the first answer is correct or not (or neither of them) I'm reminded particularly of a screenshot of someone gaslighting ChatGPT into repeatedly apologising and providing different suggestions for Neo's favourite pizza topping, despite it answering correctly that the Matrix did not specify his favourite pizza topping first time round, but it applies equally to non-ridiculous questions
  - jstanley 4y ago
    The idea isn't that you tell it to simply change what it wrote on the first try. The idea is that having a first draft to work with allows it to rewrite a better version.
    - notahacker 4y ago
      This technique works fine if you're creating new iterations of creative work, or have a specific thing you want it to fix It's not much use if ChatGPT gives you a diagnosis of your symptoms which may or may not be accurate.
      - hammyhavoc 4y ago
        Great example! What if someone refers to x part of their body incorrectly? What if they're not able to think clearly due to y reasons and tell it something completely wrong? An LLM is wholly inappropriate. As for its "bedside manner"/how polite or friendly it is, that's meaningless if it isn't good at what it does. Some of the best docs/profs I've known have been very detached and seemingly unfriendly, but I'll be damned if they weren't great at what they do. Give me the stern and grumpy doc that knows what they're doing over the cocksure LLM that can't reason.
  - hammyhavoc 4y ago
    That's assuming it doesn't just enter a fail state and keep providing the same answer again and again and again, despite explaining what about the answer is wrong.
- deleted 4y ago
  [deleted]

ChatGTP 4y ago

Is there a bot writing these comments, I’d say everyone who used ChatGPT 4 had to know this by now and takes this into account ?

andreagrandi 4y ago

the point is: my job is not to train a deep learning model, my job is to write code. If I already know the answer, I'm not asking the question. If I can recognise something is wrong, it means I should have done that task by myself. Can it do certain things faster than me? Sure! Can it do them correctly? Most of the time it can't and if I have to spend my time to check every output, the time I saved is already wasted again.

birdyrooster 4y ago
The whole point of computing is to have it do tasks for us and here you are advocating that we should do tasks by ourselves. I hate everything about this.