3 ms·

I decided such things when given an input of the comment to which I replied. If GPT were given such a comment, it could have reasonably come up with a similar a

I decided such things when given an input of the comment to which I replied. If GPT were given such a comment, it could have reasonably come up with a similar answer (it probably wouldn't look the same, as GPT isn't very intelligent, but calling it "just" a next token predictor is a gross mischaracterization.)

verdverm 4y ago
Which comments should GPT respond to on HN? All of them? If not, how to determine which ones? There is a difference here between you and the machine Looking at the LLM algorithms, they do appear to be next token predictors. Why do you ascribe something more to them when the algorithm is known? Given we know that causal patterns are in the training data, and that LLMs are capable of embedding algebra, it is understandable that they appear to "reason", while we as humans can also describe the algorithm and mechanics actually at work here.
- Sharlin 4y ago
  > All of them? If not, how to determine which ones? How does it determine how to respond to any prompt? Exactly. It might reasonably predict responses to those comments that, according to its black box, are somehow most likely to receive a reply. Different GPT instances prompted or trained to have different personalities would choose differently based on their priors and biases. I'm pretty sure the vast majority of human beings are able to reason without really having the slightest idea as to how exactly they do it. Educated humans can use language to talk about reasoning in terms of logic, and even make logic engines out of doped silicon and whatnot, but as of now, none of us has any idea of how reasoning is implemented in the mass of fat and protein that's inside our heads.
  - verdverm 4y ago
    Another interesting aspect to consider is that GPT needs priming & prompting to get it to generate a relevant response. I doubt blindly providing comment text would create valuable responses. Yet another case, many times we will respond (or not) to a questions with another question, to elicit deeper considerations. In my experience, GPTs will answer any question without thought, pun intended :]
    - Sharlin 4y ago
      ChatGPT in particular is trained to predict dialogue and helpful answers to questions, so it would naturally expect some instructions on what exactly it should do. But for example vanilla GPT-3 has no such bias and merely tries to answer the question "what is the most likely completion to this input based on my corpus?" so it might well simply start generating plausible comments that extend the thread.
      - verdverm 4y ago
        I've had it add the question mark as the first token in the response when I forget it, or intentionally leave it off
  - pwinnski 4y ago
    I think you missed the point of the parent comment. My experience with ChatGPT is that it responds to each and every thing sent to it. It doesn't seem to have the ability to not respond. The original question was, given that there were X comments which could be replied to on this page, how and why did the poster decide to respond to the one to which they responded, rather than either "all" (like ChatGPT would) or "none?"
    - Sharlin 4y ago
      If ChatGPT is given an entire message (sub)thread as input, it will decide which parts, if any, it responds to. Sure, that's a bit different from how humans tend to read and reply to these threads. If you mean feeding it the messages one at a time, then, sure, it will respond to each of them because that's what its default "goal function" is. (I assume that we're talking about a single "conversation" here so the context is retained – feeding it each comment out-of-context would be very unfair.) If you prompt it to only reply to messages it considers "interesting" in some way, and return "I'll skip this" for the others, it would certainly do that.
- ninkendo 4y ago
  If your only point is that “the modality of ChatGPT is that it responds to prompts, therefore it’s a next token predictor”, then sure. You’re not wrong, but it’s an extremely oversimplified explanation of what GPT is. It’s basically the most boring argument you could make about GPT. Yes, GPT is code that only runs when you, erm… run it. It’s not an autonomous being that’s cut loose on the internet and given free reign to use as much compute resources as it wants, a la skynet, replying to random forum posts. But nobody’s really saying that it is, so it seems a strange argument to say “it’s just a next token predictor”, if by that you really mean “it only runs when you give it a prompt.” The modality of GPT is that it responds to prompts, but the interesting question is “are the responses given a sign of intelligence?”. Saying “no, it’s just a next token predictor” is IMO a sign of a motte-and-bailey fallacy. Your motte is that it only works in response to prompts (trivially true and uninteresting), and your bailey is that it has no intelligence (very debatable and IMO false.)
coding123 4y ago
If GPT were to comment, it would comment to everyone on this board, instantly and blandly and there would be a lot of duplication. It would seem like a farce and no one would comment on HN anymore. It would be stupid and "filled with bots".
- dragonwriter 4y ago
  Well, none of the GPT models are self-willed, so it would be a matter of how the GPT powered bot was written that would determine that. I mean, sure, if you pasted every comment here intonthe ChatGPT UI and post the response back as a comment, that would hapoen, but the UI is specifically designed for people who want a response every time.

verdverm 4y ago

Which comments should GPT respond to on HN? All of them? If not, how to determine which ones? There is a difference here between you and the machine Looking at the LLM algorithms, they do appear to be next token predictors. Why do you ascribe something more to them when the algorithm is known? Given we know that causal patterns are in the training data, and that LLMs are capable of embedding algebra, it is understandable that they appear to "reason", while we as humans can also describe the algorithm and mechanics actually at work here.

Sharlin 4y ago
> All of them? If not, how to determine which ones? How does it determine how to respond to any prompt? Exactly. It might reasonably predict responses to those comments that, according to its black box, are somehow most likely to receive a reply. Different GPT instances prompted or trained to have different personalities would choose differently based on their priors and biases. I'm pretty sure the vast majority of human beings are able to reason without really having the slightest idea as to how exactly they do it. Educated humans can use language to talk about reasoning in terms of logic, and even make logic engines out of doped silicon and whatnot, but as of now, none of us has any idea of how reasoning is implemented in the mass of fat and protein that's inside our heads.
- verdverm 4y ago
  Another interesting aspect to consider is that GPT needs priming & prompting to get it to generate a relevant response. I doubt blindly providing comment text would create valuable responses. Yet another case, many times we will respond (or not) to a questions with another question, to elicit deeper considerations. In my experience, GPTs will answer any question without thought, pun intended :]
  - Sharlin 4y ago
    ChatGPT in particular is trained to predict dialogue and helpful answers to questions, so it would naturally expect some instructions on what exactly it should do. But for example vanilla GPT-3 has no such bias and merely tries to answer the question "what is the most likely completion to this input based on my corpus?" so it might well simply start generating plausible comments that extend the thread.
    - verdverm 4y ago
      I've had it add the question mark as the first token in the response when I forget it, or intentionally leave it off
- pwinnski 4y ago
  I think you missed the point of the parent comment. My experience with ChatGPT is that it responds to each and every thing sent to it. It doesn't seem to have the ability to not respond. The original question was, given that there were X comments which could be replied to on this page, how and why did the poster decide to respond to the one to which they responded, rather than either "all" (like ChatGPT would) or "none?"
  - Sharlin 4y ago
    If ChatGPT is given an entire message (sub)thread as input, it will decide which parts, if any, it responds to. Sure, that's a bit different from how humans tend to read and reply to these threads. If you mean feeding it the messages one at a time, then, sure, it will respond to each of them because that's what its default "goal function" is. (I assume that we're talking about a single "conversation" here so the context is retained – feeding it each comment out-of-context would be very unfair.) If you prompt it to only reply to messages it considers "interesting" in some way, and return "I'll skip this" for the others, it would certainly do that.
ninkendo 4y ago
If your only point is that “the modality of ChatGPT is that it responds to prompts, therefore it’s a next token predictor”, then sure. You’re not wrong, but it’s an extremely oversimplified explanation of what GPT is. It’s basically the most boring argument you could make about GPT. Yes, GPT is code that only runs when you, erm… run it. It’s not an autonomous being that’s cut loose on the internet and given free reign to use as much compute resources as it wants, a la skynet, replying to random forum posts. But nobody’s really saying that it is, so it seems a strange argument to say “it’s just a next token predictor”, if by that you really mean “it only runs when you give it a prompt.” The modality of GPT is that it responds to prompts, but the interesting question is “are the responses given a sign of intelligence?”. Saying “no, it’s just a next token predictor” is IMO a sign of a motte-and-bailey fallacy. Your motte is that it only works in response to prompts (trivially true and uninteresting), and your bailey is that it has no intelligence (very debatable and IMO false.)

coding123 4y ago

If GPT were to comment, it would comment to everyone on this board, instantly and blandly and there would be a lot of duplication. It would seem like a farce and no one would comment on HN anymore. It would be stupid and "filled with bots".

dragonwriter 4y ago
Well, none of the GPT models are self-willed, so it would be a matter of how the GPT powered bot was written that would determine that. I mean, sure, if you pasted every comment here intonthe ChatGPT UI and post the response back as a comment, that would hapoen, but the UI is specifically designed for people who want a response every time.