4 ms·

Isn’t ChatGPT also just generating plausible text that could be a response to an instruction?

• whimsicalism 4y ago
  It's not generating the most likely next word in the 'meta-corpora' of all possible discussions similar to the ones it has been trained on, it is trying to generate plausible text that would be scored well as a helpful assistant - and in the process has transferred knowledge acquired from its pre-training task.
• travisjungroth 4y ago
  Yeah, at their core they’re both trying to guess/generate what comes next. Differences: Being trained towards conversations versus code. Hyperparameters set to stop differently. “Wrappers” that form the prompt.
• circuit10 4y ago
  "that could be a response to an instruction" is the critical part here