4 ms·

You are able to prompt ChatGPT to be concise, you know? They set a default and showed it to the world. It is up to you to tune it according to your preference.

by code51 4y ago

zone411 4y ago
That's right. I see so many people get stuck thinking that the default setting without a proper prompt or context is all these models can do.
astrange 4y ago
IIRC the ChatGPT paper actually says the verbosity is an unintended effect of the human raters preferring longer/more detailed answers. Long answers from GPT are unusually obnoxious because of a way the decoder works; it emits words with a much more constant rate of perplexity than human text does (this is how GPT-vs-human detectors work) which makes it sound stuffy and monotone.
- Raphaellll 4y ago
  There is a paper?
  - zone411 4y ago
    The grandparent is probably talking about the InstructGPT paper? But I don't remember seeing a preference for longer responses in that paper.
    - astrange 4y ago
      I meant the blog post. https://openai.com/blog/chatgpt/ https://openai.com/blog/chatgpt/ > The model is often excessively verbose and overuses certain phrases, such as restating that it’s a language model trained by OpenAI. These issues arise from biases in the training data (trainers prefer longer answers that look more comprehensive) and well-known over-optimization issues.12 > Stiennon, Nisan, et al. “Learning to summarize with human feedback.” Advances in Neural Information Processing Systems 33 (2020): 3008-3021. ↩ > Gao, Leo, John Schulman, and Jacob Hilton. “Scaling Laws for Reward Model Overoptimization.” arXiv preprint arXiv:2210.10760 (2022). ↩
  - deleted 4y ago
    [deleted]
- s-macke 4y ago
  I have read in a Deepmind Blog post, that language model AIs gives more reliable and correct answers, if it is forced into some Chain-of-thought prompt. Especially for questions, which involve math. Something like "Think about it first, before you give the answer". Could it be that ChatGPT is being forced in this direction?
remify 4y ago
One trick you can do is to copy a text you like the style and ask him to describe it. You can then use the response as a request.
touringa 4y ago
lol! Excellent candidate for https://www.reddit.com/r/dontyouknowwhoiam/ https://www.reddit.com/r/dontyouknowwhoiam/

You are able to prompt ChatGPT to be concise, you know? They set a default and showed it to the world. It is up to you to tune it according to your preference.

by code51 4y ago

You are able to prompt ChatGPT to be concise, you know? They set a default and showed it to the world. It is up to you to tune it according to your preference.

zone411 4y ago

That's right. I see so many people get stuck thinking that the default setting without a proper prompt or context is all these models can do.

astrange 4y ago

IIRC the ChatGPT paper actually says the verbosity is an unintended effect of the human raters preferring longer/more detailed answers. Long answers from GPT are unusually obnoxious because of a way the decoder works; it emits words with a much more constant rate of perplexity than human text does (this is how GPT-vs-human detectors work) which makes it sound stuffy and monotone.

Raphaellll 4y ago
There is a paper?
- zone411 4y ago
  The grandparent is probably talking about the InstructGPT paper? But I don't remember seeing a preference for longer responses in that paper.
  - astrange 4y ago
    I meant the blog post. https://openai.com/blog/chatgpt/ https://openai.com/blog/chatgpt/ > The model is often excessively verbose and overuses certain phrases, such as restating that it’s a language model trained by OpenAI. These issues arise from biases in the training data (trainers prefer longer answers that look more comprehensive) and well-known over-optimization issues.12 > Stiennon, Nisan, et al. “Learning to summarize with human feedback.” Advances in Neural Information Processing Systems 33 (2020): 3008-3021. ↩ > Gao, Leo, John Schulman, and Jacob Hilton. “Scaling Laws for Reward Model Overoptimization.” arXiv preprint arXiv:2210.10760 (2022). ↩
- deleted 4y ago
  [deleted]
s-macke 4y ago
I have read in a Deepmind Blog post, that language model AIs gives more reliable and correct answers, if it is forced into some Chain-of-thought prompt. Especially for questions, which involve math. Something like "Think about it first, before you give the answer". Could it be that ChatGPT is being forced in this direction?

remify 4y ago

One trick you can do is to copy a text you like the style and ask him to describe it. You can then use the response as a request.

touringa 4y ago

lol! Excellent candidate for https://www.reddit.com/r/dontyouknowwhoiam/ https://www.reddit.com/r/dontyouknowwhoiam/