5 ms·

How do you ask ChatGPT to write long stories? It always stops after a while, and while you can ask it to "continue", the continuity between each answers is not

How do you ask ChatGPT to write long stories? It always stops after a while, and while you can ask it to "continue", the continuity between each answers is not really very good in my experience.

seydor 4y ago
maybe tell it to write the chapter titles and then ask each one?
- closewith 4y ago
  According to the API docs, the max tokens in a response is 2048 or 4096 depending on model, which is ~1,500 or ~3,000 words in length. Would that be enough for a chapter?
joe__f 4y ago
What happens if you specify a word count?
- iLoveOncall 4y ago
  From my experience it almost totally ignores it. Basically it will use it as an order of magnitude, nothing else.
fatneckbeard 4y ago
"When using GPT-3 or ChatGPT to generate text, you can control the length of the output by adjusting the "max length" parameter. The default value for this parameter is typically set to a relatively short length, to ensure that the model returns a prompt response. However, you can increase this value to generate longer outputs. For example, if you're using the OpenAI API to generate text, you can set the "max_tokens" parameter to a larger value to generate longer text. Similarly, if you're using the Hugging Face API, you can set the "max_length" parameter. It's important to note that increasing the max length will also increase the time and computation resources required to generate the text. This can also impact the quality of the output; if the story is too long the continuity may be affected as the model has less context to understand the story Another way to help this would be to explicitly tell the model what is the current point of the story and what are the next steps it could take, this way it could generate a more coherent continuation of the story. Additionally, you can set the "prompt" or "seed text" to a short summary of the story so far, this way the model will have more context to work with and the generated text will be more coherent with the existing story. It's worth noting that even with the above techniques, stories generated by AI may not be as polished or coherent as those written by humans, as the model does not have an innate understanding of narrative structure or character development." --chatgpt
- hooande 4y ago
  personal pet peeve: if you're going to post chatgpt responses, please also post the prompt that you used
  - fatneckbeard 4y ago
    i copy/pasted the parent comment into chatgpt

How do you ask ChatGPT to write long stories? It always stops after a while, and while you can ask it to "continue", the continuity between each answers is not really very good in my experience.

seydor 4y ago

maybe tell it to write the chapter titles and then ask each one?

closewith 4y ago
According to the API docs, the max tokens in a response is 2048 or 4096 depending on model, which is ~1,500 or ~3,000 words in length. Would that be enough for a chapter?

joe__f 4y ago

What happens if you specify a word count?

iLoveOncall 4y ago
From my experience it almost totally ignores it. Basically it will use it as an order of magnitude, nothing else.

fatneckbeard 4y ago

"When using GPT-3 or ChatGPT to generate text, you can control the length of the output by adjusting the "max length" parameter. The default value for this parameter is typically set to a relatively short length, to ensure that the model returns a prompt response. However, you can increase this value to generate longer outputs. For example, if you're using the OpenAI API to generate text, you can set the "max_tokens" parameter to a larger value to generate longer text. Similarly, if you're using the Hugging Face API, you can set the "max_length" parameter. It's important to note that increasing the max length will also increase the time and computation resources required to generate the text. This can also impact the quality of the output; if the story is too long the continuity may be affected as the model has less context to understand the story Another way to help this would be to explicitly tell the model what is the current point of the story and what are the next steps it could take, this way it could generate a more coherent continuation of the story. Additionally, you can set the "prompt" or "seed text" to a short summary of the story so far, this way the model will have more context to work with and the generated text will be more coherent with the existing story. It's worth noting that even with the above techniques, stories generated by AI may not be as polished or coherent as those written by humans, as the model does not have an innate understanding of narrative structure or character development." --chatgpt

hooande 4y ago
personal pet peeve: if you're going to post chatgpt responses, please also post the prompt that you used
- fatneckbeard 4y ago
  i copy/pasted the parent comment into chatgpt