3 ms·
Beyond a few thousand words (32k tokens for GPT-4), it seems the beginning of the story will be outside of the range that can influence the output, though perha
by not2b 3y ago
Beyond a few thousand words (32k tokens for GPT-4), it seems the beginning of the story will be outside of the range that can influence the output, though perhaps there are techniques to retain some memory, maybe you could first generate an outline and then fill in the chapters, scenes and so forth, so the limited memory becomes less of an issue.
- horsawlarway 3y agoThe problem is less that the context runs out (although for a full novel, it does become a challenge, since 32k tokens is only about half a book). The problem is more than the AI has no concept of actually telling a coherent story. It doesn't tell anything exciting or novel or cohesive - it just spits out similar literary sentences, and the more it spits out sentences that look like random novel content, the less cohesive the story gets as it matches more an more strongly on previous content that looks like random novel. Honestly, it's less like a real novel, and more like a panorama of small chunks of all sorts of different stories - Mostly unrelated and uninteresting.