6 ms·
Do you think this will be enough context to allow the model to generate novel-length, coherent stories? I expect you could summarize the preceding, already gen
by graboid 4y ago
Do you think this will be enough context to allow the model to generate novel-length, coherent stories?
I expect you could summarize the preceding, already generated story within that context, and then just prompt for the next chapter, until you reach a desired length. Just speculating here.
The one thing I truly cannot wait for is LLM's reaching the ability to generate (prose) books.
- deleted 4y ago[deleted]
- hooande 4y agoI've seen that it can also generate 25k words. That's about 30-40% of the average novel
- hattmall 4y agoCouldn't you feed it the first 25k words and tell it to continue the story?
- Sharlin 4y agoIf its context size is >= 25k words, yes. Otherwise it will just discard the start of the prompt. And it’s a sliding window, so the more it generates, the more it forgets.
- Applejinx 4y agoYou could get an 'Illuminatus!' type book out of this, especially if you steered the ending a bit in order to reference earlier stuff. If you're trying to make a sprawling epic that flings a kaleidoscope of ideas, GPT can do that sort of thing, it's just that it won't end up making sense. GPT is going to be rather poor at priming people for an amazing ending by seeding the ideas and building them into the narrative. Though if you're directing it with enough granularity, you could tell it to do that just like you'd tell yourself to do that when you're doing the writing yourself. But then you're becoming the executive writer. On a granular enough level, the most ultimate executive control of GPT would be picking individual words, just like you were writing them yourself. Once you want to step away and tell it to do the writing for you, you drift more into the GPT-nature to the point that it becomes obvious.
- r0uv3n 4y agoE.g. Kafka's metamorphosis fits entirely in the context window I believe, so short novellas might be possible. But I think you'd still definitely need to guide GPT4 along, I imagine without for example a plan for the plot formulated in advance, the overarching structure might suffer a lot / be incoherent.
- BarryMilo 4y agoWhat's interesting about AI-generated books? Apart from their novelty factor
- geysersam 4y agoGood question! It'd be really cool, but there are already more high quality books out than I'll be able to read in my lifetime.
- circlemaker 4y agoIf the book is actually good, then what is interesting about it is that it would still be about something that humans find important and relevant, due to the LLM being trained on human cultural data.
- grumbel 4y agoThey are interactive. What AI is doing with story generation is a text version of the holodeck, not just a plain old book. You can interact with the story, change its direction, explore characters and locations beyond what is provided by just a linear text. And of course you can create stories instantly about absolutely anything you want. You just throw some random ingredients at the AI and it will cook a coherent story out of them. Throw in some image generation and it'll provide you pictures of characters and locations as well. The possibilities are quite endless here. This goes way beyond just generating plain old static books.
- graboid 4y agoI mean, if it is a genuinely good book, I don't care about authorship. Death of the author etc. "I want <my favorite novel> rewritten in the style of <favorite author> but please focus more on <interesting theme>." I see so many possibilities. Passionate readers could become more like curators, sharing interesting prompts and creations. Because someone mentioned Kafka: I'd like to know what Kafka's The Trial written in the style of a PKD novel would be like.
- zirgs 4y agoWhat if I'm a huge fan of Jules Verne or Arthur Conan Doyle. I want new books from them, but the problem is that they're long dead. AI that's trained on their style could give me what I want. GRRM fans also should probably think of the ways to feed ASOIF to the AI if they want to know how it ends.
- chaos_emergent 4y agoYou could also do hierarchical generation just like OpenAI proposes doing hierarchical summarization in this post -- https://openai.com/research/summarizing-books https://openai.com/research/summarizing-books
- jchanimal 4y agoIt wasn’t that hard to work in chunks and write a book on GPT-3, can only be easier. https://docs.google.com/document/d/1vx6B6WuPDJ5Oa6nTewKmzeJMN_nDlwVTKIoMUZq91LY/edit https://docs.google.com/document/d/1vx6B6WuPDJ5Oa6nTewKmzeJM...