4 ms·
> Why would "creating a novel" by a human not itself be text generation based on prediction on what are the next good choices (of themes, words, etc) based on a
by duskwuff 3y ago
> Why would "creating a novel" by a human not itself be text generation based on prediction on what are the next good choices (of themes, words, etc) based on a training data set of lived experience stream and reading other literature?
Unless you're Stephen King on a cocaine bender, you don't typically write a novel in a single pass from start to finish. Most authors plan things out, at least to some degree, and go back to edit and rewrite parts of their work before calling it finished.
- astrange 3y agoThat can be expressed as text prediction. You output version 1 then output editing instructions or rewritten versions until you're done. The real issue is running out of the input window.
- anko 3y ago> The real issue is running out of the input window. isn't this what abstractions are for? you summarise the key concepts into a new input window?
- astrange 3y agoSure, but if we're talking about editing an entire book eventually the fine details do matter. That, and presumably human authors' abstraction/memories of their books are stored in some more compact form than language tokens. Though we can't be sure about that.