3 ms·
There are other ways of using the model other than iterative forward inference (completions). You could run the model over your novel (perhaps including a prefa
by clbrmbr 3y ago
There are other ways of using the model other than iterative forward inference (completions). You could run the model over your novel (perhaps including a preface) and look at the posterior distribution as it scans. This may not be so meaningful at the level of the token distribution, but there may be interesting ways of “spell checking” at a semantic level level. Think a thesaurus but operating at the level of whole paragraphs.