3 ms·
> Aren't the big GPT models really good at knowing what comes next? Good at coming up with something that COULD come next and sound reasonable but the possible
by helsinkiandrew 5y ago
> Aren't the big GPT models really good at knowing what comes next?
Good at coming up with something that COULD come next and sound reasonable but the possible directions the story could go after each page is infinite.
The storyline is likely to be vastly different from the 'real' story let alone the actual wording. See these alternate endings for Game of Thrones:
https://towardsdatascience.com/openai-gpt-2-writes-alternate-endings-for-game-of-thrones-c9be75cd2425 https://towardsdatascience.com/openai-gpt-2-writes-alternate...
- sdenton4 5y agoIt's a generative model (in the mathy sense) so you can take any page and look at the model's probabilities of the first sentence from each of the other 99 pages. This should give some strong hints at least.