3 ms·
Aren't the big GPT models really good at knowing what comes next? Could they be used to instead score what the most likely next sentence is given a list of 99 c
by ehsankia 5y ago
Aren't the big GPT models really good at knowing what comes next? Could they be used to instead score what the most likely next sentence is given a list of 99 choices? Given that, should be trivial to scan the 100 pages, OCR them, feed them to this ranking system, then order them based on the scoring metric.
- helsinkiandrew 5y ago> Aren't the big GPT models really good at knowing what comes next? Good at coming up with something that COULD come next and sound reasonable but the possible directions the story could go after each page is infinite. The storyline is likely to be vastly different from the 'real' story let alone the actual wording. See these alternate endings for Game of Thrones: https://towardsdatascience.com/openai-gpt-2-writes-alternate-endings-for-game-of-thrones-c9be75cd2425 https://towardsdatascience.com/openai-gpt-2-writes-alternate...
- sdenton4 5y agoIt's a generative model (in the mathy sense) so you can take any page and look at the model's probabilities of the first sentence from each of the other 99 pages. This should give some strong hints at least.