3 ms·
And it failed at that. As the text gets longer and longer, the lack of synthesis across the contexts you've glued together becomes ever more glaring. It's a dec
by Vetch 4y ago
And it failed at that. As the text gets longer and longer, the lack of synthesis across the contexts you've glued together becomes ever more glaring. It's a decent hack but not a solution. More research is needed for how to forget properly across long contexts.
- goodside 4y agoI assume you’re familiar with this, but if not: https://openai.com/blog/summarizing-books/ https://openai.com/blog/summarizing-books/
- nutanc 4y agoFamiliar with it. But as they themselves say,the fine tuned model(not released) achieves 5/7 rating for only 15% of the time. So 85% of the time the results are not satisfactory.
- goodside 4y agoWow, didn’t notice it was that low. Thanks for walking me through this — I might try to tackle this problem next. Very interesting.
- woojoo666 4y agoTo be fair, one of the earlier comments said "I wouldn't build a summarisation startup on top of GPT3". But it seems like GPT3 is more than capable of producing summaries that are passable, and would be far cheaper than humans. It does seem feasible that one could build a startup based on that