2 ms·
The issue with non-fiction is that some information may come from the parametric memory, rather than source text supplied to the model. So then the issue is whe
by worldaroundthe 2y ago
The issue with non-fiction is that some information may come from the parametric memory, rather than source text supplied to the model. So then the issue is whether the model can process the text and summarize the book or is it cheating? Fiction published in the last few months is your best shot, though sure depending on the nature of non-fiction this evaluation can be different (but some things remain the same, like you want it to be faithful/factual and not omit important information)
- simonw 2y agoThanks, I hadn't caught that. Now I understand why the study used fiction rather than non-fiction.
- worldaroundthe 2y agoNo prob! there was not enough explanation in the paper about this (or none). As for the prompts used for merging, there is now a link in the github repo for this.