E.g. when running inference, if previous sequence of n tokens can be found in NYT material, decrease the weight of tokens that would result in the sequence cont

E.g. when running inference, if previous sequence of n tokens can be found in NYT material, decrease the weight of tokens that would result in the sequence continuing to be found from NYT. I imagine this can be done efficiently, if you have the content of NYT available. Presumably that is part of the training material, so this should be possible to do. I think this algorithm could also be improved to deviate more from NYT content. It would work a bit similarly as llama.cpp's grammar functionality, which permits it to produce only sequences matching a grammar, but in reverse. It of course remains to be argued if this is still some kind of plagiarization. I mean, it would know exactly what to do to avoid being a direct copy..