3 ms·
>> Our study presents a surprising result: the best way to detect neural fake news is to use a model that is also a generator. This could indicate the model is
by YeGoblynQueenne 7y ago
>> Our study presents a surprising result: the best way to detect neural fake news is to use a model that is also a generator.
This could indicate the model is actually representing a grammar.
In abstract terms a grammar is at the same time a recogniser and a generator. The fact that in practice, encoded grammars are only used in one or the other mode, is only an artifact of the implementation. And as I've said here before, there is at least the example of Definite Clause Grammars in Prolog, that are both generators and recognisers out of the box [1].
Anyway, a grammar capable of generating fake news text would also be capable of recognising fake news text.
________________
[1] https://en.wikipedia.org/wiki/Definite_clause_grammar#Example https://en.wikipedia.org/wiki/Definite_clause_grammar#Exampl...
- backpropaganda 7y agoIt indicates that the model is learning a good likelihood function, and that it has still not trained to convergence which makes the samples have lower likelihood scores than real text. That's all that's needed to make it a good recognizer.