2 ms·
It's entirely non-statistical. It works by measuring the Hamming distance between samples using features consisting of single tokens, sequences of tokens and se
by Zak 18y ago
It's entirely non-statistical. It works by measuring the Hamming distance between samples using features consisting of single tokens, sequences of tokens and sequences of tokens with gaps. For example:
The
The quick
The quick brown
The quick ... jumped
would all be features of the input "The quick brown fox jumped over the lazy dog".
It doesn't know anything about grammar, though as a performance optimization it might be useful to limit the length of features to detectable sentence boundaries. I intend to make that behavior optional. More information here: http://crm114.sourceforge.net/docs/KNN_Hyperspace_Filters/KNN_Hyperspace_Filters.html http://crm114.sourceforge.net/docs/KNN_Hyperspace_Filters/KN...