3 ms·
In fact you can already get very good results, even without a dictionary, just with a distribution of the trigrams in your input languages (which is immediate t
by a3_nm 12y ago
In fact you can already get very good results, even without a dictionary, just with a distribution of the trigrams in your input languages (which is immediate to compute from a corpus). Just compute the distribution of the sample and return the language that has the closest one.
- tripzilch 12y agoEven a single letter frequency histogram is already a very powerful discriminator to detect language. Although I suppose scoring maximum likelihood on bi- or trigrams works better for very small (sub-sentence) bits of text.