3 ms·
Ooh, natural language processing, my first love. You can take a corpora of text in any language, collect letter frequencies, and create a vector for each langu
by patio11 16y ago
Ooh, natural language processing, my first love.
You can take a corpora of text in any language, collect letter frequencies, and create a vector for each language. Then, when you have sample text, create a vector of letter counts. Take dot products of sample vector and pattern vectors, rank by magnitude in descending order as guesses.
You can also do this with bigrams or trigrams.
There is a lot of academic work on this question. I can't recall citations since it has been 7 years since I worked with it.