3 ms·
These words (and a few more) have been filtered out because they are far too common in everyday English and statistically not [so] important. Had we left them i
by pceelurd 16y ago
These words (and a few more) have been filtered out because they are far too common in everyday English and statistically not [so] important. Had we left them in, they would probably outweigh the meaningful suggestions.
- kakaylor 16y agoPretty cool site. You might want to look into TF-IDF (term frequency-inverse document frequency) weighting as an alternative to filtering for common English words. http://en.wikipedia.org/wiki/Tf%E2%80%93idf http://en.wikipedia.org/wiki/Tf%E2%80%93idf
- pceelurd 16y agoThank you! We are using both techniques (filtering + TF-IDF weighting), actually :)