3 ms·
Any reasons why can't I search words like "the", "a", etc?
by iworkforthem 16y ago
Any reasons why can't I search words like "the", "a", etc?
- pceelurd 16y agoThese words (and a few more) have been filtered out because they are far too common in everyday English and statistically not [so] important. Had we left them in, they would probably outweigh the meaningful suggestions.
- kakaylor 16y agoPretty cool site. You might want to look into TF-IDF (term frequency-inverse document frequency) weighting as an alternative to filtering for common English words. http://en.wikipedia.org/wiki/Tf%E2%80%93idf http://en.wikipedia.org/wiki/Tf%E2%80%93idf
- pceelurd 16y agoThank you! We are using both techniques (filtering + TF-IDF weighting), actually :)