3 ms·
It is surprisingly difficult to get definition by word access to bulk data. A long time ago I got a hold of every comment on HN and Reddit thanks to some kind
by purple-again 8y ago
It is surprisingly difficult to get definition by word access to bulk data.
A long time ago I got a hold of every comment on HN and Reddit thanks to some kind data scientist floating around here and wanted to do a ‘word frequency by topic’ analysis but I needed to be able to define basic English before I tackled domain specific lingo like “Miss Fortune” in the “League of Legends” subreddit and slang.
Ended up giving up because I couldn’t find any remotely comprehensive lists of defined English words. There are some out there but they pail in scope to the numbers being advertised by the notable English dictionaries.