3 ms·
In the interest of completeness I updated the code based on some on and off-list feedback. The new results are much cleaner as they ignore all anchor, image, n
by robomartin 14y ago
In the interest of completeness I updated the code based on some on and off-list feedback. The new results are much cleaner as they ignore all anchor, image, navigation and other text. I've updated the gist with the new code. Here's a sample output:
United_States
[ 118] war
[ 108] states
[ 96] american
[ 78] united
[ 42] first
[ 37] president
[ 35] rights
[ 35] world
[ 34] government
[ 33] economic
England
[ 57] henry
[ 57] king
[ 54] english
[ 43] government
[ 41] britain
[ 39] century
[ 38] war
[ 37] edward
[ 34] local
[ 34] kingdom
Brazil
[ 23] military
[ 17] portugal
[ 15] first
[ 14] portuguese
[ 13] years
[ 13] war
[ 13] president
[ 12] political
[ 12] country
[ 10] called
Argentina
[ 51] president
[ 43] military
[ 41] argentine
[ 40] government
[ 37] war
[ 36] political
[ 30] buenos
[ 30] aires
[ 24] against
[ 23] national
Canada
[ 71] british
[ 62] war
[ 53] canadian
[ 38] north
[ 37] french
[ 35] quebec
[ 34] government
[ 34] first
[ 32] american
[ 27] france
Spain
[ 103] spanish
[ 62] war
[ 46] century
[ 39] empire
[ 38] king
[ 34] under
[ 29] peninsula
[ 29] first
[ 28] roman
[ 27] country
Portugal
[ 99] portuguese
[ 28] first
[ 25] war
[ 22] king
[ 21] spanish
[ 20] independence
[ 19] east
[ 19] republic
[ 18] between
[ 18] main
Russia
[ 105] soviet
[ 105] russian
[ 68] war
[ 52] union
[ 43] citation
[ 41] century
[ 39] europe
[ 39] state
[ 38] government
[ 37] moscow
Germany
[ 240] german
[ 88] war
[ 74] empire
[ 68] east
[ 63] states
[ 57] west
[ 55] france
[ 55] prussia
[ 46] austria
[ 42] between
France
[ 221] french
[ 151] war
[ 114] louis
[ 95] king
[ 68] paris
[ 56] against
[ 52] government
[ 52] republic
[ 49] would
[ 49] empire
Japan
[ 89] japanese
[ 58] war
[ 50] emperor
[ 40] main
[ 37] military
[ 37] china
[ 35] imperial
[ 35] ashikaga
[ 35] power
[ 34] government
China
[ 127] dynasty
[ 62] chinese
[ 29] han
[ 26] emperor
[ 26] shang
[ 25] zhou
[ 25] ming
[ 22] empire
[ 20] military
[ 20] main
Saudi_Arabia
[ 83] saudi
[ 48] arabia
[ 28] oil
[ 28] king
[ 21] hejaz
[ 21] arab
[ 19] mecca
[ 18] first
[ 16] saud
[ 16] state