4 ms·

i wonder if there is a way to find what are the most popular wiki articles in non english wikipedia that are missing a page in english?

SOLAR_FIELDS 5y ago
A rough but easy to glance at heuristic would be to take the top 100 entries from each non English language Wikipedia and run them through Google translate before searching. Immediate thoughts if that isn’t effective are to increase the search range to 1000 and throw away anything that isn’t a proper noun.
smegsicle 5y ago
wikipedia has links for 'this page in other languages', so just looking for popular pages that are missing an english entry should be a pretty good collection of those of course you'd probably find a few which are simply missing the appropriate reference, and it would miss out on pages which have an inaccurate language reference to english, as iirc i've seen a few which i would call a bit too broad
- iamacyborg 5y ago
  Case in point, the English speaking world does not know about this beauty https://fr.wikipedia.org/wiki/Russe_(p%C3%A2tisserie) https://fr.wikipedia.org/wiki/Russe_(p%C3%A2tisserie)
  - gnopgnip 5y ago
    https://en.wikipedia.org/wiki/Charlotte_(cake) https://en.wikipedia.org/wiki/Charlotte_(cake)
    - palunon 5y ago
      Those have nothing to do with each others?
    - mahkeiro 5y ago
      Not related at all
  - petesergeant 5y ago
    mais aussi les francaises connaint pas le cusine extraordinaire angliase, pour example le https://en.wikipedia.org/wiki/Mushy_peas https://en.wikipedia.org/wiki/Mushy_peas et aussi ou et Le https://en.wikipedia.org/wiki/Greggs https://en.wikipedia.org/wiki/Greggs? (incredibly Mushy Peas has (only) been translated to Japanese and Javanese, and someone has taken the time to translate the article for Greggs into Galician)
    - iamacyborg 5y ago
      I don’t think the French want to know about Greggs to be honest.
  - pimlottc 5y ago
    Je le veux
mtmail 5y ago
I worked with both wikipedia pageview data and link data (between articles and between wikimedia projects). Both datasets are open, and huge of course, so technically possible. https://wikimedia.bringyour.com/ https://wikimedia.bringyour.com/
brokensegue 5y ago
I short SPARQL query on wikidata would answer this
- zaik 5y ago
  Here is how such a SPARQL query could look like: https://w.wiki/54W6 https://w.wiki/54W6 EDIT: Excluding pornographic actors: https://w.wiki/54W8 https://w.wiki/54W8
  - techdragon 5y ago
    I’d managed to forget how much I hate SPARQL. I really wanted to love wikidata but SPARQL ruined it for me.
    - tuukkah 5y ago
      You don't have to use SPARQL. For example, you could download a data dump and run Cypher queries using the Knowledge Graph Toolkit: https://github.com/usc-isi-i2/kgtk https://github.com/usc-isi-i2/kgtk
  - tuukkah 5y ago
    Virtuoso can execute the query with an ORDER BY instead of LIMIT: https://wikidata.demo.openlinksw.com/sparql/?default-graph-uri=http%3A%2F%2Fwww.wikidata.org%2F&qtxt=select%20distinct%20%3Fitem%20%3FsiteLinks%20where%20%7B%0A%20%20%3Fitem%20wdt%3AP31%20wd%3AQ5.%20%23only%20humans%0A%20%20%3Fdocument%20schema%3Aabout%20%3Fitem.%0A%20%20%3Fdocument%20wikibase%3Asitelinks%20%3FsiteLinks.%0A%20%20filter%20(%3FsiteLinks%20%3E%2010).%0A%20%20filter%20not%20exists%20%7B%0A%20%20%20%20%3Farticle%20schema%3Aabout%20%3Fitem%3B%0A%20%20%20%20%20%20%20%20%20%20%20%20%20schema%3AisPartOf%20%3Chttps%3A%2F%2Fen.wikipedia.org%2F%3E.%0A%20%20%7D%0A%20%20filter%20not%20exists%20%7B%20%3Fitem%20wdt%3AP106%20wd%3AQ488111.%20%7D%20%20%20%0A%7D%0Aorder%20by%20DESC(%3FsiteLinks)&format=text%2Fhtml&timeout=0&signal_void=on https://wikidata.demo.openlinksw.com/sparql/?default-graph-u... Top three: 1. Italian photographer https://www.wikidata.org/wiki/Q29419 https://www.wikidata.org/wiki/Q29419 2. German artist https://www.wikidata.org/wiki/Q88292 https://www.wikidata.org/wiki/Q88292 3. Indian writer https://www.wikidata.org/wiki/Q1053173 https://www.wikidata.org/wiki/Q1053173

SOLAR_FIELDS 5y ago

A rough but easy to glance at heuristic would be to take the top 100 entries from each non English language Wikipedia and run them through Google translate before searching. Immediate thoughts if that isn’t effective are to increase the search range to 1000 and throw away anything that isn’t a proper noun.

smegsicle 5y ago

wikipedia has links for 'this page in other languages', so just looking for popular pages that are missing an english entry should be a pretty good collection of those of course you'd probably find a few which are simply missing the appropriate reference, and it would miss out on pages which have an inaccurate language reference to english, as iirc i've seen a few which i would call a bit too broad

iamacyborg 5y ago
Case in point, the English speaking world does not know about this beauty https://fr.wikipedia.org/wiki/Russe_(p%C3%A2tisserie) https://fr.wikipedia.org/wiki/Russe_(p%C3%A2tisserie)
- gnopgnip 5y ago
  https://en.wikipedia.org/wiki/Charlotte_(cake) https://en.wikipedia.org/wiki/Charlotte_(cake)
  - palunon 5y ago
    Those have nothing to do with each others?
  - mahkeiro 5y ago
    Not related at all
- petesergeant 5y ago
  mais aussi les francaises connaint pas le cusine extraordinaire angliase, pour example le https://en.wikipedia.org/wiki/Mushy_peas https://en.wikipedia.org/wiki/Mushy_peas et aussi ou et Le https://en.wikipedia.org/wiki/Greggs https://en.wikipedia.org/wiki/Greggs? (incredibly Mushy Peas has (only) been translated to Japanese and Javanese, and someone has taken the time to translate the article for Greggs into Galician)
  - iamacyborg 5y ago
    I don’t think the French want to know about Greggs to be honest.
- pimlottc 5y ago
  Je le veux

mtmail 5y ago

I worked with both wikipedia pageview data and link data (between articles and between wikimedia projects). Both datasets are open, and huge of course, so technically possible. https://wikimedia.bringyour.com/ https://wikimedia.bringyour.com/

brokensegue 5y ago

I short SPARQL query on wikidata would answer this

zaik 5y ago
Here is how such a SPARQL query could look like: https://w.wiki/54W6 https://w.wiki/54W6 EDIT: Excluding pornographic actors: https://w.wiki/54W8 https://w.wiki/54W8
- techdragon 5y ago
  I’d managed to forget how much I hate SPARQL. I really wanted to love wikidata but SPARQL ruined it for me.
  - tuukkah 5y ago
    You don't have to use SPARQL. For example, you could download a data dump and run Cypher queries using the Knowledge Graph Toolkit: https://github.com/usc-isi-i2/kgtk https://github.com/usc-isi-i2/kgtk
- tuukkah 5y ago
  Virtuoso can execute the query with an ORDER BY instead of LIMIT: https://wikidata.demo.openlinksw.com/sparql/?default-graph-uri=http%3A%2F%2Fwww.wikidata.org%2F&qtxt=select%20distinct%20%3Fitem%20%3FsiteLinks%20where%20%7B%0A%20%20%3Fitem%20wdt%3AP31%20wd%3AQ5.%20%23only%20humans%0A%20%20%3Fdocument%20schema%3Aabout%20%3Fitem.%0A%20%20%3Fdocument%20wikibase%3Asitelinks%20%3FsiteLinks.%0A%20%20filter%20(%3FsiteLinks%20%3E%2010).%0A%20%20filter%20not%20exists%20%7B%0A%20%20%20%20%3Farticle%20schema%3Aabout%20%3Fitem%3B%0A%20%20%20%20%20%20%20%20%20%20%20%20%20schema%3AisPartOf%20%3Chttps%3A%2F%2Fen.wikipedia.org%2F%3E.%0A%20%20%7D%0A%20%20filter%20not%20exists%20%7B%20%3Fitem%20wdt%3AP106%20wd%3AQ488111.%20%7D%20%20%20%0A%7D%0Aorder%20by%20DESC(%3FsiteLinks)&format=text%2Fhtml&timeout=0&signal_void=on https://wikidata.demo.openlinksw.com/sparql/?default-graph-u... Top three: 1. Italian photographer https://www.wikidata.org/wiki/Q29419 https://www.wikidata.org/wiki/Q29419 2. German artist https://www.wikidata.org/wiki/Q88292 https://www.wikidata.org/wiki/Q88292 3. Indian writer https://www.wikidata.org/wiki/Q1053173 https://www.wikidata.org/wiki/Q1053173