3 ms·
I wonder if there are any good sets of word vectors in languages other than English (I'm specifically interested in Polish). Same with any other language model
by r34 7y ago
I wonder if there are any good sets of word vectors in languages other than English (I'm specifically interested in Polish).
Same with any other language models and NLP related stuff. It's hard to find anything valuable.
- Der_Einzige 7y agoYeah! Fasttext has some models in polish which I can convert into the magnitude format for you! File an issue for it and I'll get it done
- r34 7y agoThanks for answering :) I have never heard about Fasttext - I will take a look.
- dcsan 7y agoYes I would look to fasttext first, they have a huge library of vectors here: https://fasttext.cc/docs/en/crawl-vectors.html https://fasttext.cc/docs/en/crawl-vectors.html Actually facebook research are pretty good at gathering things, their ParlAI project also gathers together other sources for conversational stuff.
- nestorD 7y agoAs another poster said, yes : you can find good word vectors for most languages. Furthermore, given a copy of the text from wikipedia, it only takes 2 days of computation on a laptop with a modern GPU to regenerate them from scratch for any language having a wikipedia (I did that using two R packages a few years ago, I expect that it would be even simpler nowadays).
- nathell 7y agoHere's a comprehensive list of Polish NLP resources: http://clip.ipipan.waw.pl/ http://clip.ipipan.waw.pl/ I don't think there's been much happening around word vectors specifically, but it's still worth knowing about.
- r34 7y agoThank you! I will have a look :)
- amrrs 7y agoSomething for Indian languages - https://github.com/indicnlp/ https://github.com/indicnlp/