3 ms·
Nice to see an alternative or rather a complementary library to the well worn nltk. Hopefully Stanza provides for supplemental training for their models.
by sireat 7y ago
Nice to see an alternative or rather a complementary library to the well worn nltk.
Hopefully Stanza provides for supplemental training for their models.
- JPKab 7y agoNLTK, for my uses, has been dethroned by Spacy for years now. I'm very curious to see how Stanza compares. It looks like it's built on PyTorch, so very interested to check it out.
- zwaps 7y agoInterestingly I had trouble using Spacy as it requires an internet connection to AWS to load their models and therefore work. This was blocked by deep packet inspection in my use case. I looked a bit for a workaround but finally decided to just do the work in NLTK. That's one disadvantage of Spacy.
- eindiran 7y agoIf I recall correctly, you can pre-download the models you need, which might be suitable for your use case.
- dcsan 7y agoyou can absolutely download the models locally: # download best-matching version of specific model for your spaCy installation python -m spacy download en_core_web_sm
- staticautomatic 7y agoFor a lot of things, yes, but NLTK still has a much bigger and better variety of tokenizers.
- hprotagonist 7y agogensim and spacy have been in that space for a while now as well.