4 ms·
What tools/data do you use for pos-tagging? I'm guessing it has to be fast, to run without a google data center :)
by internet_points 1y ago
What tools/data do you use for pos-tagging? I'm guessing it has to be fast, to run without a google data center :)
- marginalia_nu 1y agoI'm using RDRPosTagger[1], though I've optimized the code a bit so that it's not just algorithmically efficient, but to use the language in a way that is fast. It isn't perfect, but it's good enough to be useful. Language detection and sentence splitting are the other two slow bits of processing. [1] https://github.com/datquocnguyen/RDRPOSTagger https://github.com/datquocnguyen/RDRPOSTagger