I'm not sure I believe this represents state of the art in this area. I think they just have put enough hours into writing rules it does a passable job for the

I'm not sure I believe this represents state of the art in this area. I think they just have put enough hours into writing rules it does a passable job for the biggest languages it supports. If you get enough rules it can look like progress. I looked at the engine for the Japanese parsing and it looks like they are parsing Japanese in fundamentally the same way they are English and it's has been known for around 20 years that is insufficient. Japanese requires tagging be done in order to tokenize it not the reverse as is done with English. Take a look at spaCy if you're interested in what's possible nowadays, but it's not an end user product. Edit: it's not quite that bad they're using GoSen which stopped being used only about 10 years ago.