OP here, surprised to see this took off. I actually work with Japanese tokenization a lot - I took over maintenance of the most popular Python Mecab wrapper la

OP here, surprised to see this took off. I actually work with Japanese tokenization a lot - I took over maintenance of the most popular Python Mecab wrapper last year, and I have another Cython-based wrapper that I maintain. Word boundary awareness for Japanese is a pretty uncommon feature in applications, so I was surprised to see the feature had been in Chrome all along, even if it's buried and the quality has issues. Anyway, thanks to everyone who tracked down the icu imlementation and the relevant part of Chrome!