You can cross whitespace boundaries by setting flag `--split-on-whitespace` to false (it's true by default). https://github.com/google/sentencepiece/blob/maste

You can cross whitespace boundaries by setting flag `--split-on-whitespace` to false (it's true by default). https://github.com/google/sentencepiece/blob/master/doc/options.md https://github.com/google/sentencepiece/blob/master/doc/opti...