3 ms·
Nice, but you want an option for specifying words (or some sane default like \b), otherwise you get unreadable output.
by xixixao 12y ago
Nice, but you want an option for specifying words (or some sane default like \b), otherwise you get unreadable output.
- jkaptur 12y agoThanks for the feedback! You're exactly right, tokenizing at the letter level is pretty rough.