2 ms·
That works great for emojis and terribly for Japanese, Chinese, Korean, Thai, etc. where each character is a three byte codepoint. Then you're literally just bu
by bastawhiz 5y ago
That works great for emojis and terribly for Japanese, Chinese, Korean, Thai, etc. where each character is a three byte codepoint. Then you're literally just building a reverse index of individual characters. If this was effective, they wouldn't be using trigrams in the first place: it's a much simpler system to implement. Sure, most languages use Latin characters in keywords, but that's unhelpful for comments.