Problem with bigrams is that it will create a lot of nonwords. In the example given 你好世界 we’d get one bigram 好世 which no one is going to be looking for. Lots of

Problem with bigrams is that it will create a lot of nonwords. In the example given 你好世界 we’d get one bigram 好世 which no one is going to be looking for. Lots of wasted space in the index.