3 ms·
This is a great technique to know. I’ve used a variant to segment Twitter hash tags into meaningful words, which is a surprisingly hard thing to do.
by nl 9y ago
This is a great technique to know. I’ve used a variant to segment Twitter hash tags into meaningful words, which is a surprisingly hard thing to do.
- abecedarius 9y agoHe has that covered too! http://norvig.com/ngrams/ http://norvig.com/ngrams/ But yeah, I tackled the same problem (for Flickr tags) and did not at first use the "obvious" algorithm; I did something slower and suboptimal.