4 ms·
"AI" and "simple programming" are not mutually exclusive :) look at the Speech and Language processing book, particularly chapter 3 about language models https
by gattilorenz 5y ago
"AI" and "simple programming" are not mutually exclusive :)
look at the Speech and Language processing book, particularly chapter 3 about language models https://web.stanford.edu/~jurafsky/slp3/ https://web.stanford.edu/~jurafsky/slp3/
You can implement a language model based on character n-grams to calculate whether a sequence is more likely with or without a space. Of course you would need a way of estimating the proability of each sequence, which means you need a corpus to train your language model on.