2 ms·
TL;DR, without the dramatic narration: Naive Bayes is an old spam filter that works on words independently from each other, ie not assuming any grammatical or
by franky47 3y ago
TL;DR, without the dramatic narration:
Naive Bayes is an old spam filter that works on words independently from each other, ie not assuming any grammatical or semantical sense to what it processes.
It makes it simple, but efficient as a first line of defense against "dumb keyword stuffing spam".
(No LLM used, if that ever means anything these days).
- teruakohatu 3y ago> Naive Bayes is an old spam filter that works on words independently from each other It should be pointed out that a lot of ML models operate on a 'bag of words' approach where words (tokens) are considered without regard for structure/order. Bag of words is surprisingly powerful. It can be expanded to include n-grams (n words in order) and this makes it a powerful technique. Punctuation (where punctuation is counted as a token) is a crazy powerful predictor in text classification including spam.
- gattilorenz 3y agoTrue. It can be extended to work also on bigrams instead of individual words, I'm not sure how often this is done in spam filters. For an in-depth explanation of how it works, I suggest the excellent book from Jurafsky and Martin https://web.stanford.edu/~jurafsky/slp3/4.pdf https://web.stanford.edu/~jurafsky/slp3/4.pdf
- Karrot_Kream 3y agoYeah a good next easy step could be to use word2vec and build a quick linear regression model.