2 ms·
Learning becomes problematic if you get too complex in your features though, especially if you go up to learning things like regexes. Simple ramping up in compl
by _delirium 16y ago
Learning becomes problematic if you get too complex in your features though, especially if you go up to learning things like regexes. Simple ramping up in complexity, from e.g. word counts to word-pair counts (or other low-n n-grams) does give you gains sometimes, but there've been a number of cases where increasing the space like that gave surprisingly little/no gains, which is one reason the simple models keep being used (besides simplicity and speed).
- jacquesm 16y agoThat's true. I built a 'chatbot' long ago that used simple regexes (words+wildcards) to match incoming patterns. It worked well because at the higher levels of the conversation you'd use single words to guide to a portion of the conversation tree, and lower down you could make decisions on very specific differences in the input. For a classifier that's a less useful approach, but I think single words is too narrow. 3-grams is probably the sweet spot for something like this.