3 ms·
Off the top of my head... what do you think NLP means? Parsing sentences, understanding the grammar, POS... are not needed here. Named entity recognition would
by dfraser992 8y ago
Off the top of my head... what do you think NLP means? Parsing sentences, understanding the grammar, POS... are not needed here. Named entity recognition would probably be useful... NLP is such a broad term that it's almost useless, IMO.
There are a lot of research papers out there on web page classification. This sounds much like that.
Classification based on keywords sounds like the easiest, most straightforward way - read up on tf-idf [1]
topic models (e.g. LDA) is another approach [2]
[edit] And I forgot: if you're using Python, use spaCy [3]. There are quite a number of Python/Java toolkits out there for NLP type work and I keep using it as the base for a project.
[1] https://en.wikipedia.org/wiki/Tf%E2%80%93idf https://en.wikipedia.org/wiki/Tf%E2%80%93idf
[2] https://en.wikipedia.org/wiki/Latent_Dirichlet_allocation https://en.wikipedia.org/wiki/Latent_Dirichlet_allocation
[3] https://spacy.io/ https://spacy.io/