13 ms·
Show HN: Natural Language Processing Demystified (Part One)
Hi HN:
I published part one of my free NLP course. The course is intended to help anyone who knows Python and a bit of math go from the very basics all the way to today's mainstream models and frameworks.
I strive to balance theory and practice and so every module consists of detailed explanations and slides along with a Colab notebook (in most modules) putting the theory into practice.
In part one, we cover text preprocessing, how to turn text into numbers, and multiple ways to classify and search text using "classical" approaches. And along the way, we'll pick up useful bits on how to use tools such as spaCy and scikit-learn.
No registration required: https://www.nlpdemystified.org/ https://www.nlpdemystified.org/
- mothcamp 4y agoHi HN: I published part one of my free NLP course. The course is intended to help anyone who knows Python and a bit of math go from the very basics all the way to today's mainstream models and frameworks. I strive to balance theory and practice and so every module consists of detailed explanations and slides along with a Colab notebook (in most modules) putting the theory into practice. In part one, we cover text preprocessing, how to turn text into numbers, and multiple ways to classify and search text using "classical" approaches. And along the way, we'll pick up useful bits on how to use tools such as spaCy and scikit-learn. No registration required: https://www.nlpdemystified.org/ https://www.nlpdemystified.org/
- jll29 4y agoNLP researcher here. It's great to see many offerings for courses and tutorials, and NLP has made a lot of progress, in terms of both its science as well as its re-usable software artifacts (ibraries & notebooks, standalone tools). But what saddens me is too many people are trying to dive into NLP without trying to understand language & linguistics first. For example, you can run a part of speech (POS) tagger in three lines of Python, but you will still not know much about what parts of speech are, which languages have which ones, what function they have in linguistic theory or practical applications. What are the advantages of using the C7 tagset over the C5 or PENN tagsets? Why is AT sometimes called DET? etc. I recommend people spend a bit of time to read an(y) introduction to linguistics textbook before diving into NLP, then the second investment will be worth so much more.
- xtiansimon 4y ago“I recommend people spend a bit of time to read an(y) introduction to linguistics textbook…” Linguists is a broad area of study. Can you be more specific? Such as grammar and syntax.
- PainfullyNormal 4y ago> I recommend people spend a bit of time to read an(y) introduction to linguistics textbook Do you have a favorite you can recommend?
- mothcamp 4y agoIn addition to Jurafsky and Martin (https://web.stanford.edu/~jurafsky/slp3/ https://web.stanford.edu/~jurafsky/slp3/), I also like Emily Bender's book: https://www.goodreads.com/book/show/18128399-linguistic-fundamentals-for-natural-language-processing https://www.goodreads.com/book/show/18128399-linguistic-fund... Bender's book is NOT an end-to-end text though imo. It's more a central jumping off point. So you can read about a concept and if it sounds interesting, search more about it.
- rmellow 4y agoIn addition to Jurafsky and Martin, I recommend Foundations of Statistical NLP by Manning and Schutze: https://nlp.stanford.edu/fsnlp/promo/ https://nlp.stanford.edu/fsnlp/promo/
- jasfi 4y agoI'm working on extracting facts from sentences, see https://lxagi.com https://lxagi.com. Which are the toughest NLP problems you know of that aren't being solved satisfactorily?
- airstrike 4y agoGetting an invalid HTTPS certificate
- jasfi 4y agoIt works for me, which browser are you using? Can you see the certificate?
- Der_Einzige 4y agoQueryable, word level, extractive summarization with grammatical correctness. AKA: what a human does when they are "highlighting" a document. think extractive QA but the answer size should be configurable and the answer can potentially be multiple spans, and spans may not need to be contiguous. If you got a solution, I'd love to see it - and you could even beat the baselines for the only dataset that exists for it: https://paperswithcode.com/sota/extractive-document-summarization-on https://paperswithcode.com/sota/extractive-document-summariz...
- jasfi 4y agoThanks, I'll add that to the list of possible use cases, although that will take additional time. The solution won't be ready anytime soon, so please sign-up for the announcement list on the website if you're interested.
- jasfi 4y agoCan I ask more about your interest in NLP? How can I contact you?
- riku_iki 4y agoActually, problem you are working on doesn't look like solved satisfactory yet :-)
- deleted 4y ago[deleted]
- Utkarsh_Mood 4y agoLooks great, thanks for this!