3 ms·

What skills would you say are nessecary prerequisites for understanding this material? I'm a writer, and in the past I have had success making poems and shit v

What skills would you say are nessecary prerequisites for understanding this material? I'm a writer, and in the past I have had success making poems and shit via messing around with various NLP tools like speech to text software and Google Books ngram viewer, but I've run into situations where I wish I could do something that isn't supported by the application. Could this course be a good place to start? If not do you have any recommendations? I don't really know how to code but am comfortable using a command line interface.

jamesbriggs 5y ago
Ideally I think it's useful to be familiar with Python and some NLP. Parts of the course can get reasonably in-depth, but we have tried to simplify every as much as possible and I think much of it can be followed without too much prerequisite knowledge. That being said, as a writer it sounds like you'd be most interested in generative models that generate new text, we do cover that a little in the Question Answering chapter, but otherwise, not so much. Although I don't know your ideas or plans so I can't say for sure what is good/bad for you to focus on. I do think you should read into transformer models like BERT and GPT, there is a very good free course from HuggingFace who are the 'de-facto framework' for NLP at the moment, that could be useful for you too: https://huggingface.co/course/chapter1/1 https://huggingface.co/course/chapter1/1 (chapter one will introduce everything too, definitely go through that) With HuggingFace, you can put together a simple T5 or GPT-2 text generation script with a few lines of code
amrrs 5y ago
If you want to just try something, you can look at the latest tranformer models like GPT and try fine-tuning them for poems. You can see a tutorial for content creation here https://youtu.be/d_xRYyy2LFM https://youtu.be/d_xRYyy2LFM

jamesbriggs 5y ago

Ideally I think it's useful to be familiar with Python and some NLP. Parts of the course can get reasonably in-depth, but we have tried to simplify every as much as possible and I think much of it can be followed without too much prerequisite knowledge. That being said, as a writer it sounds like you'd be most interested in generative models that generate new text, we do cover that a little in the Question Answering chapter, but otherwise, not so much. Although I don't know your ideas or plans so I can't say for sure what is good/bad for you to focus on. I do think you should read into transformer models like BERT and GPT, there is a very good free course from HuggingFace who are the 'de-facto framework' for NLP at the moment, that could be useful for you too: https://huggingface.co/course/chapter1/1 https://huggingface.co/course/chapter1/1 (chapter one will introduce everything too, definitely go through that) With HuggingFace, you can put together a simple T5 or GPT-2 text generation script with a few lines of code

amrrs 5y ago

If you want to just try something, you can look at the latest tranformer models like GPT and try fine-tuning them for poems. You can see a tutorial for content creation here https://youtu.be/d_xRYyy2LFM https://youtu.be/d_xRYyy2LFM