4 ms·
I didn't know i wanted this. How do you scrap all that data?
by WmyEE0UsWAwC2i 10y ago
I didn't know i wanted this.
How do you scrap all that data?
- garysieling 10y agoI started out scraping sites manually, and started automating more pieces (a lot of sites use wordpress, so they are pretty structured). I'm working on a talk on the subject, so I'll have an article soon that explains better :)
- garysieling 10y agoI wrote up some more info here on data acquisition here (just notes right now) - https://www.findlectures.com/articles/2017/01/22/Software-Architecture-of-FindLectures-com/ https://www.findlectures.com/articles/2017/01/22/Software-Ar...
- WmyEE0UsWAwC2i 10y agoThanks for the write up!