2 ms·
I run scraping with Batch, CURL, SED, BCP and SQL Server 2012 or MySQL. My scripts basically download the source code into a text file, run a regex with SED to
by icu 13y ago
I run scraping with Batch, CURL, SED, BCP and SQL Server 2012 or MySQL. My scripts basically download the source code into a text file, run a regex with SED to get content and then put the info into a DB with BCP. I don't take into account any HTML codes for text so such a technique would break my scraping technique.