4 ms·
Its not effective vs any scraping; how do you imagine scraping works? In the most basic case, a program makes a HTTP request, gets the source of your page, and
by pixeloution 13y ago
Its not effective vs any scraping; how do you imagine scraping works? In the most basic case, a program makes a HTTP request, gets the source of your page, and processes it via a HTML parser.
In some cases, the same HTML source will be run through a headless browser to parse it, in which case javascript trickery can't protect it either.
The basic answer is: if an end user can see it in a browser, you can't hide it from a scraper.
- icu 13y agoI run scraping with Batch, CURL, SED, BCP and SQL Server 2012 or MySQL. My scripts basically download the source code into a text file, run a regex with SED to get content and then put the info into a DB with BCP. I don't take into account any HTML codes for text so such a technique would break my scraping technique.