Here's an analogy: Have some URLs of some Web pages and want to extract the links from those pages? Okay, first do it by hand! So, have a Web browser save t

Here's an analogy: Have some URLs of some Web pages and want to extract the links from those pages? Okay, first do it by hand! So, have a Web browser save the HTML and CSS, JS, files. Then use a good editor to look at the HTML and see how to parse the thing and extract the links. Write some code to do this and try on some more of the URLs. When see are not parsing the files just right, tweak the code. Finally, get some okay code and get and parse all the HTML files from all the URLs with the code -- scalable! So, start by hand and see how to automate the work and then have a scalable solution. I just did that for a collection of about 5000 URLs!