4 ms·
That function just retrieves the rating for one course, based on the course ID that the user has retrieved by searching for some courses. It is certainly reques
by pingswept 13y ago
That function just retrieves the rating for one course, based on the course ID that the user has retrieved by searching for some courses. It is certainly requesting data from Yale's server, but I wouldn't call it scraping. To qualify as scraping (at least as I've done it), you'd have to iterate over all possible IDs and store the records in a database.
For example, consider this basketball scraper: https://github.com/andrewgiessel/basketballcrawler https://github.com/andrewgiessel/basketballcrawler This builds a list of all the current NBA players and then pulls stats on all of them, saving them in a giant JSON file, IIRC. That's scraping.
What Sean Haufler is doing is not massively iterated, and it's linked in time and quantity to human-generated queries. Seems different to me.
- ricardobeat 13y agoScraping = extracting data from a third-party website. Even if you had a site on a specific course, fetching data for a single resource, it's still scraping.
- moocowduckquack 13y agoScraping = extracting data from a third-party website. That definition would seem to include some journalistic quotes.
- alanh 13y agoIt would, it that were an automated process. Can we satisfy your quibble by using the word "automated" before "extraction"?
- cynwoody 13y agoSince it's extracting additional data from the second-party website, I would classify it as enhanced browsing, not as scraping. Enhancing the browsing experience is the purpose of browser extensions.