11 ms·
Did you mean "retrieval is comparatively inexpensive"? I think I'm on the same page but this threw me off.
by cjonas 2y ago
Did you mean "retrieval is comparatively inexpensive"? I think I'm on the same page but this threw me off.
- franga2000 2y agoI read it as retrieval being the requests to the scraped site. I can parse a few thousand HTML pages in minutes, but fetching them in the first place takes hours.
- 0cf8612b2e1e 2y agoExactly what I intended. Scraping is slow (and may be an irreplaceable snapshot in time). Parsing is fast and repeatable so should be done in a separate process from a stored copy.