4 ms·
Parsing the html or traversing DOM is the easy part. Doing request queues, ip rotation, data quality management, exponential backoff etc. on scale is much harde
by janci 8y ago
Parsing the html or traversing DOM is the easy part. Doing request queues, ip rotation, data quality management, exponential backoff etc. on scale is much harder.
- ziflex 8y agoPRs are welcome :) There is gonna be a separate project within the organization that would do all these things and even more. It's just beginning :)