3 ms·
Once, during a tech interview, the interviewer asked me to design a system for daily scraping English Wikipedia. I started with "Let's download the gzipped arch
by SergeAx 2y ago
Once, during a tech interview, the interviewer asked me to design a system for daily scraping English Wikipedia. I started with "Let's download the gzipped archive...". It turned out that the interviewer didn't know about that possibility and was waiting for the description of a complex system to download it page by page with multi-threading, canonical URLs, checking of visited pages, retries and so on. To their credit, they gave me "A" for this assignment. In the end, I got the job.