4 ms·
> We have to crawl about 60-80k news websites per day [0] Can't even imagine that number... different languages or something?
by jcun4128 5y ago
> We have to crawl about 60-80k news websites per day [0]
Can't even imagine that number... different languages or something?
- artembugara 5y agoYeah, plus many of websites are quite niche news (construction news, for example)