4 ms·
Oh yeah, I mean 1 req/sec per domain of course. It's very easy to end up with tens of thousands of not-quite-closed connections while crawling, even with SO_LI
by marginalia_nu 3y ago
Oh yeah, I mean 1 req/sec per domain of course.
It's very easy to end up with tens of thousands of not-quite-closed connections while crawling, even with SO_LINGER(0), proper closure, tweaking the TCP settings, and doing all things by the book.
It's a different situation from e.g. having a bunch of incoming connections to a node, the traffic patterns are not at all similar.