4 ms·
Yes. However, I think how well this works depends on how many cores you have and how evenly you spread those processes across each core.
by coderdude 16y ago
Yes. However, I think how well this works depends on how many cores you have and how evenly you spread those processes across each core.
- riobard 16y agoIf the goal is to fetch as many URLs as possible, the best bet seems to be using async epoll to simultaneously fetch tens of thousands links. Processes/threads consumes too much memory to be viable.