5 ms·
I deal with this every day. Eventually we gave up on the proxy pool idea, and started running the headless browsers in the pool as Selenium nodes. It's definite
by mhluongo 12y ago
I deal with this every day. Eventually we gave up on the proxy pool idea, and started running the headless browsers in the pool as Selenium nodes. It's definitely not easy- for example, we've also had to build infrastructure that helps keep track of IPs and their history.
We've open-sourced part of it. https://github.com/cardforcoin/shale https://github.com/cardforcoin/shale