I think having this on a production website means you can crawl the web using your user's CPUs and network connections, making it harder for people to stop you

I think having this on a production website means you can crawl the web using your user's CPUs and network connections, making it harder for people to stop you from harvesting their data.