There is this rather cute "intent laundering" ecosystem surrounding this work. Starting with Common Crawl, which uses the "we're not collecting anything, we're

There is this rather cute "intent laundering" ecosystem surrounding this work. Starting with Common Crawl, which uses the "we're not collecting anything, we're just a list of URLs" excuse to reject removal requests. And then feeding into nonprofits that effectively develop the technology for buyers such as Microsoft while being able to escape scrutiny because they're just small, charitable academic research shops...