3 ms·
When Search Eats the Web: A Model of Corpus Erosion Under Generative Extraction
- sypsyp 3mo agoGenerative search engines may be eating the web they depend on. Spoiler: beyond a critical extraction rate, the crawlable web collapses. Spoiler bis: competition makes it worse. The paper adopts a game theoretical approach to proves it, then look at seven mechanisms that could keep the commons alive.