3 ms·
The pages for the search results are dynamic, based on external data. Is the idea here that, for each point in time, a static concrete, crawlable permalink is
by wow_okay 8y ago
The pages for the search results are dynamic, based on external data.
Is the idea here that, for each point in time, a static concrete, crawlable permalink is generated, with a version of the page at that point in time for a particular query?
Seems like it’d be this huge spool of link rot. The common standard for dynamic content is to flag a URI path in robots.txt as non-static content, based on live data. This is near-universal behavior for anything generated on the fly, without the intent of external linking.
Since search results are sometimes related to availability of external content, like whether the server providing the content at the search result is down or not, the quality of snapshots for concrete results would become a curiousity over time.
It would be interesting to see such an experiment, but the resources needed to host such a curiosity, catering to spell check searches, spammy requests, bot requests and so on would be suicidally prohibitive.
I think you’d need a dyson sphere to power a server attempting to host a combinatorial explosion like that. All anyone needs to do is start querying the digits of pi, to produce a spacefilling spider trap.