3 ms·
if you want to be really sneaky make it so the web doesn't start off infinite because as infinite site that has appeared out of nowhere will quickly be noticed
by blibble 1y ago
if you want to be really sneaky make it so the web doesn't start off infinite
because as infinite site that has appeared out of nowhere will quickly be noticed and blocked
start it off small, and grow it by a few pages every day
and the existing pages should stay 99% the same between crawls to gain reputation
- andrewflnr 1y agoThey don't especially want to be sneaky, they mostly want the crawlers to stop hammering their site. Getting blocked would be a win.
- akoboldfrying 1y agoGood thinking. One way to keep things mostly the same without having to store any of it yourself: 1. Use an RNG seeded from the request URL itself to generate each page. This is already enough for an unchanging static site of finite it infinite size. 2. With each word the generator outputs, generate a random number between, say, 0 and 1000. On day i, replace the about-to-be-output word with a link if this random number is between 0 and i. This way, every day roughly 0.1% of words will turn into links, with the rest of the text remaining stable over time.