3 ms·
In authors setup, sending Markova generated garbage is much lighter on resources than sending static pages. Only bots will continue to follow links to the next
by wodenokoto 1y ago
In authors setup, sending Markova generated garbage is much lighter on resources than sending static pages. Only bots will continue to follow links to the next piece of garbage and thus he traps bots in garbage. No need to detect bots, they reveal themselves.
But yes, all bots start out on an actual page.
- blackhaj7 1y agoThanks for the explanation!
- liqilin1567 1y agoSeems like these garbage pages can't trap bots. People discussed it in this thread: https://news.ycombinator.com/item?id=45711987 https://news.ycombinator.com/item?id=45711987