3 ms·
Also, when I saw the headline, I had to think of all the LLM scrapers and bots (soon to be running directly on your AIphone!) roaming the Interwebs.
by seism 2y ago
Also, when I saw the headline, I had to think of all the LLM scrapers and bots (soon to be running directly on your AIphone!) roaming the Interwebs.
- quaintdev 2y agoJust yesterday I blocked the bots from my blog using this[1]. Of course whether these bots respect robots.txt nowadays is a different question altogether [1]: https://github.com/fardog/fardog.io/commit/b2e3eac838ea25209f2da712a68c14d01c3a1647 https://github.com/fardog/fardog.io/commit/b2e3eac838ea25209...
- fartfeatures 2y agoThey do not: https://news.ycombinator.com/item?id=40759916 https://news.ycombinator.com/item?id=40759916