3 ms·
Try content labyrinth. I.e. infinitely generated content with a bunch of references to other generated pages. It may help against simple wget and till bots adap
by MoonGhost 1y ago
Try content labyrinth. I.e. infinitely generated content with a bunch of references to other generated pages. It may help against simple wget and till bots adapt.
PS: I'm on the bots side, but don't mind helping.
- palijer 1y agoThis doesn't work if you pay bandwidth and CPU usage for your servers though.
- MoonGhost 1y agoThat will be your contribution. If others join scrapping will become very pricey. Till bots become smarter. But then they will not download much of generated crap. Which makes it cheaper for you. Anyway, from bots perspective labyrinths aren't the main problem. Internet is being flooded with quality LLM-generated content.
- Twirrim 1y agoThe labyrinth doesn't have to be fast, and things like iocaine (https://iocaine.madhouse-project.org/ https://iocaine.madhouse-project.org/) don't use much CPU if you don't go and give them something like the Complete Works of Ahakespeare as input (Mine is using Moby Dick), and can easily be constrained with cgroups if you're concerned about resource usage. I've noticed that LLM scrapers tend to be incredibly patient. They'll wait for minutes for even small amounts of text.
- deleted 1y ago[deleted]
- bugfix 1y agoWouldn't this just waste your own bandwidth/resources?
- gwd 1y agoKinda wonder if a "content labyrinth" could be used to influence the ideas / attitudes of bots -- fill it with content pro/anti Communism, or Capitalism, or whatever your thing is, hope it tips the resulting LLM towards your ideas.