here's a nice project to automate this: https://marcusb.org/hacks/quixotic.html https://marcusb.org/hacks/quixotic.html couple of lines in your nginx/apache co

here's a nice project to automate this: https://marcusb.org/hacks/quixotic.html https://marcusb.org/hacks/quixotic.html couple of lines in your nginx/apache config and off you go my content rich sites provide this "high quality" data to the parasites