I didn't know about this. Thank you! After some digging, I also found a great way to surprise bots that don't respect robots.txt[1] :) [1]: https://melkat.blo

I didn't know about this. Thank you! After some digging, I also found a great way to surprise bots that don't respect robots.txt[1] :) [1]: https://melkat.blog/p/unsafe-pricing https://melkat.blog/p/unsafe-pricing