> I think if you don't want to supply even that, a better way would be to just close the connection and don't send anything back at all. I think this is the co

> I think if you don't want to supply even that, a better way would be to just close the connection and don't send anything back at all. I think this is the correct answer if a bad-mannered crawler has been identified. To take it a step further, one could do a HTTP version of a SSH Tarpit[1] although that's likely taking things too far. [1] https://nullprogram.com/blog/2019/03/22/ https://nullprogram.com/blog/2019/03/22/