3 ms·
I've toyed with the idea of a tarpit service for badly behaved crawlers which just don't get other hints. I'm glad to see that if my services are behind cloudf
by mfontani 7y ago
I've toyed with the idea of a tarpit service for badly behaved crawlers which just don't get other hints.
I'm glad to see that if my services are behind cloudflare, I could just turn something on and let _them_ deal with it.
- dclusin 7y agoWhat is does it mean to tarpit someone? Throttle their connection?
- petre 7y agoWaste their time with a very slow server. Like OpenBSD’s spamd. Think one letter per second for text based protocols.
- mfontani 7y agoPrecisely that
- snowwolf 7y agoSomething like this https://github.com/die-net/http-tarpit https://github.com/die-net/http-tarpit
- KineticLensman 7y agoTo delay incoming connections https://en.wikipedia.org/wiki/Tarpit_(networking) https://en.wikipedia.org/wiki/Tarpit_(networking)
- judge2020 7y agoCloudflare's specific methods are described in the article, it's likely some web crypto stuff or an extreme response that takes a long time to parse or handle.