14 ms·
Just a warning from a fellow search engine developer. If you happen to be cloud hosting this, and if you do not have a global rate limit, implement one ASAP!
by marginalia_nu 4y ago
Just a warning from a fellow search engine developer.
If you happen to be cloud hosting this, and if you do not have a global rate limit, implement one ASAP!
Several independent search engines have been hit hard by a botnet soon after they got attention, both mine and wiby.me, and I think a few others. I've had 10-12 QPS, sustained load for weeks after weeks from a rotating set of mostly eastern european IPs.
It's fine if this is on your own infrastructure, but on the cloud, you'll be racking up bills like crazy from something like that :-/