3 ms·
The technical solution is to apply a rate limit on your web server. Then Google bots will receive a HTTP status code 429 "too many requests" that will force the
by idoubtit 4y ago
The technical solution is to apply a rate limit on your web server. Then Google bots will receive a HTTP status code 429 "too many requests" that will force them to slow down.
Nginx has `limit_req_zone` that allows fine-tuning the rate limits.