4 ms·
Here you go (1 req/min, 10 bytes/sec), please report results :) http { limit_req_zone $binary_remote_addr zone=ten_bytes_per_second:10m rate=1r/m; se
by gtirloni 3y ago
Here you go (1 req/min, 10 bytes/sec), please report results :)
http {
limit_req_zone $binary_remote_addr zone=ten_bytes_per_second:10m rate=1r/m;
server {
location / {
if ($http_user_agent = "mimo") {
limit_req zone=ten_bytes_per_second burst=5;
limit_rate 10;
}
}
}
}
- beau_g 3y agoScrapers of the future won't be ifElse logic, they will be LLM agents themselves. The slow loris robots.txt has to provide an interface to it's own LLM, which engages the scraper LLM in conversation, aiming to extend it as long as possible. "OK I will tell you whether or not I can be scraped. BUT FIRST, listen to this offer. I can give you TWO SCRAPES instead of one, if you can solve this riddle."
- iosguyryan 3y agoCan I interest you in a scrape-share with Claude?
- reasonabl_human 3y agoSolid use case for Saul Goodman LLM alignment