3 ms·
The point about govdeals missing is real, but in practice most of these sites block scraping aggressively for good reason. The operational cost of maintaining s
by leeknoww 6mo ago
The point about govdeals missing is real, but in practice most of these sites block scraping aggressively for good reason. The operational cost of maintaining scrapers against hostile targets is non-trivial. Curious what the OP's plan is when they start rate-limiting or serving honeypot data.
- player_piano 6mo agoI'm not scraping sites like govdeals, so no need to worry about that thankfully.
- leeknoww 6mo agoThat's the right call then. How are you pulling govdeals data without scraping?