3 ms·
The point about govdeals missing is real, but in practice most of these sites block scraping aggressively for good reason. The operational cost of maintaining s
by leeknoww 7mo ago
The point about govdeals missing is real, but in practice most of these sites block scraping aggressively for good reason. The operational cost of maintaining scrapers against hostile targets is non-trivial. Curious what the OP's plan is when they start rate-limiting or serving honeypot data.
- player_piano 7mo agoI'm not scraping sites like govdeals, so no need to worry about that thankfully.
- leeknoww 7mo agoThat's the right call then. How are you pulling govdeals data without scraping?