5 ms·
what's the best way to scale scraping-heavy services like this without getting blocked?
by badmonster 1y ago
what's the best way to scale scraping-heavy services like this without getting blocked?
- vladkens 1y agoYou can read any public Telegram feed in your web browser at the URL: t.me/s/CHANNEL_NAME. So far it doesn't look like a problem with scrappe telegram feeds now. Unlike Reddit / X.
- nDmitry 1y agoIt depends on how their owners protect them. Switching IPs via proxies and changing user agents are well-known and relatively simple methods—essentially pretending to be different clients. However, nowadays, services like Cloudflare often render these techniques obsolete, forcing you to mimic human behavior instead. I don’t have expertise in that area.