3 ms·
They can still ban your service, e.g. block your IPs. Sure, you could then play a cat and mouse game with them, but your API clone going down every few days wil
by Gasp0de 3y ago
They can still ban your service, e.g. block your IPs. Sure, you could then play a cat and mouse game with them, but your API clone going down every few days will make it unusable for anyone with a real purpose. The companies that reddit (officially) wants to target, e.g. OpenAI et al., have no problem scraping.
- realusername 3y agoYou can just host on Gcloud and report as GoogleBot, good luck with that. There's also plenty of proxy services. > The companies that reddit (officially) wants to target, e.g. OpenAI et al., have no problem scraping. Indeed, on their case they just need the datasets anyways