3 ms·
Seems like scraping and providing an alternative API would violate TOS and will receive a takedown notice in due time.
by bmcclure 3y ago
Seems like scraping and providing an alternative API would violate TOS and will receive a takedown notice in due time.
- realusername 3y agoYou don't need to agree to TOS to scrape a public website, what they write in it is moot.
- midoridensha 3y agoWasn't there a recent SCOTUS case that upheld the need to follow TOS?
- deleted 3y ago[deleted]
- Gasp0de 3y agoThey can still ban your service, e.g. block your IPs. Sure, you could then play a cat and mouse game with them, but your API clone going down every few days will make it unusable for anyone with a real purpose. The companies that reddit (officially) wants to target, e.g. OpenAI et al., have no problem scraping.
- realusername 3y agoYou can just host on Gcloud and report as GoogleBot, good luck with that. There's also plenty of proxy services. > The companies that reddit (officially) wants to target, e.g. OpenAI et al., have no problem scraping. Indeed, on their case they just need the datasets anyways
- thih9 3y agoReddit may not be a public website for long. They push their app and ask for logging in so often, it wouldn’t surprise me if they shut off parts of the site for not logged in users.
- dom96 3y agoTrue, though that will seriously hurt their SEO.