3 ms·
Your website says: > Crawls social media and image sites Most social media and image sites are specifically prohibiting crawling without written permission. H
by theamk 5y ago
Your website says:
> Crawls social media and image sites
Most social media and image sites are specifically prohibiting crawling without written permission. How do you handle that? Were you able to acquire written permission from some sites or are you liming yourself to sites which allow crawling (I am very interested in knowing what those sites are)?
- newman8r 5y agoWe haven't actually created anything substantive yet - just some prototypes that are using the reddit API - so these are questions we'll have to answer. Right now we're trying to determine if there's actually demand for it, and I'm not convinced yet. Ideally the crawls will be run on a VM that the customer controls, and the customer will be responsible for complying with the TOS of the sites they choose to crawl, and comply with their own local laws, etc.