3 ms·
Ask HN: How would you try to validate this data science project?
It's an image crawler + labeler: https://gigaimager.com and I'm working on it with a couple other HNers
So far, we've just been reaching out to individual developers (via reddit and discord), however it's been hard to identify those who have a current need for image datasets.
I've read many times that PPC should be avoided at this stage, but I'm curious if people here have had success with using PPC to validate an idea.
I'd also be interested in hearing how other data science startups validated their concepts if anyone can share.
- theamk 5y agoYour website says: > Crawls social media and image sites Most social media and image sites are specifically prohibiting crawling without written permission. How do you handle that? Were you able to acquire written permission from some sites or are you liming yourself to sites which allow crawling (I am very interested in knowing what those sites are)?
- newman8r 5y agoWe haven't actually created anything substantive yet - just some prototypes that are using the reddit API - so these are questions we'll have to answer. Right now we're trying to determine if there's actually demand for it, and I'm not convinced yet. Ideally the crawls will be run on a VM that the customer controls, and the customer will be responsible for complying with the TOS of the sites they choose to crawl, and comply with their own local laws, etc.