4 ms·
We've built an automated scraper and data ingestion ETL, which crawls search engines for medical PDFs. We'll definitely need to add in compliance and verificati
by johntiger1 3y ago
We've built an automated scraper and data ingestion ETL, which crawls search engines for medical PDFs. We'll definitely need to add in compliance and verification to make sure we're not crawling any protected documents.
- upon_drumhead 3y agoWhile I appreciate the sources being available, it seems like you're not just linking to where you got them but you have a static cache that you are linking to, which is being a primary redistribution source. I would presume it's only a matter of time until the lawsuits over copyright happens.
- altdataseller 3y agoIf he’s getting lawsuits it probably means he’s getting a lot of users and that would actually be a problem he wants to have eventually