3 ms·
SEEKING FREELANCER | Remote only PROJECT 1: I need a web crawler built, with the following properties: given a URL, it should completely render the page in a h
by idlewords 6y ago
SEEKING FREELANCER | Remote only
PROJECT 1: I need a web crawler built, with the following properties: given a URL, it should completely render the page in a headless browser, then save a flat (HTML + images) version of the fully rendered page, a WARC file with all page resources, and a thumbnail screenshot. The project will include some mechanism for adding credentials for crawling paywalled sites. I prefer that the coding itself be done in Python, but have no restrictions on what other stuff you rope in to get the job done.
PROJECT 2: Given a podcast URL, do your best to retrieve it and transcribe it into a readable text version.
If you're interested in either, send me a brief description of who you are, your CV, and what you charge for your time. maciej@ceglowski.com