3 ms·
I have a similar task, but I was able to automate it with a perl script. I use Web::Scraper module along with ORLite. I check the site on a frequency for a fi
by tmaly 11y ago
I have a similar task, but I was able to automate it with a perl script. I use Web::Scraper module along with ORLite. I check the site on a frequency for a file or change to text on the page using a simple MD5 hash of the content, or the name of the file in a link. I keep track of it in a simple sqlite database. When there is a change in some SEC spec or a new file on Edgar, I grab it, mark it as processed in sqlite and then mail it to the people that need it.