samtc

4 ms·

1.
by samtc 4y ago
Fly.io is not built on top of AWS. see https://fly.io/docs/reference/regions/
2.
by samtc 6y ago
thttpd ( http://acme.com/software/thttpd/ ), mini_httpd ( http://acme.com/software/mini_httpd/ ) and micro_httpd ( http://acme.com/software/micro_httpd/ ) from acme
3.
by samtc 6y ago
Is XBRL any good? I see more filings on EDGAR/SEDAR using that.
4.
by samtc 7y ago
When you have remote hands and need to tell, over the phone, what to edit in BIOS of a specific Lenovo PC?
5.
by samtc 8y ago
You can still access com.zone [1], you have to fill a form and have a phone call with verisign and you get access to a good old FTP with a daily dump. Some other TLDs gives access through Centralized Zone Data Service [2]. Some deny access,
6.
by samtc 9y ago
It's a simple redis list containing JSON task. We have a custom Scrapy Spider hooked to next_request and item_scraped [1]. It check (lpop) for update/discovery tasks in the list and build a Request [2]. We only crawl max ~1 reques
7.
by samtc 9y ago
We monitor exceptions with Sentry. We store raw data so we don't have to hurry to fix the ETL, we only have to fix navigation logic and we keep crawling.
8.
by samtc 9y ago
I maintain ~30 different crawlers. Most of them are using Scrapy. Some are using PhantomJS/CasperJS but they are called from Scrapy via a simple web service. All data (zip files, pdf, html, xml, json) we collect are stored as-is (&#x2F
9.
by samtc 13y ago
What's wrong about billing hourly? Sometimes a client ask me to check something that's not working as expected, it could take less than 10mins, I won't do it for free nor bill a week, I'll bill an hour. I'm happy and he is. If it takes long