cldellow

22 ms·

211.
by cldellow 5y ago
To me, it's not even clear from that article that Edge received a request from the Canadian government. This reads more as good PR / linkbait to get eyeballs.
212.
by cldellow 5y ago
I've had wrist and back issues intermittently during an 18-year career. What worked for me: - Minimize working on a laptop keyboard. - Rowing machine. - Be well-rested, which may require limiting caffeine intake.
213.
by cldellow 5y ago
Maybe I misread the OP, but I took their point to be that the feature "violates [...] user's privacy." To say you agree, but it's OK because people pay you for it suggests that you don't really agree.
214.
by cldellow 5y ago
I don't think that's true. Disclaimer: I know nothing about this space. But: - Oct 2020: Certus One is proud to announce the Wormhole project [1] - August 2021: Jump Trading acquires Certus One [2] [1]: https://medium.c
215.
by cldellow 5y ago
I've been running a SaaS on Render for about a year now. In past lives, I managed ~$50k/mo of AWS spend for one company and $1k/mo of Heroku spend for another. Render's great for letting us just focus on the app. There a
216.
by cldellow 5y ago
It does, but you have to enter a digit first (0 is fine) in order to see the decimal point button.
217.
by cldellow 5y ago
Sites like https://use-the-index-luke.com/ capture a lot of wisdom around tuning. But IMO, it's easier to learn from doing. So write your product, then start monitoring it as you release it to production. Postgres can
218.
by cldellow 5y ago
If you hold down control, the "Download PNG" button becomes "Download SVG". Super intuitive, I know! :)
219.
by cldellow 5y ago
Google also once presented an official canada.ca website as claiming you didn't need to pay income tax, because it had been declared unconstitutional in a court case: https://mobile.twitter.com/cldellow/status&#x2F
220.
by cldellow 5y ago
No, for example, the datediff in years for New Year's Eve and New Year's Day should be 1 (because it spans a year boundary), but EXTRACT on the difference would give you 0: select extract(year from '2021-01-01'::ti
221.
by cldellow 5y ago
It seems like one thing is that Postgres has two types for JSON: JSON and JSONB. Both validate syntax on insert. The JSONB datatype (not JSON; note the B on the end) further stores the content in a parsed, binary form so future accesses are
222.
by cldellow 5y ago
In my experience, no. Quite the opposite. Lambdas can be cost effective for bursty loads, but if you can push sustained CPU utilization, as this example does, EC2 is cheaper. For example, an ARM-based Lambda with 2 GB of RAM running for 1 h
223.
by cldellow 5y ago
The a1.4xlarge has 16 cores, not 8. One of the sales pitches of the Graviton is that it has no SMT, so you get more predictable per-core performance.
224.
by cldellow 5y ago
I wrote a framework that does regexes of the Common Crawl. The Common Crawl is a series of captures of billions of pages of the WWW. Each member in the series has ~60 TB captures. My framework runs a fairly simple pipeline: for each 1GB fil
225.
by cldellow 5y ago
That sounds to me like a reasonable criticism and discussion to have. That wasn't the argument Berenson was putting forth. He was saying that some large number of New Zealanders would be detained indefinitely in congregate settings pur
226.
by cldellow 5y ago
I don't know his motives. The most charitable interpretation is he believes he is seeing something that the rest of us aren't, and he is willing to nobly risk his reputation in order to warn us and, thus, protect us. He is doing u
227.
by cldellow 5y ago
It seems to me that Berenson didn't "fall" for Simpson's paradox. He's a smart person. He peddles inflammatory rhetoric to build an audience. For example, he portrayed New Zealand's 2-week quarantine requiremen
228.
by cldellow 5y ago
I think I recall when this feature was discussed and implemented. If it's what I'm thinking of, this concern was carefully considered: If a subquery in the FROM clause has an ORDER BY, that ORDER BY is omitted if all of the fo
229.
by cldellow 5y ago
Expanding on the regex trick: I often use [.] instead of \. to match a period. They achieve the same thing, but [.] avoids the problem of your host language "helpfully" interpolating \. into . before sending the query to Postgres.
230.
by cldellow 5y ago
I don't think he's completely missed your point -- his point is you wrote "Median income is $100,000/hr", not "Median income is $100,000/yr" Note "hour" versus "year".
231.
by cldellow 5y ago
I don't think the user agents under discussion are the UAs sent by the Facebook browser, but rather the ones sent by Facebook's crawlers. The Facebook browser is distributed across all of humanity, so it'd be expected to have
232.
by cldellow 5y ago
Proof of ownership of an email address is often used to prove ownership of an account on a third-party site. Common examples are "forget password" workflows and Spotify/Slack's magic login link workflows. If you own the
233.
by cldellow 5y ago
It's just a number, I haven't looked at any request logs to see what hit rates are like. From a money perspective, expiring them never would be fine, and a good trade off to get better latency on subsequent loads. However, if the
234.
by cldellow 5y ago
Yeah, it's for get embed code. Could definitely have used Dynamo as a persistent layer, but the PNGs are transient - the definition is stored in a GitHub gist owned by the user (another free tier! :). But generating the PNGs is expensi
235.
by cldellow 5y ago
Sketchviz [1] runs almost entirely in free tiers from Cloudflare and AWS: - Cloudflare to avoid big bandwidth bills from AWS for the wasm-compiled graphviz that is on every page - AWS Lambda's 1M free requests and 400,000 GB-seconds fo
236.
by cldellow 5y ago
That's true. On the other hand, pages with infoboxes are likely well-linked and will end up in the cache either due to legitimate popularity or due to crawler visits. Checking a random sample of 50 pages from this guy's dataset, 7
237.
by cldellow 5y ago
Even just being able to download a tarball of the HTML of the infoboxes would be really powerful, setting aside the difficulty of, say, translating them into a consistent JSON format. That plus a few other key things (categories, opening pa
238.
by cldellow 5y ago
He was probably one of the biggest users that day, so that makes sense. The 2,400 pages, assuming a 50 KB average gzipped size, equate to 120 MB of transfer. I'm assuming CPU usage is negligible due to CDN caching, and so bandwidth is
239.
by cldellow 5y ago
You could, and if he was doing this on the entire corpus that'd be the responsible thing to do. But, his project really was very reasonable: - it fetched ~2,400 pages - he cached them after first fetch - Wikipedia aggressively caches a
240.
by cldellow 5y ago
The infoboxes, which is what this guy is scraping, are much easier to scrape from the HTML than from the XML dumps. The reason is that the dumps just have pointers to templates, and you need to understand quite a bit about Wikipedia's

More ›