phunge

9 ms·

31.
by phunge 11y ago
Here's a writeup on a few approaches: http://slides.com/shirleywu/deck#/
32.
by phunge 11y ago
Have a look at DeepDive too: http://deepdive.stanford.edu/ , this looks very similar at first glance. The approach of treating data integration&extraction as a statistical inference problem is IMHO a big idea on the rise
33.
by phunge 11y ago
I had the same sentiment. I eventually ditched the gui and went back to psql (the CLI) based on this advice: http://www.craigkerstiens.com/2013/02/13/How-I-Work-With-Pos... The CLI is really really good for a
34.
by phunge 11y ago
+1 Convox is worth looking at. Fully open source, feature-rich and leverages AWS&Docker instead of reinventing the wheel.
35.
by phunge 11y ago
Timeline seems to be missing Vienna, which tried it as early as 2001 and had problems with theft. The second iteration (2004 or so?) was a great success.
36.
by phunge 11y ago
Celery works, that's been my experience. It's buggy, complicated, and we've had unresolved issues, but it more or less does the job. The language for building workflows is pretty half-baked, and there have been times when I&#
37.
by phunge 11y ago
Did netflix actually call it a "data lake"? Great idea, terrible name IMHO :)
38.
by phunge 11y ago
I've worked on such a system before and am a fan of the idea. First I've heard of the term Data Lake though. The main benefit as I see is when data sources are external, with ill-defined or ambiguous schemas. Often when you fit da
39.
by phunge 11y ago
Matt Yglesias's recent article on how car commuting is actually on the rise in the US: http://www.vox.com/2015/4/29/8505097/car-commuting Was surprised when I read that. He also ascribed some of the
40.
by phunge 12y ago
I've been using duplicity for a few years now and have been quite satisfied. It did seem slow when I first started using it. I learned to live with it; you run backups overnight anyways. From what I can remember, a lot of the slowness
41.
by phunge 12y ago
Indeed I've always thought this was a very cool algorithm. I once had to extend it for a distributed setting (think mapreduce) where you can cheaply iterate all records but not sequentially. Instead you have multiple reservoirs, and yo
42.
by phunge 12y ago
Please do -- I've been reading the linkedin/confluent/samza writeups and thinking there's a lot of truth to their ideas. It'd be great to hear more on-the-ground experience from a different perspective.
43.
by phunge 12y ago
Though OpenEmbedded is a fantastic tool with lots of recipes, lately I've been cooling off on the whole idea. IMHO, no embedded linux build is finished unless you have a way to update the device (for security issues etc). For OE: 1) it
44.
by phunge 12y ago
I've held jobs at both ends of the spectrum, from bleeding-edge to death-by-legacy. There's a good deal of pain with both approaches, that's the reality. Would your org rather deal with security vulnerabilities and no upstre
45.
by phunge 12y ago
This was some recent advice for SSH: https://stribika.github.io/2015/01/04/secure-secure-shell.ht... It was on discussed on HN, at the time noone pointed out anything glaring about the advice given.
46.
by phunge 12y ago
There's a not-widely-publicized feature of Linux that allows programs to store secrets directly in the kernel: https://www.kernel.org/doc/Documentation/security/keys.txt That has some advantages, includi
47.
by phunge 12y ago
There's a (not widely publicized) feature of Linux that enables secure key storage inside the kernel: https://www.kernel.org/doc/Documentation/security/keys.txt Storing keys in the kernel has some advant
48.
by phunge 12y ago
Just posted this on the OP: There's a big issue with the unordered_map.erase(const_iterator) method -- STL mandates that .erase() returns an iterator to the next item in the container. There's no simple implementation of that for
49.
by phunge 12y ago
PLLs are fascinating. Software PLLs are less fun than messing with the hardware, in my experience! I started working on a software PLL recently -- not analog like this one, digital. Specifically, I was trying to work out the math on a fully
50.
by phunge 12y ago
Props to Rust for tackling this head on, more languages should provide resource allocation that's deterministic, predictable and syntactically convenient. CPython's behavior is nice, but it seems to me it came about by accident. B
51.
by phunge 12y ago
Also worth checking out http://radar.oreilly.com/2014/07/questioning-the-lambda-arch... from Jay Kreps, who's part of the Kafka braintrust.
52.
by phunge 12y ago
I'm guessing it calls system() which uses /bin/sh which is symlinked to /bin/dash on debian, not /bin/bash?
53.
by phunge 12y ago
Default apache log doesn't show the contents of HTTP headers I believe.
54.
by phunge 12y ago
Might be the case! Here was my impression though (based on what I read after the fact): The laws were always on the books but rarely enforced. Only once the UBS thing broke did the IRS start cracking down. Then the OVDI happened, which pres
55.
by phunge 12y ago
I was personally bit by this (FBAR non-compliance). I worked abroad and was unknowingly violating it; found out about it from reading the news and hired a pro to extricate myself from the situation. The bank account held five figures. The c
56.
by phunge 12y ago
Any CGI script which was written in bash, that's the worry. Since mod_cgi uses environment variables to pass along HTTP headers, those programs are sure to touch the environment. Even if the CGI script is in some other language, think
57.
by phunge 12y ago
Or a startup for peer-to-peer resale of used DVDs? Though Amazon might've already locked that market up. Why rent when I can buy for $0.01 + $3.99 shipping?
58.
by phunge 12y ago
Also worth investigating for BLE: BLEduino, McThing. I keep a list, but haven't been checking back on those campaigns. Oh and Intel Edison too.
59.
by phunge 12y ago
Here's a counterargument for this, just to be a fuddy-duddy: One of the key activities in programming is reasoning about time and space cost, and this is a space optimization that's nondeterministic . It kicks in sometimes, or s
60.
by phunge 12y ago
Counterpoint: http://www.slate.com/blogs/the_eye/2013/12/10/why_cul_de_sac...

More ›