cwsteinbach

4 ms·

1.
Dali Views: Functions as a Service for Big Data LinkedIn(engineering.linkedin.com)
8 points by cwsteinbach 9y ago|0 comments
2.
by cwsteinbach 13y ago
In 1996, the US government decided that large numbers of its nuclear weapons would require replacement, refurbishing, or decommissioning. Accordingly, the Department of Energy set up a refurbishment program aimed at extending the service li
3.
by cwsteinbach 13y ago
Starlite, meet FOGBANK: http://en.wikipedia.org/wiki/Fogbank
4.
by cwsteinbach 13y ago
Another benefit of this approach is that it allows you to save storage space by eliminating the need to create a copy of the JSON data in the DB's own internal format.
5.
by cwsteinbach 13y ago
It's genuinely refreshing to have a senator who isn't embarrassed to admit that his newest legislative proposal is inspired by the plot of a Hollywood thriller.
6.
by cwsteinbach 13y ago
The CIA also covertly funded an "Anglo-American left-of-centre" literary journal named "Encounter". More details here: http://en.wikipedia.org/wiki/Encounter_(magazine) And here: https://www.cia.gov/library/center-for-the-study-of-intell
7.
by cwsteinbach 13y ago
Matt Taibbi practically makes a living writing takedowns of Thomas Friedman's Op/Ed pieces and books. Here's a selection: http://nypress.com/flathead/ http://nypress.com/flat-n-all-that/
8.
by cwsteinbach 13y ago
Several years ago I had the idea of using Markov chain algorithms to auto-generate Thomas Friedman articles. I was going to build a site around it called mechanicalfriedman.com. I just discovered someone else beat me to it: http://thomasfr
9.
by cwsteinbach 13y ago
Author here. Believe it or not I originally had the compression ratio graph rotated 90 degrees, and had manually modified it to run from 0.00 to 1.00. Google docs for some god awful reason insists on starting at 0.2 by default. Anyway, when
10.
by cwsteinbach 13y ago
> as ZFS is likely caching the reads in the ARC Each of the seven queries we used in our benchmark required a sequential scan of the 32GB dataset. It's unlikely that the ARC had any impact on the results since the EC2 instance had only
11.
by cwsteinbach 13y ago
I wasn't aware that Reiser4 supported compression. Thanks for pointing that out. As for why we chose to use ZFS instead of Btrfs, we feel that ZFS is closer to being in a state where an enterprise customer would be comfortable deploying it
12.
by cwsteinbach 13y ago
While I can't claim that we logged CPU load while running these tests, I can say that I watched the output of top and iotop and that the CPU load was relatively light. It's also worth pointing out that Amazon describes the I/O performance o
13.
by cwsteinbach 13y ago
old-gregg's point is valid. Since we didn't benchmark ZFS without compression we can't say for sure how much of the performance improvement is attributable to compression vs. just ZFS. As far as AWS goes, we have noticed ephemeral disks con
14.
Running PostgreSQL on Compression-enabled ZFS(citusdata.com)
114 points by cwsteinbach 13y ago|56 comments
15.
by cwsteinbach 14y ago
Disclaimer: I'm a committer on the Apache Hive project. A couple points in no particular order: * EMR Hive is a closed source fork of the upstream Apache Hive code base. The EMR docs imply that the latest version of EMR Hive is based on Apa
16.
Analyzing PostgreSQL Email Archives with PostgreSQL(citusdata.com)
39 points by cwsteinbach 14y ago|3 comments