mmt

119 ms·

631.
by mmt 8y ago
It's probably easy enough to simulate the "bash" implementation done in a distributed way. Doing that python library full parsing locally, 10,000 lines (or however much memory one can configure up to) at a time might also be
632.
Scalability but at what COST? (2015)(frankmcsherry.org)
1 points by mmt 8y ago|0 comments
633.
by mmt 8y ago
> We run 30 node, autoscaling clusters which stay close to 100% for most of the time. I have exactly zero knowledge on Spark's efficiency as well as zero on how representative graph algorithms are, but I can confidently say that the
634.
by mmt 8y ago
Today's "exotic" (which is actually just high-end commodity) is tomorrow's middling. I'm not sure it's fair to summarize any one thing as "the entire point" of Hadoop, but, as I recall, it was, origin
635.
by mmt 8y ago
Close, but not quite, since what's available (space in the specific example) isn't being filled. Alternatively, with the complaint that desktop software feels more sluggish on a modern computer than contemporaneous software did on
636.
by mmt 8y ago
I'd venture that's a little too cynical, as it violates the "never attribute to malice what can adequately be explained by ineptitude" rule :) I'm not suggesting that something like resume-padding is never a motiv
637.
by mmt 8y ago
> I think that past a terabyte, there begin to be strong arguments to a distributed approach even if you can theoretically handle it on one machine I've elaborated on these in another comment, as well. Today, drawing the line at a s
638.
by mmt 8y ago
> a single machine may be harder to schedule to be close to fully allocated That seems remarkably unlikely if there truly is only the one. Maybe I don't understand what you mean, though. How is that any different from having a singl
639.
by mmt 8y ago
> Early employees probably need this too. If you really want smart talent (and you should, you really need it), you should stop trying to screw them. More so than founders, since those employees, in general, have no say in what happens t
640.
by mmt 8y ago
I think this is the other point that's so often missed/ignored in the "big data" discussion: there's a middle ground between everything-fits-in-memory and must-be-distributed. The Adam Drake article alludes to it on
641.
by mmt 8y ago
> They're well understood by anyone who has used these technologies professionally. I probably should have been ore precise with my language, though So.. It's well understood by True Scotsmen? :) I certainly understood that th
642.
by mmt 8y ago
> are well-understood. It's true that many people try to use Hadoop when they'd be better served with simpler solutions I posit that these two assertions are contradictory. My own understanding of the term "well understoo
643.
by mmt 8y ago
It's not just consumer software and not just the last 20 years. There is an axiom that software gets bigger, for no particularly good reason, for at least 40 years. This can be witnessed in how the size of /bin/true on Unix w
644.
by mmt 8y ago
You may want to re-submit that, since it didn't get any traction 38 days ago but might today, if this article and this comment get enough eyeballs. I now hear actual data scientists complain that startups trying to hire them think they
645.
by mmt 8y ago
Wasn't that true, in general, for cloud and VPS providers? 2 years is a Moore's Law doubling, which I've found tends to mean hardware offerings will be different. They're not necessarily dramatically different, if ther
646.
by mmt 8y ago
> It is nice to be able to put 4x more GPUs online in a few hours instead of a day, but I am not sure it commands a 33% premium except in very specific marginal cases. I suspect that, in general, it commands an even higher price premium,
647.
by mmt 8y ago
> I don't believe you are able to donate directly as an "instead of" option. I'm pretty sure that's not the case, at least here, as I've been personally present when a friend did exactly that. Again, I quest
648.
by mmt 8y ago
One difference is that the state also provides title to these assets, with all the legal protection that this does (or does not) imply. Another difference is that this contact information does not, AFAIK, include recipient-paid [1] contac
649.
by mmt 8y ago
> It costs $126.06 per day to house an inmate at the Sacramento County Main Jail, said sheriff's spokesman Shaun Hampton. I suspect this doesn't include the cost of land, something of particular concern in the same areas where
650.
by mmt 8y ago
At least here in the US, it's quite easy to donate directly to a local chapter (as well as higher levels of the organization). I've done it. Is that not the case where you are? Or is the problem that you're trying to support
651.
by mmt 8y ago
The "concierge" idea is a new one that I hadn't heard before. It helps describe a piece that I feel is missing from what it is I feel that I do , because, so often, perhaps because the terms "operations" or "s
652.
by mmt 8y ago
> And it’s way more rewarding, and arguably one of the best uses of your time as a manager. I'd say it's also one of the best uses of the time of the more senior engineers who will act as (additional) teachers/mentors. Hav
653.
by mmt 8y ago
> Same question, why beats specifically? Why not Apple, Samsung, Boss? To some degree, that question sounds like "whataboutism". However, all big brands receive their share of Internet criticism, especially if they release a hi
654.
by mmt 8y ago
> Maybe we really don't need social security I think the libertarian idea is that we really don't need social security through threat of violence. There's a notion of the role of "private" charity. Libertarians a
655.
by mmt 8y ago
> Pretty weird how the UK values a mort at 1.6MM and the US at 7MM I think you misread. It's 2.6 and 6.2 (in millions of USD) You might also find that it's not so weird in that this valuation is not general but specific to ro
656.
by mmt 8y ago
"Personally" (professionally), neither am I. This kind of conservatism was formed after decades of sysadmin/ops experience. However, having acquired a strong affinity for startups, I also accept that risk (even complete, bett
657.
by mmt 8y ago
That's just a summary of an interpretation of the original (a copy of which he links to): https://www.jwz.org/doc/worse-is-better.html (Be sure to copy-paste to avoid jwz's HN referer-trap) This line also app
658.
by mmt 8y ago
> Not to mention that a lot of people don’t understand what a container is. That's part of the appeal, the abstraction away of all those pesky, irrelevant details. Developers just want their app to run, as has been mentioned elsewhe
659.
by mmt 8y ago
Interestingly, of the neighboring states, only SD exhibits the same shape of curve (although NE is close, with a decreasing of the slope at the end, like KS, which is nearby). It certainly doesn't seem like full employment, but it also
660.
by mmt 8y ago
Isn't the aphorism "beggars can't be choosers" exactly about price, though? (Just the price happens to be zero) That said, I don't actually mean to merely quibble over semantics and wish to clarify: Is what you mean

More ›