cachemiss

6 ms·

1.
by cachemiss 4y ago
Correct, a common mistake people make is conflating these things. I wrote this several years ago about MongoDB: One thing that helps is if people stop referring to things as SQL / NoSQL as what ends up happening is various things get
2.
by cachemiss 4y ago
Cassandra is not a columnar database, columnar in this sense is about the storage layout. Values for a column are laid next to each other in storage, thus allowing for optimizations in compression and computation, at the expense of reconst
3.
by cachemiss 5y ago
Having used both TSDB and ClickHouse in anger I have some thoughts on this: They are both fantastic engines, I really like that both have made very specific tradeoffs and can be very clear in what they are good and bad at. Having worked on
4.
by cachemiss 7y ago
Generally these tend to be systems that work with machine generated data, my experience is with sensor data generated by automobiles (automated car efforts). Naive solutions tend to either summarize the data, store as logs and then run batc
5.
by cachemiss 8y ago
I've considered something like that, but instead of trying to figure out crimes, it would produce a score for bills. A corruption score for bills, almost like a facebook for bills "This bill is friends with Exxon". It would
6.
by cachemiss 9y ago
Honestly, if someone could mitigate the risk for this sort of thing, it's a huge deal. Personally, I hate living in the tech hubs, I'd love to be able to move back to my hometown, it was a great place to raise kids, didn't ha
7.
by cachemiss 9y ago
I am deeply concerned now that my random comment might end up as a VC funded startup.
8.
by cachemiss 9y ago
Most of them I'd wager. Issue is, and it was for me, is that moving out of an area where I can walk down the street and get another great job to an area where the only great job is the one that this hypothetical company is offering ju
9.
by cachemiss 9y ago
It depends on what you are doing. If you are trying to build something like a database kernel, you want people who have done it before, very specialized. There aren't lots of them outside of the tech hotspots. I don't necessarily
10.
by cachemiss 9y ago
We aren't going to agree on this, around remote employees. I believe there is value to co-located teams, not everyone agrees and that's fine. The other point is, most startups do not need that talented of engineers, they think th
11.
by cachemiss 9y ago
If you are bootstrapping, and you are starting a company in an area that does not need the top tier of engineers (which is most of them, regardless of how they talk about hiring the best), I'd consider starting someplace low cost. I th
12.
by cachemiss 9y ago
Caveat, this comment isn't directed at you (I agree with your comment), but rather the points around what you are saying. One thing that helps is if people stop referring to things as SQL / NoSQL as what ends up happening is vario
13.
by cachemiss 9y ago
Correct, there's relatively easy ways to de-risk things. My wife and I dated for 3.5 years and lived together for 2 before we got married. We are in a high income bracket, and both of us thought quite a bit about the person we wanted
14.
by cachemiss 9y ago
No, generally you report to a former engineer, even up to a VP level in most cases, in AWS its usually former engineers until you get to s-level. edit: those people may have ALSO gotten an MBA
15.
by cachemiss 9y ago
At the higher end of the market (i.e you can get hired at the majors in a senior role or equivalent at a smaller company), I generally see three types of people: I see people that truly understand their market value, have data backing it up
16.
by cachemiss 9y ago
Amazon as a company believes margins are an opportunity, either for them, or for someone else. They don't believe in raising prices unless forced to by something external. You aren't correct here, they believe in making money on
17.
by cachemiss 9y ago
Anecdote incoming, but I've never seen that in 12 years in the industry (asking for an existing slip). And I've worked from everyone from AmaGoogFaceSoft types to HR companies to startups.
18.
by cachemiss 9y ago
That's a bit of an oversimplification. Production grade RDBMS systems have far more guard rails, testing and work put in to them than Kafka. It's relatively straight forward to lose data in Kafka, I've done it (its usually
19.
by cachemiss 10y ago
Unfortunately, my employer and team are directly involved in this space. We may not go this way (due to the effort), but its something we may tackle. It's not necessarily new computer science, just a clever (if I can be so bold) way to
20.
by cachemiss 10y ago
I'd also add, there's a component of streaming analytics that isn't solved either. One of the points I've tried to make at various companies (we've worked at the same one before) is that streaming solutions and batc
21.
by cachemiss 10y ago
Generally people are looking for a preferred solution, solving the problem, but not in the preferred way is usually not enough. This isn't good or anything (though, sometimes there's the really obvious super slow way, and its appr
22.
by cachemiss 10y ago
I actually mean reliable. Its probably different now, but at launch, the defaults were fsync'ing every 30 seconds or so. It would literally just apply the change to an memory mapped buffer and just fsync it once in a while. They did t
23.
by cachemiss 10y ago
My general feeling is that MongoDb was designed by people who hadn't designed a database before, and marketed to people who didn't know how to use one. Its marketing was pretty silly about all the various things it would do, when
24.
by cachemiss 10y ago
(Guessing you meant to respond to me) Excellent, I'm glad that the "big data" world is starting to look at database literature in terms of how it does execution, as there is much to be learned. Most of these systems are extre
25.
by cachemiss 10y ago
Seems similar to this: http://www.vldb.org/pvldb/vol4/p539-neumann.pdf
26.
by cachemiss 10y ago
While it certainly is more efficient to automate those employees away, in my experience they are rarely assigned to new work, they are simply let go. Whether or not that's good or bad morally or for the economy I won't speculate
27.
by cachemiss 10y ago
I always use "we", and I almost always phrase things as a question. Example: "So we are doing X here, which I think will probably do Y, which could have adverse affects Z, are we sure we want to do this?"
28.
by cachemiss 10y ago
That's a failure of your team lead. Tough code reviews are important, but I don't tolerate people being petty or nasty. We actually train new employees on how we like to do reviews. If I see people being given the benefit of the
29.
by cachemiss 10y ago
To clarify, my feelings towards Kafka are from the POV of someone who has had to build a managed service on top of it, which is not the common use case (for which many people seem to be happy with). Other people may have more positive expe
30.
by cachemiss 10y ago
Kudos to Heroku. As someone who has had to make Kafka into a managed service, I know what a pain it is (I'm not a Kafka fan for a lot of reasons) to administer in a cloud environment.

More ›