jjirsa

12 ms·

91.
by jjirsa 9y ago
Helped build one on top of cassandra at past employer - they’re still apparently happy with it. It’s something like 5-6 petabytes and handles millions of writes per second, hundreds of thousands (or maybe millions) of reads/traversals
92.
by jjirsa 9y ago
The problem with making a general purpose DB is you have to have general purpose defaults. The Cassandra defaults are "dont crash anywhere", not "be super fast and low latency". You can definitely do 5x better than the d
93.
by jjirsa 9y ago
7 hosts in that poc, that is not "at scale"
94.
by jjirsa 9y ago
To be fair, a lot of big companies know how to tune the JVM. A TON of HUGE companies write a LOT of java. What you consider a constant struggle, a lot of very large companies consider trivial.
95.
by jjirsa 9y ago
Cassandra does a bunch of stuff off-heap - we keep things like Bloom Filters, our compression offsets (to seek into compressed data files), and even some of the memtable (the in-memory buffer before flushing) in direct memory, primary for t
96.
by jjirsa 9y ago
I think it's likely. It's decidedly nontrivial, and the hardest part will be the (very slow) design phase where we actually make sure the interfaces are defined properly, but I think there are enough interested people to make sure
97.
by jjirsa 9y ago
Happy to help you get started working on Cassandra. http://cassandra.apache.org/doc/latest/development/patches.h... Has some basic entry pointers. There’s also a dev mailing list that’s reasonable active.
98.
by jjirsa 9y ago
So sad I’m not in town that week
99.
by jjirsa 9y ago
Of course it could happen. Pluggable engine has a lot of positives - not only does it enable features like this, it also helps modularize the codebase making it more testable, and there are other people who will develop storage engines for
100.
by jjirsa 9y ago
I'm a committer, I'm familiar with the JIRA ticket.
101.
by jjirsa 9y ago
The article is literally written by Instagram, which is FB.
102.
by jjirsa 9y ago
Have friends who have used it, they report that it works reasonably well. Especially in p99.
103.
by jjirsa 9y ago
Why throw away something proven to run at massive scale, that you understand and trust for something that's new, has never been run at that scale, and you have no experience running? If you have a team of software engineers, and the la
104.
by jjirsa 9y ago
Nicely done! Looking forward to the pluggable storage engine.
105.
by jjirsa 9y ago
They were described in the Bigtable paper, and were widely used before leveldb was published (Cassandra, for example, used sstables and LSM concerts well before 2012)
106.
by jjirsa 9y ago
I think the parent comment is silly, but there’s a pretty fundamental difference between something you are and something you do.
107.
by jjirsa 9y ago
Review open patches
108.
by jjirsa 9y ago
(Also really good people, and doing important work)
109.
by jjirsa 9y ago
Bought a few of these (for myself, and as gifts). Was happy to have been a part of just day 1 - well worth the money. Everything else is icing on the cake.
110.
by jjirsa 9y ago
Know what would be great? Pricing info
111.
by jjirsa 9y ago
I don’t know if you lost format or context moving from Disqus but I found this largely unreadable. Of the parts that were readable, I find myself strongly disagreeing with a majority of your paragraphs, notably: - I don’t see how Crowdstrik
112.
by jjirsa 9y ago
ICO implies an initial offering Bitcoin had no ICO. There was no initial offering.
113.
by jjirsa 9y ago
http://www.dbms2.com/2013/03/18/dbms-development-marklogic-h... > Rule 1: Developing a good DBMS requires 5-7 years and tens of millions of dollars. > That’s if things go extremely well. > Rule 2: Yo
114.
by jjirsa 9y ago
Reminds me I have a ton of open patch contributions I need to review.
115.
by jjirsa 9y ago
Or, you know, use something like Cassandra that’s used at massive scales already (by Apple, Netflix, instagram, uber, Walmart, IBM, etc), and scales linearly to make future growth trivial. Bonus points that rm -rf on a Cassandra server isn’
116.
by jjirsa 9y ago
> By working with CockroachDB, we expect to be able to operate multiple active data centers – all perfectly synchronised with each other ... > Outside of Google, there is no solution like this available anywhere Cassandra offers cross
117.
by jjirsa 9y ago
Because the value of an ad is as much in knowing what you’re looking at as it showing you something - the JS is there to track and identify, not to show you pretty pictures.
118.
by jjirsa 9y ago
This tweet suggests I’m probably off by quite a bit (overestimating amazons orders) https://twitter.com/joelcomm/status/917229394212675584 That’s $3400/second in transactions for amazon, and certainly their a
119.
by jjirsa 9y ago
There’s probably a 10:1 or 100:1 page view to transaction ratio, and a 10:1 or 100:1 api request to page view ratio 200k transactions is a crazy number - a normal second for amazon is probably a few thousand orders (4-5k). This is 20x highe
120.
by jjirsa 9y ago
“I want to learn about planes” “Trains are usually a better choice. Most people don’t need planes”

More ›