4 ms·
Facebook: Why our 'next-gen' comms ditched MySQL
- sirclueless 16y agoWhy does this article contain the word "interwebs"?
- lhnn 16y agoThis website is a derivative of "The Inquirer", which is known for its annoying jargon.
- rwmj 16y agoActually the Inquirer "derived" in a sense from The Register, in that they were started serially by Mike Magee. I discover from Wikipedia that Magee has now gone on to found a third web magazine ... https://secure.wikimedia.org/wikipedia/en/wiki/The_Register#Resignation_of_Mike_Magee https://secure.wikimedia.org/wikipedia/en/wiki/The_Register#...
- maheshs 16y agoalready submitted http://news.ycombinator.com/item?id=2018656 http://news.ycombinator.com/item?id=2018656 http://www.theregister.co.uk/2010/12/17/facebook_messages_tech/ http://www.theregister.co.uk/2010/12/17/facebook_messages_te...
- jfb 16y agoIt doesn't sound like MySQL was ever in the running.
- tapiwa 16y agoThe one good thing to take out of this is that Facebook made a measured decision, and ran with the best technology. So easily (as many companies do) they could have taken a 'not invented here' decision and run with Cassandra.
- biot 16y agoIt's cool that Facebook uses HBase. But Looking at the HBase documentation at http://hbase.apache.org/docs/current/api/org/apache/hadoop/hbase/client/package-summary.html#package_description http://hbase.apache.org/docs/current/api/org/apache/hadoop/h... all the calls to Put, Get, Result, Scan, etc. have repeated calls to Byte.toBytes() to convert a string to bytes. Is there some peculiar reason why the API doesn't also have methods which take a string and do the byte conversion internally?
- ddlatham 16y agoMany users of HBase (including ourselves) use different, more efficient encoding of values into byte arrays than converting them to String's first, then byte arrays. For example, it's common to use protobuf to encode an object into a byte array for storage in HBase. Rather than have 2 copies of all the api methods (one for people storing just Strings, and one for arbitrary byte arrays), it's simpler to have a single call and let the caller use the Bytes.toBytes method if they want to store a String.
- biot 16y agoThat makes sense for the values, but the names of rows and columns are also passed as bytes. Wouldn't a convenience function that accepts strings, performs the Bytes.toBytes() conversion and calls the original method reduce code clutter?
- ddlatham 16y agoThe same thing applies to rows and columns. We don't use any simple strings for our row or column indexes. They are serialized objects. Earlier versions of the API actually did have String based versions, and were changed to just byte arrays to reduce clutter.
- biot 16y agoInteresting, that makes sense then.
- 16y ago
- ddlatham 16y agoIt's a huge vote of confidence for HBase that the creators of Cassandra would choose it and its simple strong consistency model.
- mark_l_watson 16y agoI like that they prototyped and measured. Also: for messaging FB needed consistency; for some applications Cassandra would make more sense.