2 ms·
This is extremely interesting stuff. The posts that continue tease the problem of having to process millions of events in real time. Here is the direct link to
by chuhnk 15y ago
This is extremely interesting stuff. The posts that continue tease the problem of having to process millions of events in real time. Here is the direct link to the paper http://borthakur.com/ftp/RealtimeHadoopSigmod2011.pdf http://borthakur.com/ftp/RealtimeHadoopSigmod2011.pdf incase anyone doesn't feel like clicking through. What I'm very drawn in by is facebook's continued and heavy use of mysql. They didn't run off to some nosql based datastore when things got tough, they learned to scale mysql, they leveraged its strong points while trying to minimize using its weaknesses. And then they looked at alternatives that compliment their existing systems. This is scaling at its best and as a system administrator its the kind of challenge I find both fascinating and exciting.
- simonw 15y ago"They didn't run off to some nosql based datastore when things got tough" - not exactly... they did create Cassandra, and these days they run quite a few things on top of HBase.
- chuhnk 15y agoYes however I can imagine it wasn't the solution they went to in the beginning. They continued to work with mysql and then implementing caching layers before getting to the point of needing another datastore.