3 ms·
I don't think you have a choice, you'll have to use MapReduce if the data is too big to fit into memory. I believe that's what Facebook and Google do: https:/
by ddrum001 11y ago
I don't think you have a choice, you'll have to use MapReduce if the data is too big to fit into memory. I believe that's what Facebook and Google do:
https://www.facebook.com/notes/facebook-engineering/scaling-apache-giraph-to-a-trillion-edges/10151617006153920 https://www.facebook.com/notes/facebook-engineering/scaling-...
http://googleresearch.blogspot.com/2009/06/large-scale-graph-computing-at-google.html http://googleresearch.blogspot.com/2009/06/large-scale-graph...
- bitL 11y agoYour 2nd link describes Pregel, Google's distributed graph database specifically built for these kinds of tasks. They were using Map Reduce prior to that, but it was a cascading mess.