3 ms·

Can any body throw some light on how facebook's database is designed? I am sure it will be an interesting read. I was reading somewhere sometime back that each

Can any body throw some light on how facebook's database is designed? I am sure it will be an interesting read. I was reading somewhere sometime back that each user at fb has its own database. I think that is not possible. edit: I am googling now again on this topic. First link found is http://www.quora.com/What-is-Facebooks-database-schema http://www.quora.com/What-is-Facebooks-database-schema

tristanz 12y ago
https://www.cs.cmu.edu/~pavlo/courses/fall2013/static/papers/11730-atc13-bronson.pdf https://www.cs.cmu.edu/~pavlo/courses/fall2013/static/papers...
nbm 12y ago
There isn't one database, although there are a few major types. The majority of core information (attributes of people and places and pages and so forth, as well as posts and comments) is stored in MySQL and queried through TAO. Some data is primary stored in things like HBase, such as messages. Non-primary-storage data (indexes and so forth) exist in various forms optimised for different workloads - so data in either MySQL or HBase might also exist in Hive for data warehouse queries, or in Unicorn for really fast search-style queries. Other data (such as logs) might reside in one or more of the various data stores, such as Scuba, Hive, HBase, and accessible via Presto, for example. TAO: https://www.facebook.com/publications/507347362668177/ https://www.facebook.com/publications/507347362668177/ Unicorn: https://www.facebook.com/publications/219621248185635 https://www.facebook.com/publications/219621248185635 Hive: https://www.facebook.com/publications/374595109278618/ https://www.facebook.com/publications/374595109278618/ Scuba: https://www.facebook.com/publications/148418812023978/ https://www.facebook.com/publications/148418812023978/ Presto: http://facebook.github.io/presto/ http://facebook.github.io/presto/

tristanz 12y ago

https://www.cs.cmu.edu/~pavlo/courses/fall2013/static/papers/11730-atc13-bronson.pdf https://www.cs.cmu.edu/~pavlo/courses/fall2013/static/papers...

nbm 12y ago

There isn't one database, although there are a few major types. The majority of core information (attributes of people and places and pages and so forth, as well as posts and comments) is stored in MySQL and queried through TAO. Some data is primary stored in things like HBase, such as messages. Non-primary-storage data (indexes and so forth) exist in various forms optimised for different workloads - so data in either MySQL or HBase might also exist in Hive for data warehouse queries, or in Unicorn for really fast search-style queries. Other data (such as logs) might reside in one or more of the various data stores, such as Scuba, Hive, HBase, and accessible via Presto, for example. TAO: https://www.facebook.com/publications/507347362668177/ https://www.facebook.com/publications/507347362668177/ Unicorn: https://www.facebook.com/publications/219621248185635 https://www.facebook.com/publications/219621248185635 Hive: https://www.facebook.com/publications/374595109278618/ https://www.facebook.com/publications/374595109278618/ Scuba: https://www.facebook.com/publications/148418812023978/ https://www.facebook.com/publications/148418812023978/ Presto: http://facebook.github.io/presto/ http://facebook.github.io/presto/