4 ms·

TAO: The power of the graph

• hga 13y ago
  After a history of performance improvements starting with Mark Zuckerberg putting memcache on Facebook's Apache servers in 2005: "In early 2009, a team of Facebook infrastructure engineers started to work on TAO (“The Associations and Objects”). TAO has now been in production for several years. It runs on a large collection of geographically distributed server clusters. TAO serves thousands of data types and handles over a billion read requests and millions of write requests every second." It is solving some impressive problems, and kudos to Facebook for continuing to share neat bits of engineering with us.
• currywurst 13y ago
  The interesting part is that they have not gone for a custom graph representation on disk like neo4j et al, but are persisting the graph data as MySQL records itself.
  • 3pt14159 13y ago
    Reminds me kinda of what Reddit does where attrs are stored as records.
  • th0ma5 13y ago
    There has been some precedent with this... Oracle Spatial does this, and wrappers for SemWeb projects like d2rq do this.
  • espeed 13y ago
    Titan (https://github.com/thinkaurelius/titan/wiki https://github.com/thinkaurelius/titan/wiki) persists its graph as records in a distributed Cassandra or HBase cluster.
• mianosm 13y ago
  Some interesting files that go along with the talk/presentation: https://www.usenix.org/sites/default/files/conference/protected-files/nishtala_nsdi13_slides.pdf https://www.usenix.org/sites/default/files/conference/protec... https://www.usenix.org/system/files/conference/nsdi13/nsdi13-final170_update.pdf https://www.usenix.org/system/files/conference/nsdi13/nsdi13...