4 ms·
Sounds intriguing. But how does storing the objects as blobs perform better than storing them as standard file types?
by mgalka 10y ago
Sounds intriguing. But how does storing the objects as blobs perform better than storing them as standard file types?
- majewsky 10y agoSeeing how they emphasize using XFS for the backing disks [1], I'm pretty sure that the objects/blobs end up as actual files on the disk (same as with OpenStack Swift). So in the end, an "object/blob" is the same as a "file". The different term emphasizes that the user does not know (or care) which disk actually holds the file, or how many replicas exist. That's abstracted away by the cluster. [1] http://leo-project.net/leofs/docs/installation/install_2.html http://leo-project.net/leofs/docs/installation/install_2.htm...
- mocchira 10y agoActually we have adopted a file format haystack object store[1][2] originally developed by FB for their photo storage platform. [1] https://www.usenix.org/legacy/event/osdi10/tech/full_papers/Beaver.pdf https://www.usenix.org/legacy/event/osdi10/tech/full_papers/... [2] https://code.facebook.com/posts/685565858139515/needle-in-a-haystack-efficient-storage-of-billions-of-photos/ https://code.facebook.com/posts/685565858139515/needle-in-a-...