15 ms·
Noooo, really? It all depends on what you want to do. For things that are already in files like all that data that DeepSeek and other models train on and for w
by resurrected 2y ago
Noooo, really?
It all depends on what you want to do. For things that are already in files like all that data that DeepSeek and other models train on and for which DS open sourced their own distributed file system, it makes sense to go with a distributed file system.
For OLTP you need a database with appropriate isolation levels.
I know someone will build a distributed file system on top of FoundationDB if they haven’t yet.
- jeffrallen 2y agoThey have, at Exoscale. My officemate leads the team doing it.
- EGreg 2y agoJust use hypercore with hyperdrive. And be free!
- _zoltan_ 2y ago~2006 I've built a fuse fs that used mysql as a backend, kept all file hashes (not blocks, just whole files) and did deduplication. good old times.
- AtlasBarfed 2y agoThey did it atop Cassandra.
- darkstar_16 2y agoIsn't the Cassandra file system something like that ?