3 ms·
That entirely depends on what you're using it for. Mimicking a typical block-level filesystem with object storage will lead to problems beyond a few thousand ob
by manigandham 6y ago
That entirely depends on what you're using it for. Mimicking a typical block-level filesystem with object storage will lead to problems beyond a few thousand objects or shallow "folder" levels.
Object storage is best for larger files with bulk updates. Either write new files entirely (best for S3) or append/replace where supported (like Azure/GCP). Any further structure and metadata should be maintained at a higher level with pointers to the raw files in the object store.
There are products like Stablebit Cloud Drive [1], ObjectiveFS [2], and other storage companies that handle all this for you. You can also look UtahFS [3] to see open-source code on building something yourself.
1) https://stablebit.com/CloudDrive https://stablebit.com/CloudDrive 2) https://objectivefs.com/ https://objectivefs.com/ 3) https://blog.cloudflare.com/utahfs/ https://blog.cloudflare.com/utahfs/