4 ms·
Have a look at LakeFS (https://docs.lakefs.io/understand/architecture.html https://docs.lakefs.io/understand/architecture.html). Files are stored by hash on S3
by snthpy 2y ago
Have a look at LakeFS (https://docs.lakefs.io/understand/architecture.html https://docs.lakefs.io/understand/architecture.html).
Files are stored by hash on S3. Metadata is stored in a database. I run it locally and access it just like an S3 store. Metadata is in a Postgres DB.