5 ms·

I'd say that the main difference with ObjectiveFS are metadata operations. From the documentation of ObjectiveFS: `doesn’t fully support regular file system se

I'd say that the main difference with ObjectiveFS are metadata operations. From the documentation of ObjectiveFS: `doesn’t fully support regular file system semantics or consistency guarantees (e.g. atomic rename of directories, mutual exclusion of open exclusive, append to file requires rewriting the whole file and no hard links).` HopsFS does provide strongly consistent metadata operations like atomic directory rename, which is essential if you are running frameworks like Apache Spark.

mwcampbell 6y ago
That quote from the ObjectiveFS documentation [1] is out of context. It was describing limitations in s3fs, not ObjectiveFS. My understanding is that because ObjectiveFS is a log-structured filesystem that uses S3 as underlying storage, it doesn't have those limitations. [1]: https://objectivefs.com/faq https://objectivefs.com/faq